This demo was designed to showcase two main features of Resight Engine: a real-time multiplayer game and persistence AR, which allows the content to remain anchored to the physical environment even when switching between sessions or devices.

Our goal was to create a demo that was suitable for casual gaming and provided a "feel good" experience for the user. We wanted to showcase this demo at the AWE conference in Santa Clara, so I focused on finding a creative way to incorporate Resight Engine.

Inspired by David Lee's elastic man, I wanted to create a similar experience in AR. However, I struggled with how to bring the dynamic nature of the web into AR in a proper way. That's where Resight Engine came in and helped everything fall into place.

Developing a successful demo requires not only technical proficiency, but also careful consideration of user experience challenges. As our team worked on a demo, we grappled with several UX-related questions. These questions included determining the appropriate level of pressure to apply when pressing an object, deciding how many vertices should be affected when touching an object, and exploring what would happen if two people touched the same vertices simultaneously.

Additionally, we had to consider how the experience would change when more than two people were sculpting at once. We also needed to develop an effective way to incorporate an undo function in a multiplayer environment, and we needed to determine the appropriate height for objects in the physical environment.

Another UX challenge was figuring out how to reset the space and delete virtual objects. We also needed to determine which types of objects would be the most enjoyable for users to interact with, and how complex those objects could be. Finally, we explored whether it was possible to create sculptable objects with reflective materials.

To address these questions, we used a combination of theoretical and practical approaches. By carefully considering these UX challenges, we were able to develop a demo that was both technically impressive and engaging for users.

The rest of the development process involved iterative testing with specific focus on each 3D model. This included modeling in Blender, importing to Unity, and testing the sculpting in AR before repeating the process as needed. Despite a few sleepless nights, the application finally performed satisfactorily and was a great representation of our team at various conferences and presentations.

It was quite an experience :)