Tilt Brush to Unity Workflow

Yong Hyun Kwon ’18

Creating a space for an immersive virtual reality experience is not simple. If assets are not compelling¬†enough, users won’t be convinced by the virtual environment. But if we as developers limit our assets to only realistic, easily replicated objects, users are likely to be unsatisfied with the final result, which might be a mundane experience. On top of this dilemma, we have limited resources to create the ideal models and spaces we want. In an attempt to solve this issue, we have chosen an integrated approach to designing environments for the Gaspee project, combining 360 stereoscopic video with models made in Tilt Brush. ¬†This design implementation is feasible and allows us to create realistic and exciting assets that help make our project more intriguing.

To place a player inside a 360 video, we use movie textures in Unity. Usually, textures are used to paint the outside surface of an object. However, since we are placing a player inside the space, we have to texture video on the inside surface of an object. Video-plugins available in Unity Asset Store allow us to texture the inside of a hollow object with footage from a 360 shoot. After setting up this 360 space, we can create Unity objects inside and set up object interactions. Integrating 360 stereoscopic video with Unity elements allows us to play with a variety of aesthetic styles, levels of realism, and interactivity.

A model of the burning Gaspee built in Tilt Brush

Another way we can build assets is using Tilt Brush. On January 18th this year, Tilt Brush Unity SDK was publicly released by Google. Tilt Brush has been a powerful application for VR developers to create wonderful 3D spaces, sketches, and models. But these paintings used to have limited application since there was no easy way to integrate them with other programs. With the ability to combine colorful sketches created in Tilt Brush with various interactions enabled by Unity, developers can now bring more interesting stories to life in VR. Detailed documentation from the toolkit guides us on how to implement Tilt Brush-style teleportation and animation of elements in the VR experience.

With these integrative techniques, we are able to create immersive spaces without relying on models or meshes in Unity alone.

The whole process is explained in detail here:<http://bernieroehl.com/360stereoinunity/>


tilt-brush-toolkit – Scripts and assets that help you use Tilt Brush data in your creative projects.