Nowadays, practically every television and film production incorporates CG. However, the process becomes more challenging when a show features fully digital characters. This is the case for Seth MacFarlane’s “Ted,” for which Fuzzy Door, the tech division of his production company, has developed an on-set augmented reality tool called ViewScreen. This tool aims to turn the potentially awkward process of working with CG assets into an opportunity for collaboration and improvisation.
Working with a CG character or environment can be challenging for both actors and crew. ViewScreen allows everyone to work with these assets in-camera and in real time, improving the creative process and enabling the production to achieve shots more quickly.
The traditional process for shooting with CG assets typically involves shooting the scene with a stand-in for the character, such as a tennis ball or a mocap-rigged performer. This is followed by sending the footage to VFX artists for post-production. The ViewScreen tool, on the other hand, allows these assets to be seen and interacted with on set, greatly enhancing the efficiency and spontaneity of the production process.
The co-founder of Fuzzy Door Tech, Brandon Fayette, explained the need for ViewScreen: “It came from my need as the VFX supervisor to show the invisible thing that everybody’s supposed to be interacting with.” The tool, which uses iPhones and is called ViewScreen Studio, wirelessly syncs between multiple cameras and integrates multiple streams of data, providing a middle ground between pre and post-production.
Moreover, the ViewScreen tool allows for live adjustments to assets, such as waypoints or lighting, as well as showcasing alternative shots and scenarios. It also permits live streaming of an actor’s facial animation and body movements to a digital character using an iPhone. Additionally, ViewScreen has a mobile app called Scout, which serves a similar purpose on location.
According to Fayette, using ViewScreen has led to shorter production days and the ability to try new creative approaches. The tool has been utilized extensively, with Fayette stating that they shot the entire production of “Ted” using ViewScreen for about 3,000 shots.
Fuzzy Door Tech is making its tools available, customizing them according to the specific needs of different studios and productions. Their president, Faith Sedlin, mentioned that the company partners with studios to understand their unique requirements and provide tailored solutions.