Public Funding for Dimensional Imaging Limited

Visual effects and video game companies are demanding ever higher levels of graphical detail and realism and are increasingly making use of motion capture to acquire animation from real life actors to such an extent that it is now one of the fastest growing industry sectors in the U.S. Creating increasingly realistic facial animation is particularly challenging because human perception is acutely tuned to facial appearance. Content developers are therefore demanding new and ever higher fidelity solutions for facial performance capture. In response, Dimensional Imaging has developed DI4D™, an extremely novel and innovative facial performance capture solution that can acquire very high fidelity data without requiring any special markers, make-up or structured light. DI4D™ is also uniquely amenable for use with helmet mounted camera (“HMC”) systems that are now industry standard. The main development goal of the project is to improve substantially the fidelity, efficiency and level of automation of the current DI4D™ solution by allowing more seconds of facial animation to be produced with an even higher level of fidelity and realism for substantially less manual effort.

Dimensional Imaging has developed a highly novel and proprietary facial performance capture solution (“DI4D™”) that requires no special markers, make-up or structured light. The current DI4D™ PRO system uses a bank of high resolution video cameras to capture the facial performance of a single performer who sits in front of the system. By capturing dense “3D scan” data at 60fps and then tracking a dense, fixed topology mesh through the resulting 3D scan sequence, the system provides many times the fidelity of traditional facial motion capture systems that track discrete dots. However, automatic pre-processing of the data currently requires approx. 20 minutes per second of captured data and manual post processing currently requires approx. 30 minutes per second of captured data. Under a previous InnovateUK funded Launchpad project, Dimensional Imaging has demonstrated the feasibility of using a head mounted camera (HMC) system to capture 4D facial performance capture data. This offers the benefits of more freedom of movement for the actors and the ability to allow multiple performers to be captured simultaneously. The aims of this project are 1) to develop a pre-production prototype HMC system, 2) test the prototype HMC in a “production” environment, 3) improve the efficiency of data processing stage (i.e. reduce significantly the time required to pre-process and post process 1 second of data), and 4) research the the most effective use of the captured performance data in facial animation pipelines. We believe that this will result in a world leading system that is capable of meeting the requirements of next generation video game development as well as VFX for television and movies

Dimensional Imaging has developed a highly novel and proprietary facial performance capture solution (“DI4D™”) that requires no special markers, make-up or structured light. By capturing dense “3D scan” data at 60fps and then tracking a fixed topology mesh through the resulting 3D scan sequence, the system provides much higher fidelity than traditional facial motion capture systems that track discrete dots. The current “sit down” system uses a bank of high resolution video cameras to capture a single performer who sits in front of the system and must keep their head and body relatively still. The aim of this project is to develop the system to use head mounted cameras wihc will allow more freedom of movement and allow multiple performers to be captured simultaneously. We believe that this will result in a world leading system that is capable of meeting the requirements of next generation video game development as well as VFX for television and movies.