New in-development facial capture solution works without markers or specialised cameras

Photorealism on show in dazzling Nvidia FaceWorks demo

Nvidia has unveiled a new “photorealistic” facial capture demo showing off its FaceWorks technology.

Generated in real-time using commercially available GPUs and FaceWorks itself, the impressive video showed off two close-to-realistic digital head models of a man and a woman.

The technology is part of a scheme created in collaboration with the Institute for Creative Technology at the University of Southern California, in which developers have been building new systems to capture data to “within a tenth of a millimetre” without the need for markers of specialised cameras.

A special ‘light stage’ tech uses photographic techniques to record the 3D shape of an actor’s face while also capturing various other elements to help properly represent human skin. This includes light reflections, reflectivity of oils in the skin and facial lines and bumps in the skin.

Nvidia claimed that complex skin shaders executing over 8,000 instructions per pixel to allow for realistic rendering, at full HD resolution, would create 82 billion floating point operations per second per frame, which would exceed 32gb for a few expressions.

The tech giant claimed that its FaceWorks tech however had reduced this to 300mb.

To view the FaceWorks tech demo in action, you can view the video below.

<iframe width="430" height="242" src="http://www.youtube.com/embed/5d1ZOYU4gpo" frameborder="0" allowfullscreen></iframe>

About MCV Staff

Check Also

ent [Industry news] Entity raises €5 million in seed funding to bring console-quality games to the ‘New Web’

[Industry news] Entity raises €5 million in seed funding to bring console-quality games to the ‘New Web’

Entity, a new Irish gaming distribution startup, today announced it has completed a €5 million seed round for its next-generation gaming platform which is set to launch in early 2027. Entity has embraced the latest breakthrough web technology to create the home of console-quality games for the “new web” era.  Entity is effectively replacing the need for a dedicated gaming device such as the console or PC for most games: Bringing, for the first time, instant and social game play experiences to the largest global game playing audience without the friction of downloads or installs. Entity delivers a true click and play experience for games players, anytime, anywhere and on any modern browser