nvidia remedypng Remedy Entertainment teams up with Nvidia for new face animation technology

Remedy Entertainment teams up with Nvidia for new face animation technology

Technology developer Nvidia and game developer Remedy Entertainment have been working together to create a new approach to capturing accurate facial animations without the need for costly and time-consuming touch ups post-capture, as reported by Ars Technica from SIGGRAPH in LA.

The solution, which has been created in conjunction with researchers at the University of Southern California and Pinscreen uses deep learning neural networks to not only capture and process the data but also to automatically produce accurate predictive animations with the only further input being voice dialogue.

The idea is that the data captured from motion capture and facial recordings, provided by Remedy for this case, is fed into this neural network. This is all powered by Nvidia’s expensive and rather meaty eight GPU DGX-1 server system. The neural network gets a lot of data straight away and after a short time (reportedly five-ten minutes) can predict and animate a face without the need for further visual reference data. Once an actors dialogue is fed in, the system can then produce an accurate facial animation of the character talking straight away, without the need for further work by animators or additional visual or motion capture.

The video below is a demonstration from of the technology in use.

Remedy has often used new and impressive technology to better the results of its games, especially when it comes to storytelling and expression. It’s most recent release, Quantum Break, used DI4D’s motion capture software to create realistic characters in-engine that stood up the dual television production element of the game.

About MCV Staff

Check Also

pubg 1 [Industry news] PUBG MOBILE launches the PDP European Fashion Design Contest, inviting players to have an opportunity to design the game's next outfit

[Industry news] PUBG MOBILE launches the PDP European Fashion Design Contest, inviting players to have an opportunity to design the game’s next outfit

PUBG MOBILE has announced the launch of the PDP European Fashion Design Contest, a creative competition organised as part of its PDP co-creation programme. Participants are invited to design an original outfit inspired by European urban fashion, with the opportunity to see their creation brought to life in the game. This PDP contest is being held to celebrate the global launch of PUBG MOBILE FLASH, the official lightweight version of PUBG MOBILE, today - November 13. All the info can be found on the official website.