Omniverse Audio2Face

Omniverse Audio2Face is a reference application that simplifies animation of a 3D character to match any voice-over track. It is preloaded with a 3D character model that can be animated with a voice-over track, and the audio input is fed into a pre-trained Deep Neural Network and the output drives the 3D vertices of the character mesh to create the facial animation in real-time. It also has a character transfer feature that allows users to retarget to any 3D human or human-esque face, and allows them to scale the output with multiple characters in the scene and control the emotion of the character with an AI network. It also has data conversion features that allow for blendshape conversion and blendweight export options, and supports export-import with Blendshapes for Blender and Epic Games Unreal Engine to generate motion for characters.