Description of this AI tool Omniverse Audio2Face:
A reference programme called Omniverse Audio2Face makes it simple to animate a 3D character to match any voice-over audio. The device comes preloaded with a 3D character model that can be animated using a voice-over track. The audio input is fed into a pre-trained Deep Neural Network, and the network’s output drives the 3D vertices of the character mesh to produce the facial animation in real-time. Additionally, it contains a character transfer capability that lets users retarget to any 3D human or human-like face, scale the output when there are several people in the scene, and employ an AI network to govern the character’s expression. In order to create motion for characters, it also supports export-import with Blendshapes for Blender and Epic Games Unreal Engine and has data conversion tools that enable blendshape conversion and blendweight export choices.
Pricing Model : Free
Tags : Generative Video, Motion Capture