Reallusion recently introduced two new plugins that connect iClone with Audio2Face, facilitating the utilization of NVIDIA’s AI-driven facial animation technology to create lip-sync animations from audio files. These plugins streamline the process of transferring a 3D character from Character Creator or iClone to Audio2Face, and then importing the animation back to iClone.
Audio2Face, an AI-powered tool for producing multilingual lip-sync animations from audio recordings, was initially launched in 2021 as part of NVIDIA’s Omniverse platform. While it can also animate facial expressions, its primary function is generating lip-sync animations based on voice recordings.
The latest update introduced a new AI model featuring a female Chinese character, emphasizing its versatility in handling various languages and even non-verbal sounds like songs or gibberish.
The integration of iClone and Audio2Face has been further streamlined through the introduction of new plugins that simplify the workflow significantly. The first plugin automates the export process for CC3 characters to Audio2Face, condensing what used to be an 18-step manual process into a single step.
The second plugin enables the transfer of facial animations created by Audio2Face back to iClone, offering additional controls for refining or enhancing the animation output. This alternative workflow presents a more user-friendly option compared to iClone’s built-in AccuLips automated lip sync system.
The newly released plugins are compatible with iClone 8.4, Audio2Face 2023.2, and Character Creator 4.4 and are available for free download alongside the required Character Creator and iClone Omniverse Connectors on Windows 7 operating systems.
The standard pricing for new licenses is set at $299 for Character Creator and $599 for iClone respectively. As for Audio2Face software itself, it is accessible on Windows 10 as part of Omniverse at no cost.
