Audio2Face to Metahuman: Unreal Engine + NVIDIA Omniverse & RTXGI
*NVIDIA interview: https://blogs.nvidia.com/blog/2021/12...
I just created this scene to test the @NVIDIAOmniverse Audio2Face to @UnrealEngine Metahuman.
I recorded my voice singing this music, cleaned the audio a little bit and opened that in Audio2Face.
AI generates lip sync from a voice over to a 3d face, then I manually animated the eyes, brows and neck in Unreal Engine to add more realism for the scene. I also did the lighting.
Rendered in Unreal Engine 4.27.1 with the new RTX Global Illumination by NVIDIA.
Color grading in @Adobe Premiere Pro
Powered by @NVIDIA-Studio
Music: Bad Moon Rising by Mourning Ritual (feat. Peter Dreimanis)
Follow my work:
https://www.artstation.com/artwork/ea...
/ anderson_rohr
#unrealengine #audio2face #metahuman #ai #rtxon #rtxgi #nvidia #nvidiaomniverse #ue4 #ue5 #realtime #rendering #lipsync #animation