SALSA LipSync 2.0 Pre-Release Technology Preview (2D)
This is a SALSA LipSync 2.0 tech preview using the 2D Al the Alien character from Digital Puppets and pre-release alpha software. This teaser video demonstrates a few of the technologies we are developing for the next iteration of our lip synchronization software for Unity.
NOTE: this demo footage was captured live from a Unity Editor run using Bandicam and was not rendered or pre-processed in any way. SALSA's technology provides compelling lip-synchronization at run-time, in real-time and does not require phoneme mapping or baking. The workflow appeals to anyone who wants excellent results with minimal workflow requirements. Being able to provide great lipsync at run-time enables features and capabilities that are not currently possible in phoneme mapping solutions (microphone input, text-to-speech, text-to-lipsync, etc.).
New features demonstrated include: unlimited sprite/trigger definitions for more lip-sync dynamics. This 2D character (Al the Alien, provided by Digital Puppets [see below]) is configured with 8 visemes, and each viseme is a sequence of animation progression sprites -- any number of shapes can be used. You will also notice the subtle audio-linked emphasis expressions -- for more naturally timed emotes. In addition, zero-lag processing has been enabled, providing a much improved accuracy perception. Advanced dynamics mixing creates a more accurately perceived lipsync and provides better movement dynamics, while reducing shape stalling. As well, the character movement has been setup as random emote expressions. Finally, the character was setup using our new combined 2D/3D workflow.
For more information, check out the SALSA landing page: https://crazyminnowstudio.com/unity-3...
And keep an eye on the SALSA 2.0 dev blog for updates: https://crazyminnowstudio.com/posts/s...
Al the Alien 2D character
http://digitalpuppets.co.uk/