Turn your AI images into CG movies [Workflow Video]
This workflow explores how to use various AI tools to create compelling character animations and "render" them using AI.
If you like my work, please consider supporting me on Patreon: / mickmumpitz
Follow me on Twitter: / mickmumpitz
Tools used in this video:
midjourney: https://www.midjourney.com/
ChatGPT: https://chat.openai.com/
blender: https://www.blender.org/
ICON: https://huggingface.co/spaces/Yuliang...
Stable Diffusion WebUI: https://github.com/AUTOMATIC1111/stab... Control Net
Sad Talker: https://github.com/OpenTalker/SadTalk...
Deforum: https://github.com/deforum-art/sd-web...
Adobe Creative Cloud: https://www.adobe.com/
DaVinci Resolve: https://www.blackmagicdesign.com/de/p...
-runway GEN-1: https://research.runwayml.com/gen1
Wav2Lip: https://colab.research.google.com/git...
Other resources:
Sad Talker (Huggingface): https://huggingface.co/spaces/vinthon...
High resolution Depth Maps for Stable Diffusion WebUI: https://github.com/thygate/stable-dif...
3D model Male Figure: https://clara.io/view/d49ee603-8e6c-4...
Blender Beginner Tutorials:Blender Beginner Tutorial - Part 1: • Blender 3.0 Beginner Tutorial - Part 1
The ULTIMATE GUIDE to Cameras in Blender (Beginners Start Here!) • The ULTIMATE GUIDE to Cameras in Blender (...
Stable Diffusion Models: https://civitai.com/
Chapters:
00:00 Intro
00:32 Creating the characters
02:16 Generating the 3D model
04:03 Voice
04:26 Facial Animation
05:58 Body Animation
07:51 Patreon
08:25 "Re-Rendering" with GEN-1
11:44 "Re-Rendering" with DEFORUM
14:12 Results