Generate 3D Sets for your Short Films!
Today we'll be using AI tools to create virtual environments for your film projects!
We cover the entire workflow, from generating the 3D environment, to filming in a low-budget virtual production environment, to compositing your shot with some AI tips and tricks, like re-lighting your shot based on the environment you've created!
Chapters:
00:00 Intro
00:34 What is Virtual Production?
01:42 Generating a 360° image
03:17 Preparing the 3D Model [Depth Maps]
06:22 Filming the scene
08:05 Key out the actors
09:10 Generate Normal Maps
11:15 Putting it all together
14:11 Final Shots
Tools used in this video:
Skybox Labs by Blockade Labs: https://skybox.blockadelabs.com/
NVIDIA Canvas: https://www.nvidia.com/de-de/studio/c...
ControlNet for Stable Diffusion: https://github.com/lllyasviel/ControlNet
midjourney: https://www.midjourney.com/
High Resolution Depth Maps for Stable Diffusion WebUI: https://github.com/thygate/stable-dif...
Blender: https://www.blender.org/
CamTrackAR: https://apps.apple.com/us/app/camtrac...
Reality OBJ to USDZ Converter: https://apps.apple.com/de/app/reality...
After Effects: https://www.adobe.com/products/aftere...
Runway.ml: https://runwayml.com/
High Reslution Normal Maps for Stable Diffusion: https://github.com/graemeniedermayer/...
DaVinciResolve: https://www.blackmagicdesign.com/prod...
Reference to image plane: https://github.com/Pullusb/reference_...
Videos Links:
Avatar Featurette: Performance Capture: • Avatar Featurette: Performance Capture
Avatar & Avatar 2 Behind the scenes - How James Cameron Evolved Motion Capture in the Avatar Films: • Avatar & Avatar 2 Behind the Scenes —...
The Virtual Production of The Mandalorian Season Two: • The Virtual Production of The Mandalo...
Blender Motion Tracking - Room Transformation! by Ian Hubert: • Blender Motion Tracking - Room Transf...
Grae n YouTube Channel: / @grae_n
Inpainting in Augmented Reality: • Inpainting in Augmented Reality
How to Make a Blur Node in Blender!: • How to Make a Blur Node in Blender!
❤️ Buy me a coffee:
https://ko-fi.com/mickmumpitz
Follow me on Twitter: / mickmumpitz