Using 3D and Depth2Img for Concept Art (Stable Diffusion & Blender)
In this video I experiment with using the new Stable Diffusion 2.0 Depth model to render a scene created in Blender. Overall I think this is an interesting workflow that could allow for control over composition for complex scenes. While not perfect it is worth trying out and being aware of.
There is now an extension to enable this! Install the "Depth Image I/O" extension.
Old Patch to AUTOMATIC1111 webui (NO LONGER NEEDED):
https://gist.github.com/patrickgalbra...
There is also a Blender plugin that apparently enables this but I haven't had a change to try this out yet - https://github.com/carson-katri/dream...
Depth Model:
https://huggingface.co/stabilityai/st...
#stablediffusion #aiart #blender