Kneel. Using OpenPose control net with Daz3D render in Stable Diffusion
Sometimes I have a very specific pose in mind, and they’re hard to describe with words. Trying to look for the correct pose in stock photos can be tricky. In these cases, I would use a 3D program to pose the figure myself, then use it to drive an OpenPose control net.
Although I prefer Cinema 4D for 3D animation and design, I usually use Daz3D for this workflow. Daz3D is specifically designed to pose figures. It’s also free, and comes with lots of figures.
General steps
1. Figure. Pick any figure and pose them inside Daz3D.
2. Render. Render the figure as a PNG.
3. Comp. Create a comp in Photoshop, and place the rendered image as a layer. Adjust the scale and composition as desired.
4. PNG. Export the PSD comp as a PNG.
5. OpenPose. Use that PNG as the source image for the OpenPose control net in Stable Diffusion.
6. Text prompt. Describe the scene in txt2img.
7. Weights. Use a lower weight than 1 if you want variations in the renders.
8. Dynamic prompts. Use dynamic prompts if you want to have variations in a batch.
22 example renders on my site. 4k high res.
https://gymdreams8.com/blog/kneel/
Tech
Text prompts in txt2img with Stable Diffusion
20 steps, Euler a, 512x512
Clip skip: 2
vae-ft-mse-840000-ema-pruned.vae.ckpt
Denoising: 0.5
Hires: 20 steps, 2x, 1024x1024, 8x_NMKD-Superscale_150000_G
CN OpenPose: Daz3D image, Weight 0.8, Start 0, End 0.5-1, Variable priority: prompt-priority for some, balanced for others.
Post Upscale: Topaz Gigapixel 4x HQ, 4096x4096
Color Correction: Adobe Lightroom
Limb Fix: Adobe Photoshop AI
Animation: Adobe After Effects
Music: Pray by Aylex - licensed
Soundtrack: Ableton Live Suite
Follow me on social media:
/ gymdreams8
/ gymdreams8
/ gymdreams8
https://deviantart.com/gymdreams
/ gymdreams
https://threads.net/@gymdreams8
Copyright 2023 GymDreams8. All rights reserved.