Playing around with inpainting, ControlNet, and style transfer in Automatic1111 - Part 5
🙂 This is it; this is the final video on inpainting. Here, we mix inpainting with ControlNet to change one part of the image without affecting the global composition
😵💫 We also introduce style transfer using T2I-adapter and IP-adapter
🤪 Meet InstructPix2Pix model for style transfer without ControNet, this is a standalone pix2pix checkpoint
😲 A pro tip: if things get hard, for example, when changing color, you can use the option Masked content: latent noise. This will add new noise but at the cost of a different composition. So be gentle with the Denoising strength and choose wisely your checkpoint.
👍 Keep in mind that I don't use styles in the prompt. Adding styles might help improve the results.
👉 Get the input images at this link,
https://bit.ly/3HgQxiK
Chapters
00:00 Introduction
01:34 Recap on inpainting with inpaint anything
02:25 Let's change the color of the hair only using inpainting - This will change the composition
03:57 Inpaint plus ControlNet - This is how we can avoid changing the composition
07:11 Let's get the new image/composition with inpainting + ControlNet - General comments and how to use ControlNet
15:33 Let's change the color of the hair only using ControlNet
17:30 ControlNet instructp2p + inpaint
21:31 InstructPix2Pix model. Like ControlNet instructp2p but does not require ControlNet - This is a standalone checkpoint
24:54 Summary of what we have done so far
25:31 Let's go for the extra mile - Style transfer with instructp2p, T2I-adapter and IP-adapter
28:34 Style transfer with T2I-adapter
39:24 Style transfer with IP-adapter
41:56 Transferring cyberpunk style
47:37 Final remarks
ControlNet:
https://github.com/lllyasviel/Control...
T2I-adapters:
https://github.com/TencentARC/T2I-Ada...
https://github.com/TencentARC/T2I-Ada...
IP-adapter:
https://github.com/tencent-ailab/IP-A...
InstructPix2Pix model:
https://github.com/timothybrooks/inst...
https://www.timothybrooks.com/instruc...
A few inpainting models:
https://huggingface.co/stabilityai/st...
https://huggingface.co/runwayml/stabl...
https://huggingface.co/webui/stable-d...
https://huggingface.co/diffusers/stab...
Other links:
https://civitai.com/
****************************************************************************
Wolʇ Dynamics, your reliable partner for CAE solutions,
CAD and solid modeling → Meshing → Simulations → Automation and optimization → Post-processing → Data analytics and ML → Reporting
http://www.wolfdynamics.com/
Why Wolʇ Dynamics? Simply look at our banner - notice how the F appears backwards.
Wolʇ Dynamics ↔ Flow Dynamics 😯+💣=🤯
****************************************************************************
👉 Subscribe and hit the bell to see new videos:
/ @wolfdynamics5703
🖖 Join our channel to help us create more content. By joining our channel, you can also get access to perks:
/ @wolfdynamics5703
Follow us:
Twitter → twitter.com/WolfDynamics
LinkedIn → linkedin.com/company/wolf-dynamics
#ai #aiart #aiartgenerator #SDXL