LoRA training settings tested and explained | Stable Diffusion Automatic1111
I do a deep-dive over all of the LoRA training settings in Kohya, and test every setting.
‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐
💲 My patreon:
patreon.com/RobertJene
🍵 Buy me a coffee:
https://www.buymeacoffee.com/robertjene
‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐
Check out my music channel!
🎵 • Patience in Space v1.1
‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐‐
💲 My patreon:
patreon.com/RobertJene
🍵 Buy me a coffee:
https://www.buymeacoffee.com/robertjene
⌚ Timestamps
0:00:00 - introduction
0:01:33 - about the chapters
0:02:09 - testing methodology
0:09:05 - 1. Captioning
0:12:00 - 2. Source Model
0:13:41 - 3. Number of Repeats for training data
0:17:31 - 4. Number of Repeats for Reg data
0:18:57 - 5. Batch size
0:21:39 - 6. Max Train Steps
0:25:08 - 7. Epochs
0:26:47 - 8. Mixed Precision
0:28:18 - 9. Save Precision
0:29:16 - 10. Learning Rate Scheduler
0:31:20 - 11. Learning Rate and Learning Rate Warmup
0:31:39 - 12. Optimizer
0:34:06 - support the channel
0:35:02 - 13. Network Rank and Network Alpha
0:37:42 - 14. Max Resolution
0:41:55 - 15. Gradient Accumulation Steps
0:43:29 - 16. Clip Skip
0:44:55 - Multiple LoRA training script
0:53:09 - Tensorboard while training
0:54:04 - Tensorboard after training
0:55:56 - How to use Tensorboard
0:59:36 - using LoRA inspector script
🔗 links:
LoRA training parameters by bmaltais on github
https://github.com/bmaltais/kohya_ss/...
Tutorial: Dreambooth LoRA training using Kohya_SS by Desi_Cafe on civitai
https://civitai.com/articles/391/tuto...
Explanation of number of steps (EPOCHs):
https://rentry.org/59xed3#number-of-s... epochs
Network Rank and Network Dimension
https://github.com/bmaltais/kohya_ss/...
Alpha and Dimensions: Two Wild Settings of Training LoRA in Stable Diffusion
https://ashejunius.com/alpha-and-dime...
My LoRA Training Batch Converter on github
https://github.com/robertJene/LoRA-Tr...
LoRA inspector script on github:
https://github.com/rockerBOO/lora-ins...
LoRA inspector helper from my github:
https://github.com/robertJene/LoRA-In...
🎶 soundtrack music is on my music channel:
• Patience in Space v1.1
_____________________________________________________________
😆💗 Social Links:
Twitter: twitter.com/PerRevolutions
Facebook: facebook.com/PerRevolutions
Instagram: instagram.com/PerRevolutions
TikTok: tiktok.com/@perrevolutions
Below is the gear I use.
►Mics:
PowerDeWise Lav Mic: https://amzn.to/35zB2Qt
HyperX QuadCast S – RGB USB Condenser Microphone: https://amzn.to/3cKPb0Z
iRay UW10 UHF Dual Wirless Mic https://www.amazon.com/gp/product/B09...
►Tripods:
MOUNTDOG Photography Tripod Light Stand: https://amzn.to/2U8n5q4
Fugetek Selfie Stick & Tripod: https://amzn.to/3pUMNu7Y
MOZA Power Bank Tripod: https://amzn.to/2TpYhcJ
►Webcams:
Logitech C920s (1080p): https://amzn.to/3vr5ExI
Logitech C270 (720p): https://amzn.to/3xm2XyV
►Gimbal:
MOZA Mini MI 3-Axis Gimbal Stabilizer: https://amzn.to/3gCKtDJ
►Hardware:
Hot shoe swivel mount adapter: https://amzn.to/3wmbFNA
22 Pcs Tripod screw Adapters: https://amzn.to/3ztUDyY
Super Clamp with ball head adapter: https://amzn.to/3gypkuh
Fomito 11 inch Magic Arm + Super Clamp: https://amzn.to/2TxrDpL
Simple Deluxe 2-Pack Clamp Light: https://amzn.to/3ztYX1p
YOTTO Heavy Duty Microphone stand: https://amzn.to/3xBEd6b
►Lighting:
LED Ring Light 6” With tripod and smartphone mount: https://amzn.to/3cJSHJ7
Neewer Dimmable 176 LED Video Light on Camera LED Panel: https://amzn.to/3wqKeSV
-Power adapter for Neewer 176 LED: https://amzn.to/3zqNiA9
Neewer Led Video Light Panel: https://amzn.to/3wq12Jv
VILTROX LED On Camera Video Light, Portable Mini: https://amzn.to/35jb3wk
weeylite S03 Pocket RGB video light
https://www.amazon.com/gp/product/B09...
OHLUX Smart WiFi LED Bulbs, RGBCW: https://amzn.to/3wvlMQg
Neewer 12 SMD LED Bulb Mini Pocket-Size On-Camera LED Video Light: https://amzn.to/3wCHUrO
Full disclosure: As an Amazon Associate I earn from qualifying purchases.
This means that if you make a purchase, it doesn't cost you any more money, but I will earn a commission.