RVC V2 Tutorial - Speak in any voice! - Retrieval-based Voice Conversion - Easy AI Voice Tutorial
#aivoices #aivoice #ai #aitutorial #rvc #rvcproject #rvcgui, RVC WebUI, RVC AI Tutorial, RVC GUI Tutorial, RVC Project Tutorial, AI Voice Tutorial, RVC V2, rvc voice changer
In this video you’ll be learning how to speak in any voice using nothing but your PC and a microphone. Everything will be running locally on your machine. First, we’ll prepare an audio file that will serve as an input to train an AI model. We then train the model using RVC-Project (Retrieval-based Voice Conversion) before using the model in a different and much simpler User Interface (RVC-GUI). Once everything is set up, you’ll be able to convert a recording of your voice to AI voice within seconds.
Notes:
Works with any language and you just need to train the model with the same language that you want to clone (If you use a different language for training than for cloning, then you will get an accent that is close to real accents).
Try Elevenlabs for free while supporting this channel (Up to 20 minutes of voice generation for free each month): https://try.elevenlabs.io/aivt
My other videos about AI voice-cloning: • AI Voice Cloning Tutorials
If you run into memory issues, try the following:
Lower the batch size to "1".
Cut the audio in clips shorter than 10 seconds.
Reduce the size of the dataset.
For any other issues, make sure the folder path of your input voice and of RVC Beta does not contain any spaces or special characters!
/UPDATE 1/
Download Pretrained Voices
/ discord
https://huggingface.co/QuickWick/Musi...
https://rvc-models.com
https://docs.google.com/spreadsheets/...
/UPDATE 2/
TTS Tutorial (The .pth models are not compatible to the app in this tutorial): • Free AI Text-To-Speech Voice Cloning – TTS...
/UPDATE 3/
I have now trained the voice with a dataset of 30 minutes and used 600 epochs. The resulting voice sounds better but still is not perfect. Maybe I should go even higher on the epochs.
/ UDATE 4/
When you create the zip file with the .pth model, also include the .index file that starts with "added..." which you can find in the /logs/lecturer/ folder
/Update 5/
I have now trained a dataset of 40 minutes with 300 epochs and this seems to give me the best overall results so far
/UPDATE 6/
I've now trained my original 10 minute sample with the RMVPE model (instead of Harvest) and this seems to improved or reduced some of the robotic noises. RMVPE is available in this version of RVC: https://huggingface.co/lj1995/VoiceCo...
Using "Harvest" in RVC-GUI works great with an RMVPE-trained model.
/UPDATE 7 (09/2024)
Still using this method to clone my voice for the videos. I have not yet come across any open source method that is better than RVC V2. The only thing I am doing differently now is that I am using more voice improvement filters in the video editing tool (Final Cut Pro).
/Update 8 (07/2025)/
Check out https://applio.org for a modern implementation of the RVC v2 tech which is still the best free ai voice cloning that requires training. However, zero shot methods have improved over the past year and you should check out this video for the best ai tts and voice cloning tools: • Best AI Voice Cloning In 2025
What you’ll need
NVIDIA GPU with CUDA support (at least 8GB VRAM needed for the training)
About 30GB of free disk space
About 10 minutes of the voice you want to train the AI model on
A recording of your own voice that will then be converted into AI voice
Download Links
1. Prepare input voice with Audacity
https://www.audacityteam.org/download/
2. Train Model with RVC-Project (RVC-Beta)
https://www.huggingface.co/lj1995/Voi...
Note: "RVC-Beta.7z" always includes the latest version of the tool. If you want to use the exact same version as in the video, download this one: https://huggingface.co/lj1995/VoiceCo...
3. Use Model with RVC-GUI
https://github.com/Tiger14n/RVC-GUI/r...
Optional
RVC-Project documentation on Github:
https://github.com/RVC-Project/Retrie...
If you appreciate my videos, you can buy me a Coffee: https://www.buymeacoffee.com/aivoicet...
My PC Components:
(Disclosure: As an Amazon Associate, I earn from qualifying purchases.)
My GPU: ZOTAC Gaming GeForce RTX 4090 AMP Extreme https://amzn.to/3PZHNlm (Affiliate Link)
(Alternative: Zotac NVIDIA GeForce RTX 4090 Trinity https://amzn.to/3s2GERN (Affiliate Link))
My Microphone: Razer Seiren V2 X USB Microphone https://amzn.to/46PkAtn (Affiliate Link)
Rest of the hardware: • PC Hardware Upgrade For Running AI Tools L...
Chapters:
00:00 Introduction
01:44 Step 1 - Prepare Input Voice
03:11 Step 2 - Train Voice Model in RVC V2
07:55 Step 3 - Use Voice Model in RVC GUI
11:00 Final Result