Streaming Speech to Text Models - Kyutai vs Whisper
📜 Get LIFETIME repo access at https://Trelis.com/ADVANCED-audio
🗝️ Get Trelis Multi-Repo Bundle (https://Trelis.com/multi-repo-bundle)
Access all SEVEN Trelis Github Repos (-robotics, -vision, -evals, -fine-tuning, -inference, -voice, -time-series)
Support via Github Issues & Trelis’ Private Discord
Tip: If you subscribe here on YouTube, click the bell to be notified of new vids
💡 Done-for-you Custom Fine-tuning Services
Learn More: https://trelis.com/fine-tuning-services/
🤝 Are You a Top Developer?
Work for Trelis: https://trelis.com/jobs/
💸 Starting a New Project/Venture?
Apply for a Trelis Grant: https://trelis.com/trelis-ai-grants/
📧 Get Trelis AI Tutorials by Email
Subscribe on Substack: https://trelis.substack.com
Video Links:
slides: https://docs.google.com/presentation/...
kyutai repo: https://github.com/kyutai-labs/delaye...
TIMESTAMPS:
0:00 Streaming Speech to Text Demo with Kyutai TTS
0:42 Demo en français
1:05 Video Overview
2:42 Resources & Repo
3:15 Running Kyutai TTS on your Mac
5:15 Run streaming TTS in a notebook
5:58 Word timestamping
8:52 Text and Audio Assisted Transcription
11:46 Fast STREAMING TTS server with Rust
15:27 Streaming vs Whisper TTS vs Voxtral
19:53 Theory of Timestamping
22:55 Whisper vs Kyutai TTS architectures
24:34 How Kyutai is trained (with whisper timestamped data)
25:50 Wrap up