Text-to-Speech ElevenLabs Plugin for TouchDesigner + Whisper, ChatGPT, and MediaPipe Integration
In this tutorial, you'll learn how to use the new ElevenLabs text-to-speech plugin for TouchDesigner. We'll also walk through a project creating a voice-activated 3D talking character by integrating Whisper for speech-to-text, ChatGPT for generating dialogue, ElevenLabs for text-to-speech, and MediaPipe for motion tracking to create an interactive experience.
Link to project file + Plugin on Patreon: / blankensmithing
Previous Tutorial on ChatGPT and Whisper: • GPT-4, ChatGPT, and Whisper(speech-to-text...
Noto the Talking Ball's Tutorial: • Talking ball Starboy in Touchdesigner (터치디...
MediaPipe Plugin Tutorial: • Free Motion Tracking plugin for TouchDesig...
0:00 Overview
3:11 ElevenLabs Plugin Overview
7:22 Connect ChatGPT to ElevenLabs
10:11 Configure Whisper with ElevenLabs
17:40 Add MediaPipe Face Tracking