Head-tracked Subtitles Using Augmented Reality
In this video, I showcase a real-time subtitling application for augmented reality that tracks with a user's head. It's built using Unity, Vosk, and the Llama3 large language model. The application leverages these applications to display anyone's speech as real-time subtitles, which are shown through the camera of a modded video see-through HTC Vive Pro.
Stay tuned for deployment on a standalone device and for real time translations. I'll put my code on github once all of the bugs are worked out.
Don't forget to like, comment, and subscribe if you want to see more innovative AR applications and the upcoming language translation version!