AI-Powered VR for Language Learning
http://tosolini.com - Our new #VR prototype uses #AI to enhance foreign language comprehension. In this setup, a virtual parrot offers hints, guiding users to locate objects in a virtual environment. The AI adapts, generating new clues based on user interactions in real time.
Toolset:
The new Meta XR All-in-One SDK to create the VR experience for the Oculus Quest 3 in Unity.
OpenAI API to generate the clues and real-time responses.
http://wit.ai for the text to speech.
Unity asset for the environment by VanillaArt
https://assetstore.unity.com/packages...
Sketchfab model of the parrot by Royraj Vichaidit:
https://sketchfab.com/3d-models/parro...
A big thank you to María Sánchez Isaza and the Bellevue College XR Lab for their invaluable collaboration on this project.