VR Language Café
About the Project
VR language practice prototype for Meta Quest where you talk with AI-driven NPCs in English and Spanish using Gemini and Google STT/TTS.
Key Contributions
- Designed and implemented full interaction pipeline: Voice to LLM to Speech.
- Focused on interaction flow and robustness for natural conversations.
- Tuned performance for smooth operation on Quest devices.
Genre & gameplay: VR Language Café is an experimental educational experience where players enter a virtual café and have spoken conversations with AI-powered NPCs to practice English and Spanish. Each character reacts to player input, creating a low-pressure environment to practice speaking and listening. My contributions: Designed and implemented the full interaction pipeline on Meta Quest, integrating Gemini with Google speech-to-text and text-to-speech services. Routed voice input to text, sent it to the LLM, and played responses back with basic avatar lip-sync. Focused on interaction flow, UX, and robustness of the AI loop so users could hold natural-feeling conversations inside VR. Tuned the prototype for smooth performance on Quest 2 and 3.
Gallery
