Back to Projects
Unity XR Developer • Commercial Prototype
VR Language Café
VRVR: Meta Quest 3, Meta Quest 2PrototypePersonal
About the Project
VR language practice prototype for Meta Quest where you talk with AI-driven NPCs in English and Spanish using Gemini and Google STT/TTS.
Key Contributions & Engineering Responsibilities
- Designed and implemented full interaction pipeline: Voice to LLM to Speech.
- Focused on interaction flow and robustness for natural conversations.
- Tuned performance for smooth operation on Quest devices.
Engineering Impact & Measurable Outcomes
- Social VR language conversation prototype
- Spatial audio & voice prompt interaction
- Meta Quest VR hardware deployment
Genre & gameplay: VR Language Café is an experimental educational experience where players enter a virtual café and have spoken conversations with AI-powered NPCs to practice English and Spanish. Each character reacts to player input, creating a low-pressure environment to practice speaking and listening.
My contributions: Designed and implemented the full interaction pipeline on Meta Quest, integrating Gemini with Google speech-to-text and text-to-speech services. Routed voice input to text, sent it to the LLM, and played responses back with basic avatar lip-sync. Focused on interaction flow, UX, and robustness of the AI loop so users could hold natural-feeling conversations inside VR. Tuned the prototype for smooth performance on Quest 2 and 3.
Technologies
UnityC#VRMeta Quest 3Google GeminiSpeech-to-Text
Categories
XRVREducationTraining