← Project index
RecordAI · AR · Accessibility
AI-Powered AR Smart Glasses for Hearing Accessibility
Engineered an AI-driven smart glasses system providing real-time subtitles to improve communication accessibility.
- Organisation / Context
- Accessibility research
- Role
- Lead XR engineer
- Timeline
- 8 months
- Date
- June 2024
Overview
Developed a smart glasses application delivering real-time speech-to-text subtitles directly within the user’s field of view. The system supported adjustable display settings and multilingual voice recognition. Designed for accessibility and low-latency performance, the solution improved communication in educational, public, and professional settings.
- Outcome
- Real-time multilingual subtitles inside the user's field of view
Engineering
- 01Allowed audio input to come from either the phone microphone or the glasses microphone.
- 02Presented the resulting subtitles inside the wearer's environment using a world-space AR canvas.
- 03Supported English, Yoruba, Igbo and Hausa language workflows.
- Hardest problem
- The interaction had to remain flexible across two possible audio sources while keeping subtitles readable and correctly positioned within the wearer's augmented view.
- Stack
- Unity · C# · XREAL SDK · Node.js · WebSocket · AI
Media
Project views
02
