Dual-Mode Language-Model Mobile Assistant
Worcester Polytechnic Institute
A multilingual, dual-mode assistive navigation application integrated with InnoSpire smart glasses for visually impaired and blind users.
- - Built a cross-platform React Native application supporting object recognition, obstacle awareness, and transit guidance.
- - Implemented switching between an online GPT-4o workflow and offline Phi-3-mini and YOLOv5 workflows based on connectivity.
- - Evaluated performance with image datasets and multilingual surveys involving visually impaired, blind, and sighted participants.