Goals
A robust application for Benvision where low-vision users can use an iPhone to experience surroundings through a soundscape as they explore the world.
Opportunity to lead
I led the XR Design and development with 3 other team members (Soobin Ha, Patrick Burton & Lucas Thin) from Benvision.
![Image](/_next/image?url=https%3A%2F%2Fcdn.sanity.io%2Fimages%2Fo1tg7c9j%2Fproduction%2F5298d8fd228d5218ce727a8fe37fbf552024ccf5-420x236.gif%3Fw%3D420%26auto%3Dformat&w=3840&q=75)
Understanding the Challenge
For the visually impaired, navigating the world can be a challenge filled with uncertainty. Our goal was to provide a solution that not only aids in navigation but also enriches the perception of the world through sound.
![Image](/_next/image?url=https%3A%2F%2Fcdn.sanity.io%2Fimages%2Fo1tg7c9j%2Fproduction%2F04635627e8a848d641add8ab91a160b290a55d4c-1614x896.png%3Fw%3D1614%26auto%3Dformat&w=3840&q=75)
Design Process
Identifying Needs
Through research and interaction with the visually impaired community, we identified the need for a more intuitive and enriching navigation aid.
![Image](/_next/image?url=https%3A%2F%2Fcdn.sanity.io%2Fimages%2Fo1tg7c9j%2Fproduction%2F7d4091d6afe89dc50b4862587c3dfc52adcd009d-769x455.png%3Fw%3D769%26auto%3Dformat&w=3840&q=75)
Technological Integration
We built a unique computer vision algorithm capable of identifying and locating objects in the user's surroundings. By assigning musical cues to these objects and utilizing spatial audio, our prototype creates a rich auditory landscape.
![Image](/_next/image?url=https%3A%2F%2Fcdn.sanity.io%2Fimages%2Fo1tg7c9j%2Fproduction%2Ff0d8674ba44481eaad8cd3f75fa838b126bb9b92-1596x1090.png%3Fw%3D1596%26auto%3Dformat&w=3840&q=75)
Experience Design
The design process focused on ensuring that the interface and experience were accessible, intuitive, and emotionally engaging. Feedback from early testers, like Chris McNally, played a crucial role in refining BEN's functionality and user interface.
Built a real-time navigation app
We build an iOS application that creates spatial soundscapes for the objects around a user.