AI for Accessible Street Crossings: Oko’s Smart Solution

0 comments

Oko: AI-Powered App Empowers Visually Impaired Pedestrians with Unprecedented Independence

A groundbreaking app, Oko, is redefining pedestrian safety and accessibility for individuals with visual impairments. The 2024 Apple Design Award winner for Inclusivity and App Store Award recipient for Cultural Impact leverages the power of artificial intelligence to provide real-time guidance at crosswalks, fostering confidence and independence.

Oko provides crucial, real-time information about pedestrian signals directly to users.

From Pandemic Project to Award-Winning Innovation

The story of Oko began during the height of the COVID-19 pandemic in Antwerp, Belgium. Vincent Janssen, along with his brother Michiel and longtime friend Willem Van de Mierop, found themselves with newfound free time and a desire to apply their expertise in artificial intelligence to a meaningful problem. A close friend with low vision experienced increasing isolation during lockdowns, unable to rely on volunteer guides for safe navigation.

“We started to notice his increasing isolation,” explains Janssen. “The restrictions meant he couldn’t go for walks with a guide. That sparked the question: could we leverage AI, similar to the technology driving autonomous vehicles, to create a system that would help people navigate public spaces independently?”

Initially, the team experimented with “hacky hardware”—a combination of microcomputers, 3D-printed components, and a borrowed speaker—to test the feasibility of recognizing pedestrian signals. These early prototypes involved extensive field testing, meticulously analyzing the AI’s ability to identify signal states and perform reliably in various weather conditions. However, they quickly realized that a software-based solution offered greater potential for scalability and usability.

Despite having limited experience with iOS development, the trio embarked on a crash course in Swift, dedicating themselves to learning the necessary skills to bring their vision to life. “I had maybe opened Xcode three times before,” Janssen admits, “but we were determined to overcome that hurdle.”

Oko co-founders Vincent Janssen, Michiel Janssen, and Willem Van de Mierop.
From left: Willem Van de Mierop, Michiel Janssen, and Vincent Janssen, the founders of Oko.

The resulting app, Oko—meaning “eye” in several languages—utilizes the iPhone’s camera, Maps SDK, and a sophisticated AI algorithm to provide users with real-time feedback through haptic, audio, and visual cues. The app’s core functionality centers around identifying pedestrian signals and communicating their status—walk, don’t walk, and countdown timers—in an accessible format.

Early user testing revealed a surprising preference for portrait mode, prompting a significant redesign of the user interface. The team also refined the audio feedback to more closely mimic natural sounds and incorporated additional visual cues based on user input. This iterative process underscored the importance of co-creation with the accessibility community.

Oko app screenshots showing map view and live crossing view.
Oko combines interactive maps with real-time visual and audio feedback to enhance pedestrian navigation.

Launched in December 2021, Oko quickly gained recognition within the accessibility community. The team has since expanded its reach, conducting field research in the United States to adapt the app to different traffic patterns and pedestrian infrastructure. Today, the Oko team has grown to six, including dedicated developers focused on refining the app’s performance and adding new features.

What sets Oko apart is its unwavering commitment to simplicity. While the team explored potential expansions—such as integrating public transportation information—they ultimately decided to prioritize a focused, streamlined experience. “We realized that adding complexity would detract from the app’s core value,” Janssen explains. “Our goal is to provide a reliable and intuitive tool that empowers users to navigate their surroundings with confidence.”

The success of Oko demonstrates the transformative potential of AI when applied with empathy and a deep understanding of user needs. It’s a powerful reminder that technology can be a force for inclusion, breaking down barriers and creating a more accessible world for everyone. But what other everyday challenges could be addressed with similar AI-driven solutions? And how can developers ensure that accessibility remains at the forefront of innovation?

Pro Tip: When designing for accessibility, prioritize user feedback and involve individuals with disabilities throughout the development process. Their insights are invaluable in creating truly inclusive and effective solutions.

Frequently Asked Questions About Oko

What makes the Oko app different from other navigation tools?

Oko specifically focuses on pedestrian crossings and provides real-time signal information tailored for individuals with visual impairments, unlike general navigation apps.

How does Oko ensure accuracy in different lighting and weather conditions?

The app’s AI models are trained on a diverse dataset of images captured in various conditions, and the team continues to refine the algorithms to improve performance in challenging environments.

Is the Oko app available on platforms other than iPhone?

Currently, Oko is exclusively available on iPhone. The team is exploring potential expansion to other platforms in the future.

How does Oko protect user privacy?

Oko’s AI models run locally on the device, meaning no images or data are sent to the cloud, ensuring user privacy.

What is the future development roadmap for the Oko application?

The team is focused on improving the app’s accuracy, expanding its geographic coverage, and incorporating additional features based on user feedback.

Learn more about Oko and its mission at AYES BV. Download Oko from the App Store: Download Oko.

Explore other innovative designs recognized by Apple: Meet the 2024 Apple Design Award winners.

Share this article to help spread awareness about Oko and its impact on accessibility!


Discover more from Archyworldys

Subscribe to get the latest posts sent to your email.

You may also like