MCI at the Cybathlon 2024

Our team “OptiHeroes” in the competition of innovation

The Cybathlon 2024 in Zurich - a unique platform that combines technology and inclusion in a spectacular way. This year, we were delighted to compete with our “OptiHeroes” team in the new Visual Impairment category.

1.   Why the Cybathlon?

We have been fascinated by the Cybathlon for a long time. It is not only an extraordinary event for engineers and researchers, but also one that focuses on technologies that really change lives. In the past, we lacked the right category for participation. But with the introduction of the new Visual Impairment discipline, the time was finally right.

Our team leader Prof. Yeongmi Kim in particular laid the foundation with her many years of work on assistive technologies for blind people and people with visual impairments. The new category offered us the perfect opportunity to present this expertise in a competition.

2.   The team behind “OptiHeroes”

Our team “OptiHeroes” is a colorful mix of creative minds and technical experts working together at the frontier between science and innovation. We consist of motivated students and experienced supervisors from the HealthTech Department and are dedicated to the mission of improving the lives of people with visual impairments through technology.

Our Team:

• Pilot: Bernhard Tschulnigg
• Assistant to the pilot: Felix Putzer
• Team members: Julia Jackermaier, Leon Ochtendung, Lukas Neururer, Simon Senoner und Marcel Naderer
• Supervisors: Prof. Yeongmi Kim, Prof. Bernhard Hollaus und Simon Winkler

3.   The start of our project

At the beginning of 2024 - in March/April to be precise - the starting signal was given for our adventure. After a conversation with our volunteer Bernhard Tschulnigg, it quickly became clear: we're in! From that moment on, the intensive development of our technologies, which were specially designed for the challenges of the Cybathlon event, began.

4.   Our technology: The smartphone and the Rolling Cane

Our focus was on replacing the sense of sight with technical aids. The inspiration was quickly found: the smartphone. It is a powerful device that is also accessible to many people - exactly in line with the inclusive Cybathlon spirit. The smartphone is complemented by the Rolling Cane, an intelligent cane specially developed for the tasks of the Cybathlon.

• The smartphone: The core of our technology is the software that uses the smartphone camera to recognize objects, text, and colors.
• The Rolling Cane: Equipped with ultrasonic sensors and vibration feedback, it helps to recognize obstacles and find orientation.

5.   Our Technology in detail: How our innovations work

Here we present three of the ten Cybathlon events in the Visual Impairment category and explain the technology we used to master them.

1. Color recognition
   We used the HSV color space (Hue, Saturation, Value) for color recognition. Compared to the RGB color space, this enables more precise recognition of the colors used in the Cybathlon. A special aperture on the smartphone blocks ambient light, while the phone's flash ensures constant lighting conditions. A white foil also serves as a reference point for the camera.
2. Sidewalk exercise with the Rolling Cane
   The Rolling Cane uses ultrasonic sensors at floor and hip height to detect obstacles. It provides feedback via vibration when the user approaches an object. The smartphone also provides guidance at the touch of a button - for example, whether the user is facing forwards or sideways.
3. Finding the empty seat
   For this exercise, we trained a YOLO (You Only Look Once) model that recognizes objects in real time. Our software can distinguish whether a seat is occupied by a person or a backpack, or whether it is empty. The information is passed directly to the user via an audio output.

6.   Our goal: Inclusive technologies for the future

Our project was more than just a competition entry. It was designed to show how technical innovations can make everyday life easier for people with disabilities - with affordable, accessible solutions. The Cybathlon gave us the chance to put these technologies to the test, gather feedback and develop them further.

We are incredibly proud to have been part of this inspiring event.

Special thanks go to Privatklinik Hochrum, who supported us with their sponsorship. Without their help, our project would not have been possible to this extent!