KIT | KIT-Bibliothek | Impressum | Datenschutz

A comparative study in real-time scene sonification for visually impaired people

Hu, W.; Wang, K.; Yang, K. 1; Cheng, R.; Ye, Y.; Sun, L.; Xu, Z.
1 Institut für Anthropomatik und Robotik (IAR), Karlsruher Institut für Technologie (KIT)

Abstract (englisch):

In recent years, with the development of depth cameras and scene detection algorithms, a wide variety of electronic travel aids for visually impaired people have been proposed. However, it is still challenging to convey scene information to visually impaired people efficiently. In this paper, we propose three different auditory-based interaction methods, i.e., depth image sonification, obstacle sonification as well as path sonification, which convey raw depth images, obstacle information and path information respectively to visually impaired people. Three sonification methods are compared comprehensively through a field experiment attended by twelve visually impaired participants. The results show that the sonification of high-level scene information, such as the direction of pathway, is easier to learn and adapt, and is more suitable for point-to-point navigation. In contrast, through the sonification of low-level scene information, such as raw depth images, visually impaired people can understand the surrounding environment more comprehensively. Furthermore, there is no interaction method that is best suited for all participants in the experiment, and visually impaired individuals need a period of time to find the most suitable interaction method. ... mehr


Verlagsausgabe §
DOI: 10.5445/IR/1000120983
Veröffentlicht am 07.07.2020
Originalveröffentlichung
DOI: 10.3390/s20113222
Scopus
Zitationen: 21
Dimensions
Zitationen: 20
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Anthropomatik und Robotik (IAR)
Publikationstyp Zeitschriftenaufsatz
Publikationsjahr 2020
Sprache Englisch
Identifikator ISSN: 1424-8220
KITopen-ID: 1000120983
Erschienen in Sensors
Verlag MDPI
Band 20
Heft 11
Seiten Article No. 3222
Vorab online veröffentlicht am 05.06.2020
Schlagwörter electronic travel aid; visually impaired people; sonification; scene detection
Nachgewiesen in Dimensions
Scopus
Globale Ziele für nachhaltige Entwicklung Ziel 3 – Gesundheit und Wohlergehen
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page