KIT | KIT-Bibliothek | Impressum | Datenschutz

On the Influence of Explainable AI on Automation Bias

Schemmer, Max 1; Kühl, Niklas ORCID iD icon 1; Benz, Carina 1; Satzger, Gerhard 1
1 Karlsruhe Service Research Institute (KSRI), Karlsruher Institut für Technologie (KIT)

Abstract:

Artificial intelligence (AI) is gaining momentum, and its importance for the future of work in many areas, such as medicine and banking, is continuously rising. However, insights on the effective collaboration of humans and AI are still rare. Typically, AI supports humans in decision-making by addressing human limitations. However, it may also evoke human bias, especially in the form of automation bias as an over-reliance on AI advice. We aim to shed light on the potential to influence automation bias by explainable AI (XAI). In this pre-test, we derive a research model and describe our study design. Subsequentially, we conduct an online experiment with regard to hotel review classifications and discuss first results. We expect our research to contribute to the design and development of safe hybrid intelligence systems.


Zugehörige Institution(en) am KIT Institut für Wirtschaftsinformatik und Marketing (IISM)
Karlsruhe Service Research Institute (KSRI)
Publikationstyp Proceedingsbeitrag
Publikationsjahr 2022
Sprache Englisch
Identifikator KITopen-ID: 1000145123
Erschienen in Proceedings of the 30th European Conference on Information Systems (ECIS), Timișoara, RO, June 18 - 24, 2022
Veranstaltung 30th European Conference on Information Systems (ECIS 2022), Temeswar, Rumänien, 18.06.2022 – 24.06.2022
Verlag Association for Information Systems (AIS)
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page