KIT | KIT-Bibliothek | Impressum | Datenschutz

Designing Gamification Concepts for Expert Explainable Artificial Intelligence Evaluation Tasks: A Problem Space Exploration

Toussaint, Philipp A. ORCID iD icon 1; Warsinsky, Simon Lukas ORCID iD icon 1; Schmidt-Kraepelin, Manuel 1; Thiebes, Scott ORCID iD icon 1; Sunyaev, Ali 1
1 Institut für Angewandte Informatik und Formale Beschreibungsverfahren (AIFB), Karlsruher Institut für Technologie (KIT)

Abstract:

Artificial intelligence (AI) models are often complex and require additional explanations for use in high-stakes decision-making contexts like healthcare. To this end, explainable AI (XAI) developers must evaluate their explanations with domain experts to ensure understandability. As these evaluations are tedious and repetitive, we look at gamification as a means to motivate and engage experts in XAI evaluation tasks. We explore the problem space associated with gamified expert XAI evaluation. Based on a literature review of 22 relevant studies and seven interviews with experts in XAI evaluation, we elicit knowledge about affected stakeholders, eight needs, eight goals, and seven requirements. Our results help us understand better the problems associated with expert XAI evaluation and paint a broad application potential for gamification to improve XAI expert evaluations. In doing so, we lay the foundation for the design of successful gamification concepts for expert XAI evaluation.


Verlagsausgabe §
DOI: 10.5445/IR/1000167380
Veröffentlicht am 17.01.2024
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Angewandte Informatik und Formale Beschreibungsverfahren (AIFB)
Publikationstyp Proceedingsbeitrag
Publikationsjahr 2024
Sprache Englisch
Identifikator ISBN: 978-0-9981331-7-1
KITopen-ID: 1000167380
Erschienen in Proceedings of the 57th Hawaii International Conference on System Sciences, Honolulu, HI, 3rd - 6th January 2024
Veranstaltung 57th Hawaii International Conference on System Sciences (HICSS 2024), Honolulu, HI, USA, 03.01.2024 – 06.01.2024
Verlag ScholarSpace
Seiten 1338-1347
Vorab online veröffentlicht am 04.01.2024
Externe Relationen Abstract/Volltext
Schlagwörter Gamification, Explainable Artificial Intelligence, Evaluation, Problem Space
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page