KIT | KIT-Bibliothek | Impressum | Datenschutz

On the Perception of Difficulty: Differences between Humans and AI

Spitzer, Philipp ORCID iD icon 1,2; Holstein, Joshua ORCID iD icon; Vössing, Michael ORCID iD icon 1,2; Kühl, Niklas ORCID iD icon 1,2
1 Karlsruhe Service Research Institute (KSRI), Karlsruher Institut für Technologie (KIT)
2 Institut für Wirtschaftsinformatik und Marketing (IISM), Karlsruher Institut für Technologie (KIT)

Abstract:

With the increased adoption of artificial intelligence (AI) in industry and society, effective human-AI interaction systems are becoming increasingly important. A central challenge in the interaction of humans with AI is the estimation of difficulty for human and AI agents for single task instances. These estimations are crucial to evaluate each agent's capabilities and, thus, required to facilitate effective collaboration. So far, research in the field of human-AI interaction estimates the perceived difficulty of humans and AI independently from each other. However, the effective interaction of human and AI agents depends on metrics that accurately reflect each agent's perceived difficulty in achieving valuable outcomes. Research to date has not yet adequately examined the differences in the perceived difficulty of humans and AI. Thus, this work reviews recent research on the perceived difficulty in human-AI interaction and contributing factors to consistently compare each agent's perceived difficulty, e.g., creating the same prerequisites. Furthermore, we present an experimental design to thoroughly examine the perceived difficulty of both agents and contribute to a better understanding of the design of such systems.


Verlagsausgabe §
DOI: 10.5445/IR/1000157963
Veröffentlicht am 21.04.2023
Cover der Publikation
Zugehörige Institution(en) am KIT Fakultät für Physik – Geowissenschaftliches Gemeinschaftsobservatorium Schiltach (Schiltach)
Institut für Wirtschaftsinformatik und Marketing (IISM)
Karlsruhe Service Research Institute (KSRI)
Publikationstyp Proceedingsbeitrag
Publikationsdatum 23.04.2023
Sprache Englisch
Identifikator KITopen-ID: 1000157963
Erschienen in AutomationXP23: Intervening, Teaming, Delegating Creating Engaging Automation Experiences
Veranstaltung Conference on Human Factors in Computing Systems (CHI 2023), Hamburg, Deutschland, 23.04.2023 – 28.04.2023
Verlag CEUR-WS.org
Vorab online veröffentlicht am 19.04.2023
Schlagwörter Artificial Intelligence, Human-AI Interaction, Confidence Estimation, Instance Difficulty
Nachgewiesen in Dimensions
arXiv
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page