KIT | KIT-Bibliothek | Impressum | Datenschutz

Should I Follow AI-based Advice? Measuring Appropriate Reliance in Human-AI Decision-Making

Schemmer, Max 1,2; Hemmer, Patrick 1,2; Kühl, Niklas ORCID iD icon 1,2; Benz, Carina 1,2; Satzger, Gerhard 1,2
1 Karlsruhe Service Research Institute (KSRI), Karlsruher Institut für Technologie (KIT)
2 Institut für Wirtschaftsinformatik und Marketing (IISM), Karlsruher Institut für Technologie (KIT)


Many important decisions in daily life are made with the help of advisors, e.g., decisions about medical treatments or financial investments. Whereas in the past, advice has often been received from human experts, friends, or family, advisors based on artificial intelligence (AI) have become more and more present nowadays. Typically, the advice generated by AI is judged by a human and either deemed reliable or rejected. However, recent work has shown that AI advice is not always beneficial, as humans have shown to be unable to ignore incorrect AI advice, essentially representing an over-reliance on AI. Therefore, the aspired goal should be to enable humans not to rely on AI advice blindly but rather to distinguish its quality and act upon it to make better decisions. Specifically, that means that humans should rely on the AI in the presence of correct advice and self-rely when confronted with incorrect advice, i.e., establish appropriate reliance (AR) on AI advice on a case-by-case basis. Current research lacks a metric for AR. This prevents a rigorous evaluation of factors impacting AR and hinders further development of human-AI decision-making. ... mehr

Volltext §
DOI: 10.5445/IR/1000145647
Veröffentlicht am 12.07.2022
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Wirtschaftsinformatik und Marketing (IISM)
Karlsruhe Service Research Institute (KSRI)
Publikationstyp Forschungsbericht/Preprint
Publikationsjahr 2022
Sprache Englisch
Identifikator KITopen-ID: 1000145647
Externe Relationen Siehe auch
Schlagwörter Human-AI Decision-Making, Appropriate Reliance, Human-AI teams
Nachgewiesen in arXiv
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page