KIT | KIT-Bibliothek | Impressum | Datenschutz

AI going rogue? An integrative narrative review of the tacit assumptions underlying existential AI-risks

Bareis, Jascha ORCID iD icon 1; Ackerl, Clemens; Heil, Reinhard ORCID iD icon 1
1 Institut für Technikfolgenabschätzung und Systemanalyse (ITAS), Karlsruher Institut für Technologie (KIT)

Abstract:

This paper presents an integrative narrative review of the tacit background assumptions underlying AI existential risk (X-risks) futures. Once confined to science fiction, concerns about AI X-risks now shape debates at the crossroads of the tech world, NGOs, politics and (social) media. Despite growing attention, the plausibility of AI surpassing human controllability remains highly contested. Examining 81 peer-reviewed papers from Scopus and Web of Science, we find a fragmented discourse characterized by bold yet often unsubstantiated claims, including accelerationist growth models and speculative calculations of catastrophic tipping points. Anthropomorphic and speculative AI conceptualizations prevail, while interdisciplinary perspectives that consider issues of infrastructure, social agency, Big Tech power position and politics remain scarce. Delineating how these speculative tendencies are detrimental to the current regulatory need to tackle AI harms, we deduce an AI X-risk heuristic and advocate for a shift in attention from the maximum possible negative consequences to the structural and socio-technical characteristics of how AI is embedded—which are the prerequisites for any AI futures to emerge.


Verlagsausgabe §
DOI: 10.5445/IR/1000190886
Veröffentlicht am 23.02.2026
Originalveröffentlichung
DOI: 10.1007/s43681-025-00928-w
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Technikfolgenabschätzung und Systemanalyse (ITAS)
Publikationstyp Zeitschriftenaufsatz
Publikationsmonat/-jahr 02.2026
Sprache Englisch
Identifikator ISSN: 2730-5953, 2730-5961
KITopen-ID: 1000190886
HGF-Programm 46.24.01 (POF IV, LK 01) Applied TA: Digitalizat. & Automat. Socio-Technical Change
Erschienen in AI and Ethics
Verlag Springer
Band 6
Seiten Article no: 152
Vorab online veröffentlicht am 09.02.2026
Schlagwörter Artificial intelligence · Existential risk · Catastrophic risk · Epistemic uncertainty · Controllability ·, Integrative review
Nachgewiesen in OpenAlex
KIT – Die Universität in der Helmholtz-Gemeinschaft
KITopen Landing Page