KIT | KIT-Bibliothek | Impressum | Datenschutz

Comparing AI-Assisted Authoring by Demonstration to Manual Authoring of Augmented Reality Maintenance Instructions

Knoben, Valentin Tang 1; Blattgerste, Jonas; Hein, Björn; Wurll, Christian
1 Institut für Anthropomatik und Robotik (IAR), Karlsruher Institut für Technologie (KIT)

Abstract:

Creating Augmented Reality (AR) instructions for industrial guidance remains labor-intensive, while fully automated solutions are often impractical. To bridge this gap, we present VisAARD, an open-source, human-in-the-loop authoring tool that combines vision-language models with authoring by demonstration. From stepwise expert demonstrations, VisAARD uses egocentric video and hand-tracking to generate textual descriptions and propose in-situ 3D guidance elements for later review and refinement. In a within-subject study (N=21), we compared VisAARD against an industry-standard manual authoring baseline similar to Microsoft Dynamics 365 Guides in a robotic-cell maintenance scenario. Compared to the baseline, VisAARD reduced mean authoring time from 36 to under 20 minutes, lowered perceived task load, achieved higher perceived usability, and was preferred by 20 out of 21 participants. Qualitative feedback further suggests that a hybrid workflow combining the efficiency of AI-assisted authoring with targeted manual refinement is perceived as a meaningful direction for AR authoring tools.


Verlagsausgabe §
DOI: 10.5445/IR/1000198862
Veröffentlicht am 05.11.2026
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Anthropomatik und Robotik (IAR)
Publikationstyp Proceedingsbeitrag
Publikationsdatum 30.08.2026
Sprache Englisch
Identifikator ISBN: 979-8-4007-2611-8
KITopen-ID: 1000198862
Erschienen in MuC '26: Proceedings of Mensch und Computer 2026
Veranstaltung Mensch und Computer (MuC 2026), Duisburg, Deutschland, 30.08.2026 – 02.09.2026
Verlag Association for Computing Machinery (ACM)
Seiten 396 - 409
Serie Proceedings
Vorab online veröffentlicht am 29.08.2026
Externe Relationen Siehe auch
Nachgewiesen in OpenAlex
Scopus
KIT – Die Universität in der Helmholtz-Gemeinschaft
KITopen Landing Page