KIT | KIT-Bibliothek | Impressum | Datenschutz

Assessment of a Fine-Tuned Vision-Language-Action Model for Robotic Feature-Following Inspection

Krüger, Martin ORCID iD icon 1; Salem, Mahmoud 1; Reischl, Markus ORCID iD icon 1
1 Institut für Automation und angewandte Informatik (IAI), Karlsruher Institut für Technologie (KIT)

Abstract:

Modern manufacturing increasingly relies on robotics to achieve high throughput and quality, especially as production lines become more flexible and parts more customized. Robotic inspection is a critical enabler for quality assurance as it supports repeatable measurements while reducing human workload and variability. Recent vision-language-action (VLA) models have advanced robotic manipulation by integrating visual perception and language understanding for autonomous control. However, the application to robotic inspection, which requires accurate movement without altering the environment, remains underexplored. This work investigates the feasibility of adapting manipulation-pretrained VLA models to an inspection-oriented feature-following task and presents the following contributions: Tailored to the requirements of inspection problems, two approaches for assessing VLA performance are introduced: A trajectory-based evaluation metric to quantify performance in rollouts as well as an action-level metric, useful during the fine-tuning process. In addition, an open-source, manipulation-pretrained VLA model is fine-tuned for a feature-following task. ... mehr


Verlagsausgabe §
DOI: 10.5445/IR/1000193695
Veröffentlicht am 01.06.2026
Originalveröffentlichung
DOI: 10.1007/s11063-026-11860-3
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Automation und angewandte Informatik (IAI)
Publikationstyp Zeitschriftenaufsatz
Publikationsjahr 2026
Sprache Englisch
Identifikator ISSN: 1573-773X
KITopen-ID: 1000193695
HGF-Programm 43.31.02 (POF IV, LK 01) Devices and Applications
Erschienen in Neural Processing Letters
Verlag Springer
Vorab online veröffentlicht am 29.05.2026
Nachgewiesen in OpenAlex
KIT – Die Universität in der Helmholtz-Gemeinschaft
KITopen Landing Page