KIT | KIT-Bibliothek | Impressum | Datenschutz

Automating Industrial Quality Assurance: A Zero-Shot MLLM Framework for Defect Detection and 3R

Liu, Shuchao 1; Koch, Dominik ORCID iD icon 1; Kaiser, Jan-Philipp 1; Stamer, Florian ORCID iD icon 1
1 Institut für Produktionstechnik (WBK), Karlsruher Institut für Technologie (KIT)

Abstract:

In modern industrial production, particularly within the circular economy, automated defect detection is crucial for quality control and resource efficiency. Traditional inspection methods are often inconsistent and inefficient, while existing machine learning approaches are constrained by data scarcity, poor generalization, and a lack of interpretability. This paper proposes a zero-training visual inspection framework that leverages Multi-Modal Large Language Models (MLLMs) for automated defect detection and decision-making in industrial components, using starter motors as a case study. The framework integrates the zero-shot reasoning capabilities of an MLLM with an Elasticsearch-powered knowledge base to create an end-to-end automated system for "defect identification, standard matching, and decision-making." By processing images and relevant technical documentation, the system identifies defects and provides handling recommendations based on the 3R principles (Reuse, Remanufacture, Recycle) without requiring task-specific training. Experimental results on 584 starter motor samples show that our optimized system achieves an overall accuracy of 81.4% and an F1 score of 85.3%. ... mehr


Verlagsausgabe §
DOI: 10.5445/IR/1000191680
Veröffentlicht am 26.03.2026
Originalveröffentlichung
DOI: 10.1016/j.procir.2025.09.037
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Produktionstechnik (WBK)
Publikationstyp Zeitschriftenaufsatz
Publikationsjahr 2026
Sprache Englisch
Identifikator ISSN: 2212-8271
KITopen-ID: 1000191680
Erschienen in Procedia CIRP
Verlag Elsevier
Band 139
Seiten 313–318
Vorab online veröffentlicht am 18.02.2026
Schlagwörter Multi-Modal Large Language Model, Visual Defect Detection, Zero-Shot Learning, 3R Decision-Making, Quality Assurance, Industrial Automation
Nachgewiesen in Scopus
OpenAlex
Globale Ziele für nachhaltige Entwicklung Ziel 8 – Menschenwürdige Arbeit und Wirtschaftswachstum
KIT – Die Universität in der Helmholtz-Gemeinschaft
KITopen Landing Page