KIT | KIT-Bibliothek | Impressum | Datenschutz

DMAW: A Dynamic Multimodal Measurement Fusion Network with Attention for Reliable Welding Process Monitoring under Harsh Industrial Environments

Fan, Jiawei; Yuan, Ting; Zhang, Haonan; Li, Songlin; Hanebeck, Uwe D. 1; Li, Zhuguo; Wu, Edmond Qi; Qian, Jiuchao
1 Institut für Anthropomatik und Robotik (IAR), Karlsruher Institut für Technologie (KIT)

Abstract:

In laser welding, harsh environmental conditions such as arc light interference, spatter, and strong background noise pose significant challenges to accurate process monitoring and measurement. Traditional single-modality sensing methods are often inadequate for a comprehensive characterization of welding states and remain highly vulnerable to noise contamination. To overcome the limitations, a dynamic multimodal attention-based weighting (DMAW) network is proposed, which integrates visual and acoustic information to achieve more comprehensive welding state characterization. First, modality-specific feature extractors are trained using unsupervised knowledge distillation (KD) to learn welding-relevant semantic representations. Next, the extracted features are passed through a cross-attention module to enable intermodal interaction and suppress noise. Finally, a dynamic reliability-weighted fusion is proposed that adaptively adjusts modality contributions, thereby reducing measurement uncertainty and enhancing robustness under varying conditions. Experimental validation on a dedicated laser welding platform demonstrates that the proposed framework achieves superior accuracy and resilience in welding state monitoring, highlighting its potential as a reliable solution for intelligent industrial welding systems.


Postprint §
DOI: 10.5445/IR/1000189165
Veröffentlicht am 23.03.2026
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Anthropomatik und Robotik (IAR)
KIT-Bibliothek (BIB)
Publikationstyp Zeitschriftenaufsatz
Publikationsdatum 15.01.2026
Sprache Englisch
Identifikator ISSN: 1530-437X, 1558-1748, 2379-9153
KITopen-ID: 1000189165
Erschienen in IEEE Sensors Journal
Verlag Institute of Electrical and Electronics Engineers (IEEE)
Band 26
Heft 2
Seiten 2347–2358
Schlagwörter Cross-attention, dynamic balance, laser welding, multimodal measurement, unsupervised feature learning
Nachgewiesen in OpenAlex
Web of Science
Dimensions
Scopus
KIT – Die Universität in der Helmholtz-Gemeinschaft
KITopen Landing Page