KIT | KIT-Bibliothek | Impressum | Datenschutz

A Modular Deep Learning Architecture for Anomaly Detection in HRI

Sóti, Gergely; Mamaev, Ilshat; Hein, Björn

Abstract (englisch):
Considering humans as a non-deterministic factor makes anomaly detection in Human-Robot Interaction scenarios rather a challenging problem. Anomalous events like unexpected user interaction or unforeseen environment changes are unknown before they happen. On the other hand, the work process or user intentions could evolve in time. To address this issue, a modular deep learning approach is presented that is able to learn normal behavior patterns in an unsupervised manner. We combined the unsupervised feature extraction learning ability of an autoencoder with a sequence modeling neural network. Both models were firstly evaluated on benchmark video datasets, revealing adequate performance comparable to the state-of-the-art methods. For HRI application, a continuous training approach for real-time anomaly detection was developed and evaluated in an HRI-experiment with a collaborative robot, ToF camera, and proximity sensors. In the user study with 10 subjects irregular interactions and misplaced objects were the most common anomalies, which system was able to detect reliably.

DOI: 10.1007/978-3-030-60337-3_29
Zugehörige Institution(en) am KIT Institut für Prozessrechentechnik, Automation und Robotik (IPR)
Institut für Anthropomatik und Robotik (IAR)
Publikationstyp Proceedingsbeitrag
Publikationsjahr 2020
Sprache Englisch
Identifikator ISBN: 978-3-030-60336-6
ISSN: 0302-9743, 1611-3349
KITopen-ID: 1000126105
Erschienen in Interactive Collaborative Robotics – 5th International Conference, ICR 2020, St Petersburg, Russia, October 7-9, 2020, Proceedings. Ed.: A. Ronzhin
Auflage 1st ed.
Verlag Springer International Publishing, Cham
Seiten 295–307
Serie Lecture Notes in Artificial Intelligence ; 12336
Vorab online veröffentlicht am 30.09.2020
Schlagwörter human-robot interaction, anomaly detection, machine learning
Nachgewiesen in Scopus
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page