KIT | KIT-Bibliothek | Impressum | Datenschutz

Toward Mass Video Data Analysis: Interactive and Immersive 4D Scene Reconstruction

Kraus, Matthias; Pollok, Thomas; Miller, Matthias; Kilian, Timon; Moritz, Tobias; Schweitzer, Daniel; Beyerer, Jürgen; Keim, Daniel; Qu, Chengchao; Jentner, Wolfgang

The technical progress in the last decades makes photo and video recording devices omnipresent. This change has a significant impact, among others, on police work. It is no longer unusual that a myriad of digital data accumulates after a criminal act, which must be reviewed by criminal investigators to collect evidence or solve the crime. This paper presents the VICTORIA Interactive 4D Scene Reconstruction and Analysis Framework (“ISRA-4D” 1.0), an approach for the visual consolidation of heterogeneous video and image data in a 3D reconstruction of the corresponding environment. First, by reconstructing the environment in which the materials were created, a shared spatial context of all available materials is established. Second, all footage is spatially and temporally registered within this 3D reconstruction. Third, a visualization of the hereby created 4D reconstruction (3D scene + time) is provided, which can be analyzed interactively. Additional information on video and image content is also extracted and displayed and can be analyzed with supporting visualizations. The presented approach facilitates the process of filtering, annotating, analyzing, and getting an overview of large amounts of multimedia material. ... mehr

Open Access Logo

Verlagsausgabe §
DOI: 10.5445/IR/1000126921
Veröffentlicht am 29.11.2020
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Anthropomatik und Robotik (IAR)
Publikationstyp Zeitschriftenaufsatz
Publikationsjahr 2020
Sprache Englisch
Identifikator ISSN: 1424-8220
KITopen-ID: 1000126921
Erschienen in Sensors
Band 20
Heft 18
Seiten Art. Nr.: 5426
Vorab online veröffentlicht am 22.09.2020
Schlagwörter 4D reconstruction, visual exploration; computer vision, machine learning, forensics, virtual reality, surveillance systems
Nachgewiesen in Scopus
Web of Science
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page