KIT | KIT-Bibliothek | Impressum | Datenschutz

FOGMACHINE - Leveraging Discrete-Event Simulation and Scene Graphs for Modeling Hierarchical, Interconnected Environments Under Partial Observations from Mobile Agents

Ohnemus, Lars 1; Hantke, Nils 1; Weisser, Max 1; Furmans, Kai ORCID iD icon 1
1 Institut für Fördertechnik und Logistiksysteme (IFL), Karlsruher Institut für Technologie (KIT)

Abstract:

Dynamic Scene Graphs (DSGs) provide a structured representation of hierarchical, interconnected environments, but current approaches struggle to capture stochastic dynamics, partial observability, and multi-agent activity. These aspects are critical for embodied AI, where agents must act under uncertainty and delayed perception. We introduce FOGMACHINE, an open-source framework that fuses DSGs with discrete-event simulation to model object dynamics, agent observations, and interactions at scale. This setup enables the study of uncertainty propagation, planning under limited perception, and emergent multi-agent behavior. Experiments in urban scenarios showcase realistic temporal and spatial patterns while revealing the challenges of belief estimation under sparse observations. By combining structured representations with efficient simulation, FOGMACHINE establishes an effective tool for benchmarking, model training, and advancing embodied AI in complex, uncertain environments.


Download
Originalveröffentlichung
DOI: 10.1109/ETFA68377.2026.11724864
Zugehörige Institution(en) am KIT Institut für Fördertechnik und Logistiksysteme (IFL)
Publikationstyp Proceedingsbeitrag
Publikationsmonat/-jahr 09.2026
Sprache Englisch
Identifikator ISBN: 979-8-3315-7888-6
ISSN: 1946-0740
KITopen-ID: 1000199378
Erschienen in 2026 IEEE 31st International Conference on Emerging Technologies and Factory Automation (ETFA)
Veranstaltung 31st IEEE International Conference on Emerging Technologies and Factory Automation (ETFA 2026), Västerås, Schweden, 08.09.2026 – 11.09.2026
Verlag Institute of Electrical and Electronics Engineers (IEEE)
Seiten 1–8
Externe Relationen Siehe auch
Nachgewiesen in Scopus
OpenAlex
KIT – Die Universität in der Helmholtz-Gemeinschaft
KITopen Landing Page