KIT | KIT-Bibliothek | Impressum | Datenschutz

Regression via causally informed neural networks

Youssef, Shahenda ORCID iD icon 1; Doehner, Frank ORCID iD icon 1; Beyerer, Jürgen
1 Institut für Anthropomatik und Robotik (IAR), Karlsruher Institut für Technologie (KIT)

Abstract:

Neural Networks have been successful in solving complex problems across various fields. However, they require significant data to learn effectively, and their decision-making process is often not transparent. To overcome these limitations, causal prior knowledge can be incorporated into neural network models. This knowledge improves the learning process and enhances the robustness and generalizability of the models. We propose a novel framework RCINN that involves calculating the inverse probability of treatment weights given a causal graph model alongside the training dataset. These weights are then concatenated as additional features in the neural network model. Then incorporating the estimated conditional average treatment effect as a regularization term to the model loss function, the potential influence of confounding variables can be mitigated, leading to bias minimization and improving the neural network model. Experiments conducted on synthetic and benchmark datasets using the framework show promising results.


Verlagsausgabe §
DOI: 10.5445/IR/1000177519
Veröffentlicht am 18.12.2024
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Anthropomatik und Robotik (IAR)
Publikationstyp Proceedingsbeitrag
Publikationsjahr 2024
Sprache Englisch
Identifikator KITopen-ID: 1000177519
Erschienen in ML4CPS - Machine learning for cyber physical systems, Berlin, 21st - 22nd March 2024
Veranstaltung Machine Learning for Cyber-Physical Systems (ML4CPS 2024), Berlin, Deutschland, 21.03.2024 – 22.03.2024
Verlag UB HSU
Schlagwörter Neural network, Causal graph, Prior knowledge, Causal inference, Propensity score weighting, Regression
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page