KIT | KIT-Bibliothek | Impressum | Datenschutz

Efficient Training of Boltzmann Generators Using Off-Policy Log-Dispersion Regularization

Schopmans, Henrik; von Klitzing, Christopher; Friederich, Pascal ORCID iD icon 1
1 Institut für Theoretische Informatik (ITI), Karlsruher Institut für Technologie (KIT)

Abstract:

Sampling from unnormalized probability densities is a central challenge in computational science. Boltzmann generators are generative models that enable independent sampling from the Boltzmann distribution of physical systems at a given temperature. However, their practical success depends on data-efficient training, as both simulation data and target energy evaluations are costly. To this end, we propose off-policy log-dispersion regularization (LDR), a novel regularization framework that builds on a generalization of the log-variance objective. We apply LDR in the off-policy setting in combination with standard data-based training objectives, without requiring additional on-policy samples. LDR acts as a shape regularizer of the energy landscape by leveraging additional information in the form of target energy labels. The proposed regularization framework is broadly applicable, supporting unbiased or biased simulation datasets as well as purely variational training without access to target samples. Across all benchmarks, LDR improves both final performance and data efficiency, with sample efficiency gains of up to one order of magnitude.


Volltext §
DOI: 10.5445/IR/1000193400
Veröffentlicht am 19.05.2026
Originalveröffentlichung
DOI: 10.48550/arXiv.2602.03729
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Theoretische Informatik (ITI)
Publikationstyp Forschungsbericht/Preprint
Publikationsjahr 2026
Sprache Englisch
Identifikator KITopen-ID: 1000193400
HGF-Programm 43.31.01 (POF IV, LK 01) Multifunctionality Molecular Design & Material Architecture
Verlag arxiv
Umfang 28 S.
Vorab online veröffentlicht am 03.02.2026
Schlagwörter Machine Learning (cs.LG)
Nachgewiesen in OpenAlex
arXiv
KIT – Die Universität in der Helmholtz-Gemeinschaft
KITopen Landing Page