KIT | KIT-Bibliothek | Impressum | Datenschutz
Open Access Logo
§
Volltext
DOI: 10.5445/IR/1000091969
Veröffentlicht am 11.03.2019

Minimizing Bias in Estimation of Mutual Information from Data Streams

Arzamasov, Vadim; Böhm, Klemens; Rutter, Ignaz

Abstract:
Mutual information is a measure for both linear and non-linear associations between variables. There exist several estimators of mutual information for static data. In the dynamic case, one needs to apply these estimators to samples of points from data streams. The sampling should be such that more detailed information on the recent past is available. We formulate a list of natural requirements an estimator of mutual information on data streams should fulfill, and we propose two approaches which do meet all of them. Finally, we compare our algorithms to an existing method both theoretically and experimentally. Our findings include that our approaches are faster and have lower bias and better memory complexity.


Zugehörige Institution(en) am KIT Institut für Programmstrukturen und Datenorganisation (IPD)
Publikationstyp Forschungsbericht
Jahr 2019
Sprache Englisch
Identifikator ISSN: 2190-4782
URN: urn:nbn:de:swb:90-919698
KITopen-ID: 1000091969
Verlag Karlsruhe
Umfang 16 S.
Serie Karlsruhe Reports in Informatics ; 2019,2
Schlagworte mutual information, data streams, KSG estimator, biased sampling
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft KITopen Landing Page