KIT | KIT-Bibliothek | Impressum | Datenschutz

Comparison of lossless compression schemes for high rate electrical grid time series for smart grid monitoring and analysis

Jumar, Richard ORCID iD icon 1; Maaß, Heiko ORCID iD icon 1; Hagenmeyer, Veit 1
1 Karlsruher Institut für Technologie (KIT)


The smart power grid of the future will utilize waveform level monitoring with sampling rates in the kilohertz range for detailed grid status assessment. To this end, we address the challenge of handling large raw data amount with its quasi-periodical characteristic via lossless compression. We compare different freely available algorithms and implementations with regard to compression ratio, computation time and working principle to find the most suitable compression strategy for this type of data. Algorithms from the audio domain (ALAC, ALS, APE, FLAC & TrueAudio) and general archiving schemes (LZMA, Delfate, PPMd, BZip2 & Gzip) are tested against each other. We assemble a dataset from openly available sources (UK-DALE, MIT-REDD, EDR) and establish dataset independent comparison criteria. This combination is a first detailed open benchmark to support the development of tailored lossless compression schemes and a decision support for researchers facing data intensive smart grid measurements

Verlagsausgabe §
DOI: 10.5445/IR/1000085655
Veröffentlicht am 03.09.2018
DOI: 10.1016/j.compeleceng.2018.07.008
Zitationen: 26
Zitationen: 24
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Automation und angewandte Informatik (IAI)
Publikationstyp Zeitschriftenaufsatz
Publikationsmonat/-jahr 10.2018
Sprache Englisch
Identifikator ISSN: 0045-7906
KITopen-ID: 1000085655
HGF-Programm 37.06.01 (POF III, LK 01) Networks and Storage Integration
Erschienen in Computers & electrical engineering
Verlag Elsevier
Band 71
Seiten 465–476
Nachgewiesen in Web of Science
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page