KIT | KIT-Bibliothek | Impressum | Datenschutz

LSDMA-Driven Advances in Data Analysis

Jejkal, Thomas ORCID iD icon; Schuller, Bernd; Grunzke, Richard

Abstract (englisch):

Besides data management, the analysis of research data is another important aspect covered by LSDMA. The overarching goal of all data efforts must be to start managing the scientist’s data right after the data left the data acquisition device as this is the only way to capture gapless provenance information. This is inevitable for transparent and reproducible science. However, this means also that the research data is at the very beginning of its lifecycle. In order to obtain publishable results the data often has to go through several processing steps until the final results are available. Such processing steps can reach from basic scripts to complex scientific workflows consisting of several dependent processing steps. In order to achieve the aforementioned reproducibility capturing the data provenance, e.g. what happened with the data and led to which results, should be an essential part of every processing step. This article describes the efforts taken by the LSDMA project in order to provide scientists with data analysis capabilities integrated seamlessly into data management workflows. For this, two approaches were chosen: The integration of data processing into an existing data repository system and the extension of an existing computing middleware by automated processing of data stored next to the computing environment. ... mehr

Volltext §
DOI: 10.5445/KSP/1000071931
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Prozessdatenverarbeitung und Elektronik (IPE)
Publikationstyp Buchaufsatz
Publikationsjahr 2017
Sprache Englisch
Identifikator ISBN: 978-3-7315-0695-9
KITopen-ID: 1000074133
HGF-Programm 46.12.01 (POF III, LK 01) Data Life Cycle Labs
Erschienen in Helmholtz Portfolio Theme Large-Scale Data Management and Analysis (LSDMA). Ed.: C. Jung
Verlag KIT Scientific Publishing
Seiten 179-197
Relationen in KITopen
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page