KIT | KIT-Bibliothek | Impressum | Datenschutz

Design and Implementation of the first Generic Archive Storage Service for Research Data in Germany

Bach, Felix; Schembera, Björn; Van Wezel, Jos

Research data as the true valuable good in science must be saved and subsequently kept findable, accessible and reusable for reasons of proper scientific conduct for a time span of several years. However, managing long-term storage of research data is a burden for institutes and researchers. Because of the sheer size and the required retention time apt storage providers are hard to find.

Aiming to solve this puzzle, the bwDataArchive project started development of a long-term research data archive that is reliable, cost effective and able store multiple petabytes of data. The hardware consists of data storage on magnetic tape, interfaced with disk caches and nodes for data movement and access. On the software side, the High Performance Storage System (HPSS) was chosen for its proven ability to reliably store huge amounts of data. However, the implementation of bwDataArchive is not dependant on HPSS. For authentication the bwDataArchive is integrated into the federated identity management for educational institutions in the State of Baden-Württemberg in Germany.

The archive features data protection by means of a dual copy at two distinct locations on different tape technologies, data accessibility by common storage protocols, data retention assurance for more than ten years, data preservation with checksums, and data management capabilities supported by a flexible directory structure allowing sharing and publication. ... mehr

Open Access Logo

DOI: 10.2218/ijdc.v15i1.553
Zugehörige Institution(en) am KIT Steinbuch Centre for Computing (SCC)
Publikationstyp Zeitschriftenaufsatz
Publikationsdatum 22.07.2020
Sprache Englisch
Identifikator ISSN: 1746-8256
KITopen-ID: 1000128633
HGF-Programm 46 (POF III, LK 01) SBD
Erschienen in International Journal of Digital Curation
Verlag Digital Curation Centre
Band 15
Heft 1
Nachgewiesen in Dimensions
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page