KIT | KIT-Bibliothek | Impressum | Datenschutz

Performance of Cluster File System Backed by an HDD-Based Data Storage System Under True Concurrent Read-Write Load

Falke, Uwe 1
1 Scientific Computing Center (SCC), Karlsruher Institut für Technologie (KIT)

Abstract:

Despite of the growing number of flash-based data storage systems the usage of spinning disks (HDDs) for large on-line data storage systems is still advantageous. Measurements of the read-write behaviour of a cluster file system using external storage controllers backed by HDDs are presented. Contrary to commonly expected balanced read and write rates, resp., or even read rates slightly outbalancing write rates by far prevailing write rates were seen. Starting point was the test procedure required in a Call for Tenders which turned out to be totally inadequate to characterize the system behaviour. A more thorough approach showed that in true parallel read-write traffic attempting to maximise both data streams the read rate is about one order smaller than the write rate. Possible Explanations are considered and some discussion of the results is given.

Zugehörige Institution(en) am KIT Scientific Computing Center (SCC)
Publikationstyp Vortrag
Publikationsdatum 16.04.2024
Sprache Englisch
Identifikator KITopen-ID: 1000178482
Veranstaltung HEPiX Spring Workshop (2024), Paris, Frankreich, 15.04.2024 – 19.04.2024
Schlagwörter Data Storage, Data Rate, Storage Benchmarking, Read-Write Performance

Seitenaufrufe: 19
seit 29.01.2025
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page