KIT | KIT-Bibliothek | Impressum | Datenschutz

High performance data analysis via coordinated caches

Fischer, M. ORCID iD icon 1; Metzlaff, C. 1; Kühn, E. ORCID iD icon 1; Giffels, M. ORCID iD icon 1; Quast, G. ORCID iD icon 1; Jung, C. 1; Hauth, T. 1
1 Karlsruher Institut für Technologie (KIT)


With the second run period of the LHC, high energy physics collaborations will have to face increasing computing infrastructural needs. Opportunistic resources are expected to absorb many computationally expensive tasks, such as Monte Carlo event simulation. This leaves dedicated HEP infrastructure with an increased load of analysis tasks that in turn will need to process an increased volume of data. In addition to storage capacities, a key factor for future computing infrastructure is therefore input bandwidth available per core. Modern data analysis infrastructure relies on one of two paradigms: data is kept on dedicated storage and accessed via network or distributed over all compute nodes and accessed locally. Dedicated storage allows data volume to grow independently of processing capacities, whereas local access allows processing capacities to scale linearly. However, with the growing data volume and processing requirements, HEP will require both of these features. For enabling adequate user analyses in the future, the KIT CMS group is merging both paradigms: popular data is spread over a local disk layer on compute nodes, while any data is available from an arbitrarily sized background storage. ... mehr

Volltext §
DOI: 10.5445/IR/110104362
DOI: 10.1088/1742-6596/664/9/092008
Zitationen: 3
Zitationen: 2
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Kernphysik (IKP)
Scientific Computing Center (SCC)
Universität Karlsruhe (TH) – Zentrale Einrichtungen (Zentrale Einrichtungen)
Publikationstyp Zeitschriftenaufsatz
Publikationsjahr 2015
Sprache Englisch
Identifikator ISSN: 1742-6588, 1742-6596
KITopen-ID: 110104362
HGF-Programm 51.01.01 (POF III, LK 01) Teilchenphysik
Erschienen in Journal of physics / Conference Series
Verlag Institute of Physics Publishing Ltd (IOP Publishing Ltd)
Band 664
Heft 9
Seiten 092008/1-8
Nachgewiesen in Scopus
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page