KIT | KIT-Bibliothek | Impressum | Datenschutz

HEP Analyses on Dynamically Allocated Opportunistic Computing Resources

Schnepf, M. J. 1; Cube, R. F. von 1; Heidecker, C. 1; Fischer, M. ORCID iD icon 1; Giffels, M. ORCID iD icon 1; Kuehn, E. ORCID iD icon 1; Heiss, A. 1; Petzold, A. ORCID iD icon 1; Quast, G. ORCID iD icon 1; Sauter, M. 1
1 Karlsruher Institut für Technologie (KIT)

Abstract:

The current experiments in high energy physics (HEP) have a huge data rate. To convert the measured data, an enormous number of computing resources is needed and will further increase with upgraded and newer experiments. To fulfill the ever-growing demand the allocation of additional, potentially only temporary available non-HEP dedicated resources is important. These so-called opportunistic resources cannot only be used for analyses in general but are also well-suited to cover the typical unpredictable peak demands for computing resources. For both use cases, the temporary availability of the opportunistic resources requires a dynamic allocation, integration, and management, while their heterogeneity requires optimization to maintain high resource utilization by allocating best matching resources. To find the best matching resources which should be allocated is challenging due to the unpredictable submission behavior as well as an ever-changing mixture of workflows with different requirements.
Instead of predicting the best matching resource, we base our decisions on the utilization of resources. For this reason, we are developing the resource manager TARDIS (Transparent Adaptive Resource Dynamic Integration System) which manages and dynamically requests or releases resources. ... mehr


Verlagsausgabe §
DOI: 10.5445/IR/1000123016
Veröffentlicht am 13.09.2020
Originalveröffentlichung
DOI: 10.1088/1742-6596/1525/1/012067
Dimensions
Zitationen: 1
Cover der Publikation
Zugehörige Institution(en) am KIT House of Competence (HoC)
Institut für Experimentelle Teilchenphysik (ETP)
Scientific Computing Center (SCC)
Universität Karlsruhe (TH) – Zentrale Einrichtungen (Zentrale Einrichtungen)
Publikationstyp Zeitschriftenaufsatz
Publikationsjahr 2020
Sprache Englisch
Identifikator ISSN: 1742-6588, 1742-6596
KITopen-ID: 1000123016
Erschienen in Journal of physics / Conference series
Verlag Institute of Physics Publishing Ltd (IOP Publishing Ltd)
Band 1525
Heft 1
Seiten Art. Nr.: 012067
Bemerkung zur Veröffentlichung 19th International Workshop on Advanced Computing and Analysis Techniques in Physics Research, ACAT 2019; Steinmatte Conference CentreSaas-Fee; Switzerland; 11 March 2019 through 15 March 2019
Nachgewiesen in Dimensions
Scopus
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page