KIT | KIT-Bibliothek | Impressum | Datenschutz

HEP Analyses on Dynamically Allocated Opportunistic Computing Resources

Schnepf, M. J.; Von Cube, R. F.; Heidecker, C.; Fischer, M.; Giffels, M.; Kuehn, E.; Heiss, A.; Petzold, A.; Quast, G.; Sauter, M.

Abstract:
The current experiments in high energy physics (HEP) have a huge data rate. To convert the measured data, an enormous number of computing resources is needed and will further increase with upgraded and newer experiments. To fulfill the ever-growing demand the allocation of additional, potentially only temporary available non-HEP dedicated resources is important. These so-called opportunistic resources cannot only be used for analyses in general but are also well-suited to cover the typical unpredictable peak demands for computing resources. For both use cases, the temporary availability of the opportunistic resources requires a dynamic allocation, integration, and management, while their heterogeneity requires optimization to maintain high resource utilization by allocating best matching resources. To find the best matching resources which should be allocated is challenging due to the unpredictable submission behavior as well as an ever-changing mixture of workflows with different requirements.
Instead of predicting the best matching resource, we base our decisions on the utilization of resources. For this reason, we are developing the resource manager TARDIS (Transparent Adaptive Resource Dynamic Integration System) which manages and dynamically requests or releases resources. ... mehr

Open Access Logo


Verlagsausgabe §
DOI: 10.5445/IR/1000123016
Veröffentlicht am 13.09.2020
Originalveröffentlichung
DOI: 10.1088/1742-6596/1525/1/012067
Dimensions
Zitationen: 1
Cover der Publikation
Zugehörige Institution(en) am KIT House of Competence (HoC)
Institut für Experimentelle Teilchenphysik (ETP)
Institut für Theoretische Teilchenphysik (TTP)
Steinbuch Centre for Computing (SCC)
Publikationstyp Zeitschriftenaufsatz
Publikationsjahr 2020
Sprache Englisch
Identifikator ISSN: 1742-6588, 1742-6596
KITopen-ID: 1000123016
Erschienen in Journal of physics / Conference series
Band 1525
Heft 1
Seiten Art. Nr.: 012067
Bemerkung zur Veröffentlichung 19th International Workshop on Advanced Computing and Analysis Techniques in Physics Research, ACAT 2019; Steinmatte Conference CentreSaas-Fee; Switzerland; 11 March 2019 through 15 March 2019
Nachgewiesen in Dimensions
Scopus
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page