KIT | KIT-Bibliothek | Impressum

LoGA: Low-Overhead GPU Accounting Using Events

Kehne, Jens; Spassov, Stanislav; Hillenbrand, Marius; Rittinghaus, Marc; Bellosa, Frank

Abstract (englisch):
Over the last few years, GPUs have become common in computing. However, current GPUs are not designed for a shared environment like a cloud, creating a number of challenges whenever a GPU must be multiplexed between multiple users. In particular, the round-robin scheduling used by today's GPUs does not distribute the available GPU computation time fairly among applications. Most of the previous work addressing this problem resorted to scheduling all GPU computation in software, which induces high overhead. While there is a GPU scheduler called NEON which reduces the scheduling overhead compared to previous work, NEON's accounting mechanism frequently disables GPU access for all but one application, resulting in considerable overhead if that application does not saturate the GPU by itself.

In this paper, we present LoGA, a novel accounting mechanism for GPU computation time. LoGA monitors the GPU's state to detect GPU-internal context switches, and infers the amount of GPU computation time consumed by each process from the time between these context switches. This method allows LoGA to measure GPU computation time consumed by appl ... mehr

Zugehörige Institution(en) am KIT Institut für Technische Informatik (ITEC)
Publikationstyp Proceedingsbeitrag
Jahr 2017
Sprache Englisch
Identifikator DOI: 10.1145/3078468.3078473
ISBN: 978-1-4503-5035-8
URN: urn:nbn:de:swb:90-700137
KITopen ID: 1000070013
Erschienen in SYSTOR'17. Proceedings of the 10th ACM International Systems and Storage Conference, Haifa, IL, May 22 - 24, 2017
Verlag ACM
Schlagworte Accounting, event-based, scheduling, GPU
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft KITopen Landing Page