KIT | KIT-Bibliothek | Impressum | Datenschutz

GPrioSwap : Towards a Swapping Policy for GPUs

Kehne, Jens; Metter, Jonathan; Merkel, Martin; Hillenbrand, Marius; Gottschlag, Mathias; Bellosa, Frank

Abstract (englisch):
Over the last few years, Graphics Processing Units (GPUs) have become popular in computing, and have found their way into a number of cloud platforms. However, integrating a GPU into a cloud environment requires the cloud provider to efficiently virtualize the GPU. While several research projects have addressed this challenge in the past, few of these projects attempt to properly enable sharing of GPU memory between multiple clients: To date, GPUswap is the only project that enables sharing of GPU memory without inducing unnecessary application overhead, while maintaining both fairness and high utilization of GPU memory. However, GPUswap includes only a rudimentary swapping policy, and therefore induces a rather large application overhead.

In this paper, we work towards a practicable swapping policy for GPUs. To that end, we analyze the behavior of various GPU applications to determine their memory access patterns. Based on our insights about these patterns, we derive a swapping policy that includes a developer-assigned priority for each GPU buffer in its swapping decisions. Experiments with our prototype implementation show that ... mehr

Open Access Logo

Volltext §
DOI: 10.5445/IR/1000070014
DOI: 10.1145/3078468.3078474
Zitationen: 1
Seitenaufrufe: 4
seit 04.05.2018
Downloads: 10
seit 09.07.2017
Zugehörige Institution(en) am KIT Institut für Technische Informatik (ITEC)
Publikationstyp Proceedingsbeitrag
Jahr 2017
Sprache Englisch
Identifikator ISBN: 978-1-4503-5035-8
KITopen-ID: 1000070014
Erschienen in SYSTOR'17 : Proceedings of the 10th ACM International Systems and Storage Conference, Haifa, IL, 22 - 24 May 2017. Ed.: D. Chen
Verlag ACM, New York
Seiten Art. Nr. 10
Schlagworte Virtualization; Memory Overcommitment; Oversubscription; Swapping; Profiling; GPU
Nachgewiesen in Scopus
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page