KIT | KIT-Bibliothek | Impressum | Datenschutz

GPrioSwap : Towards a Swapping Policy for GPUs

Kehne, Jens 1; Metter, Jonathan 1; Merkel, Martin 1; Hillenbrand, Marius 1; Gottschlag, Mathias ORCID iD icon 1; Bellosa, Frank 1
1 Karlsruher Institut für Technologie (KIT)

Abstract (englisch):

Over the last few years, Graphics Processing Units (GPUs) have become popular in computing, and have found their way into a number of cloud platforms. However, integrating a GPU into a cloud environment requires the cloud provider to efficiently virtualize the GPU. While several research projects have addressed this challenge in the past, few of these projects attempt to properly enable sharing of GPU memory between multiple clients: To date, GPUswap is the only project that enables sharing of GPU memory without inducing unnecessary application overhead, while maintaining both fairness and high utilization of GPU memory. However, GPUswap includes only a rudimentary swapping policy, and therefore induces a rather large application overhead.

In this paper, we work towards a practicable swapping policy for GPUs. To that end, we analyze the behavior of various GPU applications to determine their memory access patterns. Based on our insights about these patterns, we derive a swapping policy that includes a developer-assigned priority for each GPU buffer in its swapping decisions. Experiments with our prototype implementation show that a swapping policy based on buffer priorities can significantly reduce the swapping overhead.


Volltext §
DOI: 10.5445/IR/1000070014
Originalveröffentlichung
DOI: 10.1145/3078468.3078474
Scopus
Zitationen: 3
Dimensions
Zitationen: 3
Cover der Publikation
Zugehörige Institution(en) am KIT Institut für Technische Informatik (ITEC)
Publikationstyp Proceedingsbeitrag
Publikationsjahr 2017
Sprache Englisch
Identifikator ISBN: 978-1-4503-5035-8
urn:nbn:de:swb:90-700149
KITopen-ID: 1000070014
Erschienen in SYSTOR'17 : Proceedings of the 10th ACM International Systems and Storage Conference, Haifa, IL, 22 - 24 May 2017. Ed.: D. Chen
Verlag Association for Computing Machinery (ACM)
Seiten 1-10
Schlagwörter Virtualization; Memory Overcommitment; Oversubscription; Swapping; Profiling; GPU
Nachgewiesen in Scopus
Dimensions
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page