KIT | KIT-Bibliothek | Impressum

GPrioSwap : Towards a Swapping Policy for GPUs

Kehne, Jens; Metter, Jonathan; Merkel, Martin; Hillenbrand, Marius; Gottschlag, Mathias; Bellosa, Frank

Abstract (englisch):
Over the last few years, Graphics Processing Units (GPUs) have become popular in computing, and have found their way into a number of cloud platforms. However, integrating a GPU into a cloud environment requires the cloud provider to efficiently virtualize the GPU. While several research projects have addressed this challenge in the past, few of these projects attempt to properly enable sharing of GPU memory between multiple clients: To date, GPUswap is the only project that enables sharing of GPU memory without inducing unnecessary application overhead, while maintaining both fairness and high utilization of GPU memory. However, GPUswap includes only a rudimentary swapping policy, and therefore induces a rather large application overhead.

In this paper, we work towards a practicable swapping policy for GPUs. To that end, we analyze the behavior of various GPU applications to determine their memory access patterns. Based on our insights about these patterns, we derive a swapping policy that includes a developer-assigned priority for each GPU buffer in its swapping decisions. Experiments with our prototype implementation show that ... mehr


Zugehörige Institution(en) am KIT Institut für Technische Informatik (ITEC)
Publikationstyp Proceedingsbeitrag
Jahr 2017
Sprache Englisch
Identifikator DOI: 10.1145/3078468.3078474
ISBN: 978-1-4503-5035-8
URN: urn:nbn:de:swb:90-700149
KITopen ID: 1000070014
Erschienen in SYSTOR'17 : Proceedings of the 10th ACM International Systems and Storage Conference, Haifa, IL, 22 - 24 May 2017. Ed.: D. Chen
Verlag ACM, New York
Seiten Art. Nr. 10
Schlagworte Virtualization; Memory Overcommitment; Oversubscription; Swapping; Profiling; GPU
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft KITopen Landing Page