KIT | KIT-Bibliothek | Impressum | Datenschutz

Deep Reinforcement Learning for Wireless Resource Allocation Using Buffer State Information

Bansbach, Eike-Manuel 1; Eliachevitch, Victor 1; Schmalen, Laurent 1
1 Communications Engineering Lab (CEL), Karlsruher Institut für Technologie (KIT)


As the number of user equipments (UEs) with various data rate and latency requirements increases in wireless networks, the resource allocation problem for orthogonal frequency-division multiple access (OFDMA) becomes challenging. In particular, varying requirements lead to a non-convex optimization problem when maximizing the systems data rate while preserving fairness between UEs. In this paper, we solve the non-convex optimization problem using deep reinforcement learning (DRL). We outline, train and evaluate a DRL agent, which performs the task of media access control scheduling for a downlink OFDMA scenario. To kickstart training of our agent, we introduce mimicking learning. For improvement of scheduling performance, full buffer state information at the base station (e.g. packet age, packet size) is taken into account. Techniques like input feature compression, packet shuffling and age capping further improve the performance of the agent. We train and evaluate our agents using Nokia's wireless suite and evaluate against different benchmark agents. We show that our agents clearly outperform the benchmark agents.

DOI: 10.48550/arXiv.2108.12198
Zugehörige Institution(en) am KIT Communications Engineering Lab (CEL)
Publikationstyp Forschungsbericht/Preprint
Publikationsdatum 27.08.2021
Sprache Englisch
Identifikator KITopen-ID: 1000145310
Nachgewiesen in arXiv
Relationen in KITopen
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
KITopen Landing Page