A Multi-Task Approach to Robust Deep Reinforcement Learning for Resource Allocation

Conference: WSA & SCC 2023 - 26th International ITG Workshop on Smart Antennas and 13th Conference on Systems, Communications, and Coding
02/27/2023 at Braunschweig, Germany

Proceedings: ITG-Fb. 308: WSA & SCC 2023

Pages: 6Language: englishTyp: PDF

Authors:
Gracla, Steffen; Bockelmann, Carsten; Dekorsy, Armin (Dept. of Communications Engineering, University of Bremen, Germany)

Abstract:
With increasing complexity of modern communication systems, Machine Learning (ML) algorithms have become a focal point of research. However, performance demands have tightened in parallel to complexity. For some of the key applications targeted by future wireless, such as the medical field, strict and reliable performance guarantees are essential, but vanilla ML methods have been shown to struggle with these types of requirements. Therefore, the question is raised whether these methods can be extended to better deal with the demands imposed by such applications. In this paper, we look at a combinatorial Resource Allocation (RA) challenge with rare, significant events which must be handled properly. We propose to treat this as a multi-task learning problem, select two methods from this domain, Elastic Weight Consolidation (EWC) and Gradient Episodic Memory (GEM), and integrate them into a vanilla actor-critic scheduler. We compare their performance in dealing with Black Swan Events with the state-of-the-art of augmenting the training data distribution and report that the multi-task approach proves highly effective.