Skip to Main content Skip to Navigation
Conference papers

Deep Reinforcement Learning for Scheduling Uplink IoT Traffic with Strict Deadlines

Abstract : This paper considers the Multiple Access problem where N Internet of Things (IoT) devices share a common wireless medium towards a central Base Station (BS). We propose a Reinforcement Learning (RL) method where the BS is the agent and the devices are part of the environment. A device is allowed to transmit only when the BS decides to schedule it. Besides the information packets, devices send additional messages like the delay or the number of discarded packets since their last transmission. This information is used to design the RL reward function and constitutes the next observation that the agent can use to schedule the next device. Leveraging RL allows us to learn the sporadic and heterogeneous traffic patterns of the IoT devices and an optimal scheduling policy that maximizes the channel throughput. We adapt the Proximal Policy Optimization (PPO) algorithm with a Recurrent Neural Network (RNN) to handle the partial observability of our problem and exploit the temporal correlations of the users' traffic. We demonstrate the performance of our model through simulations on different number of heterogeneous devices with periodic traffic and individual latency constraints. We show that our RL algorithm outperforms traditional scheduling schemes and distributed medium access algorithms.
Document type :
Conference papers
Complete list of metadata

https://hal.telecom-paris.fr/hal-03566861
Contributor : Marceau Coupechoux Connect in order to contact the contributor
Submitted on : Friday, February 11, 2022 - 5:27:58 PM
Last modification on : Tuesday, March 8, 2022 - 7:38:11 PM
Long-term archiving on: : Thursday, May 12, 2022 - 7:16:09 PM

File

globecom21.pdf
Files produced by the author(s)

Identifiers

Citation

Marceau Coupechoux, Benoît-Marie Robaglia, Apostolos Destounis, Dimitrios Tsilimantos. Deep Reinforcement Learning for Scheduling Uplink IoT Traffic with Strict Deadlines. GLOBECOM 2021 - 2021 IEEE Global Communications Conference, Dec 2021, Madrid, France. pp.1-6, ⟨10.1109/GLOBECOM46510.2021.9685561⟩. ⟨hal-03566861⟩

Share

Metrics

Record views

27

Files downloads

18