On Meeting a Maximum Delay Constraint

The recent applications in communications are required to meet low-latency transmission with high traffic rates and reliabilities. From the latency point of view, most of the state-of-the-art techniques consider the average latency which does not directly apply to delay-sensitive scenarios. In this paper, we propose a novel approach to tackle the scheduling problem by directly addressing the max-delay constraint; this is an NP-hard problem. Our main contributions are first, proposing the Super State Monte-Carlo Tree Search (SS-MCTS) as a version of regular MCTS modified for large-scale probabilistic environments with less computational complexity, and second, addressing the scheduling problem with maximum delay constraint on flows. Our numerical results demonstrate that the proposed approach significantly improves the packet delivery rate while meeting the maximum delay constraint in large-scale scenarios compared to the state-of-the-art technologies.