Loading [MathJax]/extensions/MathMenu.js
Efficient Task Offloading in Multi-access Edge Computing Servers using Asynchronous Meta Reinforcement Learning in 5G | IEEE Conference Publication | IEEE Xplore

Efficient Task Offloading in Multi-access Edge Computing Servers using Asynchronous Meta Reinforcement Learning in 5G


Abstract:

The deployment of 5G networks has ushered in a new era for technologies that demand Ultra Reliable Low Latency (URLL) networks. However, the User Equipment (UE) responsib...Show More

Abstract:

The deployment of 5G networks has ushered in a new era for technologies that demand Ultra Reliable Low Latency (URLL) networks. However, the User Equipment (UE) responsible for handling such applications may not always have the computational capacity to meet the demanding requirements of URLL implementations. In such scenarios, certain tasks can be offloaded to a high-performance computing network known as Multi-access Edge Computing (MEC), located near the UE at a base station. Nonetheless, MEC servers themselves have computational limitations, and they can’t handle all the tasks from all the UEs efficiently. To address this challenge, we propose an efficient task offloading approach based on asynchronous Meta Reinforcement Learning (MRL). Our method involves developing an algorithm that prioritizes and organizes UE tasks based on their importance and interdependencies, and a Deep asynchronous MRL algorithm models the task offloading policy. What sets our model apart is its ability to adapt quickly to a variety of environments, whether they are heterogeneous or homogeneous. Our simulation results show that our solution has a 60% overall performance improvement in terms of training latency, energy consumption, and memory and CPU time usage compared to a benchmark.
Date of Conference: 26-29 June 2024
Date Added to IEEE Xplore: 31 October 2024
ISBN Information:

ISSN Information:

Conference Location: Paris, France
References is not available for this document.

I. Introduction

The fifth-generation (5G) standard for broadband cellular networks is designed to provide users with an Ultra Reliable Low Latency (URLL) network with speeds 10 to 100 times that of its predecessor 4G [1]. This has paved the way for deploying applications such as Tactile Internet (TI) that transfers haptic (touch) and kinesthetic (muscular movement) data.

Select All
1.
M. Z. Noohani and K. U. Magsi, "A review of 5g technology: Architecture security and wide applications", International Research Journal of Engineering and Technology (IRJET), vol. 07, pp. 3440-3471, 05 2020.
2.
O. Holland, E. Steinbach, V. Prasad, Q. Liu, Z. Dawy, A. Aijaz, et al., "The ieee 1918.1 ”tactile internet standards working group and its standards", Proceedings of the IEEE, vol. PP, pp. 1-24, 01 2019.
3.
A. Islam, A. Debnath, M. Ghose and S. Chakraborty, "A survey on task offloading in multi-access edge computing", Journal of Systems Architecture, vol. 118, pp. 102225, 2021, [online] Available: https://www.sciencedirect.com/science/article/pii/S1383762121001570.
4.
J. Wang, J. Hu, G. Min, A. Y. Zomaya and N. Georgalas, "Fast adaptive task offloading in edge computing based on meta reinforcement learning", IEEE Transactions on Parallel and Distributed Systems, vol. 32, no. 1, pp. 242-253, 2021.
5.
A. Shakarami, M. Ghobaei-Arani and A. Shahidinejad, "A survey on the computation offloading approaches in mobile edge computing: A machine learning-based perspective", Computer Networks, vol. 182, pp. 107496, 2020, [online] Available: https://www.sciencedirect.com/science/article/pii/S1389128620311634.
6.
S. Wang, M. Chen, X. Liu, C. Yin, S. Cui and H. Vincent Poor, "A machine learning approach for task and resource allocation in mobileedge computing-based networks", IEEE Internet of Things Journal, vol. 8, no. 3, pp. 1358-1372, Feb. 2021.
7.
T. T. Anh, N. C. Luong, D. Niyato, D. I. Kim and L.-C. Wang, "Efficient training management for mobile crowd-machine learning: A deep reinforcement learning approach", IEEE Wireless Communications Letters, vol. 8, no. 5, pp. 1345-1348, 2019.
8.
Z. Zhang, F. R. Yu, F. Fu, Q. Yan and Z. Wang, "Joint offloading and resource allocation in mobile edge computing systems: An actorcritic approach", 2018 IEEE Global Communications Conference (GLOBECOM), pp. 1-6, 2018.
9.
X. Wang, C. Wang, X. Li, V. C. M. Leung and T. Taleb, "Federated deep reinforcement learning for internet of things with decentralized cooperative edge caching", IEEE Internet of Things Journal, vol. 7, no. 10, pp. 9441-9455, 2020.
10.
Z. Lv, D. Chen, R. Lou and Q. Wang, "Intelligent edge computing based on machine learning for smart city", Future Generation Computer Systems, vol. 115, pp. 90-99, 2021, [online] Available: https://www.sciencedirect.com/science/article/pii/S0167739X20306889.
11.
L. Huang, L. Zhang, S. Yang, L. P. Qian and Y. Wu, "Meta-learning based dynamic computation task offloading for mobile edge computing networks", IEEE Communications Letters, vol. 25, no. 5, pp. 1568-1572, 2021.
12.
G. Qu, H. Wu, R. Li and P. Jiao, "Dmro: A deep meta reinforcement learning-based task offloading framework for edge-cloud computing", IEEE Transactions on Network and Service Management, vol. 18, no. 3, pp. 3448-3459, 2021.
13.
S. Agatonovic-Kustrin and R. Beresford, "Basic concepts of artificial neural network (ann) modeling and its application in pharmaceutical research", Journal of Pharmaceutical and Biomedical Analysis, vol. 22, no. 5, pp. 717-727, 2000, [online] Available: https://www.sciencedirect.com/science/article/pii/S0731708599002721.
14.
A. Gil Ferrer, "A neural network performance analysis with three different model structures", dissertation, 2021.
15.
J. Peters, "Policy gradient methods", Scholarpedia, vol. 5, no. 11, pp. 3698, 2010.
16.
Z. T. Wang and M. Ueda, "A convergent and efficient deep Q network algorithm", CoRR, vol. abs/2106.15419, 2021, [online] Available: https://arxiv.org/abs/2106.15419.
17.
V. Konda and J. Tsitsiklis, "Actor-critic algorithms", Advances in Neural Information Processing Systems, vol. 12, 1999, [online] Available: https://proceedings.neurips.cc/paper_files/paper/1999/file/6449f44a102fde848669bdd9eb6b76fa-Paper.pdf.
18.
C. Finn, P. Abbeel and S. Levine, "Model-agnostic meta-learning for fast adaptation of deep networks", 2017.
19.
M.-C. S. F, "Tactile braille letters dataset", May 2022, [online] Available: https://doi.org/10.5281/zenodo.6556273.
20.
V. Bochkarev, A. Shevlyakova and V. Solovyev, "Average word length dynamics as indicator of cultural changes in society", Social Evolution and History, vol. 14, pp. 153-175, 08 2012.
21.
E. Lewis, The History of the English Paragraph, 1894, [online] Available: https://books.google.com.et/books?id=HP00AQAAMAAJ.
22.
The 5G guide: A reference for oprators., GSMA Intelligence, 2019.
Contact IEEE to Subscribe

References

References is not available for this document.