Loading [MathJax]/extensions/MathMenu.js
Federated Meta-Learning for task offloading and resource allocation in MEC-IoT | IEEE Conference Publication | IEEE Xplore

Federated Meta-Learning for task offloading and resource allocation in MEC-IoT


Abstract:

MEC and the Internet of Things (IoT) are two areas rapidly expanding technologies that offer many opportunities to improve efficiency and application performance. However...Show More

Abstract:

MEC and the Internet of Things (IoT) are two areas rapidly expanding technologies that offer many opportunities to improve efficiency and application performance. However, the huge amount of data generated by IoT devices and the processing and latency constraints imposed by these technologies and mobile networks make processing this data a major challenge. As part of MEC architecture, a promising approach to solving this challenge is to deploy computing servers at the edge of the network, close to IoT devices. This makes it possible to reduce latency and traffic load on the core network, while offering a better user experience. However, offloading tasks from IoT devices to the MEC servers and efficiently allocating the available computing resources is a complex problem. IoT tasks can have latency, bandwidth, and speed requirements, resources, and available computational resources may be limited or shared between multiple users. To solve this problem, we propose an approach based on federated meta-learning. In our approach, each device IoT collects information about the tasks to be performed and the local resources available, then securely shares them with a local MEC server. The local server uses these information to train a meta-learning model that can predict the best task offload and resource allocation decisions for each task. The advantage part of our approach is that it allow us to learn from the experiences of all IoT devices, resulting in more robust and accurate models. We evaluated our FedMeta2Ag algorithm using the MNIST database (Modified National Institute of Standards and Technology database). Considering 20 epochs, the accuracy during training is 91.5% against 92.0% obtained with the test data. In addition, performance continues to increase during the first 20 iterations and gradually becomes stable. Moreover, the accuracy evaluation involves the comparison of the proposed approach with existing methods. This comparison reveals that our approach predi...
Date of Conference: 15-16 November 2023
Date Added to IEEE Xplore: 25 December 2023
ISBN Information:

ISSN Information:

Conference Location: Bandung, Indonesia
References is not available for this document.

I. Introduction

The concepts of meta-learning and federated learning are not new, but recent advances in gradient-based optimization have brought them back into the spotlight as promising solutions for fast learning. The authors of [1] investigated a task offloading mechanism based on federated reinforcement learning in mobile edge computing. The algorithm this effectiveness were determined by evaluating model loss at different learning rates to determine the change in learning loss. But these algorithms require training from scratch. In order to avoid training from scratch and obtain customized models for heterogeneous data sets, meta-learning is adopted to overcome the statistical heterogeneity problem encountered with federated learning. In particular, Finn and al [2] proposed a gradient-based algorithm called Model-Agnostic Meta-Learning (MAML), which directly optimizes learning performance over model initialization. Thus, the authors of [3] proposed a Meta-Learning-based task offloading algorithm (MELO) that trains a general Deep Neural Network (DNN) for different MEC task scenarios and can quickly learn to adapt to a new task. This algorithm addresses the limitation of federated learning, but requires the transfer of all data, resulting in the disclosure of personal data.

Select All
1.
J. Li, Z. Yang, X. Wang, Y. Xia and S. Ni, "Task offloading mechanism based on federated reinforcement learning in mobile edge computing", Digital Communications and Networks, vol. 9, no. 2, 2023, [online] Available: https://doi.org/10.1016/j.dcan.2022.04.006.
2.
F. Chelsea, A. Pieter and L. Sergey, "Model-agnostic meta-learning for fast adaptation of deep networks", International conference on machine learning, pp. 1126-1135, 2017, [online] Available: https://doi.org/10.48550/arXiv.1703.03400.
3.
H. Liang, L. Luxin, Y. Shicheng, Q. Li Ping and W. Yuan, "Meta-learning based dynamic computation task offloading for mobile edge computing networks", IEEE Communications Letters, vol. 25, no. 5, pp. 1568-1572, 2020.
4.
F. Chen, Z. Dong, Z. Li and X. He, "Federated Meta-Learning for Recommendation", ArXiv, vol. abs/1802.07876, 2018, [online] Available: https://doi.org/10.48550/arXiv.1802.07876.
5.
C. Bingyang, C. Tao, Z. Xingjie, Z. Weishan, L. Qinghua, H. Zhaoxiang, et al., "Feature-context driven Federated Meta-Learning for Rare Disease Prediction", arXiv preprint arXiv:2112.14364, 2021, [online] Available: https://doi.org/10.48550/arXiv.2112.14364.
6.
Y. Sheng, R. Ju, X. Jiang, Z. Deyu, Z. Yaoxue and Z. Weihua, "Efficient federated meta-learning over multi-access wireless networks", IEEE Journal on Selected Areas in Communications, vol. 40, no. 5, pp. 1556-1570, 2022.
7.
F. Chen, L. Mi, D. Zhenhua, L. Zhenguo and X. He, "Federated meta-learning with fast convergence and efficient communication", arXiv preprint arXiv:1802.07876, 2018, [online] Available: https://doi.org/10.48550/arXiv.1802.07876.
8.
Z. Hao, J. Fei, G. Quansheng, L. Qiang, W. Shuai, D. Hefeng, et al., "Federated Meta-Learning Enhanced Acoustic Radio Cooperative Framework for Ocean of Things", IEEE Journal of Selected Topics in Signal Processing, vol. 16, no. 3, pp. 474-486, 2022.
9.
Z. Jingjing, L. Kai, M. Naram, N. Wei, T. Eduardo and G. Mohsen, "Exploring Deep Reinforcement Learning-Assisted Federated Learning for Online Resource Allocation in Privacy-Persevering EdgeIoT", EEE Internet of Things Journal, vol. 9, no. 21, 2022.
10.
W. Jin, H. Jia, M. Geyong, Z. Albert and G. Nektarios, "Fast adaptive task offloading in edge computing based on meta reinforcement learning", IEEE Transactions on Parallel and Distributed Systems, vol. 32, no. 1, pp. 242-253, 2021.
11.
K. Wang, Y. Kun and M. Chathura, "Joint energy minimization and resource allocation in C-RAN with mobile cloud", IEEE Transactions on Cloud Computing, vol. 6, no. 3, pp. 760-770, 2018.
12.
L. Yang, J. Cao, S. Tang, T. Li and Alvin T. S. Chan, "A Framework for Partitioning and Execution of Data Stream Applications in Mobile Cloud Computing", 2012 IEEE Fifth International Conference on Cloud Computing, pp. 794-802, 2012.
13.
Y. Wenjun, D. Pingping, C. Lin and T. Wensheng, "Loss-Aware Throughput Estimation Scheduler for Multi-Path TCP in Heterogeneous Wireless Networks", IEEE Transactions on Wireless Communications, vol. 20, no. 5, pp. 3336-3349, 2021.
14.
C. Xing and L. Guizhong, "Federated Deep Reinforcement Learning-Based Task Offloading and Resource Allocation for Smart Cities in a Mobile Edge Network", Sensors, vol. 22, no. 13, 2022.
15.
J. Feibo, D. Li, W. Kezhi, Y. Kun and P. Cunhua, "Distributed resource scheduling for large-scale MEC systems: A multiagent ensemble deep reinforcement learning with imitation acceleration", IEEE Internet of Things Journal, vol. 9, no. 9, pp. 6597-6610.
16.
W. Jin, H. Jia, M. Geyong, Z. Albert Y and G. Nektarios, "Fast adaptive task offloading in edge computing based on meta reinforcement learning", IEEE Transactions on Parallel and Distributed Systems, vol. 32, no. 1, pp. 242-253, 2020.
17.
Y. Chao, G. Yangshui, D. Hongwei, N. Rencan and L. Bo, "Meta Reinforcement Learning Based Computation Offloading Strategy for Vehicular Networks", IEEE Transactions on Parallel and Distributed Systems, 2022, [online] Available: https://doi.org/10.21203/rs.3.rs-1614949/v1.
18.
H. Yixue, C. Min, H. Long, H. M. Shamim and G. Ahmed, "Energy Efficient Task Caching and Offloading for Mobile Edge Computing", IEEE Access, vol. 6, pp. 11365-11373, 2018.
19.
W. Kehao, H. Zhixin, A. Qingsong, Z. Yi, Y. Jihong, Z. Pan, et al., "Joint offloading and charge cost minimization in mobile edge computing", IEEE Open Journal of the Communications Society, vol. 1, pp. 205-216, 2020.
20.
Y. Pengfei, C. Xin, C. Ying and L. Zhuo, "Deep reinforcement learning based offloading scheme for mobile edge computing", 2019 IEEE International Conference on Smart Internet of Things (SmartIoT), pp. 417-421, 2019.
21.
W. Jyrki, D. James S, F. Peter C, S. Ralph E, Z. Stanley and D. Kalyanmoy, "Multiple criteria decision making multiattribute utility theory: Recent accomplishments and what lies ahead", Management science, vol. 54, no. 7, 2008, [online] Available: https://doi.org/10.1287/mnsc.1070.0838.
22.
P. Quoc-Viet, L. Tuan, T. Nguyen H, P. Bang Ju and H. Choong Seon, "Decentralized computation offloading and resource allocation for mobile-edge computing: A matching game approach", IEEE Access, vol. 6, pp. 75868-75885, 2018.
23.
Joaquin Vanschoren, "Meta-Learning: A Survey", ArXiv, vol. abs/1810.03548, 2018, [online] Available: https://doi.org/10.48550/arXiv.1810.03548.
24.
D. Yueyue, X. Du, M. Sabita and Z. Yan, "Joint Load Balancing and Offloading in Vehicular Edge Computing and Networks", IEEE Internet of Things Journal, vol. 6, no. 3, pp. 4377-4387, 2019.
25.
R. Yijing, S. Yaohua and P. Mugen, "Deep Reinforcement Learning Based Computation Offloading in Fog Enabled Industrial Internet of Things", IEEE Transactions on Industrial Informatics, vol. 17, no. 7, pp. 4978-4987, 2021.
26.
Z. Hangjia, X. Zhijun, Z. Roozbeh, W. Tao and C. Kewei, "Adaptive Client Selection in Resource Constrained Federated Learning Systems: A Deep Reinforcement Learning Approach", IEEE Access, vol. 9, pp. 98423-98432, 2021.
27.
T. Li, M. Sanjabi, A. Beirami and V. Smith, "Fair Resource Allocation in Federated Learning", arXiv, vol. 9, pp. 1905-10497, 2020.
28.
B. Arash, M. Setareh, T. Daniele and H. Ekram, "Computation Offloading in Heterogeneous Vehicular Edge Networks: On-Line and Off-Policy Bandit Solutions", IEEE Transactions on Mobile Computing, vol. 21, no. 12, pp. 4233-4248, 2022.

Contact IEEE to Subscribe

References

References is not available for this document.