Loading [MathJax]/extensions/MathMenu.js
RoboEC2: A Novel Cloud Robotic System With Dynamic Network Offloading Assisted by Amazon EC2 | IEEE Journals & Magazine | IEEE Xplore

RoboEC2: A Novel Cloud Robotic System With Dynamic Network Offloading Assisted by Amazon EC2


Abstract:

Deep neural networks (DNNs) are increasingly utilized in robotic tasks. However, resource-constrained mobile robots often do not have sufficient onboard computing resourc...Show More

Abstract:

Deep neural networks (DNNs) are increasingly utilized in robotic tasks. However, resource-constrained mobile robots often do not have sufficient onboard computing resources or power reserves to run the most accurate and state-of-the-art DNNs. Cloud robotics has the benefit of enabling robots to offload DNNs to cloud servers, which is considered a promising technology to address the issue. However, comprehensive issues exist, including flexibility, convenience, offloading policy, and especially network robustness in its implementations and deployments. Although it is essential to promote cloud robotics to be practical, a cloud robotic system that addresses these issues comprehensively has never been proposed. Accordingly, in this work, we present RoboEC2, a novel cloud robotic system with dynamic network offloading implemented assisted by Amazon EC2. To realize the goal, we present a cloud-edge cooperation framework based on ROS and Amazon Web Services (AWS) and a network offloading approach with a dynamic splitting way. RoboEC2 is capable of executing its network offloading program in any conditions, including disconnected. We model the DNN offloading problem in RoboEC2 to a specific multi-objective optimization problem and address it by proposing the Spotlight Criteria Algorithm (SCA). RoboEC2 is flexible, convenient, and robust. It is the first cloud robotic system with no constraints on time, location, or computing power. Finally, We demonstrate RoboEC2 with analyses and experiments that it performs better in comprehensive metrics compared with the state-of-the-art approach. We open-source the system at https://github.com/RoboEC2/RoboEC2. Note to Practitioners—RoboEC2 is a work that combines cloud computing and robotics. As the deep learning models are becoming larger, robots are becoming more and more difficult to run the state-of-the-art models locally. It has become one of the major problems in robotics. RoboEC2 was proposed to address this problem. It enables...
Published in: IEEE Transactions on Automation Science and Engineering ( Volume: 21, Issue: 4, October 2024)
Page(s): 4959 - 4973
Date of Publication: 06 December 2023

ISSN Information:

Funding Agency:

Author image of Boyi Liu
Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong, SAR
Boyi Liu (Member, IEEE) received the bachelor’s degree (Hons.) from Hainan University and the M.Phil. degree from the University of Chinese Academy of Science. He is currently pursuing the Ph.D. degree with the Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong. His research interests include robotics and federated learning. He received the Best Graduation Hono...Show More
Boyi Liu (Member, IEEE) received the bachelor’s degree (Hons.) from Hainan University and the M.Phil. degree from the University of Chinese Academy of Science. He is currently pursuing the Ph.D. degree with the Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong. His research interests include robotics and federated learning. He received the Best Graduation Hono...View more
Author image of Lujia Wang
Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong, SAR
Lujia Wang (Member, IEEE) received the Ph.D. degree from the Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, in 2015. From 2015 to 2016, she was a Research Fellow with the School of Electrical Electronic Engineering, Nanyang Technological University, Singapore. From 2016 to 2021, she was an Associate Professor with the Shenzhen Institute of Advanced Technology, Chinese Academy of Scie...Show More
Lujia Wang (Member, IEEE) received the Ph.D. degree from the Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, in 2015. From 2015 to 2016, she was a Research Fellow with the School of Electrical Electronic Engineering, Nanyang Technological University, Singapore. From 2016 to 2021, she was an Associate Professor with the Shenzhen Institute of Advanced Technology, Chinese Academy of Scie...View more
Author image of Ming Liu
Robotics and Autonomous Systems Thrust, The Hong Kong University of Science and Technology (Guangzhou), Nansha Guangzhou, Guangdong, China
Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong, SAR, China
HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute, Futian, Shenzhen, China
Ming Liu (Senior Member, IEEE) received the B.A. degree in automation from Tongji University, Shanghai, China, in 2005, and the Ph.D. degree from the Department of Mechanical and Process Engineering, ETH Zürich, Zürich, Switzerland, in 2013. During the master’s degree, he was with Tongji University, he stayed one year with Erlangen-Nüremberg University, Erlangen, Germany, and the Fraunhofer Institute IISB, Erlangen, as a ...Show More
Ming Liu (Senior Member, IEEE) received the B.A. degree in automation from Tongji University, Shanghai, China, in 2005, and the Ph.D. degree from the Department of Mechanical and Process Engineering, ETH Zürich, Zürich, Switzerland, in 2013. During the master’s degree, he was with Tongji University, he stayed one year with Erlangen-Nüremberg University, Erlangen, Germany, and the Fraunhofer Institute IISB, Erlangen, as a ...View more

I. Introduction

Deep learning models have been demonstrated to achieve superior performance in various robotics tasks, particularly in the areas of perception and decision-making. However, the use of these models can significantly increase the computational requirements and energy consumption of robots, leading to challenges in terms of endurance and resource constraints for autonomous mobile robots such as self-driving cars, delivery drones, and autonomous logistics vehicles. This issue, known as the compute-and-power-limited problem in mobile robotics, presents a significant challenge for the widespread adoption of robots.

Author image of Boyi Liu
Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong, SAR
Boyi Liu (Member, IEEE) received the bachelor’s degree (Hons.) from Hainan University and the M.Phil. degree from the University of Chinese Academy of Science. He is currently pursuing the Ph.D. degree with the Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong. His research interests include robotics and federated learning. He received the Best Graduation Honor of “Student of the Year” Award for the bachelor’s degree. He was the Winner of the Outstanding Paper Award at the National Conference of Theoretical Computer Science in 2016.
Boyi Liu (Member, IEEE) received the bachelor’s degree (Hons.) from Hainan University and the M.Phil. degree from the University of Chinese Academy of Science. He is currently pursuing the Ph.D. degree with the Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong. His research interests include robotics and federated learning. He received the Best Graduation Honor of “Student of the Year” Award for the bachelor’s degree. He was the Winner of the Outstanding Paper Award at the National Conference of Theoretical Computer Science in 2016.View more
Author image of Lujia Wang
Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong, SAR
Lujia Wang (Member, IEEE) received the Ph.D. degree from the Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, in 2015. From 2015 to 2016, she was a Research Fellow with the School of Electrical Electronic Engineering, Nanyang Technological University, Singapore. From 2016 to 2021, she was an Associate Professor with the Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China.
She is currently a Research Assistant Professor with the Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong. Her current research interests include cloud robotics, lifelong federated robotic learning, resource/task allocation for robotic systems, and applications on autonomous driving.
Lujia Wang (Member, IEEE) received the Ph.D. degree from the Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, in 2015. From 2015 to 2016, she was a Research Fellow with the School of Electrical Electronic Engineering, Nanyang Technological University, Singapore. From 2016 to 2021, she was an Associate Professor with the Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China.
She is currently a Research Assistant Professor with the Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong. Her current research interests include cloud robotics, lifelong federated robotic learning, resource/task allocation for robotic systems, and applications on autonomous driving.View more
Author image of Ming Liu
Robotics and Autonomous Systems Thrust, The Hong Kong University of Science and Technology (Guangzhou), Nansha Guangzhou, Guangdong, China
Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong, SAR, China
HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute, Futian, Shenzhen, China
Ming Liu (Senior Member, IEEE) received the B.A. degree in automation from Tongji University, Shanghai, China, in 2005, and the Ph.D. degree from the Department of Mechanical and Process Engineering, ETH Zürich, Zürich, Switzerland, in 2013. During the master’s degree, he was with Tongji University, he stayed one year with Erlangen-Nüremberg University, Erlangen, Germany, and the Fraunhofer Institute IISB, Erlangen, as a Master Visiting Scholar. He is currently with the Department of Electronic and Computer Engineering, the Department of Computer Science and Engineering, and the Robotics Institute, The Hong Kong University of Science and Technology, Hong Kong. His research interests include dynamic environment modeling, deep learning for robotics, 3-D mapping, machine learning, and visual control.
He was a recipient of the Best Student Paper Award at the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems in 2012, the Best Paper in Information Award at the IEEE International Conference on Information and Automation in 2013, the Best RoboCup Paper at the IEEE/RSJ International Conference on Intelligent Robots and Systems in 2013, and twice the Winning Prize of the Chunhui-Cup Innovation Contest.
Ming Liu (Senior Member, IEEE) received the B.A. degree in automation from Tongji University, Shanghai, China, in 2005, and the Ph.D. degree from the Department of Mechanical and Process Engineering, ETH Zürich, Zürich, Switzerland, in 2013. During the master’s degree, he was with Tongji University, he stayed one year with Erlangen-Nüremberg University, Erlangen, Germany, and the Fraunhofer Institute IISB, Erlangen, as a Master Visiting Scholar. He is currently with the Department of Electronic and Computer Engineering, the Department of Computer Science and Engineering, and the Robotics Institute, The Hong Kong University of Science and Technology, Hong Kong. His research interests include dynamic environment modeling, deep learning for robotics, 3-D mapping, machine learning, and visual control.
He was a recipient of the Best Student Paper Award at the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems in 2012, the Best Paper in Information Award at the IEEE International Conference on Information and Automation in 2013, the Best RoboCup Paper at the IEEE/RSJ International Conference on Intelligent Robots and Systems in 2013, and twice the Winning Prize of the Chunhui-Cup Innovation Contest.View more
Contact IEEE to Subscribe

References

References is not available for this document.