Loading [MathJax]/extensions/MathMenu.js
Precise Repositioning of Robotic Ultrasound: Improving Registration-Based Motion Compensation Using Ultrasound Confidence Optimization | IEEE Journals & Magazine | IEEE Xplore

Precise Repositioning of Robotic Ultrasound: Improving Registration-Based Motion Compensation Using Ultrasound Confidence Optimization


Abstract:

Robotic ultrasound (US) imaging has been seen as a promising solution to overcome the limitations of free-hand US examinations, i.e., interoperator variability. However, ...Show More

Abstract:

Robotic ultrasound (US) imaging has been seen as a promising solution to overcome the limitations of free-hand US examinations, i.e., interoperator variability. However, the fact that robotic US systems (RUSSs) cannot react to subject movements during scans limits their clinical acceptance. Regarding human sonographers, they often react to patient movements by repositioning the probe or even restarting the acquisition, in particular for the scans of anatomies with long structures like limb arteries. To realize this characteristic, we proposed a vision-based system to monitor the subject’s movement and automatically update the scan trajectory thus seamlessly obtaining a complete 3-D image of the target anatomy. The motion monitoring module is developed using the segmented object masks from RGB images. Once the subject is moved, the robot will stop and recompute a suitable trajectory by registering the surface point clouds of the object obtained before and after the movement using the iterative closest point (ICP) algorithm. Afterward, to ensure optimal contact conditions after repositioning US probe, a confidence-based fine-tuning process is used to avoid potential gaps between the probe and contact surface. Finally, the whole system is validated on a human-like arm phantom with an uneven surface, while the object segmentation network is also validated on volunteers. The results demonstrate that the presented system can react to object movements and reliably provide accurate 3-D images.
Article Sequence Number: 5020611
Date of Publication: 23 August 2022

ISSN Information:

Funding Agency:

Citations are not available for this document.

I. Introduction

Ultrasound (US) imaging is a powerful and effective tool for the diagnosis of lesions and abnormalities of internal tissues and organs. US imaging is noninvasive, real-time, radiation-free, and widely available. In 2017, over 9.2 million US scans were performed in England. This number is twice and three times larger than the number of computer tomography (CT) scans and magnetic resonance imaging (MRI), respectively, during the same period [1]. Besides, US has been employed as the primary mechanism to diagnose peripheral artery disease (PAD) in clinical practice [2]. Regarding the femoral artery, Collins et al. [3] reported that US imaging has 80%–98% sensitivity in detecting arterial stenoses.

Cites in Papers - |

Cites in Papers - IEEE (24)

Select All
1.
Zichen Song, Sitan Huang, Zhongfeng Kang, "EM-MIAs: Enhancing Membership Inference Attacks in Large Language Models through Ensemble Modeling", ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.1-5, 2025.
2.
Yuan Bi, Yang Su, Nassir Navab, Zhongliang Jiang, "Gaze-Guided Robotic Vascular Ultrasound Leveraging Human Intention Estimation", IEEE Robotics and Automation Letters, vol.10, no.4, pp.3078-3085, 2025.
3.
Cem Bilaloglu, Tobias Löw, Sylvain Calinon, "Tactile Ergodic Coverage on Curved Surfaces", IEEE Transactions on Robotics, vol.41, pp.1421-1435, 2025.
4.
Zhongliang Jiang, Yunfeng Kang, Yuan Bi, Xuesong Li, Chenyang Li, Nassir Navab, "Class-Aware Cartilage Segmentation for Autonomous US-CT Registration in Robotic Intercostal Ultrasound Imaging", IEEE Transactions on Automation Science and Engineering, vol.22, pp.4818-4830, 2025.
5.
Weiyong Si, Ning Wang, Chenguang Yang, "Design and Quantitative Assessment of Teleoperation-Based Human–Robot Collaboration Method for Robot-Assisted Sonography", IEEE Transactions on Automation Science and Engineering, vol.22, pp.317-327, 2025.
6.
Dianye Huang, Chenguang Yang, Mingchuan Zhou, Angelos Karlas, Nassir Navab, Zhongliang Jiang, "Robot-Assisted Deep Venous Thrombosis Ultrasound Examination Using Virtual Fixture", IEEE Transactions on Automation Science and Engineering, vol.22, pp.381-392, 2025.
7.
Zhongliang Jiang, Xuesong Li, Xiangyu Chu, Angelos Karlas, Yuan Bi, Yingsheng Cheng, K. W. Samuel Au, Nassir Navab, "Needle Segmentation Using GAN: Restoring Thin Instrument Visibility in Robotic Ultrasound", IEEE Transactions on Instrumentation and Measurement, vol.73, pp.1-11, 2024.
8.
Jinkun Li, Li Zhang, Wenxu Zheng, Haohui Huang, Jing Guo, Shouyan Chen, "Confidence-Driven Adaptive Optimal Impedance Control Base on Ultrasound Robot System", 2024 IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE International Conference on Robotics, Automation and Mechatronics (RAM), pp.255-260, 2024.
9.
Lin Zhu, Huayi Cheng, Xiaoqia Yin, Kaiming Zhang, Shuang Liu, Xiancheng Zhang, "A Vision-Based Simultaneous Calibration Method for Dual-Robot Collaborative System", IEEE Transactions on Industrial Informatics, vol.20, no.11, pp.13396-13405, 2024.
10.
Baoshan Niu, Dapeng Yang, Tao Geng, Le Zhang, Boyu Ma, Qi Huang, Hong Liu, "Dynamic Arm Impedance Regulation: Experiences From Medical Ultrasound Scanning Experts", IEEE Transactions on Instrumentation and Measurement, vol.73, pp.1-10, 2024.
11.
Teru Chen, Xingwei Zhao, Guo Zheng, Jiaxin Wang, Qing Ling, Bo Tao, Zhouping Yin, "Real-Time Deformable Registration for Robotic Ultrasound Surgical Guidance Based on Vectorized Trust-Region Optimization", IEEE Transactions on Instrumentation and Measurement, vol.73, pp.1-11, 2024.
12.
Yehui Li, Wing Yin Ng, Yichong Sun, Yisen Huang, Jixiu Li, Philip Wai Yan Chiu, Zheng Li, "Colon Lumen Center Detection Enables Autonomous Navigation of an Electromagnetically Actuated Soft-Tethered Colonoscope", IEEE Transactions on Instrumentation and Measurement, vol.73, pp.1-15, 2024.
13.
Li An, Pengbo Zhou, Mingquan Zhou, Yong Wang, Qi Zhang, "PointTr: Low-Overlap Point Cloud Registration With Transformer", IEEE Sensors Journal, vol.24, no.8, pp.12795-12805, 2024.
14.
Junling Fu, Ilaria Burzo, Elisa Iovene, Jianzhuang Zhao, Giancarlo Ferrigno, Elena De Momi, "Optimization-Based Variable Impedance Control of Robotic Manipulator for Medical Contact Tasks", IEEE Transactions on Instrumentation and Measurement, vol.73, pp.1-8, 2024.
15.
Guo Zheng, Xingwei Zhao, Teru Chen, Qing Ling, Bo Tao, Han Ding, "A Simultaneous Ultrasound-Robot Calibration Approach for Dual-Robot Intervention by Solving the AXP = YCQ Problem", IEEE Transactions on Instrumentation and Measurement, vol.73, pp.1-10, 2024.
16.
Qinghua Huang, Bin Gao, Mingliang Wang, "Robot-Assisted Autonomous Ultrasound Imaging for Carotid Artery", IEEE Transactions on Instrumentation and Measurement, vol.73, pp.1-9, 2024.
17.
Zhongliang Jiang, Felix Duelmer, Nassir Navab, "DopUS-Net: Quality-Aware Robotic Ultrasound Imaging Based on Doppler Signal", IEEE Transactions on Automation Science and Engineering, vol.21, no.3, pp.3229-3242, 2024.
18.
Weiyong Si, Cheng Guo, Ning Wang, Minyu Yang, Rebecca Harris, Chenguang Yang, "A Unified Deep Imitation Learning and Control Framework for Robot-Assisted Sonography", 2023 IEEE International Conference on Development and Learning (ICDL), pp.318-323, 2023.
19.
Deepak Raina, Abhishek Mathur, Richard M. Voyles, Juan Wachs, SH Chandrashekhara, Subir Kumar Saha, "RUSOpt: Robotic UltraSound Probe Normalization with Bayesian Optimization for In-Plane and Out-Plane Scanning", 2023 IEEE 19th International Conference on Automation Science and Engineering (CASE), pp.1-7, 2023.
20.
Yao Zhang, Eric Verschooten, Mouloud Ourak, Kaat Van Assche, Gianni Borghesan, Di Wu, Kenan Niu, Philip X. Joris, Emmanuel Vander Poorten, "Physiological Motion Compensation for Neuroscience Research Based on Electrical Bio-Impedance Sensing", IEEE Sensors Journal, vol.23, no.20, pp.25377-25389, 2023.
21.
Zhongliang Jiang, Xuesong Li, Chenyu Zhang, Yuan Bi, Walter Stechele, Nassir Navab, "Skeleton Graph-Based Ultrasound-CT Non-Rigid Registration", IEEE Robotics and Automation Letters, vol.8, no.8, pp.4394-4401, 2023.
22.
Guochen Ning, Hanying Liang, Xinran Zhang, Hongen Liao, "Autonomous Robotic Ultrasound Vascular Imaging System With Decoupled Control Strategy for External-Vision-Free Environments", IEEE Transactions on Biomedical Engineering, vol.70, no.11, pp.3166-3177, 2023.
23.
Kaat Van Assche, Yao Zhang, Mouloud Ourak, Eric Verschooten, Philip X. Joris, Emmanuel Vander Poorten, "Physiological Motion Compensation in Patch Clamping using Electrical Bio-impedance Sensing", 2023 International Symposium on Medical Robotics (ISMR), pp.1-7, 2023.
24.
Anthony L. Gunderman, Mishek Musa, Benjamin O. Gunderman, Filip Banovac, Kevin Cleary, Xiaofeng Yang, Yue Chen, "Autonomous Respiratory Motion Compensated Robot for CT-Guided Abdominal Radiofrequency Ablations", IEEE Transactions on Medical Robotics and Bionics, vol.5, no.2, pp.206-217, 2023.

Cites in Papers - Other Publishers (2)

1.
Xiuhong Tang, Hongbo Wang, Jingjing Luo, Jinlei Jiang, Fan Nian, Lizhe Qi, Lingfeng Sang, Zhongxue Gan, "Autonomous ultrasound scanning robotic system based on human posture recognition and image servo control: an application for cardiac imaging", Frontiers in Robotics and AI, vol.11, 2024.
2.
Cheng Wang, Li Guo, Jianjun Zhu, Lifeng Zhu, Chichi Li, Haidong Zhu, Aiguo Song, Ligong Lu, Gao-Jun Teng, Nassir Navab, Zhongliang Jiang, "Review of robotic systems for thoracoabdominal puncture interventional surgery", APL Bioengineering, vol.8, no.2, 2024.
Contact IEEE to Subscribe

References

References is not available for this document.