Loading web-font TeX/Main/Regular
Towards Autonomous Atlas-Based Ultrasound Acquisitions in Presence of Articulated Motion | IEEE Journals & Magazine | IEEE Xplore

Towards Autonomous Atlas-Based Ultrasound Acquisitions in Presence of Articulated Motion


Abstract:

Robotic ultrasound (US) imaging aims at overcoming some of the limitations of free-hand US examinations, e.g. difficulty in guaranteeing intra- and inter-operator repeata...Show More

Abstract:

Robotic ultrasound (US) imaging aims at overcoming some of the limitations of free-hand US examinations, e.g. difficulty in guaranteeing intra- and inter-operator repeatability. However, due to anatomical and physiological variations between patients and relative movement of anatomical substructures, it is challenging to robustly generate optimal trajectories to examine the anatomies of interest, in particular, when they comprise articulated joints. To address this challenge, this paper proposes a vision-based approach allowing autonomous robotic US limb scanning. To this end, an atlas MRI template of a human arm with annotated vascular structures is used to generate trajectories and register and project them onto patients’ skin surfaces for robotic US acquisition. To effectively segment and accurately reconstruct the targeted 3D vessel, we make use of spatial continuity in consecutive US frames by incorporating channel attention modules into a U-Net-type neural network. The automatic trajectory generation method is evaluated on six volunteers with various articulated joint angles. In all cases, the system can successfully acquire the planned vascular structure on volunteers’ limbs. For one volunteer the MRI scan was also available, which allows the evaluation of the average radius of the scanned artery from US images, resulting in a radius estimation (\text{1.2} \pm \text{0.05 mm}) comparable to the MRI ground truth (\text{1.2} \pm \text{0.04 mm}).
Published in: IEEE Robotics and Automation Letters ( Volume: 7, Issue: 3, July 2022)
Page(s): 7423 - 7430
Date of Publication: 08 June 2022

ISSN Information:

Funding Agency:

References is not available for this document.

I. Introduction

Ultrasound (US) imaging has become one of the standard medical imaging modalities and is widely used for diagnosis and interventional objectives. US modality is powerful and effective for identifying internal lesions and organ abnormalities, particularly considering that it is non-invasive, real-time, and radiation-free. The absence of contraindications and the potential of US imaging in vascular diagnosis suggest that it may become the main diagnostic tool to examine the extremity artery tree [1]. Particularly, US imaging is the only technique that can provide information on the degree of calcification [1].

Select All
1.
E. Favaretto et al., "Analysis of agreement between duplex ultrasound scanning and arteriography in patients with lower limb artery disease", J. Cardiovasc. Med., vol. 8, no. 5, pp. 337, 2007.
2.
S. Merouche, L. Allard, E. Montagnon, G. Soulez, P. Bigras and G. Cloutier, "A robotic ultrasound scanner for automatic vessel tracking and three-dimensional reconstruction of B-mode images", IEEE Trans. Ultrason. Ferroelectr. Freq. Control, vol. 63, no. 1, pp. 35-46, Jan. 2016.
3.
M. R. Morgan, "Versatile low-cost volumetric 3-D ultrasound platform for existing clinical 2-D systems", IEEE Trans. Med. Imag., vol. 37, no. 10, pp. 2248-2256, Oct. 2018.
4.
Z. Jiang, Y. Zhou, Y. Bi, M. Zhou, T. Wendler and N. Navab, "Deformation-aware robotic 3D ultrasound", IEEE Robot. Autom. Lett., vol. 6, no. 4, pp. 7675-7682, Oct. 2021.
5.
M. W. Gilbertson and B. W. Anthony, "Force and position control system for freehand ultrasound", IEEE Trans. Robot., vol. 31, no. 4, pp. 835-849, Aug. 2015.
6.
F. Pierrot et al., "Hippocrate: A safe robot arm for medical applications with force feedback", Med. Image Anal., vol. 3, no. 3, pp. 285-300, 1999.
7.
Z. Jiang, M. Grimm, M. Zhou, Y. Hu, J. Esteban and N. Navab, "Automatic force-based probe positioning for precise robotic ultrasound acquisition", IEEE Trans. Ind. Electron., vol. 68, no. 11, pp. 11200-11211, Nov. 2021.
8.
Z. Jiang et al., "Automatic normal positioning of robotic ultrasound probe based only on confidence map optimization and force measurement", IEEE Robot. Autom. Lett., vol. 5, no. 2, pp. 1342-1349, Apr. 2020.
9.
B. Ihnatsenka and A. P. Boezaart, "Ultrasound: Basic understanding and learning the language", Int. J. Shoulder Surg., vol. 4, no. 3, pp. 55-62, 2010.
10.
C. Hennersperger et al., "Towards MRI-based autonomous robotic us acquisitions: A first feasibility study", IEEE Trans. Med. Imag., vol. 36, no. 2, pp. 538-548, Feb. 2017.
11.
S. Virga et al., "Automatic force-compliant robotic ultrasound screening of abdominal aortic aneurysms", Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., pp. 508-513, 2016.
12.
Z. Jiang et al., "Motion-aware robotic 3D ultrasound", Proc. IEEE Int. Conf. Robot. Automat., pp. 12494-12500, 2021.
13.
D. Mishra, S. Chaudhury, M. Sarkar and A. S. Soin, "Ultrasound image segmentation: A deeply supervised network with attention to boundaries", IEEE Trans. Biomed. Eng., vol. 66, no. 6, pp. 1637-1648, Jun. 2019.
14.
A. F. Frangi, W. J. Niessen, K. L. Vincken and M. A. Viergever, "Multiscale vessel enhancement filtering", Proc. Int. Conf. Med. image Comput. Comput.- Assist. Interv., pp. 130-137, 1998.
15.
E. Karami, M. S. Shehata and A. Smith, "Adaptive polar active contour for segmentation and tracking in ultrasound videos", IEEE Trans. Circuits Syst. Video Technol., vol. 29, no. 4, pp. 1209-1222, Apr. 2019.
16.
E. Smistad and F. Lindseth, "Real-time automatic artery segmentation reconstruction and registration for ultrasound-guided regional anaesthesia of the femoral nerve", IEEE Trans. Med. Imag., vol. 35, no. 3, pp. 752-761, Mar. 2016.
17.
P. Abolmaesumi, S. E. Salcudean, W.-H. Zhu, M. R. Sirouspour and S. P. DiMaio, "Image-guided control of a robot for medical ultrasound", IEEE Trans. Robot. Autom., vol. 18, no. 1, pp. 11-23, Feb. 2002.
18.
G. Litjens et al., "A survey on deep learning in medical image analysis", Med. Image Anal., vol. 42, pp. 60-88, 2017.
19.
O. Ronneberger, P. Fischer and T. Brox, "U-Net: Convolutional networks for biomedical image segmentation", Proc. Int. Conf. Med. Image Comput. Comput.- Assist. Interv., pp. 234-241, 2015.
20.
Z. Jiang et al., "Autonomous robotic screening of tubular structures based only on real-time ultrasound imaging feedback", IEEE Trans. Ind. Electron., vol. 69, no. 7, pp. 7064-7075, Jul. 2022.
21.
A. I. Chen, M. L. Balter, T. J. Maguire and M. L. Yarmush, "Deep learning robotic guidance for autonomous vascular access", Nature Mach. Intell., vol. 2, no. 2, pp. 104-115, 2020.
22.
B. Jiang, A. Chen, S. Bharat and M. Zheng, "Automatic ultrasound vessel segmentation with deep spatiotemporal context learning", Proc. Int. Workshop Adv. Simplifying Med. Ultrasound, pp. 3-13, 2021.
23.
X. Ma, Z. Zhang and H. K. Zhang, "Autonomous scanning target localization for robotic lung ultrasound imaging", Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., pp. 9467-9474, 2021.
24.
Y. Huang, W. Xiao, C. Wang, H. Liu, R. Huang and Z. Sun, "Towards fully autonomous ultrasound scanning robot with imitation learning based on clinical protocols", IEEE Robot. Autom. Lett., vol. 6, no. 2, pp. 3671-3678, Apr. 2021.
25.
M. Welleweerd, A. de Groot, V. Groenhuis, F. Siepel and S. Stramigioli, "Out-of-plane corrections for autonomous robotic breast ultrasound acquisitions", Proc. IEEE Int. Conf. Robot. Automat., pp. 12515-12521, 2021.
26.
Y. Bi, "VesNet-RL: Simulation-based reinforcement learning for real-world us probe navigation", IEEE Robot. Autom. Lett., vol. 7, no. 3, pp. 6638-6645, Jul. 2022.
27.
S. Beniwal, K. Bhargava and S. K. Kausik, "Size of distal radial and distal ulnar arteries in adults of southern Rajasthan and their implications for percutaneous coronary interventions", Indian Heart J., vol. 66, no. 5, pp. 506-509, 2014.
28.
E. Ilg, N. Mayer, T. Saikia, M. Keuper, A. Dosovitskiy and T. Brox, "FlowNet 2.0: Evolution of optical flow estimation with deep networks", Proc. IEEE Conf. Comput. Vis. Pattern Recognit., pp. 2462-2470, 2017.
29.
Y. Yao, B. Deng, W. Xu and J. Zhang, "Quasi-newton solver for robust non-rigid registration", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., pp. 7600-7609, 2020.
Contact IEEE to Subscribe

References

References is not available for this document.