Loading [MathJax]/extensions/MathMenu.js
Robotic Arm Based Automatic Ultrasound Scanning for Three-Dimensional Imaging | IEEE Journals & Magazine | IEEE Xplore

Robotic Arm Based Automatic Ultrasound Scanning for Three-Dimensional Imaging


Abstract:

This paper presents a human skin inspired automatic robotic ultrasound (US) system for three-dimensional (3-D) imaging. A depth camera was adopted to capture the point cl...Show More

Abstract:

This paper presents a human skin inspired automatic robotic ultrasound (US) system for three-dimensional (3-D) imaging. A depth camera was adopted to capture the point cloud of the skin surface. According to the 3-D contour of the skin surface, the scan range and scan path for the US probe could be automatically determined. Then, we used a normal-vector-based method to determine the pose of the robotic arm corresponding to each scan point in the scan path. In addition, two force sensors could feedback the contact force between the scanned tissue and the emission plane of the probe for fine-tuning the pose of the robotic arm. After the scanning, the system could realize 3-D US reconstruction. Experimental results validate the feasibility of the proposed system. It is expected that the proposed system will be useful in clinical practices.
Published in: IEEE Transactions on Industrial Informatics ( Volume: 15, Issue: 2, February 2019)
Page(s): 1173 - 1182
Date of Publication: 26 September 2018

ISSN Information:

Funding Agency:

References is not available for this document.

I. Introduction

As an indispensable diagnosis-aid technology, ultrasound (US) examination is of increasing importance in recent years [1]. It provides the B-scan with low cost and no radiation in real time [2]. The use of US would even increase in daily medicine and healthcare routines in the future. Traditional two-dimensional (2-D) US can dynamically display 2-D images of the region of interest [3]. However, the lack of 3-D anatomy information makes the diagnosis result heavily dependent on the subjective experience of the doctor. The 3-D US can overcome this serious limitation [4]–[9]. 3-D US imaging can be realized with three main steps: first, collect the raw B-scans labeled with corresponding spatial information; second, reconstruct the 3-D volume; and finally, render and display the 3-D volume. Every step has a significant influence on the accuracy of 3-D imaging. Except for systems using 2-D arrays, 3-D US images are reconstructed from raw B-scans, with their respective spatial information. Therefore, the scanning manners (especially the skills for manipulating the probe) and precise recording of position and orientation of B-scans are very important to ensure correct 3-D reconstruction. Only based on accurate 3-D US imaging data, 3-D image analysis [10], [11] can be further realized.

Select All
1.
Q. Huang and Z. Zeng, "A review on real-time 3D ultrasound imaging technology", Biomed. Res. Int., vol. 2017, no. 1, 2017.
2.
S. W. Smith, G. E. Trahey and O. T. von Ramm, "Two-dimensional arrays for medical ultrasound", Ultrason. Imag., vol. 14, no. 3, pp. 213-233, 1992.
3.
T. Wang, J. Wu and Q. Huang, "Enhanced extended-field-of-view ultrasound for musculoskeletal tissues using parallel computing", Current Med. Imag. Rev., vol. 10, no. 4, pp. 237-245, 2014.
4.
O. Solberg, F. Lindseth, H. Torp, E. Richard and T. Hernes, "Freehand 3D ultrasound reconstruction algorithms—A review", Ultrasound Med. Biol., vol. 33, no. 7, pp. 991-1009, 2007.
5.
Q. Huang and Y. Zheng, "Volume reconstruction of freehand three-dimensional ultrasound using median filters", Ultrasonics, vol. 48, no. 3, pp. 182-192, 2008.
6.
Q. Huang, Y. Zheng, M. Lu, T. Wang and S. Chen, "A new adaptive interpolation algorithm for 3D ultrasound imaging with speckle reduction and edge preservation", Comput. Med. Imag. Graph., vol. 33, no. 2, pp. 100-110, 2009.
7.
Q. Huang, M. Lu, Y. Zheng and Z. Chi, "Speckle suppression and contrast enhancement in reconstruction of freehand 3D ultrasoundw images using an adaptive distance-weighted method", Appl. Acoust., vol. 70, no. 1, pp. 21-30, 2009.
8.
D. Miller et al., "Comparison of different reconstruction algorithms for three dimensional ultrasound imaging in a neurosurgical setting", Int. J. Med. Robot. Comput. Assisted Surgery, vol. 8, pp. 348-359, 2012.
9.
Z. Chen and Q. Huang, "Real-time freehand 3D ultrasound imaging", Comput. Methods Biomechanics Biomed. Eng. Imag. Visualization, pp. 74-83, 2016.
10.
S. Emmanouil, K. Banitsas, A. Badii, S. Tzoulakis, E. Maravelakis and A. Konstantaras, "ATD: A multiplatform for semiautomatic 3-D detection of kidneys and their pathology in real time", IEEE Trans. Human-Mach. Syst., vol. 44, no. 1, pp. 146-153, Feb. 2014.
11.
H. Chang, Z. Chen, Q. Huang, J. Shi and X. Li, "Graph-based learning for segmentation of 3D ultrasound images", Neurocomputing, vol. 151, no. 151, pp. 632-644, 2015.
12.
D. Gan, S. Qiu, Z. Guan, C. Shi and Z. Li, "Development of a exoskeleton robot for lower limb rehabilitation", Proc. Int. Conf. Adv. Robot. Mechatronics, pp. 312-317, 2016.
13.
Z. Li, Y. Kang, Z. Xiao and W. Song, "Human-robot coordination control of robotic exoskeletons by skill transfers", IEEE Trans. Ind. Electron., vol. 64, no. 6, pp. 5171-5181, Jun. 2017.
14.
Z. Li, Z. Huang, W. He and C. Su, "Adaptive impedance control for an upper limb robotic exoskeleton using biological signals", IEEE Trans. Ind. Electron., vol. 64, no. 2, pp. 1664-1674, Feb. 2017.
15.
A. Trejos et al., "MIRA V: An integrated system for minimally invasive robot-assisted lung brachytherapy", Proc. IEEE Int. Conf. Robot. Automat., pp. 2982-2987, 2008.
16.
K. Zinchenko, C. Wu and K. Song, "A study on speech recognition control for a surgical robot", IEEE Trans. Ind. Informat., vol. 13, no. 2, pp. 607-615, Apr. 2017.
17.
K. Lau, E. Y. Y. Leun, P. W. Y Chiu, Y. Yan, J. Y. W. Lau and C. C. Y. Poon, "A flexible surgical robotic system for removal of early-stage gastrointestinal cancers by endoscopic submucosal dissection", IEEE Trans. Ind. Informat., vol. 12, no. 6, pp. 2365-2374, Dec. 2016.
18.
G. Li et al., "Robotic system for MRI-guided stereotactic neurosurgery", IEEE Rev. Biomed. Eng., vol. 62, no. 4, pp. 1077-1088, Apr. 2015.
19.
A. M. Priester, S. Natarajan and M. O. Culjat, "Robotic ultrasound systems in medicine", IEEE Trans. Ultrason. Ferroelect. Freq. Control, vol. 60, no. 3, pp. 507-523, Mar. 2013.
20.
Z. Pan, S. Tian, M. Guo, J. Zhang, N. Yu and Y.Y. Xin, "Comparison of medical image 3D reconstruction rendering methods for robot-assisted surgery", Proc. Int. Conf. Adv. Robot. Mechatronics, pp. 94-99, 2018.
21.
Jan. 30, 2018.
22.
Jan. 30, 2018.
23.
Q. Huang, Y. Zhao, H. Wei, L. Jin, W. Gang and X. Li, "Linear tracking for 3D medical ultrasound imaging", IEEE Trans. Cybern., vol. 43, no. 6, pp. 1747-1754, Dec. 2013.
24.
Q. Huang, B. Xie, P. Ye and Z. Chen, "Correspondence-3-D ultrasonic strain imaging based on a linear scanning system", IEEE Trans. Ultrason. Ferroelect. Freq. Control, vol. 62, no. 2, pp. 392-400, Feb. 2015.
25.
Z. Chen, Y. Chen and Q. Huang, "Development of a wireless and near real-time 3Dultrasound strain imaging system", IEEE Trans. Biomed. Circuits Syst., vol. 10, no. 2, pp. 394-403, Apr. 2016.
26.
S. Merouche, L. Allard, E. Montagnon, G. Soulez, P. Bigras and G. Cloutier, "A robotic ultrasound scanner for automatic vessel tracking and three-dimensional reconstruction of B-mode images", IEEE Trans. Ultrason. Ferroelect. Freq. Control, vol. 63, no. 1, pp. 35-46, Jan. 2016.
27.
F. Conti, J. Park and O. Khati, "Interface design and control strategies for a robot assisted ultrasonic examination system", Exp. Robot. Springer Tracts Adv. Robot., vol. 79, pp. 97-113, 2014.
28.
B. Meng, Y. Zhao, L. Chen, F. Aalamifar, X. Liu and E. Boctor, "Robot-assisted mirror ultrasound scanning for deep venous thrombosis detection using RGB-D sensor", Multimedia Tools Appl., vol. 75, no. 22, pp. 14247-14261, 2016.
29.
H. H. Sen et al., "System integration and in-vivo testing of a robot for ultrasound guidance and monitoring during radiotherapy", IEEE Trans. Biomed. Eng., vol. 64, no. 7, pp. 1608-1618, Jul. 2017.
30.
R. R. Finocchi, F. F. Aalamifar, T. Fang, R. H. Taylor and E. M. Boctor, "Co-robotic ultrasound imaging: A cooperative force control approach", Proc. Conf. Med. Imag.—Image-Guided Procedures Robot. Interventions Modeling, vol. 10135, 2017.

Contact IEEE to Subscribe

References

References is not available for this document.