Loading web-font TeX/Main/Regular
A Simultaneous Ultrasound-Robot Calibration Approach for Dual-Robot Intervention by Solving the AXP = YCQ Problem | IEEE Journals & Magazine | IEEE Xplore

A Simultaneous Ultrasound-Robot Calibration Approach for Dual-Robot Intervention by Solving the AXP = YCQ Problem


Abstract:

Robotic ultrasound-guided intervention is an effective approach to ameliorating the quality of the intervention surgery. Ultrasound-robot calibration, conducted to obtain...Show More

Abstract:

Robotic ultrasound-guided intervention is an effective approach to ameliorating the quality of the intervention surgery. Ultrasound-robot calibration, conducted to obtain spatial relationships among different frames, is an essential step for the ultrasound-guided robotic system. However, existing step-by-step calibration methods mainly rely on phantoms or external trackers and are prone to error accumulation and workflow complexity. In this article, a novel simultaneous ultrasound-robot calibration approach is proposed. It calibrates the ultrasound-guided dual-robot intervention system in a one-step process without resorting to any phantoms or external trackers, thereby enhancing the calibration accuracy and simplifying the workflow. Specifically, an {\text {AXP} = \text {YCQ}} calibration equation is formulated to transform the calibration problem into the equation solving. For simultaneously deciding the equation’s unknowns, the Kronecker-product-based closed-form method and the Gauss–Newton iterative method based on the Lie algebra are proposed. The closed-form method offers a coarse estimation to the iterative method. Evaluation experiments are implemented to illustrate the favorable performance of the proposed approach. Furthermore, an in vitro ultrasound-guided dual-robot intervention experiment was also realized with the proposed approach and the intervention errors were 0.75 ± 0.27 mm when the calibration sample data size is 50.
Article Sequence Number: 4004210
Date of Publication: 23 February 2024

ISSN Information:

Funding Agency:

References is not available for this document.

I. Introduction

Attribute to its cost, tolerability, portability, nonradiation, and real-time performance, ultrasound imaging has been pretty prevalent in clinical [1], [2], [3]. With the advancement of surgical robotics, ultrasound-guided intervention is developing from freehand operations to robot-assisted operations [4]. Robotic ultrasound-guided intervention has been widely employed in treatments such as ablation, biopsy, and brachytherapy for prostate cancer [5], cervical cancer [6], and breast cancer [7]. Commonly in this workflow, a robotic arm holding an ultrasound probe scans the region of interest. Then, the system or surgeon identifies the target in the ultrasound image, guiding another robotic arm holding a needle-shaped tool to complete the intervention [8]. High precision is one of the key factors for an effective intervention. Therefore, ultrasound-robot calibration, aiming to determine all spatial relationships among robots, end-effectors, and ultrasound image within the robotic ultrasound-guided intervention system, is an essential step before the diagnosis and intervention [9].

Select All
1.
M. H. Mozaffari and W.-S. Lee, "Freehand 3-D ultrasound imaging: A systematic review", Ultrasound Med. Biol., vol. 43, no. 10, pp. 2099-2124, 2017.
2.
T. Chen, X. Zhao, Q. Ling, Z. Gong, B. Tao and Z. Yin, "An automatic prostate surgical region reconstruction method based on multilevel learning", IEEE Trans. Instrum. Meas., vol. 71, pp. 1-12, 2022.
3.
P. Liang et al., "Practice guidelines for ultrasound-guided percutaneous microwave ablation for hepatic malignancy", World J. Gastroenterol., vol. 19, no. 33, pp. 5430, 2013.
4.
S. E. Salcudean, H. Moradi, D. G. Black and N. Navab, "Robot-assisted medical imaging: A review", Proc. IEEE, vol. 110, no. 7, pp. 951-967, Jul. 2022.
5.
M. Kalia, P. Mathur, K. Tsang, P. Black, N. Navab and S. Salcudean, "Evaluation of a marker-less intra-operative augmented reality guidance system for robot-assisted laparoscopic radical prostatectomy", Int. J. Comput. Assist. Radiol. Surg., vol. 15, no. 7, pp. 1225-1233, Jul. 2020.
6.
G. Pu, S. Jiang, Z. Yang, Y. Hu and Z. Liu, "A novel ultrasound probe calibration method for multimodal image guidance of needle placement in cervical cancer brachytherapy", Phys. Medica, vol. 100, pp. 81-89, Aug. 2022.
7.
G. Yanjun, D. Xingguang, W. Chengyi, Z. Haicheng and G. Huiqin, "Calibration method for a breast intervention robot based on four-dimensional ultrasound image guidance", Auto. Robots, vol. 46, no. 7, pp. 851-859, Oct. 2022.
8.
M. Antico et al., "Ultrasound guidance in minimally invasive robotic procedures", Med. Image Anal., vol. 54, pp. 149-167, May 2019.
9.
F. Aalamifar, R. Khurana, A. Cheng, R. H. Taylor, I. Iordachita and E. M. Boctor, "Enabling technologies for robot assisted ultrasound tomography: System setup and calibration", Proc. SPIE, vol. 9040, pp. 495-503, Apr. 2014.
10.
J. Liu, W. Sun, Y. Zhao and G. Zheng, "Ultrasound probe and hand-eye calibrations for robot-assisted needle biopsy", Sensors, vol. 22, no. 23, pp. 9465, 2022.
11.
M. Najafi, N. Afsham, P. Abolmaesumi and R. Rohling, "A closed-form differential formulation for ultrasound spatial calibration: Multi-wedge phantom", Ultrasound Med. Biol., vol. 40, no. 9, pp. 2231-2243, 2014.
12.
C. Wu et al., "Automatic spatial calibration of freehand ultrasound probe with a multilayer N-wire phantom", Ultrasonics, vol. 128, Feb. 2023.
13.
T. Wen, C. Wang, Y. Zhang and S. Zhou, "A novel ultrasound probe spatial calibration method using a combined phantom and stylus", Ultrasound Med. Biol., vol. 46, no. 8, pp. 2079-2089, Aug. 2020.
14.
C. Yang, M. Jiang, M. Chen, M. Fu, J. Li and Q. Huang, "Automatic 3-D imaging and measurement of human spines with a robotic ultrasound system", IEEE Trans. Instrum. Meas., vol. 70, pp. 1-13, 2021.
15.
Z. Jiang et al., "Precise repositioning of robotic ultrasound: Improving registration-based motion compensation using ultrasound confidence optimization", IEEE Trans. Instrum. Meas., vol. 71, pp. 1-11, 2022.
16.
Q. Huang, J. Lan and X. Li, "Robotic arm based automatic ultrasound scanning for three-dimensional imaging", IEEE Trans. Ind. Informat., vol. 15, no. 2, pp. 1173-1182, Feb. 2019.
17.
J. Xiong, C. Xu, K. Ibrahim, H. Deng and Z. Xia, "A mechanism-image fusion approach to calibration of an ultrasound-guided dual-arm robotic brachytherapy system", IEEE/ASME Trans. Mechatronics, vol. 26, no. 6, pp. 3211-3220, Dec. 2021.
18.
O. Mohareri et al., "Intraoperative registered transrectal ultrasound guidance for robot-assisted laparoscopic radical prostatectomy", J. Urol., vol. 193, no. 1, pp. 302-312, Jan. 2015.
19.
D. C. Barratt et al., "Self-calibrating 3D-ultrasound-based bone registration for minimally invasive orthopedic surgery", IEEE Trans. Med. Imag., vol. 25, no. 3, pp. 312-323, Mar. 2006.
20.
M. Toews and W. M. Wells, "Phantomless auto-calibration and online calibration assessment for a tracked freehand 2-D ultrasound probe", IEEE Trans. Med. Imag., vol. 37, no. 1, pp. 262-272, Jan. 2018.
21.
F. Aalamifar et al., "Robot-assisted automatic ultrasound calibration", Int. J. Comput. Assist. Radiol. Surg., vol. 11, pp. 1821-1829, 2016.
22.
C. Kim, D. Chang, D. Petrisor, G. Chirikjian, M. Han and D. Stoianovici, "Ultrasound probe and needle-guide calibration for robotic ultrasound scanning and needle targeting", IEEE Trans. Biomed. Eng., vol. 60, no. 6, pp. 1728-1734, Jun. 2013.
23.
K.-J. Wang et al., "Ultrasound calibration for dual-armed surgical navigation system", J. Healthc. Eng., vol. 2022, Feb. 2022.
24.
N. Hungr, M. Baumann, J.-A. Long and J. Troccaz, "A 3-D ultrasound robotic prostate brachytherapy system with prostate motion tracking", IEEE Trans. Robot., vol. 28, no. 6, pp. 1382-1397, Dec. 2012.
25.
H. K. Zhang, A. Cheng, Y. Kim, Q. Ma, G. S. Chirikjian and E. M. Boctor, "Phantom with multiple active points for ultrasound calibration", J. Med. Imag., vol. 5, no. 4, Nov. 2018.
26.
J. Jiang, X. Luo, Q. Luo, L. Qiao and M. Li, "An overview of hand-eye calibration", Int. J. Adv. Manuf. Technol., vol. 119, no. 1, pp. 77-97, 2022.
27.
Q. Ma, Z. Goh, S. Ruan and G. S. Chirikjian, " Probabilistic approaches to the AXB = YCZ calibration problem in multi-robot systems ", Auton. Robot., vol. 42, pp. 1497-1520, 2018.
28.
Z. Fu, J. Pan, E. Spyrakos-Papastavridis, X. Chen and M. Li, "A dual quaternion-based approach for coordinate calibration of dual robots in collaborative motion", IEEE Robot. Autom. Lett., vol. 5, no. 3, pp. 4086-4093, Jul. 2020.
29.
S. Yan, S.-K. Ong and A. Y. Nee, "Registration of a hybrid robot using the Degradation–Kronecker method and a purely nonlinear method", Robotica, vol. 34, no. 12, pp. 2729-2740, 2016.
30.
J. Wang, L. Wu, M. Q.-H. Meng and H. Ren, "Towards simultaneous coordinate calibrations for cooperative multiple robots", Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., pp. 410-415, Sep. 2014.

Contact IEEE to Subscribe

References

References is not available for this document.