Loading [MathJax]/extensions/MathMenu.js
Genetic U-Net: Automatically Designed Deep Networks for Retinal Vessel Segmentation Using a Genetic Algorithm | IEEE Journals & Magazine | IEEE Xplore

Genetic U-Net: Automatically Designed Deep Networks for Retinal Vessel Segmentation Using a Genetic Algorithm


Abstract:

Recently, many methods based on hand-designed convolutional neural networks (CNNs) have achieved promising results in automatic retinal vessel segmentation. However, thes...Show More

Abstract:

Recently, many methods based on hand-designed convolutional neural networks (CNNs) have achieved promising results in automatic retinal vessel segmentation. However, these CNNs remain constrained in capturing retinal vessels in complex fundus images. To improve their segmentation performance, these CNNs tend to have many parameters, which may lead to overfitting and high computational complexity. Moreover, the manual design of competitive CNNs is time-consuming and requires extensive empirical knowledge. Herein, a novel automated design method, called Genetic U-Net, is proposed to generate a U-shaped CNN that can achieve better retinal vessel segmentation but with fewer architecture-based parameters, thereby addressing the above issues. First, we devised a condensed but flexible search space based on a U-shaped encoder-decoder. Then, we used an improved genetic algorithm to identify better-performing architectures in the search space and investigated the possibility of finding a superior network architecture with fewer parameters. The experimental results show that the architecture obtained using the proposed method offered a superior performance with less than 1% of the number of the original U-Net parameters in particular and with significantly fewer parameters than other state-of-the-art models. Furthermore, through in-depth investigation of the experimental results, several effective operations and patterns of networks to generate superior retinal vessel segmentations were identified. The codes of this work are available at https://github.com/96jhwei/Genetic-U-Net.
Published in: IEEE Transactions on Medical Imaging ( Volume: 41, Issue: 2, February 2022)
Page(s): 292 - 307
Date of Publication: 10 September 2021

ISSN Information:

PubMed ID: 34506278

Funding Agency:

References is not available for this document.

I. Introduction

The retinal vascular system can be observed non-invasively in vivo in humans [1]. In addition, changes in the vasculature are often associated with certain diseases, leading ophthalmologists and other physicians to consider fundus examination a routine clinical examination [2], [3]. Many diseases can be diagnosed and tracked [2] by observing the retinal vascular system. Pathological changes in retinal vessels can reflect either ophthalmology diseases or other systemic diseases, such as wet age-related macular degeneration and diabetes [4]. Diabetic retinopathy can lead to the growth of new blood vessels, and atherosclerosis [5] associated with wet age-related macular degeneration can cause the narrowing of blood vessels. Moreover, the retinal vascular system of each eye is unique. Without pathological changes, it does not alter throughout the lifetime. Hence, observation of the retinal vascular system can also be applied in biometrics [6], [7]. Through retinal vessel segmentation, relevant morphological information of retinal vascular trees (such as the width, length, and curvature of blood vessels) can be obtained [8]. Consequently, precise retinal vessel segmentation is significant. However, owing to the complexities of retinal vascular structures, manual inspection is subjective, time-consuming, and laborious [9], [10]. Therefore, developing an effective algorithm for the automated segmentation of retinal vessels to support ophthalmologists in clinical assessment has been of great interest.

Select All
1.
P. Vostatek, E. Claridge, H. Uusitalo, M. Hauta-Kasari, P. Fält and L. Lensu, "Performance comparison of publicly available retinal blood vessel segmentation methods", Computerized Med. Imag. Graph., vol. 55, pp. 2-12, Jan. 2017.
2.
M. M. Fraz et al., "Blood vessel segmentation methodologies in retinal images–A survey", Comput. Methods Programs Biomed., vol. 108, no. 1, pp. 407-433, Oct. 2012.
3.
I. P. Chatziralli, E. D. Kanonidou, P. Keryttopoulos, P. Dimitriadis and L. E. Papazisis, "The value of fundoscopy in general practice", open Ophthalmol. J., vol. 6, pp. 4-5, Mar. 2012.
4.
M. D. Abràmoff, M. K. Garvin and M. Sonka, "Retinal imaging and image analysis", IEEE Rev. Biomed. Eng., vol. 3, pp. 169-208, Dec. 2010.
5.
L. D. Hubbard et al., "Methods for evaluation of retinal microvascular abnormalities associated with hypertension/sclerosis in the atherosclerosis risk in communities study", Ophthalmology, vol. 106, no. 12, pp. 2269-2280, Dec. 1999.
6.
M. Ortega, M. G. Penedo, J. Rouco, N. Barreira and M. J. Carreira, "Personal verification based on extraction and characterisation of retinal feature points", J. Vis. Lang. Comput., vol. 20, no. 2, pp. 80-90, Apr. 2009.
7.
C. Simon and I. Golstein, "A new scientific method of identification", New York State J. Med., vol. 35, no. 18, pp. 901-906, 1935.
8.
Q. Jin, Z. Meng, T. D. Pham, Q. Chen, L. Wei and R. Su, "DUNet: A deformable network for retinal vessel segmentation", Knowl.-Based Syst., vol. 178, pp. 149-162, Aug. 2019.
9.
L. Mou, L. Chen, J. Cheng, Z. Gu, Y. Zhao and J. Liu, "Dense dilated network with probability regularized walk for vessel detection", IEEE Trans. Med. Imag., vol. 39, no. 5, pp. 1392-1403, May 2020.
10.
B. Wang, S. Qiu and H. He, "Dual encoding U-Net for retinal vessel segmentation", Proc. Int. Conf. Med. Image Comput. Comput.-Assist. Intervent. (MICCAI), pp. 84-92, Oct. 2019.
11.
J. Staal, M. D. Abramoff, M. Niemeijer, M. A. Viergever and B. van Ginneken, "Ridge-based vessel segmentation in color images of the retina", IEEE Trans. Med. Imag., vol. 23, no. 4, pp. 501-509, Apr. 2004.
12.
A. D. Hoover, V. Kouznetsova and M. Goldbaum, "Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response", IEEE Trans. Med. Imag., vol. 19, no. 3, pp. 203-210, Mar. 2000.
13.
J. Odstrcilik et al., "Retinal vessel segmentation by improved matched filtering: Evaluation on a new high-resolution fundus image database", IET Image Process., vol. 7, no. 4, pp. 373-383, Jun. 2013.
14.
J. I. Orlando, E. Prokofyeva and M. B. Blaschko, "A discriminatively trained fully connected conditional random field model for blood vessel segmentation in fundus images", IEEE Trans. Biomed. Eng., vol. 64, no. 1, pp. 16-27, Jan. 2017.
15.
Z. Fan et al., "Automated blood vessel segmentation in fundus image based on integral channel features and random forests", Proc. 12th World Congr. Intell. Control Autom. (WCICA), pp. 2063-2068, Jun. 2016.
16.
P. Liskowski and K. Krawiec, "Segmenting retinal blood vessels with deep neural networks", IEEE Trans. Med. Imag., vol. 35, no. 11, pp. 2369-2380, Nov. 2016.
17.
R. Vega, G. Sanchez-Ante, L. E. Falcon-Morales, H. Sossa and E. Guevara, "Retinal vessel extraction using lattice neural networks with dendritic processing", Comput. Biol. Med., vol. 58, pp. 20-30, Mar. 2015.
18.
Q. Li, B. Feng, L. Xie, P. Liang, H. Zhang and T. Wang, "A cross-modality learning approach for vessel segmentation in retinal images", IEEE Trans. Med. Imag., vol. 35, no. 1, pp. 109-118, Jan. 2016.
19.
J. Mo and L. Zhang, "Multi-level deep supervised networks for retinal vessel segmentation", Int. J. Comput. Assist. Radiol. Surg., vol. 12, no. 12, pp. 2181-2193, Dec. 2017.
20.
Z. Fan and J.-J. Mo, "Automated blood vessel segmentation based on de-noising auto-encoder and neural network", Proc. Int. Conf. Mach. Learn. Cybern. (ICMLC), vol. 2, pp. 849-856, Jul. 2016.
21.
O. Ronneberger, P. Fischer and T. Brox, "U-Net: Convolutional networks for biomedical image segmentation", Proc. Int. Conf. Med. Image Comput. Comput.-Assist. Intervent. (MICCAI), pp. 234-241, Nov. 2015.
22.
Y. Wu et al., "Vessel-Net: Retinal vessel segmentation under multi-path supervision", Proc. Int. Conf. Med. Image Comput. Comput.-Assist. Intervent. (MICCAI), pp. 264-272, Oct. 2019.
23.
T. Laibacher, T. Weyde and S. Jalali, "M2U-net: Effective and efficient retinal vessel segmentation for real-world applications", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), pp. 115-124, Jun. 2019.
24.
M. Z. Alom, C. Yakopcic, M. Hasan, T. M. Taha and V. K. Asari, "Recurrent residual U-Net for medical image segmentation", J. Med. Imag., vol. 6, no. 1, Mar. 2019.
25.
Z. Gu et al., "Ce-Net: Context encoder network for 2D medical image segmentation", IEEE Trans. Med. Imag., vol. 38, no. 10, pp. 2281-2292, Oct. 2019.
26.
L. Mou et al., " CS 2 -Net: Deep learning segmentation of curvilinear structures in medical imaging ", Med. Image Anal., vol. 67, Jan. 2021.
27.
G. Huang, Z. Liu and L. van der Maaten, "Densely connected convolutional networks", Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 4700-4708, Jul. 2017.
28.
C. Liu et al., "Auto-deeplab: Hierarchical neural architecture search for semantic image segmentation", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 82-92, Jun. 2019.
29.
Y. Weng, T. Zhou, Y. Li and X. Qiu, "NAS-Unet: Neural architecture search for medical image segmentation", IEEE Access, vol. 7, pp. 44247-44257, 2019.
30.
A. Mortazi and U. Bagci, "Automatically designing CNN architectures for medical image segmentation", Proc. Int. Workshop Mach. Learn. Med. Imag., pp. 98-106, Sep. 2018.

Contact IEEE to Subscribe

References

References is not available for this document.