An Adaptive Image Segmentation Network for Surface Defect Detection | IEEE Journals & Magazine | IEEE Xplore

An Adaptive Image Segmentation Network for Surface Defect Detection


Abstract:

Surface defect detection plays an essential role in industry, and it is challenging due to the following problems: 1) the similarity between defect and nondefect texture ...Show More

Abstract:

Surface defect detection plays an essential role in industry, and it is challenging due to the following problems: 1) the similarity between defect and nondefect texture is very high, which eventually leads to recognition or classification errors and 2) the size of defects is tiny, which are much more difficult to be detected than larger ones. To address such problems, this article proposes an adaptive image segmentation network (AIS-Net) for pixelwise segmentation of surface defects. It consists of three main parts: multishuffle-block dilated convolution (MSDC), dual attention context guidance (DACG), and adaptive category prediction (ACP) modules, where MSDC is designed to merge the multiscale defect features for avoiding the loss of tiny defect feature caused by model depth, DACG is designed to capture more contextual information from the defect feature map for locating defect regions and obtaining clear segmentation boundaries, and ACP is used to make classification and regression for predicting defect categories. Experimental results show that the proposed AIS-Net is superior to the state-of-the-art approaches on four actual surface defect datasets (NEU-DET: 98.38% ± 0.03%, DAGM: 99.25% ± 0.02%, Magnetic-tile: 98.73% ± 0.13%, and MVTec: 99.72% ± 0.02%).
Page(s): 8510 - 8523
Date of Publication: 29 December 2022

ISSN Information:

PubMed ID: 37015643

Funding Agency:

References is not available for this document.

I. Introduction

In the manufacturing industry, the products often suffer from a lot of surface defects, such as scratches, cracks, and pores, which may reduce their strength and hurt their quality. Therefore, detection of surface defects has become one of the most crucial processes in industry. However, it is a pity that at present, many factories still perform manual inspections, which are time-consuming, subjective, low-efficiency, and low-accuracy. Thence, it is necessary to develop an automatic detection system of surface defects to improve their efficiency and reliability.

Select All
1.
X. Ren, W. Lin, X. Yang, X. Yu and H. Gao, "Data augmentation in defect detection of sanitary ceramics in small and non-i.i.d datasets", IEEE Trans. Neural Netw. Learn. Syst., Mar. 2022.
2.
X. Zhang, X. Su, Q. Yuan and Q. Wang, "Spatial–temporal gray-level co-occurrence aware CNN for SAR image change detection", IEEE Geosci. Remote Sens. Lett., vol. 19, 2022.
3.
D. J. Pasadas, P. Baskaran, H. G. Ramos and A. L. Ribeiro, "Detection and classification of defects using ECT and multi-level SVM model", IEEE Sensors J., vol. 20, no. 5, pp. 2329-2338, Mar. 2020.
4.
T. He, G. Xing, Y. Li, Q. Li and S. Zhou, "A novel baseline-free defect detection and localization method of welded steel plate based on reciprocity loss", Meas. Sci. Technol., vol. 32, no. 2, pp. 25602-25614, 2020.
5.
M. Win, A. R. Bushroa, M. A. Hassan, N. M. Hilman and A. Ide-Ektessabi, "A contrast adjustment thresholding method for surface defect detection based on mesoscopy", IEEE Trans. Ind. Informat., vol. 11, no. 3, pp. 642-649, Jun. 2015.
6.
Z. Zhang, G. Wen and S. Chen, "Audible sound-based intelligent evaluation for aluminum alloy in robotic pulsed GTAW: Mechanism feature selection and defect detection", IEEE Trans. Ind. Informat., vol. 14, no. 7, pp. 2973-2983, Jul. 2018.
7.
J. Jin, Z. Wang, R. Xu, C. Liu, X. Wang and A. Cichocki, "Robust similarity measurement based on a novel time filter for SSVEPs detection", IEEE Trans. Neural Netw. Learn. Syst., Oct. 2021.
8.
B. Su, H. Chen and Z. Zhou, "BAF-detector: An efficient CNN-based detector for photovoltaic cell defect detection", IEEE Trans. Ind. Electron., vol. 69, no. 3, pp. 3161-3171, Mar. 2022.
9.
D.-M. Tsai, S.-K.-S. Fan and Y.-H. Chou, "Auto-annotated deep segmentation for surface defect detection", IEEE Trans. Instrum. Meas., vol. 70, pp. 1-10, 2021.
10.
D. Medak, L. Posilovic, M. Subasic, M. Budimir and S. Loncaric, "Automated defect detection from ultrasonic images using deep learning", IEEE Trans. Ultrason. Ferroelectr. Freq. Control, vol. 68, no. 10, pp. 3126-3134, Oct. 2021.
11.
Z. Tang, E. Tian, Y. Wang, L. Wang and T. Yang, "Nondestructive defect detection in castings by using spatial attention bilinear convolutional neural network", IEEE Trans. Ind. Informat., vol. 17, no. 1, pp. 82-89, Jan. 2021.
12.
J. Ji, S. Li, J. Xiong, P. Chen and Q. Miao, "Semantic image segmentation with propagating deep aggregation", IEEE Trans. Instrum. Meas., vol. 69, no. 12, pp. 9732-9742, 2020.
13.
C. G. Dias, L. C. da Silva and W. A. Luz Alves, "A histogram of oriented gradients approach for detecting broken bars in squirrel-cage induction motors", IEEE Trans. Instrum. Meas., vol. 69, no. 9, pp. 6968-6981, Sep. 2020.
14.
L. Zhuang, H. Qi and Z. Zhang, "The automatic rail surface multi-flaw identification based on a deep learning powered framework", IEEE Trans. Intell. Transp. Syst., vol. 23, no. 8, pp. 12133-12143, Aug. 2022.
15.
W. Quero-Caiza and M. Altuve, "Recognition of skin lesions in dermoscopic images using local binary patterns and multinomial logistic regression", IEEE Latin Amer. Trans., vol. 20, no. 7, pp. 2020-2028, Jul. 2022.
16.
B. A. de Castro, F. G. Baptista, J. Alfredo Ardila-Rey and F. Ciampa, "Baseline-free damage imaging algorithm using spatial frequency domain virtual time reversal", IEEE Trans. Ind. Informat., vol. 18, no. 8, pp. 5043-5054, Aug. 2022.
17.
X. Sun, L. Lin, Z. Ma and S. Jin, "Enhancement of time resolution in ultrasonic yime-of-flight diffraction technique with frequency-domain sparsity-decomposability inversion (FDSDI) method", IEEE Trans. Ultrason. Ferroelectr. Freq. Control, vol. 68, no. 10, pp. 3204-3215, Oct. 2021.
18.
P. Yao et al., "Single model deep learning on imbalanced small datasets for skin lesion classification", IEEE Trans. Med. Imag., vol. 41, no. 5, pp. 1242-1254, Dec. 2021.
19.
L. Liu, C. Guo, Y. Xiang, Y. Tu, L. Wang and F.-Z. Xuan, "A semisupervised learning framework for recognition and classification of defects in transient thermography detection", IEEE Trans. Ind. Informat., vol. 18, no. 4, pp. 2632-2640, Apr. 2022.
20.
B.-S. Lin, J.-S. Cheng, H.-C. Liao, L.-W. Yang, T. Yang and K.-C. Chen, "Improvement of multi-lines bridge defect classification by hierarchical architecture in artificial intelligence automatic defect classification", IEEE Trans. Semicond. Manuf., vol. 34, no. 3, pp. 346-351, Aug. 2021.
21.
K. Song and Y. Yan, "A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects", Appl. Surf. Sci., vol. 285, no. 21, pp. 858-864, Nov. 2013.
22.
L. Cui, X. Jiang, M. Xu, W. Li, P. Lv and B. Zhou, "SDDNet: A fast and accurate network for surface defect detection", IEEE Trans. Instrum. Meas., vol. 70, pp. 1-13, 2021.
23.
Y. Cai, L. Dai, H. Wang, L. Chen and Y. Li, "DLnet with training task conversion stream for precise semantic segmentation in actual traffic scene", IEEE Trans. Neural Netw. Learn. Syst., vol. 33, no. 11, pp. 6443-6457, Nov. 2022.
24.
D. Tabernik, S. Šela, J. Skvarč and D. Skocaj, "Segmentation-based deep-learning approach for surface-defect detection", J. Intell. Manuf., vol. 31, no. 3, pp. 759-776, Jun. 2019.
25.
M. Niu, K. Song, L. Huang, Q. Wang, Y. Yan and Q. Meng, "Unsupervised saliency detection of rail surface defects using stereoscopic images", IEEE Trans. Industr. Inform., vol. 17, no. 3, pp. 2271-2281, 2020.
26.
R. Hamaguchi, A. Fujita, K. Nemoto, T. Imaizumi and S. Hikosaka, "Effective use of dilated convolutions for segmenting small object instances in remote sensing imagery", Proc. IEEE Winter Conf. Appl. Comput. Vis. (WACV), pp. 1442-1450, Mar. 2018.
27.
X. Zhang, X. Zhou, M. Lin and J. Sun, "ShuffleNet: An extremely efficient convolutional neural network for mobile devices", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., pp. 6848-6856, Jun. 2018.
28.
D. Xu, E. Ricci, W. Ouyang, X. Wang and N. Sebe, "Multi-scale continuous CRFs as sequential deep networks for monocular depth estimation", Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 5354-5362, Jul. 2017.
29.
T. Chowdhury and M. Rahnemoonfar, "Attention based semantic segmentation on UAV dataset for natural disaster damage assessment", Proc. IEEE Int. Geosci. Remote Sens. Symp. IGARSS, pp. 2325-2328, Jul. 2021.
30.
X. Li, W. Wang, X. Hu and J. Yang, "Selective kernel networks", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 510-519, Jun. 2019.
Contact IEEE to Subscribe

References

References is not available for this document.