DTKD-Net: Dual-Teacher Knowledge Distillation Lightweight Network for Water-Related Optics Image Enhancement | IEEE Journals & Magazine | IEEE Xplore

DTKD-Net: Dual-Teacher Knowledge Distillation Lightweight Network for Water-Related Optics Image Enhancement


Abstract:

Water-related optics images are often degraded by absorption and scattering effects. Current underwater image enhancement (UIE) methods improve image quality but neglect ...Show More

Abstract:

Water-related optics images are often degraded by absorption and scattering effects. Current underwater image enhancement (UIE) methods improve image quality but neglect the constraints of underwater imaging environments. To address this issue, we propose a double-teacher knowledge distilling network (DTKD-Net), which uses a dynamic teaching strategy within a dual-teacher framework to enhance knowledge distillation (KD), improving the student network’s ability to capture complex underwater features. Specifically, DTKD-Net focuses on clear-to-clear and blurry-to-clear image learning to enhance underwater images. It aims to preserve details in clear images and restore blurred ones. The dual-teacher network uses an intermediate layer with the middle layer of the student network to compute feature differences for feature guidance. The network uses a dynamic strategy where a Teacher-Sub stops guidance when its output matches the student’s, which helps with contrastive learning and improves the network’s ability to handle complex underwater scenes. Extensive experiments and visual comparisons show that DTKD-Net reduces the model size, demonstrating superior efficiency and effectiveness in enhancing underwater images.
Article Sequence Number: 4207213
Date of Publication: 03 July 2024

ISSN Information:

Funding Agency:

References is not available for this document.

I. Introduction

Water-related optical imaging plays a crucial role in the exploration and utilization of marine resources [1], [2], [3]. These images contain rich marine information fundamental for exploring, developing, and protecting marine resources [4], [5], [6]. However, the unique conditions of underwater environments, such as light attenuation and water turbidity, often severely affect the clarity and quality of images, limiting our ability to observe and recognize important information, such as seabed structures, ecological distribution, and biological communities [7]. To address this challenge, researchers are focusing on underwater image enhancement (UIE) technologies. UIE methods significantly improve image quality and deepen our understanding of the marine environment, promoting the full utilization and effective protection of marine resources [8], [9]. The study of UIE holds significant academic value and broad application prospects, making it an important area of research from both theoretical and practical perspectives.

Select All
1.
X. Li, "Water-related optics", Scientia Sinica Informationis, vol. 52, no. 2, pp. 227, 2024.
2.
X. Li, "Water-related vision", Acta Electronica Sinica, vol. 52, no. 3, pp. 1-43, 2024.
3.
J. Yuan, Z. Cai and W. Cao, "TEBCF: Real-world underwater image texture enhancement model based on blurriness and color fusion", IEEE Trans. Geosci. Remote Sens., vol. 60, 2022.
4.
J. Yuan, W. Cao, Z. Cai and B. Su, "An underwater image vision enhancement algorithm based on contour bougie morphology", IEEE Trans. Geosci. Remote Sens., vol. 59, no. 10, pp. 8117-8128, Oct. 2021.
5.
M. Yu, L. Shen, Z. Wang and X. Hua, "Task-friendly underwater image enhancement for machine vision applications", IEEE Trans. Geosci. Remote Sens., vol. 62, 2024.
6.
M. Li, Y. Lin, L. Shen, Z. Wang, K. Wang and Z. Wang, "Human perceptual quality driven underwater image enhancement framework", IEEE Trans. Geosci. Remote Sens., vol. 60, 2022.
7.
J. Zhou, Q. Gai, D. Zhang, K.-M. Lam, W. Zhang and X. Fu, "IACC: Cross-illumination awareness and color correction for underwater images under mixed natural and artificial lighting", IEEE Trans. Geosci. Remote Sens., vol. 62, 2024.
8.
K. Li et al., "Learning scribbles for dense depth: Weakly-supervised single underwater image depth estimation boosted by multi-task learning", IEEE Trans. Geosci. Remote Sens., vol. 62, Jan. 2024.
9.
J. Zhou et al., "UGIF-Net: An efficient fully guided information flow network for underwater image enhancement", IEEE Trans. Geosci. Remote Sens., vol. 61, Jul. 2023.
10.
J. Korhonen and J. You, "Peak signal-to-noise ratio revisited: Is simple beautiful?", Proc. 4th Int. Workshop Quality Multimedia Exper., pp. 37-38, Jul. 2012.
11.
W. Zhou, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity", IEEE Trans. Image Process., vol. 13, pp. 600-612, 2004.
12.
G. Hou, N. Li, P. Zhuang, K. Li, H. Sun and C. Li, "Non-uniform illumination underwater image restoration via illumination channel sparsity prior", IEEE Trans. Circuits Syst. Video Technol., vol. 34, no. 2, pp. 799-814, Feb. 2023.
13.
P. Zhuang, J. Wu, F. Porikli and C. Li, "Underwater image enhancement with hyper-Laplacian reflectance priors", IEEE Trans. Image Process., vol. 31, pp. 5442-5455, 2022.
14.
J. Zhou, Q. Liu, Q. Jiang, W. Ren, K.-M. Lam and W. Zhang, "Underwater camera: Improving visual perception via adaptive dark pixel prior and color correction", Int. J. Comput. Vis., vol. 2023, pp. 1-19, Aug. 2023.
15.
J. Zhou, L. Pang, D. Zhang and W. Zhang, "Underwater image enhancement method via multi-interval subhistogram perspective equalization", IEEE J. Ocean. Eng., vol. 48, no. 2, pp. 474-488, Apr. 2023.
16.
M. Li, K. Wang, L. Shen, Y. Lin, Z. Wang and Q. Zhao, "UIALN: Enhancement for underwater image with artificial light", IEEE Trans. Circuits Syst. Video Technol., vol. 33, no. 8, pp. 3622-3637, Aug. 2023.
17.
Z. Wang, L. Shen, M. Xu, M. Yu, K. Wang and Y. Lin, "Domain adaptation for underwater image enhancement", IEEE Trans. Image Process., vol. 32, pp. 1442-1457, 2023.
18.
R. Zhang, L. Xu, Z. Yu, Y. Shi, C. Mu and M. Xu, "Deep-IRTarget: An automatic target detector in infrared imagery using dual-domain feature extraction and allocation", IEEE Trans. Multimedia, vol. 24, pp. 1735-1749, 2022.
19.
R. Zhang et al., "Cognition-driven structural prior for instance-dependent label transition matrix estimation", IEEE Trans. Neural Netw. Learn. Syst., Jan. 2024.
20.
R. Zhang et al., "Part-aware correlation networks for few-shot learning", IEEE Trans. Multimedia, 2024.
21.
R. Zhang, S. Yang, Q. Zhang, L. Xu, Y. He and F. Zhang, "Graph-based few-shot learning with transformed feature propagation and optimal class allocation", Neurocomputing, vol. 470, pp. 247-256, Jan. 2022.
22.
P. Zhuang, C. Li and J. Wu, "Bayesian retinex underwater image enhancement", Eng. Appl. Artif. Intell., vol. 101, May 2021.
23.
J. Zhou, D. Zhang and W. Zhang, "Underwater image enhancement method via multi-feature prior fusion", Appl. Intell., vol. 52, no. 14, pp. 16435-16457, Mar. 2022.
24.
Y.-T. Peng and P. C. Cosman, "Underwater image restoration based on image blurriness and light absorption", IEEE Trans. Image Process., vol. 26, no. 4, pp. 1579-1594, Apr. 2017.
25.
W. Song, Y. Wang, D. Huang, A. Liotta and C. Perra, "Enhancement of underwater images with statistical model of background light and optimization of transmission map", IEEE Trans. Broadcast., vol. 66, no. 1, pp. 153-169, Mar. 2020.
26.
J. Zhou, T. Yang, W. Chu and W. Zhang, "Underwater image restoration via backscatter pixel prior and color compensation", Eng. Appl. Artif. Intell., vol. 111, May 2022.
27.
C. Li, J. Guo and C. Guo, "Emerging from water: Underwater image color correction based on weakly supervised color transfer", IEEE Signal Process. Lett., vol. 25, no. 3, pp. 323-327, Mar. 2018.
28.
A. Naik, A. Swarnakar and K. Mittal, "Shallow-UWnet: Compressed model for underwater image enhancement (student abstract)", Proc. AAAI Conf. Artif. Intell., pp. 15853-15854, Sep. 2022.
29.
K. Hu, C. Weng, Y. Zhang, J. Jin and Q. Xia, "An overview of underwater vision enhancement: From traditional methods to recent deep learning", J. Mar. Sci. Eng., vol. 10, no. 2, pp. 241, Feb. 2022.
30.
C. Li, S. Anwar, J. Hou, R. Cong, C. Guo and W. Ren, "Underwater image enhancement via medium transmission-guided multi-color space embedding", IEEE Trans. Image Process., vol. 30, pp. 4985-5000, 2021.

Contact IEEE to Subscribe

References

References is not available for this document.