Loading [MathJax]/extensions/MathMenu.js
WSAMF-Net: Wavelet Spatial Attention-Based MultiStream Feedback Network for Single Image Dehazing | IEEE Journals & Magazine | IEEE Xplore

WSAMF-Net: Wavelet Spatial Attention-Based MultiStream Feedback Network for Single Image Dehazing


Abstract:

Single image-based dehazing has achieved remarkable progress with the development of deep learning technologies. End-to-end neural networks have been proposed to learn a ...Show More

Abstract:

Single image-based dehazing has achieved remarkable progress with the development of deep learning technologies. End-to-end neural networks have been proposed to learn a direct hazy-to-clear image translation to recover the clear structures and edges cues from the hazy inputs. However, the frequency domain information is explored insufficiently and lots of intermediate structure and texture related cues of current dehazing networks are ignored, which limits the performances of current approaches. To handle these limitations mentioned above, a wavelet spatial attention based multi-stream feedback network (WSAMF-Net) is proposed for effective single image dehazing. Specifically, the proposed wavelet spatial attention utilizes both frequency-domain and spatial-domain information to enhance the extracted features for better structures and edges. Meanwhile, an enhanced multi-stream based cross feature fusion strategy, including vertical and horizontal attentions, is proposed to reweight and fuse the intermediate features of each stream to acquire more meaningful aggregated features, while the weight sharing strategy is used to achieve a good trade-off between performance and parameters. Besides, feedback mechanism is also designed to provide strong reconstruction ability. Furthermore, we propose a critical real-world industrial dataset (IDS) with images captured in real-world industrial quarry scenarios for research uses. Extensive experiments on various benchmarking datasets, including both synthetic and real-world datasets, demonstrate the superiority of our WSAMF-Net over state-of-the-art single image dehazing methods. The IDS dataset will be available at https://github.com/XBSong/IDS-Datasethttps://github.com/XBSong/IDS-Dataset.
Page(s): 575 - 588
Date of Publication: 15 September 2022

ISSN Information:

Funding Agency:

References is not available for this document.

I. Introduction

Foggy, hazy and dusty conditions commonly exist in real-world scenarios, and images captured in these conditions often suffer from severe degradation of contrast and visibility, which adversely affects the performance of subsequent high-level computer vision tasks, such as classification [40], [41], object tracking [12], [43], and object detection [18], [38]. Therefore, the task of image dehazing [1], [5], [12], [24], [36], [51] has received increasing research attentions. However, due to the severe information degradation of non-homogeneous propriety in haze images, it is a challenging ill-posed problem.

Select All
1.
S. C. Agrawal and A. S. Jalal, "Dense haze removal by nonlinear transformation", IEEE Trans. Circuits Syst. Video Technol., vol. 32, no. 2, pp. 593-607, Feb. 2021.
2.
C. O. Ancuti, C. Ancuti, M. Sbert and R. Timofte, "Dense-Haze: A benchmark for image dehazing with dense-haze and haze-free images", Proc. IEEE Int. Conf. Image Process. (ICIP), pp. 1014-1018, Sep. 2019.
3.
C. O. Ancuti, C. Ancuti and R. Timofte, "NH-HAZE: An image dehazing benchmark with non-homogeneous hazy and haze-free images", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. Workshops, pp. 444-445, Jun. 2020.
4.
C. O. Ancuti, C. Ancuti, R. Timofte, L. Van Gool, L. Zhang and M. H. Yang, "NTIRE 2019 image dehazing challenge report", Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops (CVPR), pp. 1-13, Jun. 2019.
5.
C. O. Ancuti, C. Ancuti, F. A. Vasluianu and R. Timofte, "NTIRE 2020 challenge on nonhomogeneous dehazing", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. Workshops, pp. 490-491, Jun. 2020.
6.
D. Berman, T. Treibitz and S. Avidan, "Non-local image dehazing", Proc. IEEE Conf. Comput. Vis. Pattern Recognit., pp. 1674-1682, Jun. 2016.
7.
B. Cai, X. Xu, K. Jia, C. Qing and D. Tao, "DehazeNet: An end-to-end system for single image haze removal", IEEE Trans. Image Process., vol. 25, no. 11, pp. 5187-5198, Nov. 2016.
8.
D. Chen et al., "Gated context aggregation network for image dehazing and deraining", Proc. IEEE Winter Conf. Appl. Comput. Vis. (WACV), pp. 1375-1383, Jan. 2019.
9.
Z. Chen, Y. Wang, Y. Yang and D. Liu, "PSD: Principled synthetic-to-real dehazing guided by physical priors", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 7180-7189, Jun. 2021.
10.
H. Dong et al., "Multi-scale boosted dehazing network with dense feature fusion", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., pp. 2157-2167, Jun. 2020.
11.
J. Dong and J. Pan, "Physics-based feature dehazing networks", Proc. Eur. Conf. Comput. Vis. (ECCV), pp. 188-204, 2020.
12.
H. Fan et al., "LaSOT: A high-quality benchmark for large-scale single object tracking", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., pp. 5374-5383, Jun. 2019.
13.
M. Fu, H. Liu, Y. Yu, J. Chen and K. Wang, "DW-GAN: A discrete wavelet transform GAN for nonhomogeneous dehazing", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., pp. 203-212, Jun. 2021.
14.
T. Guo, X. Li, V. Cherukuri and V. Monga, "Dense scene information estimation network for dehazing", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. Workshops, pp. 1-9, Jun. 2019.
15.
K. He, J. Sun and X. Tang, "Single image haze removal using dark channel prior", IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 12, pp. 2341-2353, Dec. 2011.
16.
T. He, Z. Zhang, H. Zhang, Z. Zhang, J. Xie and M. Li, "Bag of tricks for image classification with convolutional neural networks", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., pp. 558-567, Jun. 2019.
17.
M. Hong, Y. Xie, C. Li and Y. Qu, "Distilling image dehazing with heterogeneous task imitation", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., pp. 3462-3471, Jun. 2020.
18.
H. Hu, J. Gu, Z. Zhang, J. Dai and Y. Wei, "Relation networks for object detection", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., pp. 3588-3597, Jun. 2018.
19.
A. Kar, S. K. Dhara, D. Sen and P. K. Biswas, "Progressive update guided interdependent networks for single image dehazing", 2020.
20.
D. P. Kingma and J. Ba, "Adam: A method for stochastic optimization" in arXiv:1412.6980, 2014.
21.
B. Li, X. Peng, Z. Wang, J. Xu and D. Feng, "AOD-Net: All-in-one dehazing network", Proc. IEEE Int. Conf. Comput. Vis., pp. 4770-4778, Oct. 2017.
22.
B. Li, X. Peng, Z. Wang, J. Xu and D. Feng, "End-to-end united video dehazing and detection", Proc. AAAI Conf. Artif. Intell., vol. 32, pp. 1-8, 2018.
23.
B. Li et al., "Benchmarking single-image dehazing and beyond", IEEE Trans. Image Process., vol. 28, no. 1, pp. 492-505, Jan. 2019.
24.
Y. Li et al., "LAP-Net: Level-aware progressive network for image dehazing", Proc. IEEE/CVF Int. Conf. Comput. Vis., pp. 3276-3285, Oct. 2019.
25.
J. Liu, H. Wu, Y. Xie, Y. Qu and L. Ma, "Trident dehazing network", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. Workshops, pp. 430-431, Jun. 2020.
26.
R. Liu, S. Li, J. Liu, L. Ma, X. Fan and Z. Luo, "Learning Hadamard-product-propagation for image dehazing and beyond", IEEE Trans. Circuits Syst. Video Technol., vol. 31, no. 4, pp. 1366-1379, Apr. 2021.
27.
X. Liu, Y. Ma, Z. Shi and J. Chen, "GridDehazeNet: Attention-based multi-scale network for image dehazing", Proc. IEEE/CVF Int. Conf. Comput. Vis., pp. 7314-7323, Oct. 2019.
28.
Z. S. Liu, L. W. Wang, C. T. Li and W. C. Siu, "Image super-resolution via attention based back projection networks", Proc. IEEE Int. Conf. Comput. Vis. Workshop (ICCVW), pp. 3517-3525, Oct. 2019.
29.
S. G. Mallat, "A theory for multiresolution signal decomposition: The wavelet representation" in Fundamental Papers in Wavelet Theory, Princeton, NJ, USA:Princeton Univ. Press, pp. 494-513, 2009.
30.
Y. Pang, J. Nie, J. Xie, J. Han and X. Li, "BidNet: Binocular image dehazing without explicit disparity estimation", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 5931-5940, Jun. 2020.

Contact IEEE to Subscribe

References

References is not available for this document.