Loading [MathJax]/extensions/MathMenu.js
SDCNet:Spatially-Adaptive Deformable Convolution Networks for HR NonHomogeneous Dehazing | IEEE Conference Publication | IEEE Xplore

SDCNet:Spatially-Adaptive Deformable Convolution Networks for HR NonHomogeneous Dehazing


Abstract:

In recent years, the field of image dehazing has garnered increasing attention. Many deep learning models have demonstrated exceptional capabilities in removing homogeneo...Show More

Abstract:

In recent years, the field of image dehazing has garnered increasing attention. Many deep learning models have demonstrated exceptional capabilities in removing homogeneous haze, yet they often perform suboptimally when faced with the challenge of non-homogeneous dehazing. One of the primary issues is that these models are trained under conditions of homogeneous haze, which does not align with the characteristics of real-world haze scenarios. non-homogeneous haze typically leads to structural distortion and color shifts in images. Another contributing factor is the limited scale of datasets available for non-homogeneous dehazing, which hampers the training of robust models. To address these challenges, we have designed a Spatially-Adaptive Deformable Convolution Networks (SDCNet). The first branch of our model incorporates a high-level prior model that serves as an encoder for extracting high-level features from the image. The second branch is composed of a lightweight network specifically tailored to extract low-level features from hazy images. Our model fuses the information from both branches and combines progressive training as well as dynamic data augmentation strategies to obtain visually pleasing dehaze results. Extensive ablation studies have been conducted, substantiating the effectiveness and feasibility of our proposed methodology. Furthermore, in the NTIRE 2024 Dense and NonHomogeneous Dehazing Challenge, we achieved the best performance in terms of PSNR, SSIM, and MOS.
Date of Conference: 17-18 June 2024
Date Added to IEEE Xplore: 27 September 2024
ISBN Information:

ISSN Information:

Conference Location: Seattle, WA, USA
References is not available for this document.

1. Introduction

Our results on the NTIRE 2024 Dense and NonHomogeneous Dehazing Challenge, achieving the best performance in terms of

Select All
1.
Codruta O. Ancuti, Cosmin Ancuti, Florin-Alexandru Vasluianu, Radu Timofte, Jing Liu, Wu et al., "Ntire 2020 challenge on nonhomogeneous dehazing", 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 2029-2044, 2020.
2.
Codruta O. Ancuti, Cosmin Ancuti, Florin-Alexandru Vasluianu, Radu Timofte, Minghan Fu, Liu et al., "Ntire 2021 nonhomogeneous dehazing challenge report", 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 627-646, 2021.
3.
Codruta O. Ancuti, Cosmin Ancuti, Florin-Alexandru Vasluianu, Radu Timofte, Han Zhou, Wei Dong, Yangyi Liu, Jun Chen, Yangyi Liu, Huan Liu, Li et al., "Ntire 2023 hr non-homogeneous dehazing challenge report", 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1808-1825, 2023.
4.
Codruta O. Ancuti, Cosmin Ancuti, Florin-Alexandru Vasluianu, Radu Timofte, Han Zhou, Wei Dong, Yangyi Liu, Jun Chen, Yangyi Liu, Huan Liu, Li et al., "Ntire 2024 dense and nonhomogeneous dehazing challenge report", 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2024.
5.
Bolun Cai, Xiangmin Xu, Kui Jia, Chunmei Qing and Dacheng Tao, "Dehazenet: An end-to-end system for single image haze removal", IEEE Transactions on Image Processing, vol. 25, no. 11, pp. 5187-5198, 2016.
6.
Xiaohan Ding, Yiyuan Zhang, Yixiao Ge, Sijie Zhao, Lin Song, Xiangyu Yue, et al., Unireplknet: A universal perception large-kernel convnet for audio video point cloud time-series and image recognition, 2024.
7.
Minghan Fu, Huan Liu, Yankun Yu, Jun Chen and Keyan Wang, "Dw-gan: A discrete wavelet transform gan for non-homogeneous dehazing", 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 203-212, 2021.
8.
Kaiming He, Jian Sun and Xiaoou Tang, "Single image haze removal using dark channel prior", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 12, pp. 2341-2353, 2010.
9.
Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, et al., Segment anything, 2023.
10.
Boyi Li, Xiulian Peng, Zhangyang Wang, Jizheng Xu and Dan Feng, "Aod-net: All-in-one dehazing network", Proceedings of the IEEE International Conference on Computer Vision, pp. 4770-4778, 2017.
11.
Dong Li, Jiaying Zhu, Menglu Wang, Jiawei Liu, Xueyang Fu and Zheng-Jun Zha, "Edge-aware regional message passing controller for image forgery localization", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 8222-8232, 2023.
12.
Huan Liu, Zijun Wu, Liangyan Li, Sadaf Salehkalaibar, Jun Chen and Keyan Wang, "Towards multi-domain single image dehazing via test-time training", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5831-5840, 2022.
13.
Jing Liu, Haiyan Wu, Yuan Xie, Yanyun Qu and Lizhuang Ma, "Trident dehazing network", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2020.
14.
Yangyi Liu, Huan Liu, Liangyan Li, Zijun Wu and Jun Chen, "A data-centric solution to nonhomogeneous dehazing via vision transformer", 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1406-1415, 2023.
15.
Yue Liu, Yunjie Tian, Yuzhong Zhao, Hongtian Yu, Lingxi Xie, Yaowei Wang, et al., Vmamba: Visual state space model, 2024.
16.
Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, et al., "Swin transformer: Hierarchical vision transformer using shifted windows", Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 10012-10022, 2021.
17.
Zhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer, Trevor Darrell and Saining Xie, "A convnet for the 2020s", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11976-11986, 2022.
18.
W. E. K. Middleton, Vision Through the Atmosphere, University of Toronto Press, 1952.
19.
He Mu, Hui Le, Bian Yikai, Ren Jian, Xie Jin and Yang Jian, "Ra-depth: Resolution adaptive self-supervised monocular depth estimation", ECCV, 2022.
20.
Weiping Ni, Xinbo Gao and Ying Wang, "Single satellite image dehazing via linear intensity transformation and local property analysis", Neurocomputing, vol. 175, pp. 25-39, 2016.
21.
Sinno Jialin Pan and Qiang Yang, "A survey on transfer learning", IEEE Transactions on Knowledge and Data Engineering, vol. 22, no. 10, pp. 1345-1359, 2010.
22.
Wenqi Ren, Lin Ma, Jiawei Zhang, Jinshan Pan, Xiaochun Cao, Wei Liu, et al., "Gated fusion network for single image dehazing", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3253-3261, 2018.
23.
Vishwanath A. Sindagi, Pranav Oza, Ravi Yasarla and Vishal M. Patel, "Prior-based domain adaptive object detection for hazy and rainy conditions", European Conference on Computer Vision, pp. 763-780, 2020.
24.
Dilbag Singh and Vijay Kumar, "A comprehensive review of computational dehazing techniques", Archives of Computational Methods in Engineering, vol. 26, no. 5, pp. 1395-1413, 2019.
25.
Long Sun, Jiangxin Dong, Jinhui Tang and Jinshan Pan, "Spatially-adaptive feature modulation for efficient image super-resolution", 2023 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 13144-13153, 2023.
26.
Mingxing Tan and Quoc Le, "Efficientnetv2: Smaller models and faster training", Proceedings of the 38th International Conference on Machine Learning, pp. 10096-10106, 2021.
27.
Rui-Qi Wu, Zheng-Peng Duan, Chun-Le Guo, Zhi Chai and Chongyi Li, "Ridcp: Revitalizing real image dehazing via high-quality codebook priors", 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 22282-22291, 2023.
28.
Yuwen Xiong, Zhiqi Li, Yuntao Chen, Feng Wang, Xizhou Zhu, Jiapeng Luo, et al., Efficient deformable convnets: Rethinking dynamic and sparse operator for vision applications, 2024.
29.
Yuwen Xiong, Zhiqi Li, Yuntao Chen, Feng Wang, Xizhou Zhu, Jiapeng Luo, et al., "Efficient deformable convnets: Rethinking dynamic and sparse operator for vision applications", 2024.
30.
Lihe Yang, Bingyi Kang, Zilong Huang, Xiaogang Xu, Jiashi Feng and Hengshuang Zhao, "Depth anything: Unleashing the power of large-scale unlabeled data", CVPR, 2024.
Contact IEEE to Subscribe

References

References is not available for this document.