Loading [MathJax]/extensions/MathMenu.js
A Two-branch Neural Network for Non-homogeneous Dehazing via Ensemble Learning | IEEE Conference Publication | IEEE Xplore

A Two-branch Neural Network for Non-homogeneous Dehazing via Ensemble Learning


Abstract:

Recently, there has been rapid and significant progress on image dehazing. Many deep learning based methods have shown their superb performance in handling homogeneous de...Show More

Abstract:

Recently, there has been rapid and significant progress on image dehazing. Many deep learning based methods have shown their superb performance in handling homogeneous dehazing problems. However, we observe that even if a carefully designed convolutional neural network (CNN) can perform well on large-scaled dehazing benchmarks, the network usually fails on the non-homogeneous dehazing datasets introduced by NTIRE challenges. The reasons are mainly in two folds. Firstly, due to its non-homogeneous nature, the non-uniformly distributed haze is harder to be removed than the homogeneous haze. Secondly, the research challenge only provides limited data (there are only 25 training pairs in NH-Haze 2021 dataset). Thus, learning the mapping from the domain of hazy images to that of clear ones based on very limited data is extremely hard. To this end, we propose a simple but effective approach for non-homogeneous dehazing via ensemble learning. To be specific, we introduce a two-branch neural network to separately deal with the aforementioned problems and then map their distinct features by a learnable fusion tail. We show extensive experimental results to illustrate the effectiveness of our proposed method. The source code is available at https://github.com/liuh127/Two-branch-dehazing.
Date of Conference: 19-25 June 2021
Date Added to IEEE Xplore: 01 September 2021
ISBN Information:

ISSN Information:

Conference Location: Nashville, TN, USA
References is not available for this document.

1. Introduction

Single image dehazing as a low-level vision task has gained widespread attention in recent years. In the natural atmosphere, there are smoke, dust, haze, and other atmospheric phenomena that affect visibility. Pictures taken in these environments are often affected by blurring, color distortion, and low contrast problems. Using these kinds of pictures for classification, image segmentation, and other high-level vision tasks significantly reduces prediction accuracy. Single image dehazing aims to restore a clean output image from a hazy input. Many dehazing methods [14, 23, 28, 30, 36, 38, 43, 44, 47] have been proposed.

Select All
1.
C. Ancuti, C. O. Ancuti, R. Timofte, L. Van Gool, L. Zhang, M. Yang, et al., "Ntire 2018 challenge on image dehazing: Methods and results", 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1004-100410, 2018.
2.
C. O. Ancuti, C. Ancuti, M. Sbert and R. Timofte, "Dense haze: A benchmark for image dehazing with dense-haze and haze-free images", IEEE International Conference on Image Processing (ICIP) IEEE ICIP 2019, 2019.
3.
C. O. Ancuti, C. Ancuti and R. Timofte, "NH-HAZE: an image dehazing benchmark with non-homogeneous hazy and haze-free images", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2020.
4.
C. O. Ancuti, C. Ancuti, R. Timofte and C. De Vleeschouwer, "O-haze: A dehazing benchmark with real hazy and haze-free outdoor images", 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 867-8678, 2018.
5.
C. O. Ancuti, C. Ancuti, R. Timofte, L. V. Gool, L. Zhang and M.-H. Yang, "Ntire 2019 image dehazing challenge report", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops IEEE CVPR 2019, 2019.
6.
C. O. Ancuti, C. Ancuti, R. Timofte, L. Van Gool, L. Zhang, M. Yang, et al., "Ntire 2019 image dehazing challenge report", 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 2241-2253, 2019.
7.
C. O. Ancuti, C. Ancuti, F.-A. Vasluianu and R. Timofte, "Ntire 2020 challenge on nonhomogeneous dehazing", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, June 2020.
8.
C. O. Ancuti, C. Ancuti, F.-A. Vasluianu, R. Timofte et al., "NTIRE 2020 challenge on nonhomogeneous dehazing", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops IEEE CVPR 2020, 2020.
9.
C. O. Ancuti, C. Ancuti, F.-A. Vasluianu, R. Timofte et al., "NTIRE 2021 nonhomogeneous dehazing challenge report", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2021.
10.
C. O. Ancuti, C. Ancuti, F.-A. Vasluianu, R. Timofte, J. Liu, H. Wu, et al., Ntire 2020 challenge on nonhomogeneous dehazing, 2020.
11.
B. O. Ayinde, T. Inanc and J.M. Zurada, "Regularizing deep neural networks by enhancing diversity in feature extraction", IEEE Transactions on Neural Networks and Learning Systems, vol. 30, no. 9, pp. 2650-2661, 2019.
12.
D. Berman, S. Avidan et al., "Non-local image dehazing", Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1674-1682, 2016.
13.
G. Brown, "Ensemble learning", Encyclopedia of machine learning, vol. 312, pp. 15-19, 2010.
14.
B. Cai, X. Xu, K. Jia, C. Qing and D. Tao, "Dehazenet: An end-to-end system for single image haze removal", IEEE Transactions on Image Processing, vol. 25, no. 11, pp. 5187-5198, 2016.
15.
D. Chen, M. He, Q. Fan, J. Liao, L. Zhang, D. Hou, et al., "Gated context aggregation network for image dehazing and deraining", 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1375-1383, 2019.
16.
J. Deng, W. Dong, R. Socher, L. Li, Kai Li and Li Fei-Fei, "Imagenet: A large-scale hierarchical image database", 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248-255, 2009.
17.
Q. Deng, Z. Huang, C.-C. Tsai and C.-W. Lin, "Hardgan: A haze-aware representation distillation gan for single image dehazing", European Conference on Computer Vision, pp. 722-738, 2020.
18.
T. G. Dietterich et al., "Ensemble learning", The handbook of brain theory and neural networks, vol. 2, pp. 110-125, 2002.
19.
R. Fattal, "Dehazing using color-lines", ACM transactions on graphics (TOG), vol. 34, no. 1, pp. 1-14, 2014.
20.
S. Gao, M.-M. Cheng, K. Zhao, X.-Y. Zhang, M.-H. Yang and P. H. Torr, "Res2net: A new multi-scale backbone architecture", IEEE transactions on pattern analysis and machine intelligence, 2019.
21.
R. Girshick, "Fast r-cnn", Proceedings of the IEEE International Conference on Computer Vision (ICCV), December 2015.
22.
K. He, R. Girshick and P. Dollár, "Rethinking imagenet pre-training", Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 4918-4927, 2019.
23.
K. He, J. Sun and X. Tang, "Single image haze removal using dark channel prior", IEEE transactions on pattern analysis and machine intelligence, vol. 33, no. 12, pp. 2341-2353, 2010.
24.
R. Jacobs, M. Jordan, S. Nowlan and G. Hinton, "Adaptive mixtures of local experts neural computation", Google Scholar Google Scholar Digital Library Digital Library, vol. 3, pp. 79-87, 1991.
25.
S. Kornblith, J. Shlens and Q.V. Le, "Do better imagenet models transfer better?", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2019.
26.
Y. LeCun, Y. Bengio and G. Hinton, "Deep learning", nature, vol. 521, no. 7553, pp. 436-444, 2015.
27.
C. Ledig, L. Theis, F. Huszár, J. Caballero, A. Cunningham, A. Acosta, A. Aitken, A. Tejani, J. Totz, Z. Wang et al., "Photo-realistic single image super-resolution using a generative adversarial network", Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4681-4690, 2017.
28.
B. Li, X. Peng, Z. Wang, J. Xu and D. Feng, "Aod-net: All-in-one dehazing network", Proceedings of the IEEE international conference on computer vision, pp. 4770-4778, 2017.
29.
B. Li, W. Ren, D. Fu, D. Tao, D. Feng, W. Zeng, et al., "Benchmarking single-image dehazing and beyond", IEEE Transactions on Image Processing, vol. 28, no. 1, pp. 492-505, 2019.
30.
J. Liu, H. Wu, Y. Xie, Y. Qu and L. Ma, "Trident dehazing network", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, June 2020.

Contact IEEE to Subscribe

References

References is not available for this document.