Loading [MathJax]/extensions/MathMenu.js
DnM3Net: Multi-Scale & Multi-Level Shuffle-CNN Via Multi-Level Attention for Image Denoising | IEEE Conference Publication | IEEE Xplore

DnM3Net: Multi-Scale & Multi-Level Shuffle-CNN Via Multi-Level Attention for Image Denoising


Abstract:

Recently, based on novel convolutional neural net-work architectures proposed, tremendous advances have been achieved in image denoising task. An effective and efficient ...Show More

Abstract:

Recently, based on novel convolutional neural net-work architectures proposed, tremendous advances have been achieved in image denoising task. An effective and efficient multi-level network architecture for image denoising refers to restore the latent clean image from a coarser scale to finer scales and pass features through multiple levels of the model. Unfortunately, the bottleneck of applying multi-level network architecture lies in the multi-scale information from input images is not effectively captured and the fine-to-coarse feature fusion strategy to be ignored in image denoising task. To solve these problems, we propose a multi-scale & multi-level shuffle-CNN Via multi-level attention (DnM3Net), which plugs the multi-scale feature extraction, fine-to-coarse feature fusion strategy and multi-level attention module into the new network architecture in image denoising task. The advantage of this approach are two-fold: (1) It solve the multi-scale information extraction issue of multi-level network architecture, making it more effective and efficient for the image denoising task. (2) It is impressive performance because the better trade-off between denoising and detail preservation. The proposed novel network architecture is validated by applying on synthetic gaussian noise gray and RGB images. Experimental results show that the DnM3Net effectively improve the quantitative metrics and visual quality compared to the state-of-the-art denoising methods.
Date of Conference: 21-23 October 2019
Date Added to IEEE Xplore: 06 February 2020
ISBN Information:
Conference Location: Shenyang, China
References is not available for this document.

I. Introduction

Image denoising, which has been studied extensively in computer vision for decades of years, plays an important role in improving the visual quality of real noisy images. The real images are often noised during complicated image generation process due to the effect of many factors such as camera pipelines, capturing sensor and transmission media [1].

Select All
1.
Y. Tsin, V. Ramesh and T. Kanade, "Statistical calibration of ccd imaging process", Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, vol. 1, pp. 480-487, 2001.
2.
M. Maggioni, V. Katkovnik, K. Egiazarian and A. Foi, "Nonlocal transform-domain filter for volumetric data denoising and reconstruction", IEEE transactions on image processing, vol. 22, no. 1, pp. 119-133, 2012.
3.
A. Buades, B. Coll and J.-M. Morel, "A non-local algorithm for image denoising", 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 2, pp. 60-65, 2005.
4.
M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries", IEEE Transactions on Image processing, vol. 15, no. 12, pp. 3736-3745, 2006.
5.
S. Gu, L. Zhang, W. Zuo and X. Feng, "Weighted nuclear norm minimization with application to image denoising", Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2862-2869, 2014.
6.
F. Zhu, G. Chen and P.-A. Heng, "From noise modeling to blind image denoising", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 420-429, 2016.
7.
L. I. Rudin, S. Osher and E. Fatemi, "Nonlinear total variation based noise removal algorithms", Physica D: nonlinear phenomena, vol. 60, no. 1, pp. 259-268, 1992.
8.
K. Zhang, W. Zuo, Y. Chen, D. Meng and L. Zhang, "Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising", IEEE, vol. 26, no. 7, pp. 3142-3155, 2016.
9.
X. Mao, C. Shen and Y.-B. Yang, "Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections", Advances in neural information processing systems, pp. 2802-2810, 2016.
10.
K. Zhang, W. Zuo and L. Zhang, "Ffdnet: Toward a fast and flexible solution for cnn-based image denoising", IEEE Transactions on Image Processing, vol. 27, no. 9, pp. 4608-4622, 2018.
11.
W. Shi, J. Caballero, F. Huszar, J. Totz, A. P. Aitken, R. Bishop, et al., "Real-time single image and video superresolution using an efficient sub-pixel convolutional neural network", Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1874-1883, 2016.
12.
P. Liu, H. Zhang, K. Zhang, L. Lin and W. Zuo, "Multi-level waveletcnn for image restoration", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 773-782.
13.
O. Ronneberger, P. Fischer and T. Brox, "U-net: Convolutional networks for biomedical image segmentation", International Conference on Medical image computing and computer-assisted intervention, pp. 234-241, 2015.
14.
Q. Zhao, T. Sheng, Y. Wang, Z. Tang, Y. Chen, L. Cai, et al., "M2det: A single-shot object detector based on multi-level feature pyramid network", Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 9259-9266, 2019.
15.
B. Park, S. Yu and J. Jeong, "Densely connected hierarchical network for image denoising", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 0-0, 2019.
16.
S. Yu, B. Park and J. Jeong, "Deep iterative down-up cnn for image denoising", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 0-0, 2019.
17.
J. Cai, W. Zuo and L. Zhang, "Extreme channel prior embedded network for dynamic scene deblurring", arXiv preprint arXiv:1903.00763, 2019.
18.
C. Liu, Z. Shang and A. Qin, "A multiscale image denoising algorithm based on dilated residual convolution network", arXiv preprint arXiv:1812.09131, 2018.
19.
X. Zhang, H. Dong, Z. Hu, W.-S. Lai, F. Wang and M.-H. Yang, "Gated fusion network for joint image deblurring and super-resolution", arXiv preprint arXiv:1807.10806, 2018.
20.
W.-S. Lai, J.-B. Huang, N. Ahuja and M.-H. Yang, "Deep laplacian pyramid networks for fast and accurate super-resolution", Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 624-632, 2017.
21.
X. Fu, B. Liang, Y. Huang, X. Ding and J. Paisley, "Lightweight pyramid networks for image deraining", IEEE transactions on neural networks and learning systems, 2019.
22.
Y. Zhang, K. Li, K. Li, L. Wang, B. Zhong and Y. Fu, "Image super-resolution using very deep residual channel attention networks", Proceedings of the European Conference on Computer Vision (ECCV), pp. 286-301, 2018.
23.
S. Anwar and N. Barnes, "Real image denoising with feature attention", The IEEE International Conference on Computer Vision (ICCV), 2019.
24.
D. P. Kingma and J. Ba, "Adam: A method for stochastic optimization", Proceedings of the International Conference for Learning Representations, 2015.
25.
A. Paszke, S. Gross, S. Chintala and G. Chanan, Tensors and dynamic neural networks in python with strong gpu acceleration, 2017.
26.
D. Martin, C. Fowlkes, D. Tal, J. Malik et al., "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics", Proceedings of the IEEE Conference on International Conference Computer Vision, vol. 2, pp. 6416423, 2001.
27.
E. Agustsson and R. Timofte, "Ntire 2017 challenge on single image super-resolution: Dataset and study", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 126-135, 2017.
28.
K. Ma, Z. Duanmu, Q. Wu, Z. Wang, H. Yong, H. Li, et al., "Waterloo exploration database: New challenges for image quality assessment models", IEEE Transactions on Image Processing, vol. 26, no. 2, pp. 1004-1016, 2017.
29.
J.-B. Huang, A. Singh and N. Ahuja, "Single image super-resolution from transformed self-exemplars", IEEE Conference on Computer Vision and Pattern Recognition, 2015.
30.
K. Dabov, A. Foi, V. Katkovnik and K. Egiazarian, "Image restoration by sparse 3d transform-domain collaborative filtering", Image Processing: Algorithms and Systems VI, vol. 6812, pp. 681207, 2008.

Contact IEEE to Subscribe

References

References is not available for this document.