Loading [MathJax]/extensions/MathMenu.js
Benchmark of deep learning models for single image super-resolution (SISR) | IEEE Conference Publication | IEEE Xplore

Benchmark of deep learning models for single image super-resolution (SISR)


Abstract:

In this paper we present a study of deep learning models for single image super-resolution (SISR), through the some latest methods used in neural networks for super-resol...Show More

Abstract:

In this paper we present a study of deep learning models for single image super-resolution (SISR), through the some latest methods used in neural networks for super-resolution, exploring many methods used and proposed. Moreover, this paper presents a global and complete technical benchmark of state-of-the-art machine learning algorithms based on reference metrics (PSNR and SSIM) in the field of visualization and perception. This study involved 53 different neural networks tested on 7 datasets established as reference in the vision domain (Set5, Set14, BSD100, Urban100, DIV2K, Manga109, DIV8K). This work allows us to have a reference to demonstrate the performances and the limits of these algorithms as well as to orient future research in the field of super resolution images in order to develop efficient algorithms. The benchmark covered many neural network architectures (GAN, RNN and Residual Networks), using different techniques and distinct technologies.
Date of Conference: 03-04 March 2022
Date Added to IEEE Xplore: 25 March 2022
ISBN Information:
Conference Location: Meknes, Morocco
References is not available for this document.

I. Introduction

Benchmarking is a tool for analysis and decision making that allowed to measure the performance of existing and possible technical solutions. This methodological approach allows us in this article to orient the selection of existing super-resolution models, or to improve the architectures and techniques for the design and implementation of deep learning models to better achieve the objective of super-resolution of images. In this sense, we incorporate and adapt the best practices of the super-resolution domain based on deep learning methods, not by imitating existing architectures, but by exploring them and studying their technical and architectural constraints.

Select All
1.
"theorem and its effect on real-world machine learning classification", Neural Computation, vol. 28, no. 1, pp. 216-228, 2016.
2.
C.-Y. Yang, C. Ma and M.-H. Yang, "Single-Image Super-Resolution: A benchmark", Computer Vision - ECCV, pp. 372-386, 2014.
3.
W. Yang, X. Zhang, Y. Tian, W. Wang, J.-H. Xue and Q. Liao, "Deep Learning for Single Image Super-resolution: A brief review", IEEE Transactions on Multimedia, vol. 21, no. 12, pp. 3106-3121, 2019.
4.
Y. Blau, R. Mechrez, R. Timofte, T. Michaeli and L. Zelnik-Manor, "The 2018 Pirm Challenge on Perceptual Image Super-resolution", Lecture Notes in Computer Science, pp. 334-355, 2019.
5.
J. Cai, S. Gu, R. Timofte, L. Zhang, X. Liu et al., "NTIRE 2019 Challenge on Real Image Super-resolution: Methods and results", 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2019.
6.
R. Timofte, E. Agustsson, L. V. Gool, M.-H. Yang, L. Zhang et al., "NTIRE 2017 Challenge on Single Image Super-resolution: Methods and results", 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2017.
7.
R. Timofte, S. Gu, J. Wu, L. Van Gool, L. Zhang et al., "Ntire 2018 Challenge on Single Image Super-resolution: Methods and results", 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2018.
8.
W. Yang, X. Zhang, Y. Tian, W. Wang, J.-H. Xue and Q. Liao, "Deep Learning for Single Image Super-resolution: A brief review", IEEE Transactions on Multimedia, vol. 21, no. 12, pp. 3106-3121, 2019.
9.
M. F. Tappen and C. Liu, "A bayesian approach to alignment-based image hallucination", Computer Vision - ECCV 2012, pp. 236-249, 2012.
10.
C.-Y. Yang, S. Liu and M.-H. Yang, "Structured face hallucination", 2013 IEEE Conference on Computer Vision and Pattern Recognition, 2013.
11.
Libin Sun and J. Hays, "Super-resolution from internet-scale scene matching", 2012 IEEE International Conference on Computational Photography (ICCP), 2012.
12.
J. Kopfand and D. Lischinski, "Depixelizing pixel art", ACM SIGGRAPH 2011 papers on - SIGGRAPH ‘11, 2011.
13.
J. Yang, Z. Lin and S. Cohen, "Fast image super-resolution based on in-place example regression", 2013 IEEE Conference on Computer Vision and Pattern Recognition, 2013.
14.
C.-Y. Yang and M.-H. Yang, "Fast direct super-resolution by simple functions", 2013 IEEE International Conference on Computer Vision, 2013.
15.
K. He, X. Zhang, S. Ren and J. Sun, "Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification", Proceedings of the IEEE International Conference on Computer Vision, pp. 1026-1034, 2015.
16.
J.-B. Huang, A. Singh and N. Ahuja, "Single Image Super-resolution from transformed self-exemplars", 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
17.
S. Schulter, C. Leistner and H. Bischof, "Fast and accurate image upscaling with super-resolution forests", 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
18.
M. Haris, G. Shakhnarovich and N. Ukita, "Deep Back-Projection Networks For Single Image Super-Resolution", IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020.
19.
C. Ledig, L. Theis, F. Huszar, J. Caballero, A. Cunningham, A. Acosta, A. P. Aitken, A. Tejani, J. Totz, Z. Wang et al., "Photorealistic single image super-resolution using a generative adversarial network", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
20.
Y. Zhang, Y. Tian, Y. Kong, B. Zhong and Y. Fu, "Residual dense network for image super-resolution", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018.
21.
J. Johnson, A. Alahi and L. Fei-Fei, "Perceptual losses for real-time style transfer and Super-Resolution", Computer Vision - ECCV 2016, pp. 694-711, 2016.
22.
Mehdi SM Sajjadi, Bernhard Scholkopf and Michael Hirsch, "Enhancenet: Single image super-resolution through automated texture synthesis", ICCV, 2017.
23.
Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, et al., "Caffe", Proceedings of the 22nd ACM international conference on Multimedia, 2014.
24.
M. Abadi, P. Barham, J. Chen, Z. Chen, A. Davis, J. Dean, et al., "TensorFlow: A system for large-scale machine learning", OSDI, vol. 16, pp. 265-283, 2016.
25.
C. Shorten and T. M. Khoshgoftaar, "A survey on image data augmentation for Deep Learning", Journal of Big Data, vol. 6, no. 1, 2019.
26.
A. Hore and D. Ziou, "Image quality metrics: PSNR vs. SSIM", 2010 20th International Conference on Pattern Recognition, 2010.
27.
H. Marmolin, "Subjective MSE measures", IEEE Transactions on Systems Man and Cybernetics, vol. 16, no. 3, pp. 486-489, 1986.
28.
J. Yang, Z. Lin and S. Cohen, "Fast image super-resolution based on in-place example regression", 2013 IEEE Conference on Computer Vision and Pattern Recognition, 2013.
29.
R. Timofte, E. Agustsson, L. V. Gool, M.-H. Yang, L. Zhang et al., "NTIRE 2017 Challenge on Single Image Super-resolution: Methods and results", 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2017.
30.
S. Anwar and N. Barnes, "Densely residual laplacian super-resolution", IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1-1, 2020.
Contact IEEE to Subscribe

References

References is not available for this document.