Loading [MathJax]/extensions/MathMenu.js
A Review of Super Resolution Based on Deep Learning | IEEE Conference Publication | IEEE Xplore

A Review of Super Resolution Based on Deep Learning


Abstract:

Super-resolution (SR) is the process of restoring a limited number of low-resolution (LR) images to high-resolution (HR) images. In recent years, with the vigorous develo...Show More

Abstract:

Super-resolution (SR) is the process of restoring a limited number of low-resolution (LR) images to high-resolution (HR) images. In recent years, with the vigorous development of deep learning in computer vision, its applications in image super resolution have also made significant progress. In this paper we aim to integrate and analyze the existing deep-learning based image super-resolution models, and show several models with the best performance. We divide the models into five main categories based on where the sampling is located in the different models. Then we analyze and compare the different networks architectures. We also list some tips which are effective in super-resolution networks. At the end of this paper, we analyze the existing problems of super-resolution based on deep learning and make an outlook on the future of super-resolution development.
Date of Conference: 09-12 December 2022
Date Added to IEEE Xplore: 20 March 2023
ISBN Information:
Conference Location: Chengdu, China

Funding Agency:

References is not available for this document.

I. Introduction

Image Resolution refers to the amount of information stored in a unit image, in another way, is the number of pixels per inch of the image. High-resolution images have more image details and textures. Therefore, the existing image super-resolution techniques are unified by increasing the number of pixels to display more details.

Select All
1.
L. Yue, H. Shen, J. Li, Q. Yuan, H. Zhang and L. Zhang, "Image super-resolution: The techniques applications and future", Signal Processing, vol. 128, pp. 389-408, 2016.
2.
F. Xiang and G. Baolong, "A survey of image interpolation techniques", Computer Engineering and Design, no. 1, pp. 141-144, 2009.
3.
C. Dong, C. C. Loy, K. He and X. Tang, "Learning a deep convolutional network for image super-resolution", European conference on computer vision, pp. 184-199, 2014.
4.
S. Park, J. Yoo, D. Cho, J. Kim and T. H. Kim, "Fast adaptation to super-resolution networks via meta-learning", European Conference on Computer Vision, pp. 754-769, 2020.
5.
H. Wu, J. Zhang and K. Huang, "Point cloud super resolution with adversarial residual graph networks", arXiv preprint, 2019.
6.
M. Isallari and I. Rekik, "Gsr-net: Graph super-resolution network for predicting high-resolution from low-resolution functional brain connectomes", International Workshop on Machine Learning in Medical Imaging, pp. 139-149, 2020.
7.
M. D. Zeiler, D. Krishnan, G. W. Taylor and R. Fergus, "Deconvolutional networks", 2010 IEEE Computer Society Conference on computer vision and pattern recognition, pp. 2528-2535, 2010.
8.
X. Mao, C. Shen and Y.-B. Yang, "Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections", Advances in neural information processing systems, vol. 29, pp. 2802-2810, 2016.
9.
M. Haris, G. Shakhnarovich and N. Ukita, "Deep back-projection networks for super-resolution", Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1664-1673, 2018.
10.
W. Shi, J. Caballero, F. Huszár, J. Totz, A. P. Aitken, R. Bishop, et al., "Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network", Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1874-1883, 2016.
11.
J. Qin, Y. Huang and W. Wen, "Multi-scale feature fusion residual network for single image super-resolution", Neurocomputing, vol. 379, pp. 334-342, 2020.
12.
Y. Guo, J. Chen, J. Wang, Q. Chen, J. Cao, Z. Deng, et al., "Closed-loop matters: Dual regression networks for single image super-resolution", Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 5407-5416, 2020.
13.
S. Y. Kim, H. Sim and M. Kim, "Koalanet: Blind super-resolution using kernel-oriented adaptive local adjustment", Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 10611-10620, 2021.
14.
A. Lugmayr, M. Danelljan, L. V. Gool and R. Timofte, "Srflow: Learning the super-resolution space with normalizing flow", European conference on computer vision, pp. 715-732, 2020.
15.
N. Ahn, B. Kang and K.-A. Sohn, "Fast accurate and lightweight super-resolution with cascading residual network", Proceedings of the European conference on computer vision (ECCV), pp. 252-268, 2018.
16.
Y. Tai, J. Yang and X. Liu, "Image super-resolution via deep recursive residual network", Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3147-3155, 2017.
17.
C. Ledig, L. Theis, F. Huszár, J. Caballero, A. Cunningham, A. Acosta, A. Aitken, A. Tejani, J. Totz, Z. Wang et al., "Photo-realistic single image super-resolution using a generative adversarial network", Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 4681-4690, 2017.
18.
Z.-S. Liu, L.-W. Wang, C.-T. Li and W.-C. Siu, "Hierarchical back projection network for image super-resolution", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2019.
19.
J. Liang, J. Cao, G. Sun, K. Zhang, L. Van Gool and R. Timofte, "Swinir: Image restoration using swin transformer", Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 1833-1844, 2021.
20.
W.-S. Lai, J.-B. Huang, N. Ahuja and M.-H. Yang, "Deep laplacian pyramid networks for fast and accurate super-resolution", Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 624-632, 2017.
21.
D. Park, K. Kim and S. Young Chun, "Efficient module based single image super resolution for multiple problems", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 882-890, 2018.
22.
X. Wang, K. C. Chan, K. Yu, C. Dong and C. Change Loy, "Edvr: Video restoration with enhanced deformable convolutional networks", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2019.
23.
M. Irani and S. Peleg, "Motion analysis for image enhancement: Resolution occlusion and transparency", Journal of visual communication and image representation, vol. 4, no. 4, pp. 324-335, 1993.
24.
S. Dai, M. Han, Y. Wu and Y. Gong, "Bilateral back-projection for single image super resolution", 2007 IEEE International Conference on Multimedia and Expo, pp. 1039-1042, 2007.
25.
Z.-S. Liu, L.-W. Wang, C.-T. Li, W.-C. Siu and Y.-L. Chan, "Image super-resolution via attention based back projection networks", 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), pp. 3517-3525, 2019.
26.
Z. Li, J. Yang, Z. Liu, X. Yang, G. Jeon and W. Wu, "Feedback network for image super-resolution", Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 3867-3876, 2019.
27.
R. Timofte, V. De Smet and L. Van Gool, "A+: Adjusted anchored neighborhood regression for fast super-resolution", Asian conference on computer vision, pp. 111-126, 2014.
28.
N. Schraudolph, "Accelerated gradient descent by factor-centering decomposition", Technical report/IDSIA, vol. 98, 1998.
29.
K. He, X. Zhang, S. Ren and J. Sun, "Deep residual learning for image recognition", Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770-778, 2016.
30.
K. He, X. Zhang, S. Ren and J. Sun, "Spatial pyramid pooling in deep convolutional networks for visual recognition", IEEE transactions on pattern analysis and machine intelligence, vol. 37, no. 9, pp. 1904-1916, 2015.
Contact IEEE to Subscribe

References

References is not available for this document.