Loading [MathJax]/extensions/MathMenu.js
The Ninth NTIRE 2024 Efficient Super-Resolution Challenge Report | IEEE Conference Publication | IEEE Xplore

The Ninth NTIRE 2024 Efficient Super-Resolution Challenge Report


Abstract:

This paper provides a comprehensive review of the NTIRE 2024 challenge, focusing on efficient single-image super-resolution (ESR) solutions and their outcomes. The task o...Show More

Abstract:

This paper provides a comprehensive review of the NTIRE 2024 challenge, focusing on efficient single-image super-resolution (ESR) solutions and their outcomes. The task of this challenge is to super-resolve an input image with a magnification factor of ×4 based on pairs of low and corresponding high-resolution images. The primary objective is to develop networks that optimize various aspects such as runtime, parameters, and FLOPs, while still maintaining a peak signal-to-noise ratio (PSNR) of approximately 26.90 dB on the DIV2K LSDIR valid dataset and 26.99 dB on the DIV2K LSDIR test dataset. In addition, this challenge has 4 tracks including the main track (overall performance), sub-track 1 (runtime), sub-track 2 (FLOPs), and sub-track 3 (parameters). In the main track, all three metrics (i.e., runtime, FLOPs, and parameter count) were considered. The ranking of the main track is calculated based on a weighted sum-up of the scores of all other sub-tracks. In sub-track 1, the practical runtime performance of the submissions was evaluated, and the corresponding score was used to determine the ranking. In sub-track 2, the number of FLOPs was considered. The score calculated based on the corresponding FLOPs was used to determine the ranking. In sub-track 3, the number of parameters was considered. The score calculated based on the corresponding parameters was used to determine the ranking. RLFN is set as the baseline for efficiency measurement. The challenge had 262 registered participants, and 34 teams made valid submissions. They gauge the state-of-the-art in efficient single-image super-resolution. To facilitate the reproducibility of the challenge and enable other researchers to build upon these findings, the code and the pre-trained model of validated solutions are made publicly available at https://github.com/Amazingren/NTIRE2024_ESR/.
Date of Conference: 17-18 June 2024
Date Added to IEEE Xplore: 27 September 2024
ISBN Information:

ISSN Information:

Conference Location: Seattle, WA, USA
References is not available for this document.

1. Introduction

Single image super-resolution (SR) aims at enhancing the resolution of low-resolution (LR) images to generate high-resolution (HR) counterparts. Typically, LR images are acquired through a degradation process that involves blurring and down-sampling. Among the models used to simulate this degradation in classical image SR, bicubic down-sampling stands out as widely adopted [45], [49], [63], [64]. Its prevalence as a benchmark enables the evaluation of different SR methods and facilitates direct comparisons between them, thereby validating the efficacy of novel SR methods.

Select All
1.
Eirikur Agustsson and Radu Timofte, "NTIRE 2017 challenge on single image super-resolution: Dataset and study", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 126-135, 2017.
2.
Hanadi Al-Mekhlafi and Shiguang Liu, "Single image super-resolution: a comprehensive review and recent insight", Frontiers of Computer Science, vol. 18, no. 1, pp. 181702, 2024.
3.
Cosmin Ancuti, Codruta O Ancuti, Florin-Alexandru Vasluianu, Radu Timofte et al., "NTIRE 2024 dense and non-homogeneous dehazing challenge report", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024.
4.
Nikola Banić, Egor Ershov, Artyom Panshin, Oleg Karasev, Sergey Korchagin, Shepelev Lev, Alexandr Startsev, Daniil Vladimirov, Ekaterina Zaychenkova, Dmitrii R Iarchuk, Maria Efimova, Radu Timofte, Arseniy Terekhin et al., "NTIRE 2024 challenge on night photography rendering", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024.
5.
Kartikeya Bhardwaj, Milos Milosavljevic, Liam O’Neil, Dibakar Gope, Ramon Matas, Alex Chalfin, et al., "Collapsible linear blocks for super-efficient super resolution", Proceedings of Machine Learning and Systems, vol. 4, pp. 529-547, 2022.
6.
Christopher M Bishop and Nasser M Nasrabadi, Pattern recognition and machine learning, Springer, 2006.
7.
Nicolas Chahine, Marcos V. Conde, Sira Ferradans, Radu Timofte et al., "Deep portrait quality assessment. a NTIRE 2024 challenge survey", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024.
8.
Jierun Chen, Shiu-hong Kao, Hao He, Weipeng Zhuo, Song Wen, Chul-Ho Lee, et al., "Run don’t walk: Chasing higher flops for faster neural networks", IEEE Conf. Comput. Vis. Pattern Recog, 2023.
9.
Jiadi Chen, Chunjiang Duanmu and Huanhuan Long, "Large kernel frequency-enhanced network for efficient single image super-resolution", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2024.
10.
Xiangyu Chen, Xintao Wang, Jiantao Zhou, Yu Qiao and Chao Dong, "Activating more pixels in image super-resolution transformer", Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 22367-22377, 2023.
11.
Yuantao Chen, Runlong Xia, Kai Yang and Ke Zou, "Mffn: image super-resolution via multi-level features fusion network", The Visual Computer, vol. 40, no. 2, pp. 489-504, 2024.
12.
Zheng Chen, Zongwei WU, Eduard Sebastian Zamfir, Kai Zhang, Yulun Zhang, Radu Timofte, Xiaokang Yang et al., "NTIRE 2024 challenge on image super-resolution (×4): Methods and results", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024.
13.
Sung-Jin Cho, Seo-Won Ji, Jun-Pyo Hong, Seung-Won Jung and Sung-Jea Ko, "Rethinking coarse-to-fine approach in single image deblurring", Proceedings of the IEEE/CVF international conference on computer vision, pp. 4641-4650, 2021.
14.
Haram Choi, Jeongmin Lee and Jihoon Yang, "N-gram in swin transformers for efficient lightweight image super-resolution", Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 2071-2081, 2023.
15.
Xiaojie Chu, Liangyu Chen, Chengpeng Chen and Xin Lu, "Improving image restoration by revisiting global information aggregation", Proceedings of European Conference on Computer Vision, pp. 53-71, 2022.
16.
Junyoung Chung, Çaglar Gülçehre, Kyunghyun Cho and Yoshua Bengio, "Empirical evaluation of gated recurrent neural networks on sequence modeling", 2014.
17.
Marcos V. Conde, Florin-Alexandru Vasluianu, Radu Timofte et al., "Deep raw image super-resolution. a NTIRE 2024 challenge survey", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024.
18.
Chaitra Desai, Nikhil Akalwadi, Amogh Joshi, Sampada Malagi, Chinmayee Mandi, Ramesh Ashok Tabib, et al., "Lightnet: Generative model for enhancement of low-light images", Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, pp. 2231-2240, 2023.
19.
Xiaohan Ding, Xiangyu Zhang, Jungong Han and Guiguang Ding, "Diverse branch block: Building a convolution as an inception-like unit", Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 10886-10895, 2021.
20.
Xiaohan Ding, Xiangyu Zhang, Ningning Ma, Jungong Han, Guiguang Ding and Jian Sun, "Repvgg: Making vgg-style convnets great again", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 13733-13742, 2021.
21.
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly et al., "An image is worth 16 × 16 words: Transformers for image recognition at scale", ICLR, 2021.
22.
Jie Du, Kai Guan, Yanhong Zhou, Yuanman Li and Tianfu Wang, "Parameter-free similarity-aware attention module for medical image classification and segmentation", IEEE Transactions on Emerging Topics in Computational Intelligence, 2022.
23.
Zongcai Du, Jie Liu, Jie Tang and Gangshan Wu, "Anchor-based plain net for mobile image super-resolution", Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 2494-2502, 2021.
24.
Zongcai Du, Ding Liu, Jie Liu, Jie Tang, Gangshan Wu and Lean Fu, "Fast and memory-efficient network towards efficient image super-resolution", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 853-862, 2022.
25.
Minghan Fu and Fang-Xiang Wu, "Qlabgrad: A hyperparameter-free and convergence-guaranteed scheme for deep learning", Proceedings of the AAAI Conference on Artificial Intelligence, pp. 12072-12081, 2024.
26.
Minghan Fu, Yanhua Duan, Zhaoping Cheng, Wenjian Qin, Ying Wang, Dong Liang, et al., "Total-body low-dose ct image denoising using a prior knowledge transfer technique with a contrastive regularization mechanism", Medical Physics, vol. 50, no. 5, pp. 2971-2984, 2023.
27.
Minghan Fu, Meiyun Wang, Yaping Wu, Na Zhang, Yongfeng Yang, Haining Wang, Yun Zhou, Yue Shang, Fang-Xiang Wu, Hairong Zheng et al., "A two-branch neural network for short-axis pet image quality enhancement", IEEE Journal of Biomedical and Health Informatics, 2023.
28.
Minghan Fu, Na Zhang, Zhenxing Huang, Chao Zhou, Xu Zhang, Jianmin Yuan, Qiang He, Yongfeng Yang, Hairong Zheng, Dong Liang et al., "Oif-net: An optical flow registration-based pet/mr cross-modal interactive fusion network for low-count brain pet image denoising", IEEE Transactions on Medical Imaging, 2023.
29.
Albert Gu and Tri Dao, "Mamba: Linear-time sequence modeling with selective state spaces", 2023.
30.
Zeyu Han, Fangrui Zhu, Qianru Lao and Huaizu Jiang, "Zero-shot referring expression comprehension via structural similarity between images and captions", 2023.
Contact IEEE to Subscribe

References

References is not available for this document.