Loading [MathJax]/extensions/MathZoom.js
AIM 2019 Challenge on Video Extreme Super-Resolution: Methods and Results | IEEE Conference Publication | IEEE Xplore

AIM 2019 Challenge on Video Extreme Super-Resolution: Methods and Results


Abstract:

This paper reviews the extreme video super-resolution challenge from the AIM 2019 workshop, with emphasis on submitted solutions and results. Video extreme super-resoluti...Show More

Abstract:

This paper reviews the extreme video super-resolution challenge from the AIM 2019 workshop, with emphasis on submitted solutions and results. Video extreme super-resolution x16 is a highly challenging problem, because 256 pixels need to be estimated for each single pixel in the low-resolution (LR) input. Contrary to single image super-resolution (SISR), video provides temporal information, which can be additionally leveraged to restore the heavily downscaled videos and is imperative for any video super-resolution (VSR) method. The challenge is composed of two tracks, to find the best performing method for fully supervised VSR (track 1) and to find the solution which generates the perceptually best looking outputs (track 2). A new video dataset, called Vid3oC, is introduced together with the challenge.
Date of Conference: 27-28 October 2019
Date Added to IEEE Xplore: 05 March 2020
ISBN Information:

ISSN Information:

Conference Location: Seoul, Korea (South)
Citations are not available for this document.

1. Introduction

VSR describes the task of reconstructing the high-resolution (HR) video from its LR representation. Super-resolution is an ill-posed problem, as high-frequency information is inherently lost when downscaling an image or video, because of the lower Nyquist frequency in LR space. SISR methods usually restore this information by learning image priors through paired examples. For VSR, additional information is present in the temporal domain, which can help significantly improving restoration quality over SISR methods. SISR has been an active research for a long time [6], [18], [23], [25], [11], [34], [37], [32], while VSR has gained traction in recent years [30], [15], [33], [16], [7], [2], [40], [36], [31], [17], also due to the availability of more and faster computing resources. While there exists a lot of prior work on super-resolution factors x2, x3 and x4 with impressive results, attempts at higher factors are less common in the field [22]. Restoring such a large amount of pixels from severly limited information is a very challenging task. The aim of this challenge is therefore to find out, if super-resolution with such high downscaling ratios is still possible with acceptable performance. Two tracks are provided in this challenge. Track 1 is set up for fully supervised example-based VSR. The restoration quality is evaluated with the most prominent metrics in the field, Peak Signal-to-Noise Ratio (PSNR) and structural similarity index (SSIM). Because PSNR and SSIM are not always well correlated with human perception of quality, track 2 is aimed at judging the outputs according to how humans perceive quality. Track 2 is also example-based, however, the final scores are determined by a mean opinion score (MOS).

Cites in Papers - |

Cites in Papers - IEEE (3)

Select All
1.
Dario Fuoli, Martin Danelljan, Radu Timofte, Luc Van Gool, "Fast Online Video Super-Resolution with Deformable Attention Pyramid", 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp.1735-1744, 2023.
2.
Sohyeong Kim, Guanju Li, Dario Fuoli, Martin Danelljan, Zhiwu Huang, Shuhang Gu, Radu Timofte, "The Vid3oC and IntVID Datasets for Video Super Resolution and Quality Mapping", 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), pp.3609-3616, 2019.
3.
Dario Fuoli, Shuhang Gu, Radu Timofte, "Efficient Video Super-Resolution through Recurrent Latent Space Propagation", 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), pp.3476-3485, 2019.

Cites in Papers - Other Publishers (4)

1.
Dario Fuoli, Zhiwu Huang, Danda Pani Paudel, Luc Van Gool, Radu Timofte, "An Efficient Recurrent Adversarial Framework for Unsupervised Real-Time Video Enhancement", International Journal of Computer Vision, 2023.
2.
Hongying Liu, Zhubo Ruan, Peng Zhao, Chao Dong, Fanhua Shang, Yuanyuan Liu, Linlin Yang, Radu Timofte, "Video super-resolution based on deep learning: a comprehensive survey", Artificial Intelligence Review, vol.55, no.8, pp.5981, 2022.
3.
Xuan Xu, Xin Xiong, Jinge Wang, Xin Li, "Deformable Kernel Convolutional Network for Video Extreme Super-Resolution", Computer Vision ? ECCV 2020 Workshops, vol.12538, pp.82, 2020.
4.
Dario Fuoli, Zhiwu Huang, Shuhang Gu, Radu Timofte, Arnau Raventos, Aryan Esfandiari, Salah Karout, Xuan Xu, Xin Li, Xin Xiong, Jinge Wang, Pablo Navarrete Michelini, Wenhao Zhang, Dongyang Zhang, Hanwei Zhu, Dan Xia, Haoyu Chen, Jinjin Gu, Zhi Zhang, Tongtong Zhao, Shanshan Zhao, Kazutoshi Akita, Norimichi Ukita, P. S. Hrishikesh, Densen Puthussery, C. V. Jiji, "AIM 2020 Challenge on Video Extreme Super-Resolution: Methods and Results", Computer Vision – ECCV 2020 Workshops, vol.12538, pp.57, 2020.
Contact IEEE to Subscribe

References

References is not available for this document.