Loading [MathJax]/extensions/MathZoom.js
Blind Image Super-Resolution: A Survey and Beyond | IEEE Journals & Magazine | IEEE Xplore

Blind Image Super-Resolution: A Survey and Beyond


Abstract:

Blind image super-resolution (SR), aiming to super-resolve low-resolution images with unknown degradation, has attracted increasing attention due to its significance in p...Show More

Abstract:

Blind image super-resolution (SR), aiming to super-resolve low-resolution images with unknown degradation, has attracted increasing attention due to its significance in promoting real-world applications. Many novel and effective solutions have been proposed recently, especially with powerful deep learning techniques. Despite years of efforts, it still remains as a challenging research problem. This paper serves as a systematic review on recent progress in blind image SR, and proposes a taxonomy to categorize existing methods into three different classes according to their ways of degradation modelling and the data used to solve the SR model. This taxonomy helps summarize and distinguish among existing methods. We hope to provide insights into current research states, as well as revealing novel research directions worth exploring. In addition, we make a summary on commonly used datasets and previous competitions related to blind image SR. Last but not least, a comparison among different methods is provided with detailed analysis on their merits and demerits using both synthetic and real testing images.
Page(s): 5461 - 5480
Date of Publication: 30 August 2022

ISSN Information:

PubMed ID: 36040934

1 Introduction

Single-image super-resolution (SISR) has long been a fundamental problem in low-level vision, aiming to recover a high-resolution (HR) image from an observed low-resolution (LR) input. Years of efforts from the research community have brought about remarkable progress in this field, especially with the booming deep learning techniques [1], [2], [3], [4], [5]. However, most existing methods assume a pre-defined degradation process (e.g., bicubic downsampling) from an HR image to an LR one, which can hardly hold true for real-world images with complex degradation types. Towards filling this gap, growing attention has been paid in recent years to approaches for unknown degradations, namely blind SR. Despite many exciting improvements, these proposed methods tend to fail in many real-world scenarios, as their performance is usually limited to certain kinds of inputs and will drop dramatically in other cases. The main reason is that they still make some assumptions on the degradation types related to the input LR. Readers can see Fig. 1a for an illustration, which shows four different LR inputs with assumed degradation types of some state-of-the-art methods but targeting at the same HR. Therefore, when given an arbitrary input deviating from their assumed data distributions, these methods inevitably produce much less pleasing results. Fig. 1b demonstrates different SR results for a real-world image cropped from the famous film Forrest Gump, which are generated by four state-of-the-art methods. We may find none of these methods have lived up to our expectation for a good viewing experience, since this real-world image does not strictly follow their assumptions on inputs. In fact, it is not rare that we feel confused about which method to choose for a certain image at hand, or whether we could possibly reach a high-quality result using existing methods.

Contact IEEE to Subscribe

References

References is not available for this document.