Loading web-font TeX/Math/Italic
Rank-One Prior: Real-Time Scene Recovery | IEEE Journals & Magazine | IEEE Xplore

Rank-One Prior: Real-Time Scene Recovery


Abstract:

Scene recovery is a fundamental imaging task with several practical applications, including video surveillance and autonomous vehicles, etc. In this article, we provide a...Show More

Abstract:

Scene recovery is a fundamental imaging task with several practical applications, including video surveillance and autonomous vehicles, etc. In this article, we provide a new real-time scene recovery framework to restore degraded images under different weather/imaging conditions, such as underwater, sand dust and haze. A degraded image can actually be seen as a superimposition of a clear image with the same color imaging environment (underwater, sand or haze, etc.). Mathematically, we can introduce a rank-one matrix to characterize this phenomenon, i.e., rank-one prior (ROP). Using the prior, a direct method with the complexity O(N) is derived for real-time recovery. For general cases, we develop ROP^+ to further improve the recovery performance. Comprehensive experiments of the scene recovery illustrate that our method outperforms competitively several state-of-the-art imaging methods in terms of efficiency and robustness.
Page(s): 8845 - 8860
Date of Publication: 02 December 2022

ISSN Information:

PubMed ID: 36459605

Funding Agency:

References is not available for this document.

1 Introduction

An image is worth a thousand words. However, an image or a video captured in a turbid medium provides insufficient and incorrect visual information. For instance, Fig. 1 shows five images captured in different turbid media, such as sand dust, underwater, and haze. These images suffering from severe contrast and color alteration or degradation increases the difficulty in many important computer vision tasks, including image classification [1], object detection [2], surveillance systems [3], and semantic segmentation [4]. Hence, correct scene recovery from degraded observation is an essential and fundamental step in computer vision.

Select All
1.
Y. Pei, Y. Huang, Q. Zou, X. Zhang and S. Wang, "Effects of image degradation and degradation removal to CNN-based image classification", IEEE Trans. Pattern Anal. Mach. Intell., vol. 43, no. 4, pp. 1239-1253, Apr. 2021.
2.
R. W. Liu, W. Yuan, X. Chen and Y. Lu, "An enhanced CNN-enabled learning method for promoting ship detection in maritime surveillance system", Ocean Eng., vol. 235, 2021.
3.
K. B. Gibson, D. T. Vo and T. Q. Nguyen, "An investigation of dehazing effects on image and video coding", IEEE Trans. Image Process., vol. 21, no. 2, pp. 662-673, Feb. 2012.
4.
W. Ren et al., "Deep video dehazing with semantic segmentation", IEEE Trans. Image Process., vol. 28, no. 4, pp. 1895-1908, Apr. 2019.
5.
K. He, J. Sun and X. Tang, "Single image haze removal using dark channel prior", IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 12, pp. 2341-2353, Dec. 2011.
6.
M. Sulami, I. Glatzer, R. Fattal and M. Werman, "Automatic recovery of the atmospheric light in hazy images", Proc. IEEE Int. Conf. Comput. Photography, pp. 1-11, 2014.
7.
F. Fang, F. Li and T. Zeng, "Single image dehazing and denoising: A fast variational approach", SIAM J. Imag. Sci., vol. 7, no. 2, pp. 969-996, 2014.
8.
X. Fu, Y. Huang, D. Zeng, X.-P. Zhang and X. Ding, "A fusion-based enhancing approach for single sandstorm image", Proc. IEEE 16th Int. Workshop Multimedia Signal Process., pp. 1-5, 2014.
9.
C. Li, S. Anwar and F. Porikli, "Underwater scene prior inspired deep underwater image and video enhancement", Pattern Recognit., vol. 98, 2020.
10.
Y. Y. Schechner and Y. Averbuch, "Regularized image recovery in scattering media", IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 9, pp. 1655-1660, Sep. 2007.
11.
Y.-T. Peng, K. Cao and P. C. Cosman, "Generalization of the dark channel prior for single image restoration", IEEE Trans. Image Process., vol. 27, no. 6, pp. 2856-2868, Jun. 2018.
12.
Y. Y. Schechner, S. G. Narasimhan and S. K. Nayar, "Instant dehazing of images using polarization", Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2001.
13.
D. Berman, T. Treibitz and S. Avidan, "Single image dehazing using haze-lines", IEEE Trans. Pattern Anal. Mach. Intell., vol. 42, no. 3, pp. 720-734, Mar. 2018.
14.
J. Liu, W. Liu, J. Sun and T. Zeng, "Rank-one prior: Toward real-time scene recovery", Proc. IEEE Conf. Comput. Vis. Pattern Recognit., pp. 14 802-14 810, 2021.
15.
A. Mittal, R. Soundararajan and A. C. Bovik, "Making a “completely blind", IEEE Signal Process. Lett., vol. 20, no. 3, pp. 209-212, Mar. 2013.
16.
N. Venkatanath, D. Praneeth, M. C. Bh, S. S. Channappayya and S. S. Medasani, "Blind image quality evaluation using perception based features", Proc. IEEE 21st Nat. Conf. Commun., pp. 1-6, 2015.
17.
Q. Shu, C. Wu, Z. Xiao and R. W. Liu, "Variational regularized transmission refinement for image dehazing", Proc. IEEE Int. Conf. Image Process., pp. 2781-2785, 2019.
18.
S. G. Narasimhan and S. K. Nayar, "Vision and the atmosphere", Int. J. Comput. Vis., vol. 48, no. 3, pp. 233-254, 2002.
19.
S. G. Narasimhan and S. K. Nayar, "Contrast restoration of weather degraded images", IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 6, pp. 713-724, Jun. 2003.
20.
R. Fattal, "Single image dehazing", ACM Trans. Graph., vol. 27, no. 3, pp. 1-9, 2008.
21.
R. T. Tan, "Visibility in bad weather from a single image", Proc. IEEE Conf. Comput. Vis. Pattern Recognit., pp. 1-8, 2008.
22.
F. Fang, T. Wang, Y. Wang, T. Zeng and G. Zhang, "Variational single image dehazing for enhanced visualization", IEEE Trans. Multimedia, vol. 22, no. 10, pp. 2537-2550, Oct. 2020.
23.
G. Meng, Y. Wang, J. Duan, S. Xiang and C. Pan, "Efficient image dehazing with boundary constraint and contextual regularization", Proc. IEEE Int. Conf. Comput. Vis., pp. 617-624, 2013.
24.
S.-C. Huang, B.-H. Chen and W.-J. Wang, "Visibility restoration of single hazy images captured in real-world weather conditions", IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 10, pp. 1814-1824, Oct. 2014.
25.
K. Tang, J. Yang and J. Wang, "Investigating haze-relevant features in a learning framework for image dehazing", Proc. IEEE Conf. Comput. Vis. Pattern Recognit., pp. 2995-3000, 2014.
26.
A. Golts, D. Freedman and M. Elad, "Unsupervised single image dehazing using dark channel prior loss", IEEE Trans. Image Process., vol. 29, pp. 2692-2701, 2019.
27.
R. Fattal, "Dehazing using color-lines", ACM Trans. Graph., vol. 34, no. 1, pp. 1-14, 2014.
28.
Q. Zhu, J. Mai and L. Shao, "A fast single image haze removal algorithm using color attenuation prior", IEEE Trans. Image Process., vol. 24, no. 11, pp. 3522-3533, Nov. 2015.
29.
D. Berman et al., "Non-local image dehazing", Proc. IEEE Conf. Comput. Vis. Pattern Recognit., pp. 1674-1682, 2016.
30.
T. M. Bui and W. Kim, "Single image dehazing using color ellipsoid prior", IEEE Trans. Image Process., vol. 27, no. 2, pp. 999-1009, Feb. 2018.
Contact IEEE to Subscribe

References

References is not available for this document.