Exposure Correction Model to Enhance Image Quality | IEEE Conference Publication | IEEE Xplore

Exposure Correction Model to Enhance Image Quality


Abstract:

Exposure errors in an image cause a degradation in the contrast and low visibility in the content. In this paper, we address this problem and propose an end-to-end expo-s...Show More

Abstract:

Exposure errors in an image cause a degradation in the contrast and low visibility in the content. In this paper, we address this problem and propose an end-to-end expo-sure correction model in order to handle both under- and overexposure errors with a single model. Our model contains an image encoder, consecutive residual blocks, and image decoder to synthesize the corrected image. We utilize perceptual loss, feature matching loss, and multi-scale discriminator to increase the quality of the generated image as well as to make the training more stable. The experimental results indicate the effectiveness of proposed model. We achieve the state-of-the-art result on a large-scale exposure dataset. Besides, we investigate the effect of exposure set-ting of the image on the portrait matting task. We find that under- and overexposed images cause severe degradation in the performance of the portrait matting models. We show that after applying exposure correction with the proposed model, the portrait matting quality increases significantly. https://github.com/yamand16/ExposureCorrection.
Date of Conference: 19-20 June 2022
Date Added to IEEE Xplore: 23 August 2022
ISBN Information:

ISSN Information:

Conference Location: New Orleans, LA, USA

Funding Agency:

References is not available for this document.

1. Introduction

The quality of the images depends on several factors and dramatically affects the performance of the computer vision methods. The exposure attribute is one of these factors and depends on shutter speed, f-number, and camera ISO. The exposure setting is expressed by exposure values (EVs) and each EV yields a different level of brightness in the image. In the case that zero EV value is the proper setting for an arbitrary image, negative EV makes it underexposed, while positive EV causes overexposed version. Besides, underexposed images have a darker appearance and overexposed images have a brighter view. Moreover, both situations cause low visibility. Therefore, exposure correction is a key step to overcome exposure errors to provide a better image.

Select All
1.
Mahmoud Afifi and Michael S Brown, "Deep white-balance editing", Proceedings of the IEEE/CVF Conference on computer vision and pattern recognition, pp. 1397-1406, 2020.
2.
Mahmoud Afifi, Konstantinos G Derpanis, Bjorn Ommer and Michael S Brown, "Learning multi-scale photo exposure correction", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9157-9167, 2021.
3.
Marwan Ali Albahar, "Contrast and synthetic multiexposure fusion for image enhancement", Computational Intelligence and Neuroscience, pp. 2021, 2021.
4.
Yochai Blau, Roey Mechrez, Radu Timofte, Tomer Michaeli and Lihi Zelnik-Manor, "The 2018 pirm challenge on perceptual image super-resolution", Proceedings of the European Conference on Computer Vision (ECCV) Workshops, pp. 0-0, 2018.
5.
Bolun Cai, Xianming Xu, Kailing Guo, Kui Jia, Bin Hu and Dacheng Tao, "A joint intrinsic-extrinsic prior model for retinex", Proceedings of the IEEE international conference on computer vision, pp. 4000-4009, 2017.
6.
Jianrui Cai, Shuhang Gu and Lei Zhang, "Learning a deep single image contrast enhancer from multi-exposure images", IEEE Transactions on Image Processing, vol. 27, no. 4, pp. 2049-2062, 2018.
7.
Turgay Celik and Tardi Tjahjadi, "Contextual and variational contrast enhancement", IEEE Transactions on Image Processing, vol. 20, no. 12, pp. 3431-3441, 2011.
8.
Yu-Sheng Chen, Yu-Ching Wang, Man-Hsin Kao and Yung-Yu Chuang, "Deep photo enhancer: Unpaired learning for image enhancement from photographs with gans", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6306-6314, 2018.
9.
Lisa DaNae Dayley and Brad Dayley, Photoshop CS5 Bible, John Wiley Sons, 2010.
10.
Ishan Durugkar, Ian Gemp and Sridhar Mahadevan, "Generative multi-adversarial networks", 2016.
11.
Majed El Helou, Ruofan Zhou, Sabine Susstrunk and Radu Timofte, "Ntire 2021 depth guided image relighting challenge", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 566-577, 2021.
12.
Xueyang Fu, Delu Zeng, Yue Huang, Xiao-Ping Zhang and Xinghao Ding, "A weighted variational model for simultaneous reflectance and illumination estimation", Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2782-2790, 2016.
13.
Michaël Gharbi, Jiawen Chen, Jonathan T Barron, Samuel W Hasinoff and Frédo Durand, "Deep bilateral learning for real-time image enhancement", ACM Transactions on Graphics (TOG), vol. 36, no. 4, pp. 1-12, 2017.
14.
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, et al., "Generative adversarial nets", Advances in neural information processing systems, pp. 27, 2014.
15.
Chunle Guo, Chongyi Li, Jichang Guo, Chen Change Loy, Junhui Hou, Sam Kwong, et al., "Zero-reference deep curve estimation for low-light image enhancement", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1780-1789, 2020.
16.
Xiaojie Guo, "Lime: A method for low-light image enhancement", Proceedings of the 24th ACM international conference on Multimedia, pp. 87-91, 2016.
17.
Xiaojie Guo, Yu Li and Haibin Ling, "Lime: Low-light image enhancement via illumination map estimation", IEEE Transactions on image processing, vol. 26, no. 2, pp. 982-993, 2016.
18.
Kaiming He, Xiangyu Zhang, Shaoqing Ren and Jian Sun, "Deep residual learning for image recognition", Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770-778, 2016.
19.
Haofeng Huang, Wenhan Yang, Yueyu Hu, Jiaying Liu and Ling-Yu Duan, "Towards low light enhancement with raw images", IEEE Transactions on Image Processing, 2022.
20.
Haidi Ibrahim and Nicholas Sia Pik Kong, "Brightness preserving dynamic histogram equalization for image contrast enhancement", IEEE Transactions on Consumer Electronics, vol. 53, no. 4, pp. 1752-1758, 2007.
21.
Andrey Ignatov, Nikolay Kobyshev, Radu Timofte, Kenneth Vanhoey and Luc Van Gool, "Dslr-quality photos on mobile devices with deep convolutional networks", Proceedings of the IEEE International Conference on Computer Vision, pp. 3277-3285, 2017.
22.
Yifan Jiang, Xinyu Gong, Ding Liu, Yu Cheng, Chen Fang, Xiaohui Shen, et al., "Enlightengan: Deep light enhancement without paired supervision", IEEE Transactions on Image Processing, vol. 30, pp. 2340-2349, 2021.
23.
Justin Johnson, Alexandre Alahi and Li Fei-Fei, "Perceptual losses for real-time style transfer and super-resolution", European conference on computer vision, pp. 694-711, 2016.
24.
Zhanghan Ke, Kaican Li, Yurou Zhou, Qiuhua Wu, Xiangyu Mao, Qiong Yan, et al., "Is a green screen really necessary for real-time portrait matting?", 2020.
25.
Alex Krizhevsky, Ilya Sutskever and Geoffrey E Hinton, "Imagenet classification with deep convolutional neural networks", Advances in neural information processing systems, pp. 25, 2012.
26.
Edwin H Land, "The retinex theory of color vision", Scientific american, vol. 237, no. 6, pp. 108-129, 1977.
27.
Chulwoo Lee, Chul Lee and Chang-Su Kim, "Contrast enhancement based on layered difference representation", 2012 19th IEEE international conference on image processing, pp. 965-968, 2012.
28.
Chulwoo Lee, Chul Lee and Chang-Su Kim, "Contrast enhancement based on layered difference representation of 2d histograms", IEEE transactions on image processing, vol. 22, no. 12, pp. 5372-5384, 2013.
29.
Hunsang Lee, Kwanghoon Sohn and Dongbo Min, "Unsupervised low-light image enhancement using bright channel prior", IEEE Signal Processing Letters, vol. 27, pp. 251-255, 2020.
30.
Chongyi Li, Chunle Guo, Ling-Hao Han, Jun Jiang, Ming-Ming Cheng, Jinwei Gu, et al., "Low-light image and video enhancement using deep learning: a survey", IEEE Transactions on Pattern Analysis Machine Intelligence, no. 01, pp. 1-1, 2021.
Contact IEEE to Subscribe

References

References is not available for this document.