Deep Portrait Quality Assessment. A NTIRE 2024 Challenge Survey | IEEE Conference Publication | IEEE Xplore

Deep Portrait Quality Assessment. A NTIRE 2024 Challenge Survey


Abstract:

This paper reviews the NTIRE 2024 Portrait Quality Assessment Challenge, highlighting the proposed solutions and results. This challenge aims to obtain an efficient deep ...Show More

Abstract:

This paper reviews the NTIRE 2024 Portrait Quality Assessment Challenge, highlighting the proposed solutions and results. This challenge aims to obtain an efficient deep neural network capable of estimating the perceptual quality of real portrait photos. The methods must generalize to diverse scenes and diverse lighting conditions (indoor, outdoor, low-light), movement, blur, and other challenging conditions. In the challenge, 140 participants registered, and 35 submitted results during the challenge period. The performance of the top 5 submissions is reviewed and provided here as a gauge for the current state-of-the-art in Portrait Quality Assessment.
Date of Conference: 17-18 June 2024
Date Added to IEEE Xplore: 27 September 2024
ISBN Information:

ISSN Information:

Conference Location: Seattle, WA, USA
References is not available for this document.

1. Introduction

Portrait Quality Assessment (PQA) is becoming increasingly important in a variety of fields, from social media engagement to professional photography. The subjective nature of aesthetic appreciation, combined with the technical complexities of image capture and processing, makes PQA a challenging task. While Redi et al. [25] have explored the attributes that contribute to the perceived beauty of portraits, the utility-focused approach of Face Image Quality Assessment (FIQA) [27] underscores the diversity of criteria required for different quality assessment contexts.

Select All
1.
Cosmin Ancuti, Codruta O Ancuti, Florin-Alexandru Vasluianu, Radu Timofte et al., "NTIRE 2024 dense and non-homogeneous dehazing challenge report", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024.
2.
Nikola Banić, Egor Ershov, Artyom Panshin, Oleg Karasev, Sergey Korchagin, Shepelev Lev, Alexandr Startsev, Daniil Vladimirov, Ekaterina Zaychenkova, Dmitrii R Iarchuk, Maria Efimova, Radu Timofte, Arseniy Terekhin et al., "NTIRE 2024 challenge on night photography rendering", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024.
3.
Nicolas Chahine, Stefania Calarasanu, Davide Garcia-Civiero, Théo Cayla, Sira Ferradans and Jean Ponce, "An image quality assessment dataset for portraits", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 9968-9978, 2023.
4.
Nicolas Chahine, Marcos V. Conde, Gabriel Pacianotto, Daniela Carfora, Benoit Pochon, Sira Ferradans, Radu Timofte et al., "Deep portrait quality assessment. A NTIRE 2024 challenge survey", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2024.
5.
Nicolas Chahine, Sira Ferradans, Javier Vazquez-Corral and Jean Ponce, "Generalized portrait quality assessment", 2024.
6.
Zewen Chen, Juan Wang, Bing Li, Chunfeng Yuan, Weiming Hu, Junxian Liu, et al., "Gmc-iqa: Exploiting global-correlation and mean-opinion consistency for no-reference image quality assessment", 2024.
7.
Zheng Chen, Zongwei WU, Eduard Sebastian Zamfir, Kai Zhang, Yulun Zhang, Radu Timofte, Xiaokang Yang et al., "NTIRE 2024 challenge on image super-resolution (×4): Methods and results", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024.
8.
Alexandre Ciancio, Eduardo AB da Silva, Amir Said, Ramin Samadani, Pere Obrador et al., "No-reference blur assessment of digital pictures based on multifeature classifiers", IEEE Transactions on image processing, vol. 20, no. 1, pp. 64-75, 2010.
9.
Marcos V. Conde, Florin-Alexandru Vasluianu, Radu Timofte et al., "Deep raw image super-resolution. a NTIRE 2024 challenge survey", Proceedings of the IEEE/CVF Confer ence on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024.
10.
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, et al., "An image is worth 16x16 words: Transformers for image recognition at scale", CoRR, 2020.
11.
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly et al., "An image is worth 16x16 words: Transformers for image recognition at scale", 2020.
12.
Yuming Fang, Hanwei Zhu, Yan Zeng, Kede Ma and Zhou Wang, "Perceptual quality assessment of smartphone photography", Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 3677-3686, 2020.
13.
Deepti Ghadiyaram and Alan C Bovik, "Massive online crowdsourced study of subjective and objective picture quality", IEEE Transactions on Image Processing, vol. 25, no. 1, pp. 372-387, 2015.
14.
Vlad Hosu, Hanhe Lin, Tamas Sziranyi and Dietmar Saupe, "Koniq-10k: An ecologically valid database for deep learning of blind image quality assessment", IEEE Transactions on Image Processing, vol. 29, pp. 4041-4056, 2020.
15.
Eric C Larson and Damon M Chandler, "Most apparent distortion: full-reference image quality assessment and the role of strategy", Journal of electronic imaging, vol. 19, no. 1, pp. 011006-011006, 2010.
16.
Jian Li, Yabiao Wang, Changan Wang, Ying Tai, Jianjun Qian, Jian Yang, et al., "Dsfd: Dual shot face detector", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019.
17.
Leida Li, Tianshu Song, Jinjian Wu, Weisheng Dong, Jian-sheng Qian and Guangming Shi, "Blind image quality index for authentic distortions with local and global deep feature aggregation", IEEE Transactions on Circuits and Systems for Video Technology, vol. 32, no. 12, pp. 8512-8523, 2022.
18.
Xin Li, Kun Yuan, Yajing Pei, Yiting Lu, Ming Sun, Chao Zhou, Zhibo Chen, Radu Timofte et al., "NTIRE 2024 challenge on short-form UGC video quality assessment: Methods and results", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024.
19.
Jie Liang, Qiaosi Yi, Shuaizheng Liu, Lingchen Sun, Rongyuan Wu, Xindong Zhang, Hui Zeng, Radu Timofte, Lei Zhang et al., "NTIRE 2024 restore any image model (RAIM) in the wild challenge", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024.
20.
Hanhe Lin, Vlad Hosu and Dietmar Saupe, "Kadid-10k: A large-scale artificially distorted iqa database", 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX), pp. 1-3, 2019.
21.
Xiaohong Liu, Xiongkuo Min, Guangtao Zhai, Chunyi Li, Tengchuan Kou, Wei Sun, Haoning Wu, Yixuan Gao, Yuqin Cao, Zicheng Zhang, Xiele Wu, Radu Timofte et al., "NTIRE 2024 quality assessment of AI-generated content challenge", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024.
22.
Xiaoning Liu, Zongwei WU, Ao Li, Florin-Alexandru Vasluianu, Yulun Zhang, Shuhang Gu, Le Zhang, Ce Zhu, Radu Timofte et al., "NTIRE 2024 challenge on low light image enhancement: Methods and results", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024.
23.
Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, et al., "Swin transformer: Hierarchical vision transformer using shifted windows", Proceedings of the IEEE/CVF international conference on computer vision, pp. 10012-10022, 2021.
24.
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark et al., "Learning transferable visual models from natural language supervision", International conference on machine learning, pp. 8748-8763, 2021.
25.
Miriam Redi, Nikhil Rasiwasia, Gaurav Aggarwal and Alejandro Jaimes, "The beauty of capturing faces: Rating the quality of digital portraits", 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), pp. 1-8, 2015.
26.
Bin Ren, Yawei Li, Nancy Mehta, Radu Timofte et al., "The ninth NTIRE 2024 efficient super-resolution challenge report", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2024.
27.
Torsten Schlett, Christian Rathgeb, Olaf Henniger, Javier Galbally, Julian Fierrez and Christoph Busch, "Face image quality assessment: A literature survey", ACM Computing Surveys (CSUR), vol. 54, no. 10s, pp. 1-49, 2022.
28.
Hamid R Sheikh, Muhammad F Sabir and Alan C Bovik, "A statistical evaluation of recent full reference image quality assessment algorithms", IEEE Transactions on image processing, vol. 15, no. 11, pp. 3440-3451, 2006.
29.
Shaolin Su, Qingsen Yan, Yu Zhu, Cheng Zhang, Xin Ge, Jinqiu Sun, et al., "Blindly assess image quality in the wild guided by a self-adaptive hyper network", Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3667-3676, 2020.
30.
Shaolin Su, Hanhe Lin, Vlad Hosu, Oliver Wiedemann, Jin-qiu Sun, Yu Zhu, et al., "Going the extra mile in face image quality assessment: A novel database and model", IEEE Transactions on Multimedia, 2023.
Contact IEEE to Subscribe

References

References is not available for this document.