Loading [MathJax]/extensions/MathMenu.js
Pushing the Limits of Unconstrained Face Detection: a Challenge Dataset and Baseline Results | IEEE Conference Publication | IEEE Xplore

Pushing the Limits of Unconstrained Face Detection: a Challenge Dataset and Baseline Results


Abstract:

Face detection has witnessed immense progress in the last few years, with new milestones being surpassed every year. While many challenges such as large variations in sca...Show More

Abstract:

Face detection has witnessed immense progress in the last few years, with new milestones being surpassed every year. While many challenges such as large variations in scale, pose, appearance are successfully addressed, there still exist several issues which are not specifically captured by existing methods or datasets. In this work, we identify the next set of challenges that requires attention from the research community and collect a new dataset of face images that involve these issues such as weather-based degradations, motion blur, focus blur and several others. We demonstrate that there is a considerable gap in the performance of state-of-the-art detectors and real-world requirements. Hence, in an attempt to fuel further research in unconstrained face detection, we present a new annotated Unconstrained Face Detection Dataset (UFDD) with several challenges and benchmark recent methods. Additionally, we provide an in-depth analysis of the results and failure cases of these methods. The UFDD dataset as well as baseline results, evaluation code and image source are available at: www.ufdd.info/.
Date of Conference: 22-25 October 2018
Date Added to IEEE Xplore: 25 April 2019
ISBN Information:

ISSN Information:

Conference Location: Redondo Beach, CA, USA
References is not available for this document.

1. Introduction

Face detection is the most important pre-processing step for many facial analysis tasks such as landmark detection [20], [55], face alignment [51], [43], [32], face recognition [30], face synthesis [42], [10], etc. The accuracy of face detection systems has a direct impact on these tasks and hence, the success of face detection is of crucial importance. Various challenges such as variations in pose, scale, illumination changes, variety of facial expressions, occlusion, etc., have to be addressed while building face detection algorithms. The success of Viola Jones face detector [40] enabled widespread usage of face detection in a variety of consumer devices and security systems.

Select All
1.
[online] Available: https://github.com/playerkk/face-py-faster-rcnn.
2.
[online] Available: https://pypi.python.org/pypi/imagehash.
3.
[online] Available: https://www.how2des.com/2014/10/realistic-water-dropseffect-on-a-wet-frosted-glass.html.
4.
[online] Available: https://www.mathworks.com/help/images/ref/imnoise.html.
5.
[online] Available: https://www.photoshopessentials.com/photoeffects/photoshop-weather-effects-rain/.
6.
[online] Available: https://www.photoshopessentials.com/photoeffects/photoshop-weather-effects-snow/.
7.
S. C. Brubaker, J. Wu, J. Sun, M. D. Mullin and J. M. Rehg, "On the design of cascades of boosted ensembles for face detection", International Journal of Computer Vision, vol. 77, no. 13, pp. 65-86, 2008.
8.
Z. Cai, Q. Fan, R. S. Feris and N. Vasconcelos, "A unified multi-scale deep convolutional neural network for fast object detection", European Conference on Computer Vision, pp. 354-370, 2016.
9.
D. Chen, S. Ren, Y. Wei, X. Cao and J. Sun, "Joint cascade face detection and alignment", European Conference on Computer Vision, pp. 109-122, 2014.
10.
X. Di, V. A. Sindagi and V. M. Patel, "Gp-gan: gender preserving gan for synthesizing faces from landmarks", arXiv preprint arXiv:1710.00962, 2017.
11.
M. Everingham, S. A. Eslami, L. Van Gool, C. K. Williams, J. Winn and A. Zisserman, "The pascal visual object classes challenge: A retrospective", International journal of computer vision, vol. 111, no. 1, pp. 98-136, 2015.
12.
R. Gross, I. Matthews, J. Cohn, T. Kanade and S. Baker, "Multi-pie", Image and Vision Computing, vol. 28, no. 5, pp. 807-813, 2010.
13.
M. Günther, P. Hu, C. Herrmann, C. H. Chan, M. Jiang, S. Yang, A. R. Dhamija, D. Ramanan, J. Beyerer, J. Kittler et al., "Unconstrained face detection and open-set face recognition challenge", arXiv preprint arXiv:1708.02337, 2017.
14.
K. He, J. Sun and X. Tang, "Single image haze removal using dark channel prior", IEEE transactions on pattern analysis and machine intelligence, vol. 33, no. 12, pp. 2341-2353, 2011.
15.
K. He, X. Zhang, S. Ren and J. Sun, "Deep residual learning for image recognition", Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770-778, 2016.
16.
P. Hu and D. Ramanan, "Finding tiny faces", 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1522-1530, 2017.
17.
V. Jain and E. Learned-Miller, Fddb: A benchmark for face detection in unconstrained settings.
18.
H. Jiang and E. Learned-Miller, "Face detection with the faster r-cnn", Automatic Face Gesture Recognition (FG 2017) 2017 12th IEEE International Conference on, pp. 650-657, 2017.
19.
B. F. Klare, B. Klein, E. Taborsky, A. Blanton, J. Cheney, K. Allen, et al., "Pushing the frontiers of unconstrained face detection and recognition: Iarpa janus benchmark a", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1931-1939, 2015.
20.
M. Koestinger, P. Wohlhart, P. M. Roth and H. Bischof, "Annotated facial landmarks in the wild: A large-scale real-world database for facial landmark localization", Computer Vision Workshops (ICCV Workshops) 2011 IEEE International Conference on, pp. 2144-2151, 2011.
21.
M. Levoy, Stanford lecture notes digital photography ‘noise and iso’, 2014, [online] Available: http://graphics.stanford.edu/courses/cs448a10/sensors-noise-14jan10-opt.pdf.
22.
H. Li, Z. Lin, J. Brandt, X. Shen and G. Hua, "Efficient boosted exemplar-based face detection", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1843-1850, 2014.
23.
H. Li, Z. Lin, X. Shen, J. Brandt and G. Hua, "A convolutional neural network cascade for face detection", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5325-5334, 2015.
24.
W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.Y. Fu, et al., "Ssd: Single shot multibox detector", European conference on computer vision, pp. 21-37, 2016.
25.
M. Mathias, R. Benenson, M. Pedersoli and L. Van Gool, "Face detection without bells and whistles", European Conference on Computer Vision, pp. 720-735, 2014.
26.
B. Maze, J. Adams, J. A. Duncan, N. Kalka, T. Miller, C. Otto, A. K. Jain, W. T. Niggel, J. Anderson, J. Cheney et al., Iarpa janus benchmark–c: Face dataset and protocol.
27.
M. Najibi, P. Samangouei, R. Chellappa and L. S. Davis, "Ssh: Single stage headless face detector", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4875-4884, 2017.
28.
H. Qin, J. Yan, X. Li and X. Hu, "Joint training of cascaded cnn for face detection", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3456-3465, 2016.
29.
R. Ranjan, V. M. Patel and R. Chellappa, "A deep pyramid deformable part model for face detection", Biometrics Theory Applications and Systems (BTAS) 2015 IEEE 7th International Conference on, pp. 1-8, 2015.
30.
R. Ranjan, V. M. Patel and R. Chellappa, "Hyperface: A deep multi-task learning framework for face detection landmark localization pose estimation and gender recognition", IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017.
Contact IEEE to Subscribe

References

References is not available for this document.