Real-time tracking of face features and gaze direction determination

A non-intrusive real-time program detects the face, then eyes and nose of a moving workstation user at a rate of between 10 and 30 Hertz. Based on the head pose, it determines where on the display the subject is looking. The long term goal is to provide a system for controlling a computer using head movements and gaze direction. The current program creates a base facility for other capabilities such as detecting facial gestures, creating face models, and normalizing for face recognition. A skin color model is used along with geometric knowledge about the face and weak assumptions about the lighting. Good results are reported with various subjects and conditions, including facial hair; 3D motion, and use of eyeglasses.