Natural user interface for interactive television

In this paper, we try to develop a natural user interface for interactive TV, which is more natural and easy to use with a webcam and the fingers of user. We analyze the images captured by the camera settled on the screen and track any fingers of the users. After the fingers were tracked, users can control the TV by the gestures. We invited several user to participate the testing of the system. The testing is to find out the accuracy of the gesture direction detection and finger click detection and the tested accuracy of them relatively were 97.75% and 93.5%. Finally, the total processing time is 18 ms. So the system reaches Real-time processing.

I. Introduction

In this paper, we proposed a natural user interface system for interactive TV. The system was partitioned into three part (Pre-processing, Hand Tracking, and Finger Tracking). The architecture of the proposed system was depicted in Fig. 1. Fig. 1. The proposed natural user interface system.