Human Computer Interaction using Hand Gestures and Voice

Human-Computer Interaction (HCI) exists everywhere in our everyday life. It is usually achieved by using a physical controller such as a mouse, keyboard or touch screen. This hinders the users natural experience as it creates a barrier between the user and computer as well as they are costly and take up lots of space on the desk. There are few hand tracking systems available in the market, but they are complex and expensive. The development of a marker-less hand tracking system and gesture recognition with low-cost hardware is presented here. The proposed system is a simple but effective method that allows rapid manual tracking despite the complex background. This system eliminates motion blur and is able to detect gestures like clicking and also hand tracking. The detected gesture is converted into specific functional inputs like clicking and mouse movement to control other applications. A voice module is integrated to receive voice commands from the user and perform it. This enables intuitive HCI and interactive motion gaming.