Virtual Mouse Using Face Gesture and NLP

The mouse plays a very important role in interacting with laptop’s and computer system, to perform necessary operations. In this paper, we are proposing a method to carry out mouse operations on the computer system without a physical mouse by utilizing voice commands and face-motion gestures. The system employs an internal webcam to detect facial gestures and an internal microphone to receive voice commands from the user. By employing a virtual mouse based on face gestures and natural language processing (NLP), we can accomplish all the fundamental functionalities of a mouse by issuing voice commands to the computer system. The system accepts these commands and executes corresponding mouse events such as "click," "right-click," "double-click," "scroll-up," "scroll-down," "minimize," and "close." The mobility of the mouse cursor on the monitor is achieved through face motion gestures, enabling the cursor to move up, down, left, and right, respectively.