Artificial Intelligence Based Enhanced Virtual Mouse Hand Gesture Tracking Using Yolo Algorithm

Virtual mouse technology has revolutionized human computer interaction, allowing users to interact with digital environments without physical peripherals. The concept traces back to the late 1970s, and over the years, it has evolved with significant advancements in computer vision, motion tracking, and gesture recognition technologies. In recent times, machine learning techniques, particularly YOLOv8, have been integrated into virtual mouse technology, enabling accurate and swift detection of virtual objects and surfaces. This advancement enhances seamless interaction, intuitive hand gestures, and personalized virtual reality experiences tailored to individual user preferences. The proposed model, EHT (Enhanced Hand Tracking), leverages the power of YOLOv8 to address the limitations of existing models, such as Mediapipe. EHT achieves higher accuracy in hand tracking, real-time hand gesture recognition, and improved multi-user interactions. It adapts to users' unique gestures over time, delivering a more natural and immersive computing experience with accuracy rates exceeding those of Mediapipe. For instance, across multiple sample datasets, EHT consistently outperformed Mediapipe in hand tracking accuracy. In Sample Dataset 1, EHT demonstrated an accuracy of 98.3% compared to Mediapipe's 95.65%. Similarly, in Sample Dataset 2, EHT achieved an accuracy of 99.35%, surpassing Mediapipe's 94.63%. Even in Sample Dataset 3, EHT maintained its superiority with an accuracy of 98.54 %, whereas Mediapipe achieved 98.26%. The successful implementation of EHT requires a custom dataset and optimization techniques to ensure efficiency on virtual reality hardware. EHT model is anticipated redefining how users interact with digital environments, unlocking new possibilities for intuitive and immersive computing experiences.