Real-Time Hand Palm Detection and Tracking Augmented Reality Game Using Lucas Kanade Optical Flow Combined with Color Blob Detection

Games have become an increasingly widespread part of society because of the spread and use of mobile devices. But playing games for a long time can simulate a negative impact on health such as hemorrhoids caused by sitting within a long period. The body's metabolism will decrease due to lack of activity when playing games. Many games on the market today are usually played in a sitting position and only move a finger. But with the development of technology, games can now be played by moving other limbs. One example is to combine the Augmented Reality, Hand Tracking, and Hand Gesturing technology so that players are required to move their limbs, such as hands, head, and body to play the game. The Hand Tracking algorithm used is the Lucas Kanade Optical Flow algorithm combined with Color Blob Detection, while the Convex Hull algorithm is used to recognize Hand Gesture. The results of this study indicate that by applying the above three algorithms for Hand Tracking and Hand Gesturing in Android games, it has a profound effect on lighting and background color, using background colors that contrast with skin color and adequate lighting, Hand Tracking and hand movements can work well.