Bluetooth communication controlled robot based on gesture recognition

Gesture recognition is a topic in computer science and communication technology with the goal of interpreting human gesticulations via model outputs and mathematical algorithms. Gesture recognition is usually processed before transmitting the results to the user applications. Today, robotic field is being explored in various aspects for the possible applications in gesture recognition. In this paper, gesture recognition tool has been used to control the robot movement and gripper arm pair for gripping the object of interest using bluetooth module. For this, an Android app of the algorithm has been developed which gives an interactive user interface where the user will tilt the smartphone in the direction of his desired movement and the degree of tilt decides the speed of robot. The App uses smartphone's inbuilt accelerometer, processor and bluetooth as a processing unit and data transmitter. By doing so, the user has the flexibility to control the speed as well as direction of the robot. The robot also consists of a pair of grippers which can be controlled using gesture outputs for holding any object of interest. The direction, i.e., the orientation is calculated using the readings of accelerometer on 2-axes. Apart from this, an extra feature also added to give a robots' gripper arm with 2 degree of freedom along X-axis and Z-axis. The aim of this paper is to introduce another mode of automation for industrial application, military purpose and various other fields.