Human Motion Prediction Based on Visual Tracking

Following and moving according to human motion is an important task for mobile robots. To ensure more compliant motion planning and execution of mobile robots, they can not be controlled by real-time visual information. In the tracking process, robots need to recognize and track the target then, plan the motion and execute the motion. In practical applications, the environments are very complex, such as illumination, shadows and occlusion, which the traditional visual tracking algorithms often deviate or lose the target. Therefore, to achieve fast human motion tracking, it is necessary to predict human motions by video prediction. In this paper, we propose a human motion tracking algorithm of mobile robot based on video prediciton. (1) The multi-layer generation adversarial loop network, which trained by off-line video dataset and learn how to predict human motion. (2) We used the pre-trained model to predict the state of the tracking target in the video. (3) This video prediction model was integrated into human-to-robot tracking algorithms of mobile robot following human system. Experiments show that the proposed algorithm can track human motion at a certain speed and precision.