Efficient Human Action Recognition with Dual-Action Neural Networks for Virtual Sports Training

In this paper, we propose an efficient human action recognition method for virtual sports training. In the proposed method, 3D skeleton data of human actions for four kinds of sports, which are composed of ready actions and main ones, are accurately captured by using RGB-D cameras. Then, skeleton features, which are sophisticatedly designed for each sport training, are extracted from captured 3D skeleton data. Finally, a dual-action neural network, which is developed to simultaneously recognize ready actions and main ones for sports training, is trained with extracted skeleton features. The effectiveness of the proposed method based on the dual-action neural network is verified with several real experiments for various sports.