Gait Pattern Recognition Based on Supervised Contrastive Learning Between EEG and EMG

Electroencephalography (EEG) and lower-limb electromyography (EMG) signals are widely used in lower-limb kinematic classification and regression tasks. Since it directly measures muscle responses, EMG usually works better. However, due to the susceptibility of EMG signals to muscle fatigue, insufficient residual myoelectric activity, and the difficulty of precise localization, it is difficult to acquire EMG signals in practice. In contrast, EEG signals are stable and easy to sample. Therefore, in this work, we propose a multimodal training strategy based on supervised contrastive learning. With this training strategy, we can effectively use the guiding role of EMG in the training phase to help the model fit the gait with EEG signal while using only EEG signal in the testing phase to obtain better results than using any single modal signal to train and test the model. Finally, we compared the models trained with the strategy proposed in this paper with other models trained with EEG signals. The obtained Pearson’s Correlation Coefficient value exceeds those of all baseline models.