An Architecture for Capturing and Synchronizing Heart Rate and Body Motion for Stress Inference

This paper aims to propose a system for capturing and synchronizing human heart rate (HR) and body motion (BMR) for stress inference. For this purpose, OpenPose skeleton-based method was used, which is capable of analyzing sequential videos, processing them frame by frame, and obtaining an approximation to the human figure composed of 18 key points, roughly corresponding to the joints. It is expected that by combining these two distinct measurements, HR and BMR, a more grounded evaluation of player stress levels while playing a Virtual Reality (VR) game, will be achieved. The experiment was conducted with 5 participants playing 5 different types of games, with different levels of intensity. During the game, the players wore a smartwatch to measure the HR and images were captured to calculate the BMR. Future work will assess this dataset to confirm the stress level in these 5 situations.