Prototype Monitoring System Detecting Mental Workload During Pilot Simulation Training

Monitoring psychophysiological signals in training and real-world scenarios is crucial for optimal personnel performance, especially in high demanding jobs - military pilots, commercial truck drivers, heavy lifters, tunnel - boring machines, etc. In this paper, we propose a prototype monitoring system that measures vital signs, estimates stress levels and attention to the given tasks. The system is intended for military pilots' annual evaluation, as well as initial aviation training. Nevertheless, the current study suggests that such a system can easily be integrated into other high-risk domains and professions. For the system implementation, we use commercial-off-the-shelf (COTS) connected devices and software, such as VR headset with integrated eye tracking (Varjo VR-3), budget USB polygraph and flight simulation software (Digital combat simulator). We gather data via those sensors, measure the pilots' performance under stressful conditions and draw conclusions.