Assessment model for operator’s working ability based on deep learning

In enclosed or extreme environments, the psychological stress and physical state of the operator can prevent the work from being carried out effectively in the long term. To decrease an operator’s decisional and operational errors caused by his poor status in this environment, it is significant to develop an assessment model for getting the operator’s working ability in order to assist operators in assisting decision-making or providing advice. The present study presents an assessment model for the operator’s working ability based on deep learning. The model recognizes the operator’s emotion by using the Vision Transformer (ViT) and then collects the operator’s physical state through smart devices. Obtaining the ability assessment results of personnel in different states through surveys. Eventually, assess his ability through the convolutional neural network (CNN). The result suggests that the proposed method is feasible and reliable. The assessment model proposed in this paper considering physical state and mental state can be used to assist decision-making and ability assessment.