Emotion-aware system for upper extremity rehabilitation

Immersive and multimodal sensory feedback was implemented to improve neurorehabilitation movement training. A major aspect of feedback is to reflect back the patient's psychophysiological state into the environment, and also to use this as a guidance mechanism as to how events within the virtual environment unfold. The virtual environment was constructed using haptic, visual and acoustic primitives (basic sets of changes applied to the multimodal virtual environment that are expected to change the psychophysiological state of the patient). State transitions between primitives are defined as a response to changes in the user's psychological state and motor performance. The mapping of biomechanical and physiological measurements to motor performance and psychological state and then to changes in action primitives was implemented using a fuzzy-logic system.