AdaptEEG: A Deep Subdomain Adaptation Network With Class Confusion Loss for Cross-Subject Mental Workload Classification | IEEE Journals & Magazine | IEEE Xplore

AdaptEEG: A Deep Subdomain Adaptation Network With Class Confusion Loss for Cross-Subject Mental Workload Classification


Model architecture of the proposed DSAN-CCL. The LMMD aligns the feature distributions between the source domain and the target domain for each category. The process of m...

Abstract:

EEG signals exhibit non-stationary characteristics, particularly across different subjects, which presents significant challenges in the precise classification of mental ...Show More

Abstract:

EEG signals exhibit non-stationary characteristics, particularly across different subjects, which presents significant challenges in the precise classification of mental workload levels when applying a trained model to new subjects. Domain adaptation techniques have shown effectiveness in enhancing the accuracy of cross-subject classification. However, current state-of-the-art methods for cross-subject mental workload classification primarily focus on global domain adaptation, which may lack fine-grained information and result in ambiguous classification boundaries. We proposed a novel approach called deep subdomain adaptation network with class confusion loss (DSAN-CCL) to enhance the performance of cross-subject mental workload classification. DSAN-CCL utilizes the local maximum mean discrepancy to align the feature distributions between the source domain and the target domain for each mental workload category. Moreover, the class confusion matrix was constructed by the product of the weighted class probabilities (class probabilities predicted by the label classifier) and the transpose of the class probabilities. The loss for maximizing diagonal elements and minimizing non-diagonal elements of the class confusion matrix was added to increase the credibility of pseudo-labels, thus improving the transfer performance. The proposed DSAN-CCL method was validated on two datasets, and the results indicate a significant improvement of 3∼10 percentage points compared to state-of-the-art domain adaptation methods. In addition, our proposed method is not dependent on a specific feature extractor. It can be replaced by any other feature extractor to fit new applications. This makes our approach universal to cross-domain classification problems.
Model architecture of the proposed DSAN-CCL. The LMMD aligns the feature distributions between the source domain and the target domain for each category. The process of m...
Published in: IEEE Journal of Biomedical and Health Informatics ( Volume: 29, Issue: 3, March 2025)
Page(s): 1940 - 1949
Date of Publication: 09 December 2024

ISSN Information:

References is not available for this document.

I. Introduction

Mental workload (MW) describes the amount of psychological and cognitive effort required to perform a specific task or activity [1], [2]. Too low MW might cause boredom, lack of desire, inattention, and blunders. Too high MW might impair a person's decision-making capability and work efficiency, as well as lead to physical and mental health issues [3]. Therefore, it is crucial to recognize MW accurately so as to enhance work efficiency, lower error rates, and improve personal health [4].

Select All
1.
C. D. Wickens, "Multiple resources and performance prediction", Theor. Issues Ergonom. Sci., vol. 3, no. 2, pp. 159-177, 2002.
2.
Y. Zhou, S. Huang, Z. Xu, P. Wang, X. Wu and D. Zhang, "Cognitive workload recognition using EEG signals and machine learning: A review", IEEE Trans. Cogn. Devlop. Syst., vol. 14, no. 3, pp. 799-818, Sep. 2022.
3.
P. Zhang, X. Wang, J. Chen, W. You and W. Zhang, "Spectral and temporal feature learning with two-stream neural networks for mental workload assessment", IEEE Trans. Neural Syst. Rehabil. Eng., vol. 27, no. 6, pp. 1149-1159, Jun. 2019.
4.
J. Li, "Thoughts on neurophysiological signal analysis and classification", Brain Sci. Adv., vol. 6, no. 3, pp. 210-223, Sep. 2020.
5.
S. G. Hart and L. E. Staveland, "Development of NASA-TLX (task load index): Results of empirical and theoretical research", Adv. Psychol., vol. 52, pp. 139-183, 1988.
6.
D. Tao, H. Tan, H. Wang, X. Zhang, X. Qu and T. Zhang, "A systematic review of physiological measures of mental workload", Int. J. Environ. Res. Public Health, vol. 16, no. 15, 2019.
7.
W. L. Lim, O. Sourina, Y. Liu and L. Wang, "EEG-based mental workload recognition related to multitasking", Proc. IEEE 10th Int. Conf. Inf. Commun. Signal Process., pp. 1-4, 2015.
8.
H. Qu, X. Gao and L. Pang, "Classification of mental workload based on multiple features of ECG signals", Inform. Med. Unlocked, vol. 24, 2021.
9.
T. Shimizu et al., "Measurement of frontal cortex brain activity attributable to the driving workload and increased attention", SAE Int. J. Passenger Cars-Mech. Syst., vol. 2, no. 2009-01–0545, pp. 736-744, 2009.
10.
U. Asgher, K. Khalil, Y. Ayaz, R. Ahmad and M. J. Khan, "Classification of mental workload (MWL) using support vector machines (SVM) and convolutional neural networks (CNN)", Proc. IEEE 3rd Int. Conf. Comput. Math. Eng. Technol., pp. 1-6, 2020.
11.
D. Das Chakladar, S. Dey, P. P. Roy and D. P. Dogra, "EEG-based mental workload estimation using deep BLSTM-LSTM network and evolutionary algorithm", Biomed. Signal Process. Control, vol. 60, 2020.
12.
S. Yang, Z. Yin, Y. Wang, W. Zhang, Y. Wang and J. Zhang, "Assessing cognitive mental workload via EEG signals and an ensemble deep learning classifier based on denoising autoencoders", Comput. Biol. Med., vol. 109, pp. 159-170, 2019.
13.
L.-W. Ko, R. K. Chikara, Y.-C. Lee and W.-C. Lin, "Exploration of user's mental state changes during performing brain–computer interface", Sensors, vol. 20, no. 11, 2020.
14.
Z. Pei, H. Wang, A. Bezerianos and J. Li, "EEG-based multiclass workload identification using feature fusion and selection", IEEE Trans. Instrum. Meas., vol. 70, 2021.
15.
I. Guler and E. D. Ubeyli, "Multiclass support vector machines for EEG-signals classification", IEEE Trans. Inf. Technol. Biomed., vol. 11, no. 2, pp. 117-126, Mar. 2007.
16.
Q. She, T. Chen, F. Fang, J. Zhang, Y. Gao and Y. Zhang, "Improved domain adaptation network based on wasserstein distance for motor imagery EEG classification", IEEE Trans. Neural Syst. Rehabil. Eng., vol. 31, pp. 1137-1148, 2023.
17.
C. Gao, H. Uchitomi and Y. Miyake, "Cross-sensory EEG emotion recognition with filter bank Riemannian feature and adversarial domain adaptation", Brain Sci., vol. 13, no. 9, 2023.
18.
Z. He, Y. Zhong and J. Pan, "An adversarial discriminative temporal convolutional network for EEG-based cross-domain emotion recognition", Comput. Biol. Med., vol. 141, 2022.
19.
W. Liu, C. Guo and C. Gao, "A cross-session motor imagery classification method based on Riemannian Geometry and deep domain adaptation", Expert Syst. Appl., vol. 237, 2024.
20.
X. Zhang, Z. Miao, C. Menon, Y. Zheng, M. Zhao and D. Ming, "Priming cross-session motor imagery classification with a universal deep domain adaptation framework", Neurocomputing, vol. 556, 2023.
21.
X. Cui, T. Wang, X. Lai, T. Jiang, F. Gao and J. Cao, "Cross-subject seizure detection by joint-probability-discrepancy-based domain adaptation", IEEE Trans. Instrum. Meas., vol. 72, 2023.
22.
Y. Zhou et al., "Cross-task cognitive workload recognition based on EEG and domain adaptation", IEEE Trans. Neural Syst. Rehabil. Eng., vol. 30, pp. 50-60, 2022.
23.
K. Guan, Z. Zhang, T. Liu and H. Niu, "Cross-task mental workload recognition based on EEG tensor representation and transfer learning", IEEE Trans. Neural Syst. Rehabil. Eng., vol. 31, pp. 2632-2639, 2023.
24.
M. Jiménez-Guarneros and P. Gómez-Gil, "Custom domain adaptation: A new method for cross-subject EEG-based cognitive load recognition", IEEE Signal Process. Lett., vol. 27, pp. 750-754, 2020.
25.
Y. Zhou et al., "Cross-subject cognitive workload recognition based on EEG and deep domain adaptation", IEEE Trans. Instrum. Meas., vol. 72, 2023.
26.
Z. Yin and J. Zhang, "Cross-session classification of mental workload levels using EEG and an adaptive deep learning model", Biomed. Signal Process. Control, vol. 33, pp. 30-47, 2017.
27.
K. M. Borgwardt, A. Gretton, M. J. Rasch, H.-P. Kriegel, B. Schölkopf and A. J. Smola, "Integrating structured biological data by Kernel maximum mean discrepancy", Bioinformatics, vol. 22, no. 14, pp. e49-e57, 2006.
28.
A. Gretton, K. M. Borgwardt, M. J. Rasch, B. Schölkopf and A. Smola, "A Kernel two-sample test", J. Mach. Learn. Res., vol. 13, no. 1, pp. 723-773, 2012.
29.
Y. Zhu et al., "Deep subdomain adaptation network for image classification", IEEE Trans. Neural Netw. Learn. Syst., vol. 32, no. 4, pp. 1713-1722, Apr. 2021.
30.
W. Sun and J. Li, "Deep subdomain adaptation network improves cross-subject mental workload classification", Proc. Int. Conf. Cyberworlds, pp. 138-143, 2024.
Contact IEEE to Subscribe

References

References is not available for this document.