Loading [MathJax]/extensions/MathMenu.js
Wearable 3.0: From Smart Clothing to Wearable Affective Robot | IEEE Journals & Magazine | IEEE Xplore

Wearable 3.0: From Smart Clothing to Wearable Affective Robot


Abstract:

With the rapid development of science and technology and the accelerating pace of life, people's mental health problems have become increasingly prominent. Besides, tradi...Show More

Abstract:

With the rapid development of science and technology and the accelerating pace of life, people's mental health problems have become increasingly prominent. Besides, traditional wearable technologies and affective computing technologies (i.e., Wearable 2.0 based on smart clothing) have been unable to meet the requirements brought by computation-intensive affective analysis and latency-sensitive affective interaction. Therefore, in this article, Wearable 3.0, which integrates brain wearable devices, intelligent affective interaction robots, and intelligent tactile devices, is proposed. Wearable 3.0 can provide users with more personalized mental health monitoring services by collecting EEG data, speech emotion data, and tactile behavioral perception data. Also, the advantages of Wearable 3.0 and performance comparison with Wearable 2.0 are given in this article. Two typical application cases of Wearable 3.0, namely, wearable affective robot and CreativeBioMan, are introduced. Moreover, the detailed architecture design and realization of Wearable 3.0 are also given, which show that our proposed user mental healthcare system based on Wearable 3.0 has deeper cognitive intelligence and provides more flexible affective interaction.
Published in: IEEE Network ( Volume: 33, Issue: 6, Nov.-Dec. 2019)
Page(s): 8 - 14
Date of Publication: 16 December 2019

ISSN Information:

School of Computer Science and Technology, Embedded and Pervasive Computing Lab
Jun Yang (junyang_cs@hust.edu.cn) received his Bachelor's and Master's degrees in software engineering from Huazhong University of Science and Technology (HUST), China, in 2008 and 2011, respectively. Then he got his Ph.D. degree from the School of Computer Science and Technology, HUST, in June 2018. Currently, he works as a postdoctoral fellow at the Embedded and Pervasive Computing (EPIC) Lab in the School of Computer S...Show More
Jun Yang (junyang_cs@hust.edu.cn) received his Bachelor's and Master's degrees in software engineering from Huazhong University of Science and Technology (HUST), China, in 2008 and 2011, respectively. Then he got his Ph.D. degree from the School of Computer Science and Technology, HUST, in June 2018. Currently, he works as a postdoctoral fellow at the Embedded and Pervasive Computing (EPIC) Lab in the School of Computer S...View more
Huazhong University of Science and Technology, Wuhan National Laboratory for Optoelectronics
Jun Zhou (junzhou@hust.edu.cn)has been a full professor in the Wuhan National Laboratory for Optoelectronics (WNLO) at HUST since 2009. He is the deputy director of WNLO. He received his Bachelor's degree (2001) in materials physics and Ph.D. degree (2007) in materials physics and chemistry from Sun Yat-sen University. During 2005–2006, he was a visiting student at the School of Materials Science and Engineering, Georgia ...Show More
Jun Zhou (junzhou@hust.edu.cn)has been a full professor in the Wuhan National Laboratory for Optoelectronics (WNLO) at HUST since 2009. He is the deputy director of WNLO. He received his Bachelor's degree (2001) in materials physics and Ph.D. degree (2007) in materials physics and chemistry from Sun Yat-sen University. During 2005–2006, he was a visiting student at the School of Materials Science and Engineering, Georgia ...View more
Huazhong University of Science and Technology, Wuhan National Laboratory for Optoelectronics
Guangming Tao (tao@hust.edu.cn) is a professor at Wuhan National Laboratory for Optoelectronics and the School of Optical and Electronic Information at HUST. He is the director of the Center of Advanced Functional Fibers (CAFF) and the director of Man-Machine Lab (2M lab) at HUST. He received his Ph.D. degree (2014) in optics from the University of Central Florida. He was a research scientist/senior research scientist at ...Show More
Guangming Tao (tao@hust.edu.cn) is a professor at Wuhan National Laboratory for Optoelectronics and the School of Optical and Electronic Information at HUST. He is the director of the Center of Advanced Functional Fibers (CAFF) and the director of Man-Machine Lab (2M lab) at HUST. He received his Ph.D. degree (2014) in optics from the University of Central Florida. He was a research scientist/senior research scientist at ...View more
King Saud University
Mubarak Alrashoud (malrashoud@ksu.edu.sa) is an assistant professor and head of the Department of Software Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia. He received his Ph.D. in computer science from Ryerson University, Toronto, Canada.
Mubarak Alrashoud (malrashoud@ksu.edu.sa) is an assistant professor and head of the Department of Software Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia. He received his Ph.D. in computer science from Ryerson University, Toronto, Canada.View more
King Saud University
Khaled N. Al-mutib (muteb@ksu.edu.sa) is an associate professor in the Department of Software Engineering, College of Computer and Information Sciences, King Saud University. His research interests include robotics, computation intelligence, and healthcare.
Khaled N. Al-mutib (muteb@ksu.edu.sa) is an associate professor in the Department of Software Engineering, College of Computer and Information Sciences, King Saud University. His research interests include robotics, computation intelligence, and healthcare.View more
King Saud University
Muneer Al-hammadi (eng.muneer2008@gmail.com) is a researcher and a Ph.D. candidate in the Department of Computer Engineering, College of Computer and Information Sciences, King Saud University. His research interests include image and video processing, and deep learning.
Muneer Al-hammadi (eng.muneer2008@gmail.com) is a researcher and a Ph.D. candidate in the Department of Computer Engineering, College of Computer and Information Sciences, King Saud University. His research interests include image and video processing, and deep learning.View more

Introduction

With the arrival of the information era and the rapid development of technology, the pace of life continues to accelerate, as well as the growing pressure of survival. People's psychological sub-health and pathosis have become a general trend, including depression, anxiety, insomnia, and so on. People often suffer from these diseases at an earlier age, which leads to a series of social health and safety problems. According to the statistics from 2016 released by the World Health Organization, there are about 450 million people suffering from mental illness in the world, among whom more than 350 million suffer from depression; about 21 million people suffer from schizophrenia; and in China, more than 100 million people suffer from mental illness [1]. Among all mental diseases, depression is the main cause of suicide, and also brings significant economic losses to both individuals and society [2]. In addition, emotion has become the main indicator of mental health problems, especially for empty nesters, autistic children, recovered patients, as well as drivers. However, due to insufficient numbers of psychologists in China, it is hard to meet the needs of people with mental illness. Thus, how to take care of the emotions of people effectively with the help of highly developed artificial intelligence, robots, and wearable technology [3]–[5] is becoming more and more important. Currently, typical wearable equipment for user mental healthcare and treatment face the following challenges:

Shallow value: Due to the diverse sources of user data and limited data quantity, the existing systems have failed to mine deeper value.

Single-modal data: The existing systems analyze only a certain type of data, so the potential of user physiological data and social emotion data cannot be found.

Static affective interaction: The current emotion monitoring systems take user mobility and comfort as a price. At the same time, they lack a real-time and effective communication mechanism between terminals, which makes real-time diagnosis and treatment impossible.

School of Computer Science and Technology, Embedded and Pervasive Computing Lab
Jun Yang (junyang_cs@hust.edu.cn) received his Bachelor's and Master's degrees in software engineering from Huazhong University of Science and Technology (HUST), China, in 2008 and 2011, respectively. Then he got his Ph.D. degree from the School of Computer Science and Technology, HUST, in June 2018. Currently, he works as a postdoctoral fellow at the Embedded and Pervasive Computing (EPIC) Lab in the School of Computer Science and Technology, HUST. His research interests include cognitive computing, software intelligence, Internet of Things, cloud computing and big data analytics, and more.
Jun Yang (junyang_cs@hust.edu.cn) received his Bachelor's and Master's degrees in software engineering from Huazhong University of Science and Technology (HUST), China, in 2008 and 2011, respectively. Then he got his Ph.D. degree from the School of Computer Science and Technology, HUST, in June 2018. Currently, he works as a postdoctoral fellow at the Embedded and Pervasive Computing (EPIC) Lab in the School of Computer Science and Technology, HUST. His research interests include cognitive computing, software intelligence, Internet of Things, cloud computing and big data analytics, and more.View more
Huazhong University of Science and Technology, Wuhan National Laboratory for Optoelectronics
Jun Zhou (junzhou@hust.edu.cn)has been a full professor in the Wuhan National Laboratory for Optoelectronics (WNLO) at HUST since 2009. He is the deputy director of WNLO. He received his Bachelor's degree (2001) in materials physics and Ph.D. degree (2007) in materials physics and chemistry from Sun Yat-sen University. During 2005–2006, he was a visiting student at the School of Materials Science and Engineering, Georgia Institute of Technology. During 2007–2009, he served as a research scientist in the Wallace H. Coulter Department of Biomedical Engineering and the School of Materials Science and Engineering, Georgia Institute of Technology. He has published over 130 peer reviewed journal papers, including 3 ESI hot papers and 29 ESI highly cited papers. All of the papers have been cited over 11,000 times. His H-index is 52, and he was one of the top 0.1% highly cited authors in the Royal Society of Chemistry journals in 2014. He has organized 6 conferences, and delivered over 30 invited talks at conferences. He was awarded the National Natural Science Award of Chinese government (second prize) for 2016, the Natural Science Award of the Ministry of Education Department of China (first prize) for 2015, and the Excellent Doctoral Dissertation of China for 2009. He was also awarded by the Excellent Youth Fund of National Natural Science Foundation of China in 2013, enrolled in the National Program for Support of Top-Notch Young Professionals for 2014, and the Youth project of the “Cheung Kong Scholars programme” of the Ministry of Education Department of China for 2015. His research focuses on energy harvesting from environmental and flexible electronics.
Jun Zhou (junzhou@hust.edu.cn)has been a full professor in the Wuhan National Laboratory for Optoelectronics (WNLO) at HUST since 2009. He is the deputy director of WNLO. He received his Bachelor's degree (2001) in materials physics and Ph.D. degree (2007) in materials physics and chemistry from Sun Yat-sen University. During 2005–2006, he was a visiting student at the School of Materials Science and Engineering, Georgia Institute of Technology. During 2007–2009, he served as a research scientist in the Wallace H. Coulter Department of Biomedical Engineering and the School of Materials Science and Engineering, Georgia Institute of Technology. He has published over 130 peer reviewed journal papers, including 3 ESI hot papers and 29 ESI highly cited papers. All of the papers have been cited over 11,000 times. His H-index is 52, and he was one of the top 0.1% highly cited authors in the Royal Society of Chemistry journals in 2014. He has organized 6 conferences, and delivered over 30 invited talks at conferences. He was awarded the National Natural Science Award of Chinese government (second prize) for 2016, the Natural Science Award of the Ministry of Education Department of China (first prize) for 2015, and the Excellent Doctoral Dissertation of China for 2009. He was also awarded by the Excellent Youth Fund of National Natural Science Foundation of China in 2013, enrolled in the National Program for Support of Top-Notch Young Professionals for 2014, and the Youth project of the “Cheung Kong Scholars programme” of the Ministry of Education Department of China for 2015. His research focuses on energy harvesting from environmental and flexible electronics.View more
Huazhong University of Science and Technology, Wuhan National Laboratory for Optoelectronics
Guangming Tao (tao@hust.edu.cn) is a professor at Wuhan National Laboratory for Optoelectronics and the School of Optical and Electronic Information at HUST. He is the director of the Center of Advanced Functional Fibers (CAFF) and the director of Man-Machine Lab (2M lab) at HUST. He received his Ph.D. degree (2014) in optics from the University of Central Florida. He was a research scientist/senior research scientist at the College of Optics & Photonics (CREOL), University of Central Florida from 2014 to 2017. He was a visiting scholar at the Chinese Academy of Science (2007–2008), Massachusetts Institute of Technology (2012), and Centre national de la recherche scientifique (2017). He has published about 35 scientific papers, holds 7 U.S. and foreign patents, has given in excess of 45 invited lectures/colloquia and keynote talks, and has co-organized more than 10 national and international conferences and symposia, including Symposium SM2 (advanced multifunctional fibers and textiles) at 2017 Spring MRS Meeting, Symposium J (multifunctional and multimaterial fibers) at the 2017 International Conference on Advanced Fibers and Polymer Materials and others. He has years of research experience in optical sciences and engineering in academia, industry, and government institutes with expertise in the areas of functional fibers, smart fabric, man-machine interactions, specialty optical fibers, and in-fiber nano-fabrication.
Guangming Tao (tao@hust.edu.cn) is a professor at Wuhan National Laboratory for Optoelectronics and the School of Optical and Electronic Information at HUST. He is the director of the Center of Advanced Functional Fibers (CAFF) and the director of Man-Machine Lab (2M lab) at HUST. He received his Ph.D. degree (2014) in optics from the University of Central Florida. He was a research scientist/senior research scientist at the College of Optics & Photonics (CREOL), University of Central Florida from 2014 to 2017. He was a visiting scholar at the Chinese Academy of Science (2007–2008), Massachusetts Institute of Technology (2012), and Centre national de la recherche scientifique (2017). He has published about 35 scientific papers, holds 7 U.S. and foreign patents, has given in excess of 45 invited lectures/colloquia and keynote talks, and has co-organized more than 10 national and international conferences and symposia, including Symposium SM2 (advanced multifunctional fibers and textiles) at 2017 Spring MRS Meeting, Symposium J (multifunctional and multimaterial fibers) at the 2017 International Conference on Advanced Fibers and Polymer Materials and others. He has years of research experience in optical sciences and engineering in academia, industry, and government institutes with expertise in the areas of functional fibers, smart fabric, man-machine interactions, specialty optical fibers, and in-fiber nano-fabrication.View more
King Saud University
Mubarak Alrashoud (malrashoud@ksu.edu.sa) is an assistant professor and head of the Department of Software Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia. He received his Ph.D. in computer science from Ryerson University, Toronto, Canada.
Mubarak Alrashoud (malrashoud@ksu.edu.sa) is an assistant professor and head of the Department of Software Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia. He received his Ph.D. in computer science from Ryerson University, Toronto, Canada.View more
King Saud University
Khaled N. Al-mutib (muteb@ksu.edu.sa) is an associate professor in the Department of Software Engineering, College of Computer and Information Sciences, King Saud University. His research interests include robotics, computation intelligence, and healthcare.
Khaled N. Al-mutib (muteb@ksu.edu.sa) is an associate professor in the Department of Software Engineering, College of Computer and Information Sciences, King Saud University. His research interests include robotics, computation intelligence, and healthcare.View more
King Saud University
Muneer Al-hammadi (eng.muneer2008@gmail.com) is a researcher and a Ph.D. candidate in the Department of Computer Engineering, College of Computer and Information Sciences, King Saud University. His research interests include image and video processing, and deep learning.
Muneer Al-hammadi (eng.muneer2008@gmail.com) is a researcher and a Ph.D. candidate in the Department of Computer Engineering, College of Computer and Information Sciences, King Saud University. His research interests include image and video processing, and deep learning.View more
Contact IEEE to Subscribe

References

References is not available for this document.