Multimodal Framework for Multilingual Social Interaction Assistive Application (MSIAA) for Elderly People

Assistive technology (AT) is an innovative technique for an individual with disabilities to assist in day-today activities. Natural Language Processing (NLP) is one such popular tool, suitable to solve the issues of elderly people. Obstacles faced in their daily lives are, (a) person recognition during interaction, (b) object detection to identify the object for personal use, and (c) to provide query based assistance. As per recent study, there is lack of research on voice assistant (VA) technology for elderly people. The VA, home assistant has a great impact on assisting an individual based on human-computer interaction. It enables quick access to the required services to perform the task. A brief review on AT is discussed in TABLE I. The purpose of this work, is to propose a multimodal framework to address elderly people challenges. The proposed model achieves overall, 68% of accuracy.