Smart Memory Companion for elderly

Not all age-related problems can be solved using technology. However, it has the potential to relieve a significant amount of stress on elderly and their family. In this paper we present the idea of a virtual companion, which leverages the personalized digital journal curated using historical, daily life experiences of the aged person to uplift their mental wellbeing. The virtual buddy has a dual purpose of reminiscence therapy through memory triggering and to aid in recalling. The implementation proposed in this paper is an application of natural language processing and focuses on using fine-tuned generative transformers for personalized dialog generation, sentence transformers for visual search and zero shot topic classification to build an intelligent conversational agent. The companion can be used to store memorable experiences and activities by the user, their family and caretakers in the form of text and images so as to utilize them when needed and to recollect happy glimpses of life.