Vision Controlled Matter Smart Home Solution for Dysdiadochokinesia Patients

Smart home products are means of comfort for many, but they are still of dire need for a few. Dysdiadochokinesia (DDK) is a type of disease which results in difficulty in performing fast, consecutive action, most probably because of a prevailed issue. Matter is constructed with an aim of making smart home products interoperable, easy to use and smooth without compromising on security. By stacking the same on top of Internet Protocol (IP) layer, Matter will make communication possible across smart home products, mobile-based applications, and cloud-based services, and demonstrate a specific set of IP networking technologies for the certification of smart products. Development of an independent smart home solution for people suffering from Dysdiadochokinesia is proposed in this work. The system proposed enables them to travel indoors using a vision-controlled wheelchair and establish control over home appliances via vision commands by leveraging Matter Smart Home Protocol. Eye gaze movements and eye blinks are used as controlling parameters which are fed to machine learning models such as SVM and KNN which produces a classification label. Controller designed is tested for the movements of wheelchair in either of the four directions and also for controlling Matter enabled light and door lock producing promising results.