Gesture Talk : Multi-Modal Sign Language Recognition System

For the deaf community, sign language is an essential means of communication. It is a three-dimensional language that uses hands that move dynamically and visually to represent letters and words. The field of gesture recognition has garnered significant attention and is widely used in academia and industry. This work focuses on the creation of a comprehensive system that can recognise complex hand gestures made by humans and utilise them to operate devices or express ideas and feelings. By offering a strong substitute for conventional speech, this technology improves a person's ability to interact and take part in society. Interestingly, different nations with similar spoken languages frequently have different sign languages. For example, American Sign Language (ASL), British Sign Language (BSL), and Australian Sign Language (Auslan) are all included in the English language. In this work, we focus on American Sign Language (ASL) in order to develop a system that can interpret written words from ASL hand gestures by first recognising and analysing them. By fusing ASL gesture recognition with audio output, our research seeks to close the communication gap and promote an environment that is more inclusive and accessible for those who are deaf or hard of hearing.