Sign Language to Text Conversion using RNN-LSTM

The speech-impaired community only uses sign language; the rest of society interacts verbally. Our research intends to fill this communication gap by proposing a state-of-the-art method for comprehending both static and moving signs in Indian Sign Language and translating them into text. Data is collected, pre-processed, and hand recognition is finished using media pipe holistic before being categorized into suitable speech output. Because LSTM networks can develop long-term dependencies, they were investigated and employed for the classification of gesture data. The constructed model exhibited a 100% accuracy rate while categorizing 26 motions, highlighting the usefulness of LSTM-based neural networks for sign language translation. For those who are deaf or dumb, translating sign language into text allows them to interact with each other or with people in the general public by using hand gestures. According to a survey we conducted on sign language comprehension, most people are unable to identify the hand gestures and mode of communication used by sign language users. After hearing about all the difficulties, they have communicating with regular people, we developed this initiative on sign language transcription. The community of deaf and mute people will benefit from this initiative because it explains the meaning of each hand gesture and uses hand gestures to communicate various signs. In this project, hand gestures were recognized using a pipeline method called media pipe, and training and testing were carried out using deep learning techniques. Sign language was then converted to text format.