Ashwin Krishna Raparthy¹, Bhim Prajapati¹, Santhi Priya Yalla¹, Vigneshkkar Ravichandran¹, Enrico De Santis² and Parisa Naraei³*

¹Postgraduate AI Student, Lambton College, Canada
²Machine Learning Engineer and Chief Technology Officer, SisterPomos and Scientific Researcher, Sapienza Università di Roma, Italy
³Professor, Cestar College of Business, Health and Technology, Department of Artificial Intelligence, Lambton College, Applied Researcher, Toronto Metropolitan University Alumni, Canada

*Corresponding Author: Parisa Naraei, Professor, Cestar College of Business, Health and Technology, Department of Artificial Intelligence, Lambton College, Applied Researcher, Toronto Metropolitan University Alumni, Canada.

Received: July 26, 2022; Published: September 23, 2022

Abstract

Human beings are wonderful creations of nature. People are known for the intelligence they have. Among the various creations of human thoughts, language is also one that human beings use to communicate with each other. But for, differently abled people who cannot hear have a different language to communicate with, called sign language. This type of language is expressed using the physical articulation of the body parts. In this case, it should not be confused with the body language that normal people use. Deaf people primarily use sign language, but people who cannot speak also use this language.

With the evolution of technology and advancement in AI, computers can now process human language using NLP. In this project, we use a deep learning method to predict sign language. We are building a web app through which a sign user can interact with a normal person who cannot understand sign language. We have used a convolutional neural network (CNN) to get the key points of the human body like the face, shoulder, arm, hand, and fingers. Then we used long short-term memory (LSTM) to model the neural network. Our model can predict sign language with an accuracy of 95.8%.

Keywords: Convolutional Neural Network (CNN); Hidden Markov Model (HMM); Artificial Neural Network (ANN)