Analysis of Facial Emotion Recognition for Image and Video Data using Convolution Neural Networks

Facial Emotion Recognition is used to classify the emotional states of a human. The objective is to group every facial picture into one of the seven facial emotion classes like Surprise, Sad, Neutral, Happy, Fear, Disgust and Angry. Convolutional Neural Network (CNN) is used for classifying the emotion. Various gray scale pictures from the dataset and real-time videos are taken as input. Then feature extraction is done using the series of convolution and pooling layers of CNN and classification is done using softmax layer. To overcome the overfitting problem of the model, various procedures including dropout, cluster standardization and L2 regularization are used. Experiments are performed on Facial expression dataset image folders (fer2013) dataset and achieved better accuracy with our model than the existing works in predicting the individual emotions. In addition to this, the model is also used to predict the emotion of each image in the real time video data with good performance.