CFP last date
20 June 2024
Reseach Article

Facial Expression Recognition based on Hybrid Featured CNN (FERHC) Algorithm

by Rajan Saini, Shainy Bakshi
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 183 - Number 24
Year of Publication: 2021
Authors: Rajan Saini, Shainy Bakshi

Rajan Saini, Shainy Bakshi . Facial Expression Recognition based on Hybrid Featured CNN (FERHC) Algorithm. International Journal of Computer Applications. 183, 24 ( Sep 2021), 32-38. DOI=10.5120/ijca2021921611

@article{ 10.5120/ijca2021921611,
author = { Rajan Saini, Shainy Bakshi },
title = { Facial Expression Recognition based on Hybrid Featured CNN (FERHC) Algorithm },
journal = { International Journal of Computer Applications },
issue_date = { Sep 2021 },
volume = { 183 },
number = { 24 },
month = { Sep },
year = { 2021 },
issn = { 0975-8887 },
pages = { 32-38 },
numpages = {9},
url = { },
doi = { 10.5120/ijca2021921611 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
%0 Journal Article
%1 2024-02-07T01:17:47.561056+05:30
%A Rajan Saini
%A Shainy Bakshi
%T Facial Expression Recognition based on Hybrid Featured CNN (FERHC) Algorithm
%J International Journal of Computer Applications
%@ 0975-8887
%V 183
%N 24
%P 32-38
%D 2021
%I Foundation of Computer Science (FCS), NY, USA

Human has various type of emotions by which his/ her mood can identify. There are three kinds of emotions such as basic, ambiguous, and complex type of emotions. Anger, joy, fear, sadness, neutral, surprise, and disgust are included in basic types of emotions. In the complex type of emotions pride, shame, anxiety, etc. are included. The ambiguous emotions are hope and compassion. The process which is used to detect human facial emotions is known as facial expression recognition. For a human, it is easy to understand the facial expression but for a machine it is difficult. The advancement in technology made expression recognition easier with the help of artificial intelligence. There are various applications of facial expression recognition systems such as user verification, mug shot matching, and user access control. There are several existing techniques of human facial expression recognition, but still, it is a challenging task. In the proposed work, an advanced learning-based CNN (Convolutional Neural Network) model with hybrid features is used to recognize human facial expressions. In images, some features are connection-oriented and some are edge-oriented, therefore hybrid methodology is used. The PCA (principal component analysis) and LBP (Local binary pattern) are used to extract the hybrid features from the image. For the classification of facial expression, a deep learning-based CNN model is used. Numerous fully connected layers are applied to the surface of one another in deep neural networks, for efficient recognition of complicated parts. The proposed model is evaluated on different parameters such as MSE, FAR, FRR, and accuracy.

  1. Wang, W., Xu, K., Niu, H., & Miao, X. 2020 Emotion Recognition of Students Based on Facial Expressions in Online Education Based on the Perspective of Computer Simulation. Complexity, 2020.
  2. Mehendale, N. 2020. Facial emotion recognition using convolutional neural networks (FERC). SN Applied Sciences, 2(3), 1-8.
  3. "Emotion | Introduction to Psychology",, 2021. [Online]. Available: [Accessed: 22- May- 2021].
  4. "The 6 Types of Basic Emotions and Their Effect on Human Behavior", Verywell Mind, 2021. [Online]. Available:,shame%2C%20embarrassment%2C%20and%20excitement. [Accessed: 22- May- 2021].
  5. Liliana, D. Y. 2019, Emotion recognition from facial expression using deep convolutional neural network. In Journal of physics: conference series (Vol. 1193, No. 1, p. 012004). IOP Publishing.
  6. Borkar, N. R., &Kuwelkar, S. 2017, Real-time implementation of face recognition system. In 2017 International Conference on Computing Methodologies and Communication (ICCMC) (pp. 249-255).IEEE.
  7. Mehendale, N. 2020. Facial emotion recognition using convolutional neural networks (FERC). SN Applied Sciences, 2(3), 1-8.
  8. Gupta, A., Arunachalam, S., &Balakrishnan, R. 2020. Deep self-attention network for facial emotion recognition. Procedia Computer Science, 171, 1527-1534.
  9. Supta, S. R., Sahriar, M. R., Rashed, M. G., Das, D., &Yasmin, R. 2020, December. An Effective Facial Expression Recognition System. In 2020 IEEE International Women in Engineering (WIE) Conference on Electrical and Computer Engineering (WIECON-ECE) (pp. 66-69). IEEE.
  10. Chen, Y., Wang, J., Chen, S., Shi, Z., &Cai, J. 2019, December. Facial motion prior networks for facial expression recognition.In 2019 IEEE Visual Communications and Image Processing (VCIP) (pp. 1-4).IEEE.
  11. Kim, S., & Kim, H. 2019, February. Deep explanation model for facial expression recognition through facial action coding unit.In 2019 IEEE International Conference on Big Data and Smart Computing (BigComp) (pp. 1-4).IEEE.
  12. Niu, B., Gao, Z., &Guo, B. 2021. Facial Expression Recognition with LBP and ORB Features. Computational Intelligence and Neuroscience,.
  13. Tcherkassof, A., &Dupré, D. 2020. The emotion–facial expression link: evidence from human and automatic expression recognition. Psychological Research, 1-16.
  14. Zhang, F., Zhang, T., Mao, Q., &Xu, C. 2020. Geometry guided pose-invariant facial expression recognition. IEEE Transactions on Image Processing, 29, 4445-4460.
  15. M. Lyons, S. Akemastu, and M. Kamachi, “Coding facial expressions with gabor wavelets,” in Proceedings of the ;ird IEEE International Conference on Automatic Face and GestureRecognition, pp. 200–205, Nara, Japan, April 1998.
Index Terms

Computer Science
Information Sciences


Face expression recognition emotions hybrid features using LBP+PCA CNN (Convolutional Neural Network).