(Publisher of Peer Reviewed Open Access Journals)
Navigation

International Journal of Advanced Technology and Engineering Exploration (IJATEE)

ISSN (Print):2394-5443    ISSN (Online):2394-7454
Volume-8 Issue-83 October-2021
Full-Text PDF
Paper Title : Human emotion recognition based on block patterns of image and wavelet transform
Author Name : Pravin B Chopade and Prabhakar N Kota
Abstract :

In this manuscript, Human Emotion Recognition based on Block Patterns of Image and Discrete Wavelet Transform (HER-BP-DWT) is proposed. The different facial parts, such as eyebrows, eye, lips, mouth, and muscle movements play an important role in emotion recognition. But according to change in age, the movements of facial parts and muscles become weaker, so recognizing emotions can be a little more tedious and complicated. Therefore, in this manuscript, a new approach that is different from the conventional one using block patterns and discrete wavelet transform is proposed. Here, first of all, the test image is divided horizontally and vertically into different block patterns. Then, each block is separated as sub blocks. The particular area block is decomposed into different frequency sub bands with the help of discrete wavelet transform. The energy of these sub bands of each block is calculated. The energy of sub bands of the test image and the reference image is compared. The main aim of this proposed method is to recognize emotional expressions using a simple parameter, like energy of sub bands that is obtained from discrete wavelet transform and it is easy to use. The main objective is to increase the accuracy during face image recognition. The proposed HER-BP-DWT method can be efficiently and accurately recognized different emotions, such as happiness, sadness, anger, etc. The proposed method is very convenient to use due to the use of block patterns. The proposed approach is activated in MATLAB platform, then the performance is compared with other existing approaches, such as Human Emotion Recognition using Convolutional Neural Networks (HER-CNN) and Human Emotion Recognition using Bimodal Fusion Algorithm (HER-BFA). Finally, the experimental results show that the HER-BP-DWT method is superior to the existing methods. From the experimental analysis, the HER-BP-DWT method shows the accuracy of 99.55%, sensitivity of 85.93%, precision of 92.43% and 90.74% of specificity, which is prominent than the existing methods.
Keywords : Energy component, Discrete wavelet transform, Image blocks, Pattern, Coefficients of frequency sub bands, Facial emotion expression.
Cite this article : Chopade PB, Kota PN. Human emotion recognition based on block patterns of image and wavelet transform. International Journal of Advanced Technology and Engineering Exploration. 2021; 8(83):1394-1409. DOI:10.19101/IJATEE.2021.874165.
References :
[1]Matsumoto D, Hwang HS. Evidence for training the ability to read microexpressions of emotion. Motivation and Emotion. 2011; 35(2):181-91.
[Crossref] [Google Scholar]
[2]Quintana DS, Guastella AJ, Outhred T, Hickie IB, Kemp AH. Heart rate variability is associated with emotion recognition: direct evidence for a relationship between the autonomic nervous system and social cognition. International Journal of Psychophysiology. 2012; 86(2):168-72.
[Crossref] [Google Scholar]
[3]Khalili Z, Moradi MH. Emotion recognition system using brain and peripheral signals: using correlation dimension to improve the results of EEG. In international joint conference on neural networks 2009 (pp. 1571-5). IEEE.
[Crossref] [Google Scholar]
[4]Haag A, Goronzy S, Schaich P, Williams J. Emotion recognition using bio-sensors: first steps towards an automatic system. In tutorial and research workshop on affective dialogue systems 2004 (pp. 36-48). Springer, Berlin, Heidelberg.
[Crossref] [Google Scholar]
[5]Ko KE, Yang HC, Sim KB. Emotion recognition using EEG signals with relative power values and bayesian network. International Journal of Control, Automation and Systems. 2009.
[Crossref] [Google Scholar]
[6]Ringrose K. Law enforcements pairing of facial recognition technology with body-worn cameras escalates privacy concerns. Online - Virginia Law Review. 2019; 105:57-66.
[Google Scholar]
[7]Mythili S, Thiyagarajah K, Rajesh P, Shajin FH. Ideal position and size selection of unified power flow controllers (UPFCs) to upgrade the dynamic stability of systems: an antlion optimiser and invasive weed optimisation algorithm. HKIE Transactions. 2020; 27(1):25-37.
[Google Scholar]
[8]Stark L, Stanhaus A, Anthony DL. “I dont want someone to watch me while im working”: gendered views of facial recognition technology in workplace surveillance. Journal of the Association for Information Science and Technology. 2020; 71(9):1074-88.
[Google Scholar]
[9]Wilkinson S. Artificial intelligence, facial recognition technology and data privacy. Journal of Data Protection & Privacy. 2020; 3(2):186-98.
[Google Scholar]
[10]Baig Z, Shivakumar DS, Ananthapadmanabha DT. A multi-objective hybrid algorithm for planning electrical distribution system. International Journal of Electrical Engineering and Technology. 2020; 11(3):66-82.
[Google Scholar]
[11]Leong B. Facial recognition and the future of privacy: i always feel like… somebody’s watching me. Bulletin of the Atomic Scientists. 2019; 75(3):109-15.
[Crossref] [Google Scholar]
[12]Martinez-martin N. What are important ethical implications of using facial recognition technology in health care?. AMA Journal of Ethics. 2019; 21(2): 180-7.
[Crossref] [Google Scholar]
[13]Shajin FH, Rajesh P. Trusted secure geographic routing protocol: outsider attack detection in mobile ad hoc networks by adopting trusted secure geographic routing protocol. International Journal of Pervasive Computing and Communications. 2020.
[Crossref] [Google Scholar]
[14]Hamann K, Smith R. Facial recognition technology. CRIM. JUST. 2019.
[Google Scholar]
[15]Kostka G, Steinacker L, Meckel M. Between privacy and convenience: facial recognition technology in the eyes of citizens in China, Germany, the UK and the US. Germany, the UK and the US. 2020.
[Google Scholar]
[16]Thota MK, Shajin FH, Rajesh P. Survey on software defect prediction techniques. International Journal of Applied Science and Engineering. 2020; 17(4):331-44.
[Crossref] [Google Scholar]
[17]Conger K, Fausset R, Kovaleski SF. San Francisco bans facial recognition technology. The New York Times. 2019.
[Google Scholar]
[18]Stark L, Stanhaus A, Anthony DL. I dont want someone to watch me while im working: gendered views of facial recognition technology in workplace surveillance. Journal of the Association for Information Science and Technology. 2020; 71(9):1074-88.
[Crossref] [Google Scholar]
[19]Morosan C. Disclosing facial images to create a consumer’s profile: a privacy calculus perspective of hotel facial recognition systems. International Journal of Contemporary Hospitality Management. 2019.
[Crossref] [Google Scholar]
[20]Kosinski M. Facial recognition technology can expose political orientation from naturalistic facial images. Scientific Reports. 2021.
[Crossref] [Google Scholar]
[21]Varma S, Shinde M, Chavan SS. Analysis of PCA and LDA features for facial expression recognition using SVM and HMM classifiers. In techno-societal 2018 (pp. 109-19). Springer, Cham.
[Crossref] [Google Scholar]
[22]Kehri V, Ingle R, Patil S, Awale RN. Analysis of facial EMG signal for emotion recognition using wavelet packet transform and SVM. In machine intelligence and signal analysis 2019 (pp. 247-57). Springer, Singapore.
[Crossref] [Google Scholar]
[23]Xu X, Zhang Y, Tang M, Gu H, Yan S, Yang J. Emotion recognition based on double tree complex wavelet transform and machine learning in internet of things. IEEE Access. 2019; 7:154114-20.
[Crossref] [Google Scholar]
[24]Acharya D, Billimoria A, Srivastava N, Goel S, Bhardwaj A. Emotion recognition using fourier transform and genetic programming. Applied Acoustics. 2020.
[Crossref] [Google Scholar]
[25]Zhang YD, Yang ZJ, Lu HM, Zhou XX, Phillips P, Liu QM, et al. Facial emotion recognition based on biorthogonal wavelet entropy, fuzzy support vector machine, and stratified cross validation. IEEE Access. 2016; 4:8375-85.
[Crossref] [Google Scholar]
[26]Ayyavoo T, Suseela JJ. Illumination pre-processing method for face recognition using 2D DWT and CLAHE. IET Biometrics. 2018; 7(4):380-90.
[Google Scholar]
[27]Krishna AH, Sri AB, Priyanka KY, Taran S, Bajaj V. Emotion classification using EEG signals based on tunable-Q wavelet transform. IET Science, Measurement & Technology. 2019; 13(3):375-80.
[Google Scholar]
[28]Meena HK, Sharma KK, Joshi SD. Facial expression recognition using the spectral graph wavelet. IET Signal Processing. 2019; 13(2):224-9.
[Google Scholar]
[29]Ekman P, Friesen WV. Facial action coding systems. Consulting Psychologists Press; 1978.
[Google Scholar]
[30]Ekman P. The argument and evidence about universals in facial expressions. Handbook of Social Psychophysiology. 1989.
[Google Scholar]
[31]Sown M. A preliminary note on pattern recognition of facial emotional expression. In the international joint conferences on pattern recognition, 1978.
[Google Scholar]
[32]Li C, Huang Y, Zhu L. Color texture image retrieval based on gaussian copula models of Gabor wavelets. Pattern Recognition. 2017; 64:118-29.
[Crossref] [Google Scholar]
[33]Wu T, Bartlett MS, Movellan JR. Facial expression recognition using gabor motion energy filters. In computer society conference on computer vision and pattern recognition-workshops 2010 (pp. 42-7). IEEE.
[Crossref] [Google Scholar]
[34]Huang L, Xie F, Zhao J, Shen S, Guang W, Lu R. Human emotion recognition based on face and facial expression detection using deep belief network under complicated backgrounds. International Journal of Pattern Recognition and Artificial Intelligence. 2020; 34(14).
[Crossref] [Google Scholar]
[35]Belhouchette K, Berkane M, Belhadef H. Interest emotion recognition approach using self-organising map and motion estimation. International Journal of Intelligent Systems Technologies and Applications. 2019; 18(5):494-508.
[Google Scholar]
[36]Wei M. A novel face recognition in uncontrolled environment based on block 2D-CS-LBP features and deep residual network. International Journal of Intelligent Computing and Cybernetics. 2020; 13(2):207-21.
[Crossref] [Google Scholar]
[37]Zhang QN. Improvement of face recognition technology based on intelligent image. In international conference on intelligent transportation, big data & smart city 2019 (pp. 570-3). IEEE.
[Crossref] [Google Scholar]
[38]Putri TT, Rachmawati E, Sthevanie F. Indonesian ethnicity recognition based on face image using uniform local binary pattern (ULBP) and color histogram. In international conference on informatics and computational sciences 2020 (pp. 1-5). IEEE.
[Crossref] [Google Scholar]
[39]Li H. Application of image recognition based on grey relational analysis. Automatic Control and Computer Sciences. 2020; 54(4):371-7.
[Crossref] [Google Scholar]
[40]Baker SA, Mohammed HH, Aldabagh HA. Improving face recognition by artificial neural network using principal component analysis. TELKOMNIKA. 2020; 18(6):3357-64.
[Crossref] [Google Scholar]
[41]Shi D, Tang H. Face recognition algorithm based on self-adaptive blocking local binary pattern. Multimedia Tools and Applications. 2021; 80:23899-921.
[Crossref] [Google Scholar]
[42]Li Z, Cui LL. Three-dimensional image reconstruction method for human maxillofacial defect images based on block sample feature matching. International Journal of Engineering Systems Modelling and Simulation. 2019; 11(3):112-8.
[Google Scholar]
[43]Nhat HT, Hoang VT. Feature fusion by using LBP, HOG, GIST descriptors and canonical correlation analysis for face recognition. In international conference on telecommunications 2019 (pp. 371-5). IEEE.
[Crossref] [Google Scholar]
[44]Tran-Trung K, Hoang VT. Hand gesture recognition under multi-view cameras using local image descriptors. In inventive computation and information technologies 2021 (pp. 299-304). Springer, Singapore.
[Crossref] [Google Scholar]
[45]Qin Y, Sun L, Xu Y. Exploring of alternative representations of facial images for face recognition. International Journal of Machine Learning and Cybernetics. 2020; 11(10):2289-95.
[Crossref] [Google Scholar]
[46]Mi JX, Zhu Q, Lu J. Principal component analysis based on block-norm minimization. Applied Intelligence. 2019; 49(6):2169-77.
[Crossref] [Google Scholar]
[47]Liu J. Feature recognition method for similar key points of human face based on adaptive median filter. International Journal of Biometrics. 2021; 13(1):1-6.
[Google Scholar]
[48]Mehta R, Satam S, Ansari M, Samantaray S. Real-time image processing: face recognition based automated attendance system in-built with “two-tier authentication” method. In international conference on data science and engineering 2020 (pp. 1-6). IEEE.
[Crossref] [Google Scholar]
[49]Aiordachioaie D, Culea-Florescu A, Pavel SM. On human faces thermal image processing for classification purposes. In 6th international symposium on electrical and electronics engineering 2019 (pp. 1-6). IEEE.
[Crossref] [Google Scholar]
[50]Gnouma M, Ladjailia A, Ejbali R, Zaied M. Stacked sparse autoencoder and history of binary motion image for human activity recognition. Multimedia Tools and Applications. 2019; 78(2):2157-79.
[Crossref] [Google Scholar]
[51]Majhi M, Pal AK. An image retrieval scheme based on block level hybrid DCT-SVD fused features. Multimedia Tools and Applications. 2021; 80(5):7271-312.
[Crossref] [Google Scholar]
[52]Courville PL, Goodfellow A, Mirza IJ, Bengio Y. FER-2013 face database. Universit De Montreal: Montréal, QC, Canada. 2013.
[Google Scholar]
[53]Lucey P, Cohn JF, Kanade T, Saragih J, Ambadar Z, Matthews I. The extended cohn-kanade dataset (ck+): a complete dataset for action unit and emotion-specified expression. In computer society conference on computer vision and pattern recognition-workshops 2010 (pp. 94-101). IEEE.
[Crossref] [Google Scholar]
[54]Minaee S, Minaei M, Abdolrashidi A. Deep-emotion: facial expression recognition using attentional convolutional network. Sensors. 2021; 21(9):1-16.
[Crossref] [Google Scholar]
[55]Aneja D, Colburn A, Faigin G, Shapiro L, Mones B. Modeling stylized character expressions via deep learning. In Asian conference on computer vision 2016 (pp. 136-53). Springer, Cham.
[Crossref] [Google Scholar]
[56]Mehendale N. Facial emotion recognition using convolutional neural networks (FERC). SN Applied Sciences. 2020.
[Crossref] [Google Scholar]
[57]Wang X, Chen X, Cao C. Human emotion recognition by optimally fusing facial expression and speech feature. Signal Processing: Image Communication. 2020.
[Crossref] [Google Scholar]