Performance of ShuffleNet and VGG-19 Architectural Classification Models for Face Recognition in Autistic Children

Melinda Melinda, Maulisa Oktiana, Yudha Nurdin, Indah Pujiati, Muhammad Irhamsyah, Nurlida Basir

Abstract


This study discusses the face recognition of children with special needs, especially those with autism. Autism Spectrum Disorder (ASD) is a complex neurodevelopmental disorder that affects social skills, ways of interacting, and communication disorders. Facial recognition in autistic children is needed to help detect autism quickly to minimize the risk of further complications. There is extraordinarily little research on facial recognition of autistic children, and the resulting system is not fully accurate. This research proposes using the Convolution Neural Network (CNN) model using two architectures: ShuffleNet, which uses randomization channels, and Visual Geometry Group (VGG)-19, which has 19 layers for the classification process. The research object used in the face recognition system is secondary data obtained through the Kaggle site with a total of 2,940 image data consisting of images of autism and non-autism. The faces of autistic children are visually difficult to distinguish from those of normal children. Therefore, this system was built to recognize the faces of people with autism. The method used in this research is applying the CNN model to autism face recognition through images by comparing two architectures to see their best performance. Autism and non-autism data are grouped into training data, 2,540, and test data, as much as 300. In the training stage, the data was validated using validation data consisting of 50 autism image data and 50 non-autism image data. The experimental results show that the VGG-19 has high accuracy at 98%, while ShuffleNet is 88%.

Keywords


Face recognition system; Autism; Convolutional Neural Network (CNN); ShuffleNet; VGG-19

Full Text:

PDF

References


S. Singh, D. Singh, and V. Yadav, “Face Recognition Using HOG Feature Extraction and Svm Classifier,†Int. J. Emerg. Trends Eng. Res., vol. 8, no. 9, pp. 6437–6440, 2020, doi: 10.30534/ijeter/2020/244892020.

A. P. Ismail and N. M. Tahir, “Human Gait Silhouettes Extraction Using Haar Cascade Classifier on OpenCV,†Proc. - 2017 UKSim-AMSS 19th Int. Conf. Model. Simulation, UKSim 2017, pp. 105–110, 2018, doi: 10.1109/UKSim.2017.25.

A. Almansour, G. Alsaeedi, H. Almazroui, and H. Almuflehi, “I-Privacy Photo: Face Recognition and Filtering,†ACM Int. Conf. Proceeding Ser., pp. 131–141, 2020, doi: 10.1145/3388142.3388161.

E. Setiawan and A. Muttaqin, “Implementation of K-Nearest Neightbors Face Recognition on Low-power Processor,†Telkomnika (Telecommunication Comput. Electron. Control., vol. 13, no. 3, p. 949, 2015, doi: 10.12928/telkomnika.v13i3.713.

M. M. Ghazi and H. K. Ekenel, “A Comprehensive Analysis of Deep Learning Based Representation for Face Recognition,†IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Work., pp. 102–109, 2016, doi: 10.1109/CVPRW.2016.20.

M. Beary, A. Hadsell, R. Messersmith, and M. P. Hosseini, “Diagnosis of autism in children using facial analysis and deep learning,†arXiv, 2020.

P. Catherine Lord, P. Susan Risi, P. Pamela S. DiLavore, P. Cory Shulman, P. Audrey Thurm and P. Andrew Pickles, "Autism From 2 to 9 Years of Age," American Medical Association. All rights reserved, vol. 63, no. 6, pp.694-701, 2006.

V. Anagnostopoulou, "The Effectiveness of Social StoriesTM on children with Autism Spectrum Disorder," School Teacher & Special Education Teacher, MA, National and Kapodistrian University of Athens, University of Nottingham, vol. ix, pp. 16, 2020.

L. Mapeli, T. Soda, E. D'angelo and F. Prestori, "The Cerebellar Involvement in Autism Spectrum Disorder from the Social Brain to Mouse Models,"International Journal of Molecular Sciences, 2022

M. P. Kazunari Yoshida, P. Emiko Koyama, P. Clement C. Zai, M. Joseph H. Beitchman, M. James L. Kennedy, P. C. P. Yona Lunsky,

M. Pushpal Desarkar and M. P. Daniel J. Muller, "Pharmacogenomic Studies in Intellectual Disabilities and Autism Spectrum Disorder: A Systematic Review," The Canadian Journal of Psychiatry La Revue Canadienne de Psychiatrie, pp. 1-23, 2020.

B. Robson, "Autism spectrum disorder: A review of the current understanding of pathophysiology and complementary therapies in children,"Australian Journal of Herbal Medicine, pp. 128-151, 2013.

S. Jahanara, “Detecting autism from facial image,†Int. J. Adv. Res. Ideas Innov. Technol., no. March, pp. 1–8, 2021, doi: 10.13140/RG.2.2.35268.35202.

T. Akter et al., “Improved transfer-learning-based facial recognition framework to detect autistic children at an early stage,†Brain Sci., vol. 11, no. 6, 2021, doi: 10.3390/brainsci11060734.

H. Kalantarian et al., “Labeling images with facial emotion and the potential for pediatric healthcare,†Artif. Intell. Med., vol. 98, no. April 2018, pp. 77–86, 2019, doi: 10.1016/j.artmed.2019.06.004.

B. Banire, D. Al Thani, M. Qaraqe, and B. Mansoor, “Face-Based Attention Recognition Model for Children with Autism Spectrum Disorder,†J. Healthc. Informatics Res., vol. 5, no. 4, pp. 420–445, 2021, doi: 10.1007/s41666-021-00101-y.

J. Hernandez-Ortega, J. Galbally, J. Fierrez, R. Haraksim, and L. Beslay, “FaceQnet: Quality Assessment for Face Recognition based on Deep Learning,†2019 Int. Conf. Biometrics, ICB 2019, 2019, doi: 10.1109/ICB45273.2019.8987255.

S. Albawi, O. Bayat, S. Al-Azawi, and O. N. Ucan, “Social touch gesture recognition using convolutional neural network,†Comput. Intell. Neurosci., vol. 2018, 2018, doi: 10.1155/2018/6973103.

J. Alamri, R. Harrabi, and S. Ben Chaabane, “Face Recognition based on Convolution Neural Network and Scale Invariant Feature Transform,†Int. J. Adv. Comput. Sci. Appl., vol. 12, no. 2, pp. 644–654, 2021, doi: 10.14569/IJACSA.2021.0120281.

B. Banire, D. Al Thani, M. Qaraqe, and B. Mansoor, “Face-Based Attention Recognition Model for Children with Autism Spectrum Disorder,†J. Healthc. Informatics Res., 2021, doi: 10.1007/s41666-021-00101-y.

Zhang, X., Zhou, X., Lin, M., and Sun, J. "ShuffleNet : An extremely efficeint convolutional neural network for mobile devices," Proceeedings of the IEEE conference on computer vision and pattern recognition., pp. 6848-6856, 2018

L. Tidmarsh and F. R. Volkmar, “Diagnosis and Epidemiology of Autism Spectrum Disorders,†Can. J. Psychiatry, vol. 48, no. 8, pp. 517–525, 2003, doi: 10.1177/070674370304800803.

A. K. Jain, “Handbook of Face Recognition,†pp. 1–40, 2014, [Online]. Available: papers3://publication/uuid/17FEF3DC-D6F9-408B-96E5-871ED133A4F1. [Diakses: 10 September 2021]

K. H. Teoh, R. C. Ismail, S. Z. M. Naziri, R. Hussin, M. N. M. Isa, and M. S. S. M. Basir, “Face Recognition and Identification using Deep Learning Approach,†J. Phys. Conf. Ser., vol. 1755, no. 1, 2021, doi: 10.1088/1742-6596/1755/1/012006.

A. K. Dubey and V. Jain, "Automatic Facial Recognition Using VGG16 based Transfer Learning Model," Journal of Information and Optimization Sciences, vol. 41, no. 7, pp. 1589-1596, 2020.

M. A. Aghdam, A. Sharifi and M. M. Pedram, "Diagnosis of Autism Spectrum Disorders in Young Children Based on Resting-State Functional Magnetic Resonance Imaging Data Using Convolutional Neural Networks,"Journal of Digital Imaging, vol. 32, no. 6, pp. 899-918, 2019.

M. P. Hosseini, M. Beary, A. Hadsell, R. Messermith and H. Soltanian Zadeh, "Deep Learning for Autism Diagnosis and Facial Analysis in Children," Frontiers in Computational Neuroscience, 2022.

Y. Lecun, Y. Bengio, and G. Hinton, “Deep learning,†Nature, vol. 521, no. 7553, pp. 436–444, 2015, doi: 10.1038/nature14539.

A. A. Cruz-Roa, J. E. Arevalo Ovalle, A. Madabhushi, and F. A. González Osorio, “A deep learning architecture for image representation, visual interpretability and automated basal-cell carcinoma cancer detection,†Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 8150 LNCS, no. PART 2, pp. 403–410, 2013, doi: 10.1007/978-3-642-40763-5_50.

J. S. Asri and G. Firmansyah, “Implementasi Objek Detection Dan Tracking Menggunakan Deep Learning Untuk Pengolahan Citra Digital,†Knsi 2018, pp. 717–723, 2018..

S. J. Rashid, A. I. Abdullah and M. A Shihab, “Face Recognition System Based on Gabor Wavelets Transform, Principal Component Analysis and Support Vector Machine,†International Journal on Advanced Science, Engineering and Information Technology, vol.10,no. 3. pp. 959—963, 2020.

B. Achmad and K. Firdausy, “Neural Network-based Face Pose Tracking for Interactive Face Recognition System,†International Journal on Advanced Science, Engineering and Information Technology, 1 vol.2, no. 1. pp.105—108, 2012.

F. H. K. Zaman, A. A Sulaiman, I. M. Yassin, N. M. Tahir and Z. I. Rizman, “Development of Mobile Face Verification Based on Locally Normalized Gabor Wavelets,†International Journal on Advanced Science, Engineering and Information Technology, vol.7, no. 4. pp. 1198--1205, 2017.

J. Xiao, J. Wang, S. Cao, and B. Li, “Application of a Novel and Improved VGG-19 Network in the Detection of Workers Wearing Masks,†in Journal of Physics: Conference Series, 2020, vol. 1518, no. 1, doi: 10.1088/1742-6596/1518/1/012041.

“Autism_Image_Data_Kaggle.†[Online]. Available: https://www.kaggle.com/cihan063/autism-image-data.

C. He, M. Ma, and P. Wang, “Extract interpretability-accuracy balanced rules from artificial neural networks: A review,†Neurocomputing, vol. 387, pp. 346–358, 2020, doi: 10.1016/j.neucom.2020.01.036.




DOI: http://dx.doi.org/10.18517/ijaseit.13.2.18274

Refbacks

  • There are currently no refbacks.


Published by INSIGHT - Indonesian Society for Knowledge and Human Development