Implementing Augmented Reality (AR) on Phonics-based Literacy among Children with Autism

Zainal Rasyid Mahayuddin, Najmiah Mamat

Abstract


The implementation of Augmented Reality (AR) technology in education has created an interesting approach to enhance the effectiveness and attractiveness of teaching and learning for students in real-life scenarios. This medium offers unique affordances, combining physical and virtual worlds, with continuous and implicit user control of the point of view and interactivity. This paper introduces the technology of augmented reality and its capabilities in facilitating children with autism. AR is a technology that overlays digital information on a live view of the physical world to create a blended experience. AR provides unique experiences and opportunities to learn and interact with information in the physical world. Hence, AR can be one of the effective technologies available in developing tools for teaching and learning with the combination of the virtual world and real objects such as transportation, fruits, numbers, and alphabets. This will facilitate the autistic child to recognize the abstract concepts of the real objects and their descriptions. The purpose of this paper was to investigate the use of AR on mobile devices in fostering literacy in academic and learning skills for children with autism using the phonics learning method. This prototype helps the autistic child to capture and associate the graphics or pictures of the surrounding objects so as improving the literacy and learning skills of the children. The results show that the children can pronounce and to distinguish between vowels “aâ€, “i†and “uâ€. The children are also able to answer most of the questions in the exercises provided. The interactivity between the children and the application raises their attention and focus mainly in literacy and learning skills.

Keywords


augmented reality; autism; literacy; learning skills; mobile; phonics method.

Full Text:

PDF

References


Kirner, C. & Zorzal, E.R. (2005). XVI Simpósio Brasileiro de Informática na Educação - SBIE – UFJF (2005). Educational Applications in Collaborative Environments with Augmented Reality. 114-124.

N. H. Anas, Z. R. Mahayuddin: Aiding Autistic Children Learn Arabic Through Developing an Engaging User-Friendly Android App. IIOABJ. 2017. Vol.8 (Suppl 3): 87-90.

N. H. Anas, Z. R. Mahayuddin: A Review On Android Applications For Arabic Language Learning. IIOABJ. 2017. Vol.8 (Suppl 3): 102-105.

Zainal Rasyid Mahayuddin, Nur Afyfah Suwadi, Ruzzakiah Jenal, Haslina Arshad, Trio Adiono. Implementing Smart Mobile Application to Achieve a Sustainable Campus. International Journal of Supply Chain Management (IJSCM). 2018. Vol. 7 No. 3: 154-159.

Bai, Z., Blackwell, A. F., and Coulouris, G. Using Augmented Reality to Elicit Pretend Play for Children with Autism. IEEE Transactions on Visualization and Computer Graphics. 2015. Vol. 21 No. 5: 598 – 610.

Aliee, Z. S., Jomhari, N., Rezaei, R., Alias, N. The Effectiveness of Managing Split Attention among Autistic Children Using Computer-Based Intervention. The Turkish Online Journal of Educational Technology. 2013. Vol 12 No. 2: 281 – 302.

Fossett. B. 2004. Visual Support Strategies for Literacy Development. SEA Crosscurrents Magazine.

C. M. Juan, E. Llop, F. Abad and J. Lluch. 2010. 10th IEEE International Conference on Advanced Learning Technologies, Sousse. Learning Words Using Augmented Reality. 422-426.

Rao, S., & Gagie, B. 2006. Learning Through Seeing and Doing Visual Support for Children with Autism. Teaching Exceptional Children. Vol. 38. No. 6: 26-33.

Zhou, F., Duh, H. B. L., Billinghurst, M. 2008. Proceedings of the 7th IEEE / ACM International Symposium on Mixed and Augmented Reality. Trends in Augmented Reality Tracking, Interaction and Display: A Review Of Ten Years In ISMAR. 193-202.

Hameedur Rahman, Haslina Arshad, Rozi Mahmud, Zainal Rasyid Mahayuddin, Waqas Khalid Obeidy. A Framework to Visualize 3D Breast Tumor Using X-Ray Vision Technique in Mobile Augmented Reality. Journal of Telecommunication, Electronic and Computer Engineering. 2017. Vol. 9 No. 2-11: 145-149.

Dillenbourg, P., Järvelä, S., Fischer, F. The Evolution of Research on Computer-Supported Collaborative Learning. Technology-Enhanced Learning. 2009. 3-19.

Tentori, M., Hayes, G. R. 2010. UbiComp '10 Proceedings of the 12th ACM International Conference on Ubiquitous Computing Designing for Interaction Immediacy to Enhance Social Skills of Children with Autism. 51-60.

Craig, A. & McGrath, R. 2007. Augmenting Science Texts with Inexpensive Interactive 3D Illustrations.

Dror, I. E. Technology Enhanced Learning: The Good, The Bad, and The Ugly. Pragmatics Cognition. 2008. Vol 16. No. 2: 215 – 223. John Benjamins Publishing Company.

Martin, S., Diaz, G., Sancristobal, E., Gil, R., Castro, M., Peire, J. New Technology Trends in Education: Seven Years of Forecasts and Convergence. Computers & Education. 2011. Vol. 57. No.3. 1893 – 1906.

Chen, C. H., Lee, I. J., Lin, L. Y. Augmented reality-based self-facial modeling to promote the emotional expression and social skills of adolescents with autism spectrum disorders. Research in Development Disabilities. 2015. Vol. 36: 396-403.

Bruno Malta de La Plata. 2013. 3D Modeling Optimization for Multimedia Production. Thesis Helsinki Metropolia University of Applied Sciences. 30th April 2013.

Juan, C. M., Llop, E., Abad, F., Lluch, J. 2010. 10th IEEE International Conference on Advanced Learning Technologies. Learning Words using Augmented Reality. 422-426.

Delzell, L. A., Browder, D., Wood, L. Effects of Systematic Instruction and an Augmentative Communication Device on Phonic Skills Acquisition for Students with Moderate Intellectual Disability Who are Nonverbal. Education and Training in Autism and Developmental Disabilities. 2014. Vol. 49. No. 4: 517-532.

Rao, S. M., Gagie, B. Learning Through Seeing and Doing Visual Supports for Children with Autism. Teaching Exceptional Children. 2006. Vol. 38. No. 6: 26-33.

Kesim, M. & Ozarslan, Y. Augmented Reality in Education: Current Technologies and the Potential for Education. Procedia - Social and Behavioral Sciences. 2012. Vol. 47: 297 – 302.

Vacca, J. S. Autistic Children Can Be Taught To Read. International Journal of Special Education. 2007. Vol 22. No.3: 54-61.

Khan, M. & Bayoumi, S. 2015. International Conference on Cloud Computing (ICCC). Multimedia as a Help for Children with Special Learning Needs.

Travers, J. C. 2010. Emergent Literacy Skills of Young Children with Autism: A Comparison of Teacher-led and Computer-Assisted Instruction. University of Nevada Las Vegas Theses.

Yahya Othman, Aisah Md. Daud, Azmey Othman, DK. Siti Ardiah Pg. Mohiddin, Maszuraimah Muizz Sulaiman. (2012). Pelaksanaan Pengajaran Membaca Menggunakan Kaedah Fonik Peringkat Prasekolah di Brunei Darussalam. Jurnal Pendidikan Bahasa Melayu. Vol.2. No. 1: 93-109.

Menon, N. 2000. Keberkesanan Kaedah Gabungan Bunyikata dalam Kebolehan Awal Bacaan Dikalangan Kanak-Kanak PraSekolah. Tesis Universiti Putra Malaysia.

Bowman, D., Kruijff, E., LaViola, J. J., Poupyrev, I. P. 2004. 3D User Interfaces: Theory and Practice. Addison Wesley Longman Publishing.




DOI: http://dx.doi.org/10.18517/ijaseit.9.6.6833

Refbacks

  • There are currently no refbacks.


Published by INSIGHT - Indonesian Society for Knowledge and Human Development