Leveraging Multimodal Interaction and Adaptive Interfaces for Location-based Augmented Reality Islamic Tourism Application

Rimaniza Zainal Abidin, Haslina Arshad, Saidatul A’isyah Ahmad Shukri, Mah Fui Ling

Abstract


A Location-based Augmented Reality (LBAR) application leveraging multimodal interaction and adaptive interface based on Islamic tourism information was proposed to enhance user experience while travelling. LBAR has the potential to improve tourist experience and help tourists to access relevant information, thus improving their knowledge regarding touristic destination while increasing levels of their entertainment throughout the process. In LBAR application, Point of Interest (POI) displayed are exposed to the “occlusion problem†where the AR contents are visually redundant and overlapping with one another causing the users to loose valuable information. Previous research have suggested the design of AR POI which help user to see the augmented POI clearly. The user can click on the desired POI but it still displays a large amount of POI. From our best study, there is limitation of research studying on how to minimize the amount of displayed POI based on user’s current needs. Therefore, in this paper we suggest to use an adaptive user interface and multimodal interaction to solve this problem. We discussed the process of analysing and designing the user interfaces of previous studies. The proposed mobile solution was presented by explaining the application contents, the combination of adaptive multimodal inputs, system’s flow chart and multimodal task definition. Then the user evaluation was conducted to measure the level of satisfaction in terms of the usability of the application. A total of 24 Islamic tourists have participated in this study. The findings revealed that the average SUS score of 75.83 of respondents agree in terms of satisfaction of the LBAR application to be utilized while traveling. Finally, we conclude this paper by providing the suggestion of future works.


Keywords


Location-based Augmented Reality; Multimodal Interaction; Adaptive Interfaces; Tourism Application.

Full Text:

PDF

References


S. B. Zaibon, U. C. Pendit, and J. A. Abu Bakar, “Applicability of Mobile Augmented Reality Usage At Melaka Cultural Heritage Sites,†Proc. 5Th Int. Conf. Comput. Informatics, no. 144, pp. 235–240, 2015.

A. L. KeÄkeÅ¡ and I. TomiÄić, “Augmented Reality in Tourism –– Research and Applications Overview,†vol. 15, no. 2, pp. 157–167, 2017.

S. A. A. Shukri, H. Arshad, and R. Z. Abidin, “Mobile Augmented Reality System Design Guidelines Based on Tourist’s Emotional State,†J. Telecommun. Electron. Comput. Eng., vol. 9, no. 2–12, pp. 75–79, 2017.

E. Ortman and K. Swedlund, “Guidelines for User Interactions in Mobile Augmented Reality,†pp. 24–26, 2012.

P. Kourouthanassis, C. Boletsis, C. Bardaki, and D. Chasanidou, “Tourists responses to mobile augmented reality travel guides: The role of emotions on adoption behavior,†Pervasive Mob. Comput., vol. 18, pp. 71–87, 2015.

M. Pu, N. A. Abd Majid, and B. Idrus, “Framework based on Mobile Augmented Reality for Translating Food Menu in Thai Language to Malay Language,†Int. J. Adv. Sci. Eng. Inf. Technol., vol. 7, no. 1, pp. 153–159, 2017.

H. Arshad, S. A. Bt Ahmad Shukri, W. K. Obeidy, and R. Z. Abidin, “An Interactive Application for Halal Products Identification based on Augmented Reality,†Int. J. Adv. Sci. Eng. Inf. Technol., vol. 7, no. 1, p. 139, 2017.

A. Ali and A. J. Frew, “ICT for sustainable tourism: a challenging relationship?,†Inf. Technol. Tour., vol. 14, no. 4, pp. 261–264, 2014.

A.-M. Hjalager, “Innovation patterns in sustainable tourism,†Tour. Manag., vol. 18, no. 1, pp. 35–41, 1997.

K. Lina Munirah and N. Hairul, “Islamic Tourism: The Impacts To Malaysia’s Tourism Industry,†Int. Conf. Tour. Dev., no. February, p. 397, 2012.

J. C. Henderson, “Muslim travellers, tourism industry responses and the case of Japan,†Tour. Recreat. Res., vol. 41, no. 3, pp. 339–347, 2016.

“Islamic Tourism Centre,†2018.

M. Battour, “Muslim Travel Behavior in Halal Tourism,†Mobilities, Tour. Travel Behav. - Context. Boundaries, 2018.

M. A. Ikbal Hussain, Anas Raza, “Islamic GPS driving location-based augmented reality into the Islamic Economy,†2017.

Z. Yovcheva, D. Buhalis, and C. Gatzidis, “Smartphone Augmented Reality Applications for Tourism,†e-Review Tour. Res., vol. 10, no. 2, pp. 63–66, 2012.

A. Fedosov and S. Misslinger, “Location Based Experience Design for Mobile Augmented Reality,†Proc. 2014 ACM SIGCHI Symp. Eng. Interact. Comput. Syst., pp. 185–188, 2014.

D. Prochazka, M. Stencl, O. Popelka, and J. Stastny, “Location-based Mobile Augmented Reality Applications Challenges, Examples, Lessons Learned,†2014.

S. Jamali, M. F. Shiratuddin, and K. Wong, “An Overview of mobile-Augmented Reality in Higher Education,†vol. 11, no. 1, 2014.

J. Carmigniani, B. Furht, M. Anisetti, P. Ceravolo, E. Damiani, and M. Ivkovic, “Augmented reality technologies, systems and applications,†Multimed. Tools Appl., vol. 51, no. 1, pp. 341–377, 2011.

M. Lee, M. Billinghurst, W. Baek, R. Green, and W. Woo, “A usability study of multimodal input in an augmented reality environment,†Virtual Real., vol. 17, no. 4, pp. 293–305, 2013.

A. Möller, S. Diewald, L. Roalter, and M. Kranz, “Supporting Mobile Multimodal Interaction with a Rule-Based Framework,†2014.

R. a Bolt, “‘Put-that-there’: Voice and Gesture at the Graphics Interface,†Proc. 7th Annu. Conf. Comput. Graph. Interact. Tech. - SIGGRAPH ’80, pp. 262–270, 1980.

P. R. Cohen, M. Johnston, D. Mcgee, S. Oviatt, and P. O. Box, “QuickSet : Multimodal Interaction for Distributed Applications Center for Human Computer Communication Oregon Graduate Institute of Science and Technology Portland , OR 97291-1000 USA Tel : l-503-690-1326,†pp. 31–40.

W. Hürst and C. Van Wezel, “Multimodal Interaction Concepts for Mobile Augmented Reality Applications,†pp. 157–167, 2011.

X. Wang, S. K. Ong, and A. Y. C. Nee, “Advanced Engineering Informatics Multi-modal augmented-reality assembly guidance based on bare-hand interface,†Adv. Eng. Informatics, vol. 30, no. 3, pp. 406–421, 2016.

N. C. Hashim, N. Aini, A. Majid, H. Arshad, and W. K. Obeidy, “User Satisfaction for an Augmented Reality Application to Support Productive Vocabulary Using Speech Recognition,†vol. 2018, 2018.

R. Z. Abidin, H. Arshad, and S. A. A. Shukri, “A framework of adaptive multimodal input for location-based augmented reality application,†J. Telecommun. Electron. Comput. Eng., vol. 9, no. 2–11, pp. 97–103, 2017.

L. Rothrock, R. Koubek, F. Fuchs, M. Haas, and G. Salvendy, “Review and reappraisal of adaptive interfaces: Toward biologically inspired paradigms,†Theor. Issues Ergon. Sci., vol. 3, no. 1, pp. 47–84, 2002.

C. Duarte, “A Conceptual Framework for Developing Adaptive Multimodal Applications,†2006.

J. Kong, W. Y. Zhang, N. Yu, and X. J. Xia, “Design of human-centric adaptive multimodal interfaces,†Int. J. Hum. Comput. Stud., vol. 69, no. 12, pp. 854–869, 2011.

B. Dumas, M. Solórzano, and B. Signer, “Design guidelines for adaptive multimodal mobile input solutions,†Proc. 15th Int. Conf. Human-computer Interact. with Mob. devices Serv. - MobileHCI ’13, p. 285, 2013.

J. Brooke, “SUS - A quick and dirty usability scale,†Usability Eval. Ind., vol. 189, no. 194, pp. 4–7, 1996.

J. R. Lewis and J. Sauro, “The factor structure of the System Usability Scale.dot.pdf,†vol. 1, pp. 1–10, 2009.




DOI: http://dx.doi.org/10.18517/ijaseit.8.4-2.6822

Refbacks

  • There are currently no refbacks.


Published by INSIGHT - Indonesian Society for Knowledge and Human Development