Improvement of the Usability of Online Mentoring Website

Daeseop Kim, Jae-Kyeong Lee, Dong-Gu Shin, Mi-Hwan Hyun

Abstract


The purpose of this study is to improve the usability of the current online mentoring website by deriving what should be improved through assessment and reflecting it to system improvement. The related data such as search log and Think Aloud were collected from user groups (9 users in total), and usability was tested according to the predefined test procedures. The collected data were analyzed, using quantitative methods. In terms of search log, the related items including effectiveness, efficiency, satisfaction and error were quantified according to usability testing standards. Then, descriptive statistics was performed. According to usability comparison before and after system improvement, it has mostly improved such as improved effectiveness (increase by 15 points), better efficiency (reduction by 41 seconds), increase in satisfaction (by 8 points) and decrease in error frequency (decrease by 1.2 times). Usability testing should be viewed as a process, not outcome itself. Therefore, it could be used during system prototype in addition to the current system and useful in system improvement.


Keywords


usability test; online mentoring; user log analysis; user experience; HCI; Human Computer Interaction.

Full Text:

PDF

References


ISO, IOFS, "ISO 9241-11: 1998: Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs)-Part 11: Guidance on Usability", International Organization for Standardization, 1998.

Nielsen, Jakob, Designing web usability: The practice of simplicity. New Riders Publishing, 1999.

Shneiderman, Ben, et al, “Designing the user interface: strategies for effective human-computer interactionâ€, 2016.

Hooshyar, Danial, Moslem Yousefi, and Heuiseok Lim, "Data-Driven Approaches to Game Player Modeling: A Systematic Literature Review", ACM Computing Surveys, 50.6, 2018.

Hooshyar, Danial, Moslem Yousefi, and Heuiseok Lim, "A systematic review of data-driven approaches in player modeling of educational games", Artificial Intelligence Review, 1-21, 2017

Nielsen, J., Usability Engineering, Academic Press, Boston, MA., 1993

Lund, Arnold M, “Expert ratings of usability maximsâ€, Ergonomics in Design, 5.3: 15-20, 1997

JI, Hyesung, et al, “An adaptable UI/UX considering user’s cognitive and behavior information in distributed environmentâ€. Cluster Computing, 1-14, 2017.

PREECE, Jenny, et al, Interface Metaphors and Conceptual Models. Human-Computer Interation, 1994.

Ã…gerfalk, Pär J., et al. “Setting the scene for actability evaluation: understanding information systems in contextâ€. In: Proceedings of the 9th European Conference on IT Evaluation, p. 15-16, 2002.

Standard, I, “Ergonomics of human-system interaction–usability methods supporting human-centred design. ISO Standard TR 16982: 2002â€, International Organization for Standardization, 2002.

Kaur, Kawaljit; Singh, Hardeep. “Analysis of Website using Click Analytics. International Journal of Scienceâ€, Engineering and Computer Technology, 5.6: 185, 2015

Ericsson, Karl Anders; Simon, Herbert Alexander. “Protocol analysis: Verbal reports as dataâ€, Rev. the MIT Press, 1993.

Wang, Peiling; Hawk, William B.; Tenopir, Carol. “Users’ interaction with World Wide Web resources: An exploratory study using a holistic approachâ€, Information processing & management, 36.2: 229-251, 2000.

Nielsen, Jakob. “Why you only need to test with 5 usersâ€, 2000.




DOI: http://dx.doi.org/10.18517/ijaseit.8.4-2.5741

Refbacks

  • There are currently no refbacks.


Published by INSIGHT - Indonesian Society for Knowledge and Human Development