Quality Model for Massive Open Online Course (MOOC) Web Content

Wan Nurhayati Wan Ab Rahman, Hazura Zulzalil, Iskandar Ishak, Ahmad Wiraputra Selamat


With the philosophy of providing open education to all, Massive Open Online Course (MOOC), which introduced in 2006, has been through its first decade. Despite its popularity and worldwide acceptance, MOOC faces a few criticisms about the weaknesses of its content such as lack of clarity, unstructured, poor design and lack of fundamental initial requirements. This caused by the paucity of understanding among content providers about the facet of qualities contributes to the content. There are some previous efforts to improve the quality of MOOCs, but none focused on the content from the content providers or experts' view. As a result, most of the vital internal quality factors are neglected. Besides, the operational definition for the MOOC content quality factors is still missing or not well-defined. Therefore, this research proposes a quality model for MOOC web content as a content provider’s reference to develop quality MOOC content. In order to achieve that, three basic elements were implemented which is the content’s provider perspective, MOOC content quality dimensions and MOOC content quality factors. Development of MOOC content quality dimension is based on 7C’s model and PDCA for continuity, while the determination of factors involves the process like a revision of the possible factors from literature, factors combination and categorization. This proposed hierarchical model tends to make MOOC's learning more optimistic and beneficial to the learners through the development of high-quality content.


web content; quality model; MOOC quality; content provider; hierarchical model.

Full Text:



K. S. Hone and G. R. El Said, “Exploring the factors affecting MOOC retention: A survey study,” Comput. Educ., vol. 98, pp. 157–168, 2016.

G. Conole, “MOOCs as disruptive technologies : strategies for enhancing the learner experience and quality of MOOCs,” Rev. Educ. a Distancia, no. 50, p. Art 2, 2016.

J. Rosewell and D. Jansen, “The OpenupEd quality label : Benchmarks for MOOCs,” Int. J. Innov. Qual. Learn., 2014.

D. Jansen, J. Rosewell, and K. Kear, “Quality Frameworks for MOOCs,” OERs to MOOCs. Lect. Notes Educ. Technol., pp. 261–281, 2016.

C. M. Stracke, “The Quality of MOOCs: How to Improve the Design of Open Education and Online Courses for Learners?,” vol. 10295, pp. 285–293, 2017.

T. Markova, I. Glazkova, and E. Zaborova, “Quality Issues of Online Distance Learning,” Procedia - Soc. Behav. Sci., vol. 237, no. June 2016, pp. 685–691, 2017.

M. A. Uppal, S. Ali, and S. R. Gulliver, “Factors determining e-learning service quality,” Br. J. Educ. Technol., vol. 49, no. 3, pp. 412–426, 2018.

E. Costello, J. Brunton, M. Brown, and L. Daly, “In MOOCs we trust: Learner perceptions of MOOC quality via trust and credibility,” Int. J. Emerg. Technol. Learn., vol. 13, no. 6, pp. 214–222, 2018.

D. Jansen, “Existing MOOC quality models,” BizMOOC Discuss. Pap. 03, 2016.

W. Goh, E. Ayub, S. Y. Wong, and C. L. Lim, “The importance of teacher’s presence and engagement in MOOC learning environment: A case study,” 2017 IEEE Conf. e-Learning, e-Management e-Services, IC3e 2017, no. October, pp. 127–132, 2018.

G. Salmon, E. Pechenkina, A. M. Chase, and B. Ross, “Designing Massive Open Online Courses to take account of participant motivations and expectations,” Br. J. Educ. Technol., vol. 48, no. 6, pp. 1284–1294, 2017.

Z. Liu et al., “MOOC Learner Behaviors by Country and Culture; an Exploratory Analysis,” Proc. 9th Int. Conf. Educ. Data Min., pp. 127–134, 2016.

N. Rushby and D. Surry, The Wiley Handbook of Learning Technology (Vol. 1). John Wiley & Sons., 2016.

G. R. El Said, “Understanding How Learners Use Massive Open Online Courses and Why They Drop Out: Thematic Analysis of an Interview Study in a Developing Country,” J. Educ. Comput. Res., pp. 1–29, 2016.

MOOC-Maker, “Attrition and Retention Aspects in MOOC Environments,” 2016.

B. T. Wong, “Factors leading to effective teaching of MOOCs,” Asian Assoc. Open Univ. J., vol. 11, no. 1, pp. 105–118, 2016.

M. Yepes-Baldó, M. Romeo, C. Martín, M. Á. García, G. Monzó, and A. Besolí, “Quality indicators: developing ‘MOOCs’ in the European Higher Education Area,” EMI. Educ. Media Int., vol. 53, no. 3, pp. 184–197, 2016.

S. Joksimović et al., How Do We Model Learning at Scale? A Systematic Review of Research on MOOCs, vol. 88, no. 1. 2018.

A. Margaryan, M. Bianco, and A. Littlejohn, “Instructional quality of Massive Open Online Courses (MOOCs),” Comput. Educ., vol. 80, pp. 77–83, 2015.

N. Hood and A. Littlejohn, “MOOC Quality: the need for new measures,” J. Learn. Dev., vol. 3, no. 3, pp. 28–42, 2016.

W. Suryn, Software quality engineering: a practitioner’s approach. John Wiley & Sons, 2014.

C. M. Stracke and G. Tan, E., Texeira, A., Pinto, M., Vassiliadis, B., Kameas, A., Sgouropoulou, C., & Vidal, “Quality Reference Framework ( QRF ) for the Quality of MOOCs,” 2018.

E. Syahrial, H. Suzuki, S. J. Schvaneveldt, and M. Masuda, “Customer Perceptions of Mediating Role of Ownership Cost in Garvin’s Dimensions of Quality,” J. Japan Ind. Manag. Assoc., vol. 69, no. 2E, pp. 95–112, 2018.

F. Xiao and B. Pardamean, “MOOC model: Dimensions and model design to develop learning,” New Educ. Rev., vol. 43, no. 1, pp. 28–40, 2016.

S. Nagrecha, J. Z. Dillon, and N. V Chawla, “MOOC Dropout Prediction: Lessons Learned from Making Pipelines Interpretable,” 2017 Int. World Wide Web Conf. Comm., pp. 351–359, 2017.

Y. Ichimura and K. Suzuki, “Dimensions of MOOCs for Quality Design: Analysis and Synthesis of the Literature,” Int. J. Educ. Media Technol., vol. 1111, no. 1, pp. 42–49, 2017.

W. E. Lewis, Software testing and continuous quality improvement. Auerbach publications, 2017.

R A Khan, K Mustafa, and S I Ahson, Software Quality : Concept and Practices. Oxford: Alpha Science, 2006.

A. M. Aladwani and P. C. Palvia, “Developing and validating an instrument for measuring user-perceived web quality,” Inf. Manag., vol. 39, no. 6, pp. 467–476, 2002.

R. S. Pressman and D. Lowe, Web Engineering A Practitioner’s Approach, vol. 3140. 2009.

A. Caro, C. Calero, I. Caballero, and M. Piattini, “A proposal for a set of attributes relevant for Web portal data quality,” Softw. Qual. J., pp. 513–542, 2008.

R. Y. Wang and D. M. Strong, “Beyond Accuracy : What Data Quality Means to Data Consumers,” J. Manag. Inf. Syst., vol. 1222, no. February, 1996.

H. N. Tillman, “Evaluating Quality on the Net,” pp. 1–13, 2001.

P. Lew, L. Olsina, and L. Zhang, “Quality, Quality in Use, Actual Usability and User Experience as Key Drivers for Web Application Evaluation,” Lncs, vol. 6189, pp. 218–232, 2010.

P. Leite, J. Goncalves, P. Teixeira, and A. Rocha, “Assessment of data quality in Web sites: towards a model,” 2014 Int. Conf. Contemp. Comput. Informatics, pp. 367–373, 2014.

W. N. Wan AB Rahman, “The Three Concepts of Design Principles for Usability,” pp. 192–197, 2013.

S. Neve, “Aesthetic-Usability Effect: Can beauty become the key to usability in online retail?,” Conversion, 2017. [Online]. Available: https://conversion.com/blog/aesthetic-usability-effect/. [Accessed: 28-Feb-2019].

D. Lee, S. L. Watson, and W. R. Watson, “Systematic literature review on self-regulated learning in massive open online courses,” Australas. J. Educ. Technol., no. March, 2018.

P. Ghislandi, “‘The fun they had’ or about the quality of MOOC,” J. E-Learning Knowl. Soc., vol. 12, no. 3, pp. 99–114, 2016.

M. Pérez-Mateo, M. F. Maina, M. Guitert, and M. Romero, “Learner Generated Content: Quality Criteria in online Collaborative Learning,” Eur. J. Open, Distance E-Learning, 2011.

I. E. Allen, J. Seaman, T. T. Straut, and R. Poulin, “Online Report Card Tracking Online Education in The United States,” pp. 9–38, 2016.

R. Djouab and M. Bari, “An ISO 9126 Based Quality Model for the e-Learning Systems,” Int. J. Inf. Educ. Technol., vol. 6, no. 5, pp. 370–375, 2016.

I. Doherty, D. Harbutt, and N. Sharma, “Designing and Developing a MOOC,” Med. Sci. Educ., vol. 25, no. 2, pp. 177–181, 2015.

F. Iniesto et al., “An investigation into the perspectives of providers and learners on MOOC accessibility An investigation into the perspectives of providers and learners on MOOC accessibility,” no. October, pp. 1–8, 2017.

T. R. Liyanagunawardena, P. Parslow, and S. A. Williams, “Exploring ’ success ’ in MOOCs : Participants ’ perspective,” no. May, 2017.

S. M. Hadi and P. Gagen, “New model for measuring MOOCs completion rates,” Proc. Eur. MOOC Stakehold. Summit 2016, pp. 1–11, 2016.

B. Buch, R. B. Christiansen, D. Hansen, A. K. Petersen, and R. S. Sørensen, “Using the 7Cs Framework for Designing MOOCs in Blended Contexts - New Perspectives and Ideas,” vol. 6, no. 3, pp. 421–429, 2018.

A. M. F. Yousef, M. A. Chatti, U. Schroeder, and M. Wosnitza, “What drives a successful MOOC? An empirical examination of criteria to assure design quality of MOOCs,” Proc. - IEEE 14th Int. Conf. Adv. Learn. Technol. ICALT 2014, pp. 44–48, 2014.

B. Oakley, D. Poole, and M. A. Nestor, “Creating a sticky MOOC,” J. Asynchronous Learn. Netw., vol. 20, no. 1, 2016.

S. Sergis, D. G. Sampson, and L. Pelliccione, Educational Design for MOOCs: Design Considerations for Technology-Supported Learning at Large Scale, vol. 2020, no. November 2016. 2017.

A. A. Shah, S. D. Ravana, S. Hamid, and M. A. Ismail, “Web credibility assessment : affecting factors and assessment techniques,” Inf. Res. J., vol. 20, pp. 1–28, 2015.

B. A. Kitchenham and S. L. Pfleeger, “Personal Opinion Surveys,” Guid. to Adv. Empir. Softw. Eng., pp. 63–92, 2008.

D. Nabil, A. Mosad, and H. A. Hefny, “Web-Based Applications quality factors : A survey and a proposed conceptual model,” Egypt. Informatics J., pp. 211–217, 2011.

V. Dyomin, G. Mozhaeva, and O. Babanskaya, “Digital Education: Out to the World and Back to the Campus,” vol. 10254, pp. 197–202, 2017.

R. Pitt, C. Friedl, D. Jansen, and O. Driha, “The MOOC potential to address European challenges in CPD and continuous education,” 2017.

DOI: http://dx.doi.org/10.18517/ijaseit.10.1.10192


  • There are currently no refbacks.

Published by INSIGHT - Indonesian Society for Knowledge and Human Development