How Much Does Student Engagement with Videos and Forums in a MOOC Affect Their Achievement?
DOI:
https://doi.org/10.24059/olj.v21i4.1270Keywords:
MOOCs, students’ achievement in MOOCs, MOOC forums, videos in MOOCsAbstract
Engagement in Massive Open Online Courses (MOOCs) is based on students who self-organize their participation according to their own goals and interests. Visual materials such as videos and discussion forums are basic ways of engaging students in MOOCs. Student achievement in MOOCs is typically measured using assessments distributed throughout the course. Although there is research on the basic forms of student’s engagement and assessment in MOOCs, little is known about their effect on students’ achievement in the form of students completing a MOOC. Using binomial logistic regression models, this paper addresses this gap in the literature by presenting the degree to which student engagement with videos and forum posts can predict students’ probability of achievement in a MOOC. It also explores the extent to which participation behaviors and their intention to receive the course certification can be used to predict achievement in MOOCs. Using qualitative content analysis, this paper discusses the quality of the forum posts exchanged by participants in this MOOC. The findings from quantitative analysis support MOOC’s pedagogical assumptions, showing that students’ engagement in forums and with videos increases the probability of course achievement. It also shows that intention to certify plays a moderator effect on the number of videos watched, enhancing achievement in MOOCs. The findings from qualitative analysis reveal that most students’ posts in forums display more information acquisition than critical thinking. Implications for practice suggest MOOC designers and MOOC instructors foster engagement in forums by implementing discussion prompts that foster interactions about deep meaning of concepts or application of concepts covered in the MOOC. In regard to videos, implications for practice suggest the creation of interactive videos that promote students’ engagement and control such as inserting guiding questions and segmenting the video content. Future research comprising multiple MOOC cohorts is suggested to validate the empirical model presented in this study.
References
Anderson, T. (2013). Promise and/or peril: MOOCs and open and distance learning. Retrieved from http://www.col.org/SiteCollectionDocuments/MOOCsPromisePeril_Anderson.pdf
Anderson, A., Huttenlocher, D., Kleinberg, J., & Leskovec, J. (2014). Engaging with massive online courses. In C. W. Chung et al. (Ed.), 23rd International Conference on World Wide Web (WWW '14), (pp. 687–698). Seoul, Korea
Admiraal, W., Huisman, B., & Van de Ven, M. (2014). Self-and peer assessment in massive open online courses. International Journal of Higher Education, 3(3), 119-128.
Belanger, Y., & Thornton, J. (2013, February 5). Bioelectricity: A quantitative approach. Duke University's first MOOC. Retrieved from http://dukespace.lib.duke.edu/dspace/bitstream/handle/10161/6216/Duke_Bioelectricity_MOOC_Fall2012.pdf
Breslow, L., Pritchard, D. E., DeBoer, J., Stump, G.S., Ho, A.D., & Seaton, D. T. (2013). Studying learning in the worldwide classroom: Research into edX’s first MOOC. Research & Practice in Assessment, 8, 13–25
Coetzee, D., Fox, A., Hearst, M. A., & Hartmann, B. (2014). Should your MOOC forum use a reputation system? In Proceeding of the 17th ACM conference on Computer supported cooperative work & social computing, 1176-1187.
Daniel, J. (2012). Making sense of MOOCs: Musings in a maze of myth, paradox and possibility. Journal of Interactive Media in Education, 3. Retrieved from http://jime.open.ac.uk
Darabi, A., Arrastia, M. C., Nelson, D.W., Cornille, T., & Liang, X. (2011). Cognitive presence in asynchronous online learning: A comparison of four discussion strategies. Journal of Computer Assisted Learning, 27(3), 216-227.
Dooley, K. E., & Wickersham, L. E. (2007). Distraction, domination, and disconnection in whole-class, online discussions. The Quarterly Review of Distance Education, 8(1), 1–8.
Dubosson, M., & Emad, S. (2015). The Forum Community, the Connectivist Element of an xMOOC. Universal Journal of Educational Research, 3(10), 680-690.
Glance, D. G., Forsey, M., & Riley, M. (2013). The pedagogical foundations of massive open online courses. First Monday, 18(5).
Guo, P. J., Kim, J., & Rubin, R. (2014). How video production affects student engagement: An empirical study of mooc videos. In Learning at Scale (L@S), 41–50.
Gunawardena, C., Lowe, C., & Anderson, T. (1997). Analysis of a global online debate and the development of an interaction analysis model for examining social construction of knowledge in computer conferencing. Journal of Educational Computing Research, 17 (4), 397-431.
Ho, A. D., Reich, J., Nesterko, S., Seaton, D. T., Mullaney, T., Waldo, J., & Chuang, I. (2014). HarvardX and MITx: The first year of open online courses all 2012-summer 2013. Retrieved from http://ssrn.com/abstract=2381263
Jablokow, K., Matson, J., & Velegol, D. (2014). A multidisciplinary MOOC on creativity, innovation, and change: Encouraging experimentation and experiential learning on a grand scale. Paper presented at the 121 ASEE Annual Conference & Exposition, Indianapolis, IN. Retrieved from http://www.asee.org
Jordan, K. (2014). Initial trends in enrolment and completion of massive open online courses. International Review of Research on Open and Distance Learning, 15(1), 133-160. Retrieved from http://www.irrodl.org/index.php/irrodl/article/view/1651
Kanuka, H., & Anderson, T. (2007). Online social interchange, discord, and knowledge construction, International Journal of E-Learning & Distance Education, 13(1), 57–74.
Kizilcec, R. F., & Schneider, E. (2015). Motivation as a lens to understand online learners: Toward data-driven design with the OLEI scale. ACM Transactions on Computer-Human Interaction (TOCHI), 22(2), 6.
Kizilcec, R. F., Piech, C., & Schneider, E. (2013). Deconstructing disengagement: analyzing learner subpopulations in massive open online courses. In Proceeding of the third international conference on Learning Analytics and Knowledge (pp. 170-179). ACM.
Koller, D. (2012). What we're learning from online education. TED. Retrieved from http://www.ted.com/talks/daphne_koller_what_we_re_learning_from_online_education.html
Koller, D., Ng, A., Chuong, D., & Zhenghao, C. (2013). Retention and intention in massive open online courses: In depth. EDUCAUSE Review Online, 48(3), 62–63. Retrieved from http://www.educause.edu/ero/article/retention-and-intention-massive-open-online- courses-depth-0
Lee, Y. C., Lin, W. C., Cherng, F. Y., Wang, H. C., Sung, C. Y., and King, J. T. (2015). Using time-anchored peer comments to enhance social interaction in online educational videos. In ACM CHI (2015), 689–698
Loizzo, J., Ertmer, P. A., Watson, W. R., & Watson, S. L. (2017). Adults as self-directed and determined to set and achieve personal learning goals in MOOCs: learners’ perceptions of MOOC motivation, success, and completion. Online Learning, 21(2) doi: 10.24059/olj.v21i2.889
McAuley, A., Stewart, B., Siemens, G., & Cormier, D. (2010). The MOOC model for digital practice. elearnspace.org. Retrieved from http://www.elearnspace.org/Articles/MOOC_Final.pdf
Moore, M. G., & Kearsley, G. (2011). Distance education: A systems view of online learning. (3rd ed.). Belmont, California: Wadsworth Publishing.
Morris, N.P., & Lambe, J. (2014). Studying a MOOC: a guide. Palgrave MacMillan. Retrieved from https://he.palgrave.com/resources/Product-Page-Downloads/M/Morris-Studying-a-MOOC/Studying-a-MOOC-Neil-Morris-James-Lambe.pdf
Onah, D.F.O., Sinclair, J., & Boyatt, R. (2014). Dropout Rates of Massive Open Online Courses: Behavioural Patterns. EDULEARN14 Proceedings, 5825-5834.
O'Toole, R. (2013) Pedagogical strategies and technologies for peer assessment in Massively Open Online Courses (MOOCs). Discussion Paper. University of Warwick, Coventry, UK: University of Warwick. (Unpublished)
Thomas, M. J. (2002). Learning within incoherent structures: The space of online discussion forums, Journal of Computer Assisted Learning, 18(3), 351–366.
Triay, J., Sancho-Vinuesa, T., Minguillón, J., & Daza, V. (2016). Analyzing non-linear video usage in an introductory x-MOOC about basic linear algebra. In LASI Spain 2016, 27-28 June 2016, Bilbao, Spain. Retrieved from http://repositorio.grial.eu/handle/grial/624
Walker, B. K. (2007). Bridging the distance: How social interaction, presence, social presence, and sense of community influence student learning experiences in an online virtual environment (unpublished doctoral dissertation). University of North Carolina.
Young, J. R. (2012). Providers of Free MOOC’s Now Charge Employers for Access to Student Data, Chronicle of Higher Education. Retrieved from http://chronicle.com/article/ProvidersofFreeMOOCsNow/136117/.
Waldrop, M. (2013). Campus 2.0. Nature, 495(7440), 160–163.
Wang, Y., & Baker, R. (2015). Content or platform: Why do students complete MOOCs? MERLOT Journal of Online Learning and Teaching, 11(1), 17-30.
Downloads
Published
Issue
Section
License
As a condition of publication, the author agrees to apply the Creative Commons – Attribution International 4.0 (CC-BY) License to OLJ articles. See: https://creativecommons.org/licenses/by/4.0/.
This licence allows anyone to reproduce OLJ articles at no cost and without further permission as long as they attribute the author and the journal. This permission includes printing, sharing and other forms of distribution.
Author(s) hold copyright in their work, and retain publishing rights without restrictions
