Student engagement as predictor of xMOOC completion: An analysis from five courses on energy sustainability

Authors

DOI:

https://doi.org/10.24059/olj.v23i2.1523

Keywords:

Engagement, learning analytics, xMOOC, self-regulated learning, completion

Abstract

MOOC are characterized as being courses to which a large number of students enroll, but only a small fraction completes them. An understanding of students' engagement construct is essential to minimize dropout rates. This research is of a quantitative design and exploratory in nature, and investigates the interaction between contextual factors (demographic characteristics), student engagement types (academic, behavioral, cognitive and affective), and learning outcomes, with the objective of identifying the factors that are associated with completion of massive and open online courses. Two logistic models were adjusted in two samples, general and secondary, with the binary dependent variable defined as completes the course yes/no. The results in the general sample (15% completion rate) showed that the probabilities of a participant completing the course are positively and significantly related to participation in the forum and the participant educational level, and negatively related to gender (female) and age. The results in the secondary sample (87% completion rate) showed that the probabilities of a participant completing the course are positively and significantly related to participation in the forum,  gender (female), and the motivation and satisfaction indexes, and negatively related to age, having previous experience in other MOOC, and self-efficacy and task strategies indexes. The results lead to ideas on how these variables can be used to support students to persist in these learning environments.

References

Appleton, J. J., Christenson, S. L., & Furlong, M. J. (2008). Student engagement with school: Critical conceptual and methodological issues of the construct. Psychology in the Schools, 45(5), 369–386. doi: 10.1002/pits.20303

Breslow, L. B., Pritchard, D. E., DeBoer, J., Stump, G. S., Ho, A. D., & Seaton, D. T. (2013). Studying learning in the worldwide classroom: Research into edX’s first MOOC. Research & Practice in Assessment, 8 (March 2012), 13–25.

Christenson, S. L., Reschly, A. L., Appleton, J. J., Berman, S., Spanjers, D., & Varro, P. (2008). Best practices in fostering student engagement. In A. Thomas & J. Grimes (Eds.), Best practices in school psychology (5th ed., pp. 1099–1119). Bethesda, MD: National Association of School Psychologists.

Cleary, T. J., & Zimmerman, B. J. (2012). A cyclical self-regulatory account of student engagement: Theoretical foundations and applications. In S. L. Christenson, A. L. Reschly, & C. Wylie (Eds.), Handbook of research on student engagement (pp. 237-257). New

York, NY, US: Springer Science + Business Media. doi:10.1007/978-1-4614-2018-7_11

Crossley, S., Dascalu, M., McNamara, D. S., Baker, R., & Trausan-Matu, S. (2017). Predicting Success in Massive Open Online Courses (MOOCs) Using Cohesion Network Analysis. In B. K. Smith, M. Borge, E. Mercier, and K. Y. Lim (Eds.), Making a Difference: Prioritizing Equity and Access in CSCL, 12th International Conference on Computer Supported Collaborative Learning (CSCL) 2017, Volume 1. Philadelphia, PA: International Society of the Learning Sciences.

de Barba, P. G., Kennedy, G. E., & Ainley, M. D. (2016). The role of students’ motivation and participation in predicting performance in a MOOC. Journal of Computer Assisted Learning, 32(3), 218–231. doi: 10.1111/jcal.12130

Engle, D., Mankoff, C., & Carbrey, J. (2015). Coursera’s introductory human physiology course: Factors that characterize successful completion of a MOOC. International Review of Research in Open and Distributed Learning, 16(2), 46–68. doi:10.19173/irrodl.v16i2.2010

Fredricks, J. A., & Mccolskey, W. (2012). The measurement of student engagement: A comparative analysis of various methods and student self-report instruments. In S.L. Christenson et al. (Ed.), Handbook of Research on Student Engagement (pp. 763–782). Springer. doi:10.1007/978-1-4614-2018-7

French, B. F., Immekus, H. C., & Yen, H. J. (2013) Logistic Regression. In T. Teo (Ed.), Handbook of Quantitative Methods for Educational Research. Rotterdam, Netherlands: Sense.

Goldberg, L. R., Bell, E., King, C., O’Mara, C., McInerney, F.,

Robinson, A., & Vickers, J. (2015). Relationship between participants’ level of education and engagement in their completion of the Understanding Dementia Massive Open Online Course. BMC Medical Education, 15(1), 1–7. doi:10.1186/s12909-015-0344-z

Greene, B. A. (2015). Measuring cognitive engagement with self-report scales: Reflections from over 20 years of research. Educational Psychologist, 50(1), 14–30. doi: 10.1080/00461520.2014.989230

Greene, J. A., Oswald, C. A., & Pomerantz, J. (2015). Predictors of retention and achievement in a Massive Open Online Course. American Educational Research Journal, 52(5), 925–955. doi: 10.3102/0002831215584621

Halawa, S., Greene, D., & Mitchell, J. (2014). Dropout prediction in MOOCs using learner activity features. eLearning Papers, 37, 1–10.

Jiang, S., Williams, A. E., Schenke, K., Warschauer, M., & Dowd, D. O. (2014). Predicting MOOC Performance with Week 1 Behavior. Proceedings of the 7th International Conference on Educational Data Mining (EDM), 273–275. London, UK.

Joksimović, S., Dowell, N., Skrypnyk, O., Kovanović, V., Gašević, D., Dawson, S., & Graesser, A. C. (2015). How do you connect? Analysis of social capital accumulation in connectivist MOOCs. In Proceedings of the Fifth International Conference on Learning Analytics and Knowledge (LAK’15) (pp. 64–68). New York, NY: ACM. doi:10.1145/2723576.2723604

Joksimović, S., Gašević, D., Kovanović, V., Riecke, B. E., & Hatala, M. (2015). Social presence in online discussions as a process predictor of academic performance. Journal of Computer Assisted Learning, 31(6), 638–654. doi: 10.1111/jcal.12107

Joksimović, S., Poquet, A., Kovanovic, V., Dowell, N., Millis, C., Gasevic, D., & Brooks, C. (2018). How do we model learning at scale? A systematic review of research on MOOCs. Review of Educational Research, 88(1), 43–86.

Kizilcec, R. F., & Halawa, S. (2015). Attrition and achievement gaps in online learning. In Proceedings of the Second ACM Conference on Learning @ Scale (L@S’15) (pp. 57–66). New York, NY: ACM. doi:10.1145/2724660.2724680

Kizilcec, R. F., Pérez-Sanagustín, M., & Maldonado, J. J. (2017). Self-regulated learning strategies predict learner behavior and goal attainment in Massive Open Online Courses. Computers and Education, 104, 18–33. doi: 10.1016/j.compedu.2016.10.001

Kizilcec, R. F., Piech, C., & Schneider, E. (2013). Deconstructing Disengagement: Analyzing learner subpopulations in Massive Open Online Courses. In Lak ’13. Leuven, Bélgica. doi: 10.1145/2460296.2460330

Miller, R. B., Greene, B. A., Montalvo, G. P., Ravindran, B., & Nichols, J. D. (1996). Engagement in academic work: The role of learning goals, future consequences, pleasing others, and perceived ability. Contemporary Educational Psychology, 21(4), 388–422. doi: 10.1006/ceps.1996.0028

Newmann, F., Wehlage, G., & Lamborn, S. (1992). The significance and sources of student engagement. In F. Newmann (Ed.), Student engagement and achievement in American secondary schools (pp. 11–39). New York, NY: Teachers College, Columbia University. doi: 10.4236/ojapps.2014.45022

Pajares, F. (1996). Self-Efficacy Beliefs and Mathematical Problem-Solving of Gifted Students. Contemporary Educational Psychology, 21, 325-344.

Pekrun, R., & Linnenbrink, L. (2012). Academic emotions and student engagement. In S. L. Christenson, A. L. Reschly, & C. Whlie (Eds.), Handbook of Research on Student Engagement (pp. 259–282). New York, NY: Springer.

Pintrich, P. R., & DeGroot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82(1), 33–40. doi: 10.1037/0022-0663.82.1.33

Pursel, B. K., Zhang, L., Jablokow, K. W., Choi, G. W., & Velegol, D. (2016). Understanding MOOC students: Motivations and behaviours indicative of MOOC completion. Journal of Computer Assisted Learning, 32(3), 202–217. doi: 10.1111/jcal.12131

Reschly, A. L., & Christenson, S. L. (2012). Jingle, jangle, and conceptual haziness: Evolution and future directions of the engagement construct. In S. L. Christenson, A. L. Reschly, & C. Whlie (Eds.), Handbook of Research on Student Engagement (pp. 3–20). New York, NY: Springer.

York, T. T., Gibson, C., & Rankin, S. (2015). Defining and measuring academic success. Practical Assessment. Research & Evaluation, 20(5), 1–20.

Yukselturk, E., & Bulut, S. (2007). Predictors for student success in an online course. Educational Technology & Society, 10, 71–83.

Downloads

Published

2019-06-01

Issue

Section

Student Issues, Pedagogy, Tools, and Support