A Meta-Analysis of Self-Regulated Learning Interventions Studies on Learning Outcomes in Online and Blended Environments

Authors

  • Mochamad Guntur Universitas Negeri Yogyakarta
  • Yoppy Wahyu Purnomo Universitas Negeri Yogyakarta

DOI:

https://doi.org/10.24059/olj.v28i3.4025

Keywords:

Blended Learning, online environments, learning outcomes, online learning, Self-Regulated Learning

Abstract

Self-regulated learning intervention studies influence students’ learning outcomes in online and blended environments.  Reviewing the national literature about self-regulated learning strategies, studies have indicated both significant and insignificant effects on learning outcomes in online and blended environments. The aim of this study is to calculate the common effect size of empirical studies conducted out between 2017-2022 that investigated the effect of self-regulated learning strategies on learning outcomes in online and blended environments, and to determine whether the common effect size shows a significant difference in terms of course type, self-regulated learning strategy type, school level, and learning context. A meta-analytical review method was employed to combine the outcome of independent empirical studies. The studies included in this review were collected from Scopus, IEEE Explore, and ERIC databases.  A total of 15 studies included in this study. Cohen’s d coefficient was calculated for the effect size in this study. As the heterogeneity among the effect sizes of the studies was high (Q > χ2, p < .05), the common effect size was calculated in accordance with the random effects model. As a result of the meta-analysis, it was determined that self-regulated learning strategies had a “moderate” effect (Q= 0.65) on learning outcomes in online and blended environments. Moreover, the calculated common effect size showed no significant difference according to the type of self-regulated learning strategy, course type, school level, and learning context.

 

 

Author Biographies

Mochamad Guntur, Universitas Negeri Yogyakarta

 

 

Yoppy Wahyu Purnomo, Universitas Negeri Yogyakarta

 

 

 

References

Alexa, L., Avasilcai, S., Pislaru, M., Bujor, A., Avram, E., & Lucescu, L. (2022). Exploring romanian engineering students’ perceptions of COVID-19 emergency e-learning situation. A mixed-method case study. Electronic Journal of E-Learning, 20(1), pp19-35. https://doi.org/10.34190/ejel.20.1.2190

Altan, S., Lane, J. F., & Dottin, E. (2019). Using habits of mind, intelligent behaviors, and educational theories to create a conceptual framework for developing effective teaching dispositions. Journal of Teacher Education, 70(2), 169–183. https://doi.org/10.1177/0022487117736024

Altıok, S., Başer, Z., & Yükseltürk, E. (2019). Enhancing metacognitive awareness of undergraduates through using an e-educational video environment. Computers and Education, 139(1), 129–145. https://doi.org/10.1016/j.compedu.2019.05.010

Anthonysamy, L., Ah Choo, K., & Soon Hin, H. (2021). Investigating self-regulated learning strategies for digital learning relevancy. Malaysian Journal of Learning and Instruction, 18(1), 29–64. https://doi.org/10.32890/mjli2021.18.1.2

Anthonysamy, L., Koo, A. C., & Hew, S. H. (2020). Self-regulated learning strategies in higher education: Fostering digital literacy for sustainable lifelong learning. Education and Information Technologies, 25(4), 2393–2414. https://doi.org/10.1007/s10639-020-10201-8

Ariel, R., & Karpicke, J. D. (2018). Improving self-regulated learning with a retrieval practice intervention. Journal of Experimental Psychology: Applied, 24(1), 43–56. https://doi.org/10.1037/xap0000133

Baker, S., Morawska, A., & Mitchell, A. (2019). Promoting children’s healthy habits through self-regulation via parenting. Clinical Child and Family Psychology Review, 22(1), 52–62. https://doi.org/10.1007/s10567-019-00280-6

Bandura, A. (2021). Analysis of modeling processes. In Psychological Modeling (pp. 1–62). Routledge. https://doi.org/10.4324/9781003110156-1

Ben-Eliyahu, A. (2019). Academic emotional learning: A critical component of self-regulated learning in the emotional learning cycle. Educational Psychologist, 54(2), 84–105. https://doi.org/10.1080/00461520.2019.1582345

Bergmark, U. (2020). Teachers’ professional learning when building a research-based education: context-specific, collaborative and teacher-driven professional development. Professional Development in Education, 1–15. https://doi.org/10.1080/19415257.2020.1827011

Boykin, A., Evmenova, A. S., Regan, K., & Mastropieri, M. (2019). The impact of a computer-based graphic organizer with embedded self-regulated learning strategies on the argumentative writing of students in inclusive cross-curricula settings. Computers and Education, 137(August 2018), 78–90. https://doi.org/10.1016/j.compedu.2019.03.008

Broadbent, J., & Fuller-Tyszkiewicz, M. (2018). Profiles in self-regulated learning and their correlates for online and blended learning students. Educational Technology Research and Development, 66(6), 1435–1455. https://doi.org/10.1007/s11423-018-9595-9

Cai, R., Wang, Q., Xu, J., & Zhou, L. (2020). Effectiveness of students’ self -regulated learning during the Covid-19 pandemic. Sci Insigt, 34(1), 175–182. https://doi.org/10.15354/si.20.ar011.Author

Callan, G. L., DaVia Rubenstein, L., Barton, T., & Halterman, A. (2022). Enhancing motivation by developing cyclical self-regulated learning skills. Theory Into Practice, 61(1), 62–74. https://doi.org/10.1080/00405841.2021.1932153

Cervin-Ellqvist, M., Larsson, D., Adawi, T., Stöhr, C., & Negretti, R. (2021). Metacognitive illusion or self-regulated learning? Assessing engineering students’ learning strategies against the backdrop of recent advances in cognitive science. Higher Education, 82(3), 477–498. https://doi.org/10.1007/s10734-020-00635-x

Chumbley, S., Haynes, J. C., Hainline, M., & Sorensen, T. (2018). A measure of self-regulated learning in online agriculture courses. Journal of Agricultural Education, 59(1), 153–170. https://doi.org/10.5032/jae.2018.01153

Chytrý, V., Říčan, J., Eisenmann, P., & Medová, J. (2020). Metacognitive knowledge and mathematical intelligence—two significant factors influencing school performance. Mathematics, 8(6), 969. https://doi.org/10.3390/math8060969

Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2013). Applied multiple regression/correlation analysis for the behavioral sciences. Routledge.

Cooper, H. (2015). Research synthesis and meta-analysis: A step-by-step approach (Vol. 2). Sage publications.

Cuyvers, K., Van den Bossche, P., & Donche, V. (2020). Self-regulation of professional learning in the workplace: a state of the art and future perspectives. Vocations and Learning, 13(2), 281–312. https://doi.org/10.1007/s12186-019-09236-x

Dent, A. L., & Koenka, A. C. (2016). The relation between self-regulated learning and academic achievement across childhood and adolescence: A meta-analysis. Educational Psychology Review, 28(3), 425–474. https://doi.org/10.1007/s10648-015-9320-8

Dontre, A. J. (2021). The influence of technology on academic distraction: A review. Human Behavior and Emerging Technologies, 3(3), 379–390. https://doi.org/10.1002/hbe2.229

du Boulay, B. (2019). Escape from the Skinner Box: The case for contemporary intelligent learning environments. British Journal of Educational Technology, 50(6), 2902–2919. https://doi.org/10.1111/bjet.12860

Du, J., & Hew, K. F. T. (2022). Using recommender systems to promote self-regulated learning in online education settings: current knowledge gaps and suggestions for future research. Journal of Research on Technology in Education, 54(4), 557–580. https://doi.org/10.1080/15391523.2021.1897905

Elcin, D., & Şahinkarakaş, Ş. (2021). Self-regulatory capacity of learners’ with differing proficiency levels in vocabulary acquisition during three periods. Shanlax International Journal of Education, 9(S1-May), 162–197. https://doi.org/10.34293/education.v9iS1-May.4011

Fukuda, A. (2022). The development of a self-regulated second language learning questionnaire for an l2 self-study setting. Journal for the Psychology of Language Learning, 4(2), 1–17. https://doi.org/10.52598/jpll/4/2/3

García Botero, G., Botero Restrepo, M. A., Zhu, C., & Questier, F. (2021). Complementing in-class language learning with voluntary out-of-class MALL. Does training in self-regulation and scaffolding make a difference? Computer Assisted Language Learning, 34(8), 1013–1039. https://doi.org/10.1080/09588221.2019.1650780

Gupta, A., & Pathania, P. (2021). To study the impact of google classroom as a platform of learning and collaboration at the teacher education level. Education and Information Technologies, 26(1), 843–857. https://doi.org/10.1007/s10639-020-10294-1

He, W., Zhao, L., & Su, Y. (2022). Effects of online self-regulated learning on learning ineffectiveness in the context of COVID-19. The International Review of Research in Open and Distributed Learning, 23(2), 25–43. https://doi.org/10.19173/irrodl.v23i2.5775

Hensley, N. (2020). Educating for sustainable development: Cultivating creativity through mindfulness. Journal of Cleaner Production, 243, 118542. https://doi.org/10.1016/j.jclepro.2019.118542

Hong, J. C., Lee, Y. F., & Ye, J. H. (2021). Procrastination predicts online self-regulated learning and online learning ineffectiveness during the coronavirus lockdown. Personality and Individual Differences, 174(October 2020), 110673. https://doi.org/10.1016/j.paid.2021.110673

Huang, L., & Lajoie, S. P. (2021). Process analysis of teachers’ self-regulated learning patterns in technological pedagogical content knowledge development. Computers & Education, 166, 104169. https://doi.org/10.1016/j.compedu.2021.104169

Jansen, R. S., van Leeuwen, A., Janssen, J., Jak, S., & Kester, L. (2019). Self-regulated learning partially mediates the effect of self-regulated learning interventions on achievement in higher education: A meta-analysis. Educational Research Review, 28(2), 1–20. https://doi.org/10.1016/j.edurev.2019.100292

Järvelä, S., Gašević, D., Seppänen, T., Pechenizkiy, M., & Kirschner, P. A. (2020). Bridging learning sciences, machine learning and affective computing for understanding cognition and affect in collaborative learning. British Journal of Educational Technology, 51(6), 2391–2406. https://doi.org/10.1111/bjet.12917

Jin, S. H., Im, K., Yoo, M., Roll, I., & Seo, K. (2023). Supporting students’ self-regulated learning in online learning using artificial intelligence applications. International Journal of Educational Technology in Higher Education, 20(1), 1–21. https://doi.org/10.1186/s41239-023-00406-5

Karacan, C. G., Yildiz, M., & Atay, D. (2022). The relationship between self-regulated learning and efl achievement in synchronous online language education. Mextesol Journal, 46(3), 0–2.

Karekla, M., Karademas, E. C., & Gloster, A. T. (2019). The common sense model of self-regulation and acceptance and commitment therapy: Integrating strategies to guide interventions for chronic illness. Health Psychology Review, 13(4), 490–503. https://doi.org/10.1080/17437199.2018.1437550

Khurshid, F. (2020). Online collaboration and self-regulated learning in online learning environment. Pakistan Journal of Distance & Online Learning, I, 177–193.

Kintu, M. J., Zhu, C., & Kagambe, E. (2017). Blended learning effectiveness: the relationship between student characteristics, design features and outcomes. International Journal of Educational Technology in Higher Education, 14(1), 1–20. https://doi.org/10.1186/s41239-017-0043-4

Koivuniemi, M., Järvenoja, H., Järvelä, S., & Thomas, V. (2021). An overview of instruments for assessing and supporting elementary school students’ self-regulated learning. Learning: Research and Practice, 7(2), 109–146. https://doi.org/10.1080/23735082.2020.1859123

Lai, C. L., Hwang, G. J., & Tu, Y. H. (2018). The effects of computer-supported self-regulation in science inquiry on learning outcomes, learning processes, and self-efficacy. Educational Technology Research and Development, 66(4), 863–892. https://doi.org/10.1007/s11423-018-9585-y

Lanaj, K., Foulk, T. A., & Erez, A. (2019). Energizing leaders via self-reflection: A within-person field experiment. Journal of Applied Psychology, 104(1), 1–18. https://doi.org/10.1037/apl0000350

Lane, H. C., & D’Mello, S. K. (2019). Uses of physiological monitoring in intelligent learning environments: A review of research, evidence, and technologies. In Mind, Brain and Technology: Learning in the Age of Emerging Technologies (pp. 67–86). Springer. https://doi.org/10.1007/978-3-030-02631-8_5

Lemmetty, S., & Collin, K. (2020). Self-directed learning as a practice of workplace learning: interpretative repertoires of self-directed learning in ict work. Vocations and Learning, 13(1), 47–70. https://doi.org/10.1007/s12186-019-09228-x

Li, K. (2019). MOOC learners’ demographics, self-regulated learning strategy, perceived learning and satisfaction: A structural equation modeling approach. Computers & Education, 132, 16–30. https://doi.org/10.1016/j.compedu.2019.01.003

Lim, L., Bannert, M., van der Graaf, J., Singh, S., Fan, Y., Surendrannair, S., Rakovic, M., Molenaar, I., Moore, J., & Gašević, D. (2023). Effects of real-time analytics-based personalized scaffolds on students’ self-regulated learning. Computers in Human Behavior, 139, 107547. https://doi.org/10.1016/j.chb.2022.107547

Machmud, A., & Ramadhan, I. A. (2022). High school learning outcomes: The effect of self-regulation, resilience, and family environment. Jurnal Cakrawala Pendidikan, 41(3), 764–778. https://doi.org/10.21831/cp.v41i3.43562

Maddison, T., Doi, C., Lucky, S., & Kumaran, M. (2017). Literature review of online learning in academic libraries. In Distributed Learning: Pedagogy and Technology in Online Information Literacy Instruction (Vol. 2). Elsevier Ltd. https://doi.org/10.1016/B978-0-08-100598-9.00002-7

Martin, F., Wu, T., Wan, L., & Xie, K. (2022). A meta-analysis on the community of inquiry presences and learning outcomes in online and blended learning environments. Online Learning Journal, 26(1), 325–359. https://doi.org/10.24059/olj.v26i1.2604

McCardle, L., Young, B. W., & Baker, J. (2019). Self-regulated learning and expertise development in sport: current status, challenges, and future opportunities. International Review of Sport and Exercise Psychology, 12(1), 112–138. https://doi.org/10.1080/1750984X.2017.1381141

Morris, T. H. (2019). Self-directed learning: A fundamental competence in a rapidly changing world. International Review of Education, 65(4), 633–653. https://doi.org/10.1007/s11159-019-09793-2

Núñez, J. C., Tuero, E., Fernández, E., Añón, F. J., Manalo, E., & Rosário, P. (2022). Effect of an intervention in self-regulation strategies on academic achievement in elementary school: A study of the mediating effect of self-regulatory activity. Revista de Psicodidáctica (English Ed.), 27(1), 9–20. https://doi.org/10.1016/j.psicoe.2021.09.001

Özdal, H., Özden, C., Atasoy, R., & Güneylİ, A. (2022). Effectiveness of self-regulated learning skills on web-based instruction attitudes in online environments. Pegem Egitim ve Ogretim Dergisi, 12(1), 182–193. https://doi.org/10.47750/pegegog.12.01.18

Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. International Journal of Surgery, 88(1), 1–9. https://doi.org/10.1016/j.ijsu.2021.105906

Panadero, E., Jonsson, A., & Botella, J. (2017). Effects of self-assessment on self-regulated learning and self-efficacy: Four meta-analyses. Educational Research Review, 22(2), 74–98. https://doi.org/10.1016/j.edurev.2017.08.004

Perry, J. C., Fisher, A. L., Caemmerer, J. M., Keith, T. Z., & Poklar, A. E. (2018). The role of social support and coping skills in promoting self-regulated learning among urban youth. Youth & Society, 50(4), 551–570. https://doi.org/10.1177/0044118X15618313

Rahiem, M. D. H. (2021). Remaining motivated despite the limitations: University students’ learning propensity during the COVID-19 pandemic. Children and Youth Services Review, 120, 105802. https://doi.org/10.1016/j.childyouth.2020.105802

Rako, S., Šimić, D., & Rienties, B. (2014). Supporting self-regulated learning in a blended learning environment using prompts and learning analytics. Choice Reviews Online, 51(6), 66–71. https://doi.org/10.5860/choice.51-2973

Ramírez-Hurtado, J. M., Hernández-Díaz, A. G., López-Sánchez, A. D., & Pérez-León, V. E. (2021). Measuring online teaching service quality in higher education in the COVID-19 environment. International Journal of Environmental Research and Public Health, 18(5), 2403. https://doi.org/10.3390/ijerph18052403

Rizaldi, D. R., & Fatimah, Z. (2020). How the distance learning can be a solution during the COVID-19 pandemic. International Journal of Asian Education, 1(3), 117–124. https://doi.org/10.46966/ijae.v1i3.42

Sadeghi, M. (2019). A shift from classroom to distance learning: advantages and limitations. International Journal of Research in English Education, 4(1), 80–88. https://doi.org/10.29252/ijree.4.1.80

Sahade, S., Putri, D. R., & Hasyim, S. H. (2022). The influence of learning interest, intrinsic motivation, and extrinsic motivation on student achievement at SMK PGRI Enrekang. Pinisi Business Administration Review, 4(1), 65–72. https://ojs.unm.ac.id/PBAR/article/view/33423%0Ahttps://ojs.unm.ac.id/PBAR/article/download/33423/15884

Scherer, R., & Beckmann, J. F. (2014). The acquisition of problem solving competence: evidence from 41 countries that math and science education matters. Large-Scale Assessments in Education, 2(1), 1–22. https://doi.org/10.1186/s40536-014-0010-7

Song, D., & Kim, D. (2021). Effects of self-regulation scaffolding on online participation and learning outcomes. Journal of Research on Technology in Education, 53(3), 249–263. https://doi.org/10.1080/15391523.2020.1767525

Suleman, Q., Syed, M. A., Mahmood, Z., & Hussain, I. (2020). Correlating emotional intelligence with job satisfaction: Evidence from a cross-sectional study among secondary school heads in Khyber Pakhtunkhwa, Pakistan. Frontiers in Psychology, 11, 240. https://doi.org/10.3389/fpsyg.2020.00240

Sutarni, N., Arief Ramdhany, M., Hufad, A., & Kurniawan, E. (2021). Self-regulated learning and digital learning environment: Its’ effect on academic achievement during the pandemic. Cakrawala Pendidikan, 40(2), 374–388. https://doi.org/10.21831/cp.v40i2.40718

Tejedor, G., Segalàs, J., Barrón, Á., Fernández-Morilla, M., Fuertes, M. T., Ruiz-Morales, J., Gutiérrez, I., García-González, E., Aramburuzabala, P., & Hernández, À. (2019). Didactic strategies to promote competencies in sustainability. Sustainability (Switzerland), 11(7), 1–24. https://doi.org/10.3390/su11072086

Teng, M. F. (2020). The role of metacognitive knowledge and regulation in mediating university EFL learners’ writing performance. Innovation in Language Learning and Teaching, 14(5), 436–450. https://doi.org/10.1080/17501229.2019.1615493

Teng, M. F., Qin, C., & Wang, C. (2022). Validation of metacognitive academic writing strategies and the predictive effects on academic writing performance in a foreign language context. Metacognition and Learning, 17(1), 167–190. https://doi.org/10.1007/s11409-021-09278-4

Theobald, M. (2021). Self-regulated learning training programs enhance university students’ academic performance, self-regulated learning strategies, and motivation: A meta-analysis. Contemporary Educational Psychology, 66, 101976. https://doi.org/10.1016/j.cedpsych.2021.101976

Thomas, V., De Backer, F., Peeters, J., & Lombaerts, K. (2019). Parental involvement and adolescent school achievement: the mediational role of self-regulated learning. Learning Environments Research, 22(3), 345–363. https://doi.org/10.1007/s10984-019-09278-x

Vaculíková, J. A. (2018). Measuring self-regulated learning and online learning events to predict student academic performance. Studia Paedagogica, 23(4), 91–118. https://doi.org/10.5817/SP2018-4-5

van Alten, D. C. D., Phielix, C., Janssen, J., & Kester, L. (2020). Effects of self-regulated learning prompts in a flipped history classroom. Computers in Human Behavior, 108, 106318. https://doi.org/10.1016/j.chb.2020.106318

Vanslambrouck, S., Zhu, C., Pynoo, B., Lombaerts, K., Tondeur, J., & Scherer, R. (2019). A latent profile analysis of adult students’ online self-regulation in blended learning environments. Computers in Human Behavior, 99(1), 126–136. https://doi.org/10.1016/j.chb.2019.05.021

Venkatesh, S., Rao, Y. K., Nagaraja, H., Woolley, T., Alele, F. O., & Malau-Aduli, B. S. (2020). Factors influencing medical students’ experiences and satisfaction with blended integrated e-learning. Medical Principles and Practice, 29(4), 396–402. https://doi.org/10.1159/000505210

Wan Yunus, F., Bissett, M., Penkala, S., Kadar, M., & Liu, K. P. Y. (2021). Self-regulated learning versus activity-based intervention to reduce challenging behaviors and enhance school-related function for children with autism spectrum disorders: A randomized controlled trial. Research in Developmental Disabilities, 114(May), 103986. https://doi.org/10.1016/j.ridd.2021.103986

Wong, J., Baars, M., Davis, D., Van Der Zee, T., Houben, G.-J., & Paas, F. (2019). Supporting self-regulated learning in online learning environments and moocs: A systematic review. International Journal of Human–Computer Interaction, 35(4–5), 356–373. https://doi.org/10.1080/10447318.2018.1543084

Yeh, Y. C., Kwok, O. M., Chien, H. Y., Sweany, N. W., Baek, E., & McIntosh, W. A. (2019). How college students’ achievement goal orientations predict their expected online learning outcome: The mediation roles of self-regulated learning strategies and supportive online learning behaviors. Online Learning Journal, 23(4), 23–41. https://doi.org/10.24059/olj.v23i4.2076

Zhang, Z., Xu, Q., Koehler, A. A., & Newby, T. (2023). Comparing blended and online learners’ self-efficacy, self-regulation, and actual learning in the context of educational technology. Online Learning Journal, 27(4), 295–314. https://doi.org/10.24059/olj.v27i4.4039

Zheng, B., & Zhang, Y. (2020). Self-regulated learning: the effect on medical student learning outcomes in a flipped classroom environment. BMC Medical Education, 20(1), 100. https://doi.org/10.1186/s12909-020-02023-6

Downloads

Published

2024-09-01

How to Cite

Guntur, M., & Purnomo, Y. W. (2024). A Meta-Analysis of Self-Regulated Learning Interventions Studies on Learning Outcomes in Online and Blended Environments. Online Learning, 28(3). https://doi.org/10.24059/olj.v28i3.4025

Issue

Section

Section III