Examining Students’ Self-Regulation Skills, Confidence to Learn Online, and Perception of Satisfaction and Usefulness of Online Classes in Three Suggested Online Learning Environments that Integrates ChatGPT

Authors

  • Bilal Khallel Younis Palestine Technical University Kadoorie

DOI:

https://doi.org/10.24059/olj.v28i2.4397

Keywords:

online learning, ChatGPT, self-regulation skills, confidence to learn online, perception of satisfaction

Abstract

This study aims to investigate students’ self-regulation skills, confidence to learn online, and perception of satisfaction and usefulness of online classes in three learning environments that integrates ChatGPT. In this study, a quasi-experiential design was used to compare three online learning environments that integrate ChatGPT (independent, peer, and group). A total of 100 undergraduate students were randomly assigned to these three groups. Three questionaries’ were used for data collection. The results showed that the self-regulation levels were high among the participants in these three online ChatGPT groups. However, learning in peer and group environments were more effective in developing self-regulation skills than learning independently. This research also found that the participants in the peer and group learning environments had high levels of confidence to learn online compared to the participants in the independent group. The results also showed that the participants in the peer learning group had the highest scores of perception of satisfaction and usefulness of online classes compared to the participants in the independent and group learning environments. The findings of this study support the notion that integrating ChatGPT within peer groups can enhance students' perception of satisfaction and usefulness of online classes. Educators should explore ways to leverage ChatGPT to facilitate meaningful interactions and collaboration among students, thereby increasing their satisfaction and engagement with online learning materials and activities.

Author Biography

Bilal Khallel Younis, Palestine Technical University Kadoorie

Acoss. Prof

Technology Education Department

References

Afify, M. K. (2019). The Influence of group size in the asynchronous online discussions on the development of critical thinking skills, and on improving students’ performance in online discussion forum. International Journal of Emerging Technologies in Learning, 14(5), 132–152. https://doi.org/10.3991/ijet.v14i05.9351

Ahuja, A. (2019). The impact of artificial intelligence in medicine on the future role of the physician. PeerJ, 7, no. 7702. https://doi.org/10.7717/peerj.7702

Akcaoglu, M., & Lee, E. (2016). Increasing social presence in online learning through small group discussions. The International Review of Research in Open and Distributed Learning, 17(3). https://doi.org/10.19173/irrodl.v17i3.2293

Alqahtani, M. A., Alamri, M. M., Sayaf, A. M., & Al-Rahmi, W. M. (2022). Investigating students’ perceptions of online learning use as a digital tool for educational sustainability during the COVID-19 pandemic. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.886272

Artino, A. R. (2007). Self-regulated learning in online education: A review of the empirical literature. International Journal of Instructional Technology and Distance Learning, 4(6), 3–18. http://itdl.org/Journal/Jun_07/article01.htm

Artino, A. R. (2008). Online military training: Using a social cognitive view of motivation and self-regulation to understand students' satisfaction, perceived learning, and choice. Quarterly Review of Distance Education, 9(3), 207–223.

Bai, L., Liu, X., & Su, J. (2023). ChatGPT: The cognitive effects on learning and memory. Brain‐X, 1(3). https://doi.org/10.1002/brx2.30

Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191–215. https://doi.org/10.1037//0033-295x.84.2.191

Bandura, A. (2010). Self‐efficacy. The Corsini Encyclopedia of Psychology, 1–3. https://doi.org/10.1002/9780470479216.corpsy0836

Barak, M., Watted, A., & Haick, H. (2016). Motivation to learn in massive open online courses: Examining aspects of language and social engagement. Computers & Education, 94, 49–60. https://doi.org/10.1016/j.compedu.2015.11.010

Barnard, L., Lan, W. Y., To, Y. M., Paton, V. O., & Lai, S. L. (2009). Measuring self-regulation in online and blended learning environments. Internet and Higher Education, 12, 1–6. https://doi.org/10.1016/j.iheduc.2008.10.005

Benson, R., & Samarawickrema, G. (2009). Addressing the context of e-learning: Using transactional distance theory to inform design. Distance Education, 30, 5–21. Doi.org: 10.1080/01587910902845972

Boekaerts, M., & Corno, L. (2005). Self-regulation in the classroom: A perspective on assessment and intervention. Applied Psychology, 54(2), 199–231. https://doi.org/10.1111/j.1464-0597.2005.00205.x

Bozkurt, A. (2024). GenAI et al.: Cocreation, authorship, ownership, academic ethics and integrity in a time of generative AI. Open Praxis, 16(1), 1–10. https://doi.org/10.55982/openpraxis.16.1.654

Bradley, R. L., Browne, B. L., & Kelley, H. M. (2017). Examining the influence of self-efficacy and self-regulation in online learning. College Student Journal, 51(4), 518–530.

Broadbent, J., & Poon, W. L. (2015). Self-regulated learning strategies & academic achievement in online higher education learning environments: A systematic review. The Internet and Higher Education,27, 1–13.

http://dx.doi.org/10.1016/j.iheduc.2015.04.007

Butt, S., Mahmood, A., Saleem, S., Rashid, T., & Ikram, A. (2021). Students’ performance in online learning environment: The role of task technology fit and actual usage of system during COVID-19. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.759227

Bylieva, D., Hong, J.-C., Lobatyuk, V., & Nam, T. (2021). Self-regulation in e-learning environment. Education Sciences, 11(12), 785. https://doi.org/10.3390/educsci11120785

Cai, J., Yang, H. H., Gong, D., MacLeod, J., & Zhu, S. (2018). Understanding the continued use of flipped classroom instruction: a personal beliefs model in Chinese higher education. Journal of Computing in Higher Education, 31(1), 137–155. https://doi.org/10.1007/s12528-018-9196-y

Charo, R., Maite, A.-S., & Guillermo, M. (2020). Self-regulation of learning and MOOC retention. Computers in Human Behavior, 111, 106423. https://doi.org/10.1016/j.chb.2020.106423

Chatterjee, J., & Dethlefs, N. (2023). This new conversational AI model can be your friend, philosopher, and guide ... and even your worst enemy. Pattern, 4(1), no. 100676. https://doi.org/10.1016/j.patter.2022.100676

Correge, J.-B., & Michinov, N. (2021). Group size and peer learning: Peer discussions in different group size influence learning in a biology exercise performed on a tablet with stylus. Frontiers in Education, 6. https://doi.org/10.3389/feduc.2021.733663

Dai, W., Li, Z., & Jia, N. (2022). Self-regulated learning, online mathematics learning engagement, and perceived academic control among Chinese junior high school students during the COVID-19 pandemic: A latent profile analysis and mediation analysis. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.1042843

de Winter, J. C. F., Dodou, D., & Stienen, A. H. A. (2023). ChatGPT in education: Empowering educators through methods for recognition and assessment. Informatics, 10(4), 87. https://doi.org/10.3390/informatics10040087

Dempere, J., Modugu, K., Hesham, A., & Ramasamy, L. K. (2023). The impact of ChatGPT on higher education. Frontiers in Education, 8. https://doi.org/10.3389/feduc.2023.1206936

Doebel, S., & Munakata, Y. (2017). Group influences on engaging self-control: Children delay gratification and value it more when their in-group delays and their out-group doesn’t. Psychological Science, 29(8), 738–748. https://doi.org/10.31219/osf.io/chwju

Downey, J., & Kher, H. (2015). A longitudinal examination of the effects of computer self-efficacy growth on performance during technology training. Journal of Information Technology Education: Research, 14, 091–111. https://doi.org/10.28945/2114

Francis, M. K., Wormington, S. V., & Hulleman, C. (2019). The costs of online learning: Examining differences in motivation and academic outcomes in online and face-to-face community college developmental mathematics courses. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.02054

Garner, S., Kuborn, S., & Chisum, M. (2022). Confidence in crisis: Student self-efficacy and the online pivot. International Journal on Innovations in Online Education, 6(1), 29–47. https://doi.org/10.1615/intjinnovonlineedu.2022044659

Garrison, D. R., Anderson, T., & Archer, W. (1999). Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2–3), 87–105. https://doi.org/10.1016/s1096-7516(00)00016-6

Gaytan, J. (2015). Comparing faculty and student perceptions regarding factors that affect student retention in online education. American Journal of Distance Education, 29(1), 56–66. https://doi.org/10.1080/08923647.2015.994365

Gopal, R., Singh, V., & Aggarwal, A. (2021). Impact of online classes on the satisfaction and performance of students during the pandemic period of COVID 19. Education and Information Technologies, 26(6), 6923–6947. https://doi.org/10.1007/s10639-021-10523-1

Greener, S., & Wakefield, C. (2015). Developing confidence in the use of digital tools in teaching. Electronic Journal of e-Learning, 13, 260–267. https://eric.ed.gov/?id=EJ1062118

Harasim, L. (2017). Connectivism as an online learning theory. Learning Theory and Online Technologies, 80–104. https://doi.org/10.4324/9781315716831-6

Herlo, D. (2017). Connectivism, A new learning theory? The European Proceedings of Social and Behavioral Sciences. https://doi.org/10.15405/epsbs.2017.05.02.41

Herlo, D. (2017). Connectivism, a new learning theory? The European Proceedings of Social and Behavioural Sciences. https://doi.org/10.15405/epsbs.2017.05.02.41

Hwang, G. J., & Chang, C. Y. (2021). A review of opportunities and challenges of chatbots in education. Interactive Learning Environments, 31(7), 4099–4112. https://doi.org/10.1080/10494820.2021.1952615

Jansen, R. S., van Leeuwen, A., Janssen, J., Jak, S., & Kester, L. (2019). Self-regulated learning partially mediates the effect of self-regulated learning interventions on achievement in higher education: A meta-analysis. Educational Research Review, 28, 100292. https://doi.org/10.1016/j.edurev.2019.100292

Javaid, M., Haleem, A., Singh, R. P., Khan, S., & Khan, I. H. (2023). Unlocking the opportunities through ChatGPT Tool towards ameliorating the education system. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 3(2), 100115. https://doi.org/10.1016/j.tbench.2023.100115

Khurshid, F. (2020). Online collaboration and self-regulated learning in online learning environment. Pakistan Journal of Distance and Online Learning, 6(1), 177–193.

Labadze, L., Grigolia, M., & Machaidze, L. (2023). Role of AI chatbots in education: Systematic literature review. International Journal of Educational Technology in Higher Education, 20(1). https://doi.org/10.1186/s41239-023-00426-1

Landrum, B. (2020). Examining students’ confidence to learn online, self-regulation skills and perceptions of satisfaction and usefulness of online classes. Online Learning, 24(3). https://doi.org/10.24059/olj.v24i3.2066

Landrum, B., Bannister, J., Garza, G., & Rhame, S. (2020). A class of one: Students’ satisfaction with online learning. Journal of Education for Business, 96(2), 82–88. https://doi.org/10.1080/08832323.2020.1757592

Lee, H. Y., et al. (2024). Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction. International Journal of Educational Technology in Higher Education, 21(16). https://doi.org/10.1186/s41239-024-00447-4

Levy, Y. (2007). Comparing dropouts and persistence in e-learning courses. Computers & Education, 48(2), 185–204. https://doi.org/10.1016/j.compedu.2004.12.004

Li, P.-H., Lee, H.-Y., Cheng, Y.-P., Starčič, A. I., & Huang, Y.-M. (2023). Solving the self-regulated learning problem: Exploring the performance of ChatGPT in mathematics. Innovative Technologies and Learning, 77–86. https://doi.org/10.1007/978-3-031-40113-8_8

Lin, J.-W., Szu, Y.-C., & Lai, C.-N. (2016). Effects of group awareness and self-regulation level on online learning behaviors. The International Review of Research in Open and Distributed Learning, 17(4). https://doi.org/10.19173/irrodl.v17i4.2370

Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410

Luo, H., Chen, Y., Chen, T., Koszalka, T. A., & Feng, Q. (2023). Impact of role assignment and group size on asynchronous online discussion: An experimental study. Computers & Education, 192, 104658. https://doi.org/10.1016/j.compedu.2022.104658

Mai, D. T. T., Da, C. V., & Hanh, N. V. (2024). The use of ChatGPT in teaching and learning: a systematic review through SWOT analysis approach. Frontiers in Education, 9. https://doi.org/10.3389/feduc.2024.1328769

Martin, F., & Bolliger, D. U. (2022). Developing an online learner satisfaction framework in higher education through a systematic review of research. International Journal of Educational Technology in Higher Education, 19(1). https://doi.org/10.1186/s41239-022-00355-5

Miao, J., & Ma, L. (2022). Students’ online interaction, self-regulation, and learning engagement in higher education: The importance of social presence to online learning. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.815220

Montenegro-Rueda, M., Fernández-Cerero, J., Fernández-Batanero, J. M., & López-Meneses, E. (2023). Impact of the implementation of ChatGPT in education: A systematic review. Computers, 12(8), 153. https://doi.org/10.3390/computers12080153

Moore, M. G. (1993). Theory of transactional distance. In D. Keegan (ed.), Theoretical principles of distance education (pp. 84–103). Routledge.

Murdoch, Y. D., & Lin, Y.-H. (2023). Factors mediating the link between engagement and satisfaction among online English-mediated instruction learners during COVID-19. Electronic Journal of E-Learning, 21(3), 158–174. https://doi.org/10.34190/ejel.21.3.3031

Nistor, N., & Neubauer, K. (2010). From participation to dropout: Quantitative participation patterns in online university courses. Computers & Education, 55(2), 663–672. https://doi.org/10.1016/j.compedu.2010.02.026

Pérez-Álvarez, R., Maldonado-Mahauad, J., & Pérez-Sanagustín, M. (2018). Tools to support self-regulated learning in online environments: Literature review. Lecture Notes in Computer Science, 16–30. https://doi.org/10.1007/978-3-319-98572-5_2

Sa’adi, S. (2016). Introduction to views of connectivism theory of learning. Register Journal, 3(2), 201. https://doi.org/10.18326/rgt.v3i2.201-214

Saeidi, M., Sun, S., Shakeri, S., & Eskandani, F. (2021). Challenges in deploying large language models: A review. IEEE Access, 9, 16160–16175. doi:10.1109/ACCESS.2021.3056369

Saqr, M., Nouri, J., & Jormanainen, I. (2019). A learning analytics study of the effect of group size on social dynamics and performance in online collaborative learning. Transforming Learning with Meaningful Technologies, 466–479. https://doi.org/10.1007/978-3-030-29736-7_35

Strachota, E., (2006, October 4-6). The use of survey research to measure student satisfaction in online courses [Conference presentation]. Midwest Research to Practice Conference in Adult Continuing and Community Education. University of Missouri-St. Louis, MO, United States. https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=4ca117aea5a58c5426420e4989d974134de38b1d

Su, Y. S., & Wu, S. Y. (2021). Applying data mining techniques to explore users behaviors and viewing video patterns in converged environments. Journal of Ambient Intelligence and Humanized Computing. https://doi.org/10.1007/s12652-020-02712-6

Taber, K.S. (2018). The use of Cronbach’s alpha when developing and reporting research instruments in science education. Research Science Education 48, 1273–1296. https://doi.org/10.1007/s11165-016-9602-2

Terwiesch, C. (2023). Would Chat GPT3 get a Wharton MBA? A prediction based on its performance in the operations management. The Wharton School of the University of Pennsylvania. https://mackinstitute.wharton.upenn.edu/wp-content/uploads/2023/01/Christian-Terwiesch-Chat-GTP.pdf

Thürmer, J. L., Wieber, F., & Gollwitzer, P. M. (2020). Strategic self-regulation in groups: collective implementation intentions help cooperate when cooperation is called for. Frontiers in Psychology, 11. https://doi.org/10.3389/fpsyg.2020.561388

Trust, T. (2023). Essential Considerations for Addressing the Possibility of AI-Driven Cheating, Part 1. Faculty Focus. https://www.facultyfocus.com/articles/teaching-with-technology-articles/essential-considerations-for-addressing-the-possibility-of-ai-driven-cheating-part-1/

Urban, M., Děchtěrenko, F., Lukavský, J., Hrabalová, V., Svacha, F., Brom, C., & Urban, K. (2024). ChatGPT improves creative problem-solving performance in university students: An experimental study. Computers & Education, 105031. https://doi.org/10.1016/j.compedu.2024.105031

Vaughan, N. (2013). Community of Inquiry framework, digital technologies, and student assessment in higher education. Educational Communities of Inquiry, 334–348. https://doi.org/10.4018/978-1-4666-2110-7.ch016

Veloso, M., Balch, T., Borrajo, D., Reddy, P., & Shah, S. (2021). Artificial intelligence research in finance: Discussion and examples. Oxford Review of Economic Policy, 37(3), 564–584. https://doi.org/10.1093/oxrep/grab019

Wu, Y., Xu, X., Xue, J., & Hu, P. (2023). A cross-group comparison study of the effect of interaction on satisfaction in online learning: The parallel mediating role of academic emotions and self-regulated learning. Computers & Education, 199, 104776. https://doi.org/10.1016/j.compedu.2023.104776

Zhan, Z., He, G., Li, T., He, L., & Xiang, S. (2022). Effect of groups size on students' learning achievement, motivation, cognitive load, collaborative problem-solving quality, and in-class interaction in an introductory AI course. Journal of Computer Assisted Learning, 38(6), 1807–1818. https://doi.org/10.1111/jcal.12722

Zimmerman, B. J. (2000). Attaining self-regulation: A social cognitive perspective. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 13–39). Academic Press.

Zimmerman, B. J. (2008). Investigating self-regulation and motivation: Historical background, methodological developments, and future prospects. American Educational Research Journal, 45, 166–183.

Zimmerman, W. A., & Kulikowich, J. M. (2016). Online learning self-efficacy in students with and without online learning experience. American Journal of Distance Education, 30(3), 180–191. https://doi.org/10.1080/08923647.2016.1193801

Downloads

Published

2024-06-01

How to Cite

Younis, B. K. (2024). Examining Students’ Self-Regulation Skills, Confidence to Learn Online, and Perception of Satisfaction and Usefulness of Online Classes in Three Suggested Online Learning Environments that Integrates ChatGPT. Online Learning, 28(2). https://doi.org/10.24059/olj.v28i2.4397

Issue

Section

Online and Blended Learning in the Age of Generative AI