Epistemic Network Models of Students’ Cognitive Engagement and Teachers’ Feedback in Online Research Writing Courses
DOI:
https://doi.org/10.24059/olj.v30i1.4793Keywords:
Epistemic network analysis, cognitive engagement, teacher feedback, online research writing courseAbstract
Understanding cultural systems in online learning with voluminous data, such as the engagement of students and teachers, has proven to be challenging. This predicament catalyzed the need for an emerging methodology to assess learning and complex thinking in online environments using statistical tools to analyze qualitative data. Quantitative Ethnography (QE) blends qualitative and quantitative approaches and uses statistical tools in analyzing qualitative data. This study advanced Epistemic Network Analysis (ENA), a QE tool, to analyze the engagement of teachers and students in online research courses of six groups of students. Observation of synchronous classes and asynchronous activities was carried out, 4,137 utterances were coded, and network models of engagements were generated. The findings show that the ENA engagement models among teachers and students in synchronous and asynchronous sessions differed significantly, with the teachers giving more frequent and varied feedback during synchronous classes. The network models of engagement in synchronous classes reveal the co-occurrence of students’ cognitive engagement and teachers’ feedback. When students try to connect with the lesson, they are given corrective feedback, and when they extend their understanding of the content, they are given affective feedback. On the other hand, when students are given prompts during asynchronous sessions, they try to connect. When they simply agree, they are given informative-procedural feedback, and when they emancipate their understanding, they receive affective feedback. This study illuminates the methodological advantages of ENA as an ethnographic tool that mixes qualitative and quantitative approaches in understanding cultural systems and processes in online education.
References
Altowairiki, N. F. (2023). Universal design for learning infusion in online higher education. Online Learning, 27(1), 296–312. https://doi.org/10.24059/olj.v27i1.3080
Andrist, S., Collier, W., Gleicher, M., Mutlu, B., & Shaffer, D. W. (2015). Look together: Analyzing gaze coordination with epistemic network analysis. Frontiers in Psychology, 6, Article 1016. https://doi.org/10.3389/fpsyg.2015.01016
Anthony, M., Van Dusen, B., & Jones, L. (2019). Connections between feedback and student happiness and engagement in high achievement classrooms. In Proceedings of the 41st Annual Meeting of the North American Chapter of the Psychology of Mathematics Education (PME-NA) (pp. 583–590). https://files.eric.ed.gov/fulltext/ED606800.pdf
Arapakis, I. (2008). Affective feedback: An investigation of the role of emotions in the information seeking process. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 395–402). ACM. https://doi.org/10.1145/1390334.1390416
Bressler, D. (2019). Using epistemic network analysis to examine discourse and scientific process during a collaborative game. Journal of Science Education and Technology, 28(6), 553–566. https://doi.org/10.1007/s10956-019-09784-2
Bright, K., & Vogler, J. S. (2024). Learning online vs. learning in person: A mixed-methods approach to understanding how student preferences and perceptions have evolved since the pandemic. Online Learning, 28 (4), (56-78). https://doi.org/10.24059/olj.v28i4.4565
Cai, Z., Liao, Q., Yao, Y., & Hu, J. (2019). nCoder+: A semantic tool for improving recall of nCoder coding. Springer Nature Switzerland
Casimiro, L. (2016). Cognitive engagement in online intercultural interactions: Beyond analytics. International Journal of Information and Education Technology, 6(6), 440–446. https://doi.org/10.18178/ijiet.2016.6.6.758
Chafouk, O., & Marjanei, D. (2024). Comparing the impact of synchronous and asynchronous online learning on student retention and satisfaction. European Journal of Education Studies, 11(11). https://doi.org/10.46827/ejes.v11i11.5605
Conklin, S., Ovarzun, B., Kim, S., & Dikkers, A.G. (2024). Exploring the relationships of learners and instructors in online courses. Online Learning, 28 (4), (257-281). https://doi.org/10.24059/olj.v28i4.4051
Dhawan, S. (2020). Online learning: A panacea in the time of COVID-19 crisis. Journal of Educational Technology Systems, 49(1), 5-22.
https://doi.org/10.1177/0047239520934018
DeWitt, P. (2020, April 19). Six reasons why students aren't showing up for virtual learning. Education Week. https://www.edweek.org/leadership/opinion-6-reasons-students-arent-showing-up-for-virtual-learning/2020/04
Eriksson, E., Gidlund, U., & Sundberg, D. (2018). A qualitative study of the primary teachers' classroom feedback rationales. Educational Research, 60(2), 168–185. https://doi.org/10.1080/00131881.2018.1451755
Everett, D. (2015). Adding value: Online student engagement. Information Systems Education Journal, 13(2), 20-27. https://files.eric.ed.gov/fulltext/EJ1137356.pdfFarrell, O., & Brunton, J. (2020). A balancing act: A window into online student engagement experiences. International Journal of Educational Technology in Higher Education, 17(5). https://doi.org/10.1186/s41239-020-00199-x
Fredricks, J. A., & McColskey, W. (2012). The measurement of student engagement: A comparative analysis of various methods and student self-report instruments. In S. L. Christenson, A. L. Reschly, & C. Wylie (Eds.), Handbook of research on student engagement (pp. 763–782). Springer Science + Business Media. https://doi.org/10.1007/978-1-4614-2018-7_37
Fonseca, J., Canhoto, J., & Pinto, P. (2015). Changing teachers’ feedback practices: A workshop challenge. Australian Journal of Teacher Education, 40(8), 88–101. https://doi.org/10.14221/ajte.2015v40n8.6
Fougt, S. (2018). Epistemic network analysis of students’ longer written assignments as formative/summative evaluation. In LAK '18: Proceedings of the 8th International Conference on Learning Analytics and Knowledge (pp. 411–415). ACM. https://doi.org/10.1145/3170358.3170414
Gillett-Swan, J. (2017). The challenges of online learning: Supporting and engaging the isolated learner. Journal of Learning Design, 10(1), 20-30. https://doi.org/10.5204/jld.v10i1.302
Gilbert, B. (2015). Online learning: Revealing the benefits and challenges (Master’s thesis, St. John Fisher College). Education Masters, Paper 303. https://fisherpub.sjf.edu/education_ETD_masters/303
Harnin, K. N., Padmadewi, N. N., Dewi, N. L. P. E. S., & Suwastini, N. K. A. (2022). Teachers’ perception and practices on giving feedback on students’ work during online learning. SAE (Journal of Indonesian Student Assessment and Evaluation). https://doi.org/10.21009/JISAE
Hatfield, D. (2015). The right kind of telling: An analysis of feedback and learning in a journalism epistemic frame. International Journal of Gaming and Computer-Mediated Simulations, 7(2), 1–23. https://doi.org/10.4018/IJGCMS.2015040101
Hibert, A., Phillips, M., Gaševic, D., Pantic, N., MacLean, J., & Tsai, Y. S. (2023). Dialogic feedback in online teaching: Implications for teacher education. In People, partnerships and pedagogies: ASCILITE 2023 conference proceedings. Australasian Society for Computers in Learning in Tertiary Education (ASCILITE).
Hodge, E., & Chenelle, S. (2018). The challenge of providing high-quality feedback online: Building a culture of continuous improvement in an online course for adult learners. Transformations: The Journal of Inclusive Scholarship and Pedagogy, 28(2), 195–201. https://doi.org/10.1353/tnf.2018.0013
Hollister, B., Nair, P., Hill-Lindsay, S., & Chukoskie, L. (2022). Engagement in online learning: Student attitudes and behavior during COVID-19. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.851019
Howard, A., & Mawyer, A. (2015). Ethnography in the digital age. http://alanhowardanthro.net/Documents/Ethnography_in_the_Digital_Age.pdf
Hu, M., & Li, H. (2017). Student engagement in online learning: A review. In 2017 International Symposium on Educational Technology (ISET) (pp. 39-43). IEEE. https://doi.org/10.1109/ISET.2017.17
Hysaj, A., & Haroon, H. A. (2022). Online formative assessment and feedback: A focus group discussion among language teachers. In R. A. R. Oliveira, G. Craveiro, & F. J. García-Peñalvo (Eds.), Proceedings of the International Conference on Learning and Collaboration Technologies. Springer.
Kristiana, I. F., Prihatsanti, U., Simanjuntak, E., & Widayanti, C. G. (2023). Online student engagement: The overview of HE in Indonesia. International Review of Research in Open and Distributed Learning, 24(3). https://doi.org/10.19173/irrodl.v24i3.7260
Leibold, N., & Schwarz, L. M. (2015). The art of giving online feedback. The Journal of Effective Teaching, 15(1), 34-46. https://files.eric.ed.gov/fulltext/EJ1060438.pdf
Lu, J., & Law, N. (2012). Online peer assessment: Effects of cognitive and affective feedback. Instructional Science, 40(2), 257–275. https://doi.org/10.1007/s11251-011-9177-2
Mamun, A., Lawrie, G., & Wright, T. (2016, September). Factors affecting student engagement in self-directed online learning module. In Proceedings of the Australian Conference on Science and Mathematics Education (ACSME). Brisbane, Australia.
Meier, E. (2015). Beyond a digital status quo: Re-conceptualizing online learning opportunities. Occasional Paper Series, 2015(34).
https://educate.bankstreet.edu/occasional-paper-series/vol2015/iss34/2
Means, B., & Neisler, J. (2023). Bridging theory and measurement of student engagement: A practical approach. Online Learning, 27(4), 26-47. https://doi.org/10.24059/olj.v27i4.4034
Medelyan, A. (2020, October 13). Coding qualitative data: How to code qualitative research. Thematic. https://getthematic.com/insights/coding-qualitative-data
Ocak, G., & Karafil, B. (2020). Development of teacher feedback use evaluation scale. International Journal of Progressive Education, 16(1), 110–125. https://doi.org/10.29329/ijpe.2020.228.8
Pedler, M., Keddie, A., & Dunn, K. (2020). The teachers' role in student engagement: A review. Australian Journal of Teacher Education, 45(3). https://doi.org/10.14221/ajte.2020v45n3.1
Pilotti, M. A. (2017). Factors related to cognitive, emotional, and behavioral engagement in the online asynchronous classroom. International Journal of Teaching and Learning in Higher Education, 29(1), 145–153.
Ravichandran, N., & Kohli, C. (2022). The future of online learning: An outlook based on recent worldwide pandemic experience. International Dialogues on Education Journal, 8(1), 89-120. https://doi.org/10.53308/ide.v8i1.250
Riel, J., Lawless, K. A., & Oren, J. B., (2020). Comparisons of synchronous and asynchronous discussions in an online roleplaying simulation to teach middle school written argumentation skills. Online Learning, 26(4), 146-167. https://doi.org/10.24059/olj.v26i4.3468
Sandelowski, M., Voils, C., & Knafl, G. (2009). On quantitizing. Journal of Mixed Methods Research, 3(3), 208-222. https://doi.org/10.1177/1558689809334210
Savvidou, C. (2018). Exploring the pedagogy of online feedback in supporting distance learning students. In A. Ozturk (Ed.), Advanced learning and teaching environments: Innovation, contents, and methods (pp. 93-108). IntechOpen. https://doi.org/10.5772/intechopen.74645
Shaffer, D. W. (2017). A tutorial on epistemic network analysis: Analyzing the structure of connections in cognitive, social, and interaction data. Journal of Learning Analytics, 3(3), 9–45. https://files.eric.ed.gov/fulltext/EJ1126800.pdf
Shernoff, D. J., Mehta, S., Atkins, M. S., & Tseng, V. (2016). Student engagement as a function of environmental complexity in high school classrooms. Learning and Instruction, 43, 52-60. https://doi.org/10.1016/j.learninstruc.2016.01.002
Shute, V. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153-189. https://doi.org/10.3102/0034654307313791
Tiwari, A., et al. (2018). Transcription process in qualitative research. https://www.happyscribe.com/blog/transcription-qualitative-research/
Wang, Y., Liu, W., & Kee, Y. H. (2018). The nature of learning tasks and knowledge acquisition: The role of cognitive engagement in physical education. European Physical Education Review, 24(2), 137–152. https://doi.org/10.1177/1356336X17724173
Watson, S., Sullivan, D. P., & Watson, K. (2023). Teaching presence in asynchronous online classes: It’s not just a façade. Online Learning Journal, 27(2). https://doi.org/10.24059/olj.v27i2.3231
Yuyun, I. (2023). Investigating university student engagement in online learning: A case study in EFL classroom. Indonesian Journal of Applied Linguistics, 12(3), 634-653. https://doi.org/10.17509/ijal.v12i3.46035
Zhang, S., Koehler, M. J., & Mishra, P. (2019). Exploring primary school teachers’ technological pedagogical content knowledge (TPACK) in online collaborative discourse: An epistemic network analysis. British Journal of Educational Technology. https://doi.org/10.1111/bjet.12791
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Alvin Barcelona
This work is licensed under a Creative Commons Attribution 4.0 International License.
As a condition of publication, the author agrees to apply the Creative Commons – Attribution International 4.0 (CC-BY) License to OLJ articles. See: https://creativecommons.org/licenses/by/4.0/.
This licence allows anyone to reproduce OLJ articles at no cost and without further permission as long as they attribute the author and the journal. This permission includes printing, sharing and other forms of distribution.
Author(s) hold copyright in their work, and retain publishing rights without restrictions
