A Case Study of Community of Inquiry Presences and Cognitive Load in Asynchronous Online STEM Courses

Authors

  • Emily Kaye Faulconer Embry-Riddle Aeronautical University
  • Darryl Chamberlain
  • Beverly L Wood

DOI:

https://doi.org/10.24059/olj.v26i3.3386

Keywords:

cognitive load, online courses, instructional design, community of inquiry

Abstract

The design and facilitation of asynchronous online courses can have notable impacts on students related to persistence, performance, and perspectives. This case study presents current conditions for cognitive load and Community of Inquiry (CoI) presences in an asynchronous online introductory undergraduate STEM course. Researchers present the novel use of Python script to clean and organize data and a simplification of the instructional efficiency calculation for use of anonymous data. Key relationships between cognitive load and CoI presences are found through validated use of NASA-TLX instrument and transcript analysis of discussion posts. The data show that student presences are not consistent throughout a course but are consistent across sections. Instructor presences are not consistent throughout a course or across sections. The study also explored predominant factors within each presence, confirming previous reports of low cognitive presence in discussions. The highest extraneous cognitive load was reported for understanding expectations and preparing an initial post. These results provide support for improvements to course design and instructor professional development to promote Community of Inquiry and reduce extraneous cognitive load.  

 

Author Biography

Emily Kaye Faulconer, Embry-Riddle Aeronautical University

Associate Professor

Department of Math, Science & Technology

References

Akcaoglu, M., & Lee, E. (2016). Increasing Social Presence in Online Learning through Small Group Discussions. International Review of Research in Open and Distance Learning, 17(3), 1–17. https://doi.org/10.19173/irrodl.v17i3.2293

Alfauzan, A. A. H., & Tarchouna, N. (2017). The Role of an Aligned Curriculum Design in the Achievement of Learning Outcomes. Journal of Education and E-Learning Research, 4(3), 81.

Aloni, M., & Harrington, C. (2018). Research Based Practices for Improving the Effectiveness of Asynchronous Online Discussion Boards. Scholarship of Teaching and Learning in Psychology, 4(4), 271–289. https://doi.org/10.1037/stl0000121

Bandura, A. (2002). Social cognitive theory in cultural context. Applied Psychology, 51(2), 269–290. https://doi.org/10.1111/1464-0597.00092

Bean, J. P. (1990). Why students leave: Insights from research. In D. Hossler & J. P. Bean (Eds.), The Strategic Management of College Enrollments (Vol. 1–Book, Section, pp. 170–185). Jossey-Bass.

Bradford, G. R. (2011). A relationship study of student satisfaction with learning online and cognitive load: Initial results. The Internet and Higher Education, 14(4), 217–226. https://doi.org/10.1016/j.iheduc.2011.05.001

Caskurlu, S., Richardson, J. C., ALamri, H. A., Chartier, K., Farmer, T., Janakiraman, S., Strait, M., & Yang, M. (2021). Cognitive load and online course quality: Insights from instructional designers in a higher education context. British Journal of Educational Technology, 52(2), 584–605. https://doi.org/10.1111/bjet.13043

Chen, G., & Chiu, M. M. (2008). Online discussion processes: Effects of earlier messages’ evaluations, knowledge content, social cues and personal information on later messages. Computers and Education, 50(3), 678–692. https://doi.org/10.1016/j.compedu.2006.07.007

Chen, Y., Lei, J., & Cheng, J. (2019). What if Online Students Take on the Responsibility: Students’ Cognitive Presence and Peer Facilitation Techniques. Journal of Asynchronous Learning Networks JALN, 23(1), 37. https://doi.org/10.24059/olj.v23i1.1348

Cochran, J., Campbell, S. M., Baker, H. M., & Leeds, E. M. (2014). The role of student characteristics in predicting retention in online courses. Research in Higher Education, 55(1), 27–48. https://doi.org/10.1007/s11162-013-9305-8

Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46. https://doi.org/10.1177/001316446002000104

Cranney, M., Alexander, J. L., Wallace, L., & Alfano, L. (2011). Instructor’s Discussion Forum Effort: Is It Worth It? 7(3), 12.

Dancey, C., & Reidy, J. (2007). Statistics without maths for psychology (5th ed.). Prentice Hall.

Darabi, A., Arrastia, M. C., Nelson, D. W., Cornille, T., & Liang, X. (2011). Cognitive presence in asynchronous online learning: A comparison of four discussion strategies: Discussion strategies in online learning. Journal of Computer Assisted Learning, 27(3), 216–227. https://doi.org/10.1111/j.1365-2729.2010.00392.x

Darabi, A., & Jin, L. (2013). Improving the quality of online discussion: The effects of strategies designed based on cognitive load theory principles. Distance Education, 34(1), 21–36. https://doi.org/10.1080/01587919.2013.770429

Ertmer, P. A., Sadaf, A., & Ertmer, D. J. (2011). Student-content interactions in online courses: The role of question prompts in facilitating higher-level engagement with course content. Journal of Computing in Higher Education, 23(2–3), 157–186. https://doi.org/10.1007/s12528-011-9047-6

Eryilmaz, E., Ryan, T., Poplin, M., & Mary, J. (2012). Re-design and Evaluation of an Anchored Discussion System. 2012 45th Hawaii International Conference on System Sciences, 108–117. https://doi.org/10.1109/HICSS.2012.498

Eryilmaz, E., Thoms, B., Mary, J., Kim, R., & van der Pol, J. (2015). Instructor versus Peer Attention Guidance in Online Learning Conversations. Association for Information Systems Transactions on Human-Computer Interaction, 7(4), 234–268. https://doi.org/10.17705/1thci.00074

Garrison, D. R., Anderson, T., & Archer, W. (2001). Critical thinking, cognitive presence, and computer conferencing in distance education. The American Journal of Distance Education, 15(1), 7–23. https://doi.org/10.1080/08923640109527071

Garrison, D. R., & Arbaugh, J. B. (2007). Researching the community of inquiry framework: Review, issues, and future directions. The Internet and Higher Education, 10(3), 157–172. https://doi.org/10.1016/j.iheduc.2007.04.001

Gašević, D., Adesope, O., Joksimović, S., & Kovanović, V. (2015). Externally-facilitated regulation scaffolding and role assignment to develop cognitive presence in asynchronous online discussions. The Internet and Higher Education, 24(Journal Article), 53–65. https://doi.org/10.1016/j.iheduc.2014.09.006

Gaytan, J. (2015). Comparing Faculty and Student Perceptions Regarding Factors That Affect Student Retention in Online Education. American Journal of Distance Education, 29(1), 56–66. https://doi.org/10.1080/08923647.2015.994365

Giacumo, L. A., & Savenye, W. (2019). Asynchronous discussion forum design to support cognition: Effects of rubrics and instructor prompts on learner’s critical thinking, achievement, and satisfaction. Educational Technology Research and Development, 68(1), 37–66. https://doi.org/10.1007/s11423-019-09664-5

Gillmore, S., Poggio, J., & Embretson, S. (2015). Effects of Reducing the Cognitive oad of Mathematics Test Items on Student Performance. Numeracy, 8(1), 1–18. http://dx.doi.org/10.5038/1936-4660.8.1.4

Goggins, S., & Xing, W. (2016). Building models explaining student participation behavior in asynchronous online discussion. Computers & Education, 94, 241–251. https://doi.org/10.1016/j.compedu.2015.11.002

Goode, C. T., Lamoreaux, M., Atchison, K. J., Jeffress, E. C., Lynch, H. L., & Sheehan, E. (2018). Quantitative Skills, Critical Thinking, and Writing Mechanics in Blended Versus Face-to-Face Versions of a Research Methods and Statistics Course. Teaching of Psychology, 45(2), 124–131. https://doi.org/10.1177/0098628318762873

Hachey, A. C., Wladis, C., & Conway, K. (2015). Prior online course experience and GPA as predictors of subsequent online STEM course outcomes. The Internet and Higher Education, 25, 11–17. https://doi.org/10.1016/j.iheduc.2014.10.003

Harrell, I. L., & Bower, B. L. (2011). Student characteristics that predict persistence in community college online courses. American Journal of Distance Education, 25(3), 178–191. https://doi.org/10.1080/08923647.2011.590107

Hart, C. (2012). Factors associated with student persistence in an online program of study: A review of the literature. Journal of Interactive Online Learning, 11(1), 19–42.

Hegeman, J. S. (2015). Using Instructor-Generated Video Lectures in Online Mathematics Courses Improves Student Learning. Online Learning, 19(3), 70–87.

Hosler, K. A., & Arend, B. D. (2012). The importance of course design, feedback, and facilitation: Student perceptions of the relationship between teaching presence and cognitive presence. Educational Media International, 49(3), 217–229. https://doi.org/10.1080/09523987.2012.738014

Hostetter, C. (2013). Community Matters: Social Presence and Learning Outcomes. Journal of the Scholarship of Teaching and Learning, 13(1), 77–86.

Howell, G. S., LaCour, M. M., & McGlawn, P. A. (2017). Constructing Student Knowledge in the Online Classroom: The Effectiveness of Focal Prompts. College Student Journal, 51(4), 483–490.

Hughes, M., Ventura, S., & Dando, M. (2007). Assessing social presence in online discussion groups: A replication study. Innovations in Education and Teaching International, 44(1), 17–29. https://doi.org/10.1080/14703290601090366

Ice, P., Gibson, A. M., Boston, W., & Becher, D. (2011). An Exploration of Differences between Community of Inquiry Indicators in Low and High Disenrollment Online Courses. Journal of Asynchronous Learning Networks, 15(2), 44–69.

Jaggars, S. S., & Xu, D. (2016). How do online course design features influence student performance? Computers & Education, 95, 270–284. https://doi.org/10.1016/j.compedu.2016.01.014

Joyner, S. A., Fuller, M. B., Holzweiss, P. C., Henderson, S., & Young, R. (2014). The Importance of Student-Instructor Connections in Graduate Level Online Courses. MERLOT Journal of Online Learning and Teaching, 10, 436–445.

Kalyuga, S. (2011). Cognitive Load Theory: How Many Types of Load Does It Really Need? Educational Psychology Review, 23(1), 1–19. https://doi.org/10.1007/s10648-010-9150-7

Kanuka, H., Rourke, L., & Laflamme, E. (2007). The influence of instructional methods on the quality of online discussion. British Journal of Educational Technology, 38(2), 260–271. https://doi.org/10.1111/j.1467-8535.2006.00620.x

Kovanovic, V., Joksimovic, S., Waters, Z., Gasevic, D., Kitto, K., Hatala, M., & Siemens, G. (2016). Towards automated content analysis of discussion transcripts | Proceedings of the Sixth International Conference on Learning Analytics & Knowledge. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, 15–24. https://dl.acm.org/doi/abs/10.1145/2883851.2883950

Kozan, K. (2015). The predictive power of the presences on cognitive load: Vol. Ph.D. https://docs.lib.purdue.edu/open_access_dissertations/491

Kwon, K., Shin, S., & Park, S. J. (2018). Effects of graphic organizers in online discussions: Comparison between instructor-provided and student-generated. Educational Technology Research and Development, 66(6), 1479–1503. https://doi.org/10.1007/s11423-018-9617-7

Landis, J. R., & Koch, G. G. (1977). The Measurement of Observer Agreement for Categorical Data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310

Lee, S.-M. (2014). The relationships between higher order thinking skills, cognitive density, and social presence in online learning. The Internet and Higher Education, 21, 41–52. https://doi.org/10.1016/j.iheduc.2013.12.002

Lou, Y., Bernard, R. M., & Abrami, P. C. (2006). Media and pedagogy in undergraduate distance education: A theory-based meta-analysis of empirical literature. Educational Technology Research and Development, 54(2), 141–176. https://doi.org/10.1007/s11423-006-8252-x

Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1), 43–52. https://doi.org/10.1207/S15326985EP3801_6

McKinney, L., Novak, H., Hagerdorn, L. S., & Luna-Torres, M. (2018). Giving up on a course: An analysis of course dropping behaviors among community college students. Research in Higher Education, 60(2), 1–19. https://doi.org/10.1007/s11162-018-9509-z

Mills, J. (2016). A mixed methods approach to investigating cognitive load and cognitive presence in an online and face-to-face college algebra course: Vol. Ph.D. https://doi.org/10.13023/ETD.2016.069

Noyelles, A. de, Zydney, J., & Chen, iyun. (2014). Strategies for Creating a Community of Inquiry through Online Asynchronous Discussions. Journal of Online Learning and Teaching, 10(1), 153.

Pattison, A. B. (2017). An Exploratory Study of the Relationship between Faculty Social Presence and Online Graduate Student Achievement, Satisfaction, and Persistence [Ed.D., Grand Canyon University]. https://www.proquest.com/docview/1874562951/abstract/AEBC0EE81BF146AEPQ/1

Qiu, M., Hewitt, J., & Brett, C. (2014). Influence of group configuration on online discourse writing. Computers and Education, 71(Journal Article), 289–302. https://doi.org/10.1016/j.compedu.2013.09.010

Rourke, L., Anderson, T., Garrison, D. R., & Archer, W. (1999). Assessing Social Presence in Asynchronous Text-based Computer Conferencing. The Journal of Distance Education / Revue de l’ducation Distance, 14(2), 50–71.

Rovai, A. P. (2003). In search of higher persistence rates in distance education online programs. The Internet and Higher Education, 6(1), 1–16. https://doi.org/10.1016/S1096-7516(02)00158-6

Rovai, A. P. (2007). Facilitating online discussions effectively. The Internet and Higher Education, 10(1), 77–88. https://doi.org/10.1016/j.iheduc.2006.10.001

Schneider, S., Beege, M., Nebel, S., & Rey, G. D. (2018). A meta-analysis of how signaling affects learning with media. Educational Research Review, 23(Journal Article), 1–24. https://doi.org/10.1016/j.edurev.2017.11.001

Shea, P., & Bidjerano, T. (2009). Community of inquiry as a theoretical framework to foster “epistemic engagement” and “cognitive presence” in online education. Computers & Education, 52(3), 543–553. https://doi.org/10.1016/j.compedu.2008.10.007

Silva, L. A. (2018). Moderating Relationships: Online Learners’ Cognitive Presence and Non-designer Instructor’s Teaching Presence [Ph.D., Grand Canyon University]. In ProQuest Dissertations and Theses. https://www.proquest.com/docview/2031574013/abstract/5AC5BE3132C54869PQ/1

Sinclair, E. (2017). A Case Study on the Importance of Peer Support for e-Learners: Proceedings of the 9th International Conference on Computer Supported Education, 280–284. https://doi.org/10.5220/0006263602800284

Stachel, J., Marghitu, D., Brahim, T. B., Sims, R., Reynolds, L., & Czelusniak, V. (2013). Managing cognitive load in introductory programming courses: A cognitive aware scaffolding tool. Journal of Integrated Design and Process Science, 17(1), 37–54. https://doi.org/10.3233/jid-2013-0004

Stein, D. S., Wanstreet, C. E., Slagle, P., Trinko, L. A., & Lutz, M. (2013). From ‘hello’ to higher-order thinking: The effect of coaching and feedback on online chats. The Internet and Higher Education, 16(Journal Article), 78–84. https://doi.org/10.1016/j.iheduc.2012.03.001

Stiller, K. D., & Koster, A. (2016). Learner attrition in an advanced vocational online training: The role of computer attitude, computer anxiety, and online learning experience. European Journal of Open, Distance, and E-Learning, 19(2), 1–14.

Stull, A. T., & Mayer, R. E. (2007). Learning by Doing Versus Learning by Viewing: Three Experimental Comparisons of Learner-Generated Versus Author-Provided Graphic Organizers. Journal of Educational Psychology, 99(4), 808–820. https://doi.org/10.1037/0022-0663.99.4.808

Swan, K., & Shih, L. F. (2005). On the nature and development of social presence in online course discussions. Journal of Asynchronous Learning Networks JALN, 9(3), 115.

Tinto, V. (1987). Leaving College: Rethinking the causes and cures of student attrition. The University of Chicago Press.

Tyler-Smith, K. (2006). Early Attrition among First Time eLearners: A Review of Factors that Contribute to Drop-out, Withdrawal, and Non-completion Rates of Adult Learners undertaking eLearning Programmes. Journal of Online Learning and Teaching, 2(2), 73–85.

van Gog, T., & Paas, F. (2008). Instructional Efficiency: Revisiting the Original Construct in Educational Research. Educational Psychologist, 43(1), 16–26. https://doi.org/10.1080/00461520701756248

Wladis, C. W., Hachey, A. C., & Conway, K. M. (2012). An analysis of the effect of the online environment on STEM student success. 2, 291–300.

Zhu, X. (2018). Facilitating Effective Online Discourse: Investigating Factors Influencing Students’ Cognitive Presence in Online Learning. Master’s Theses. https://opencommons.uconn.edu/gs_theses/1277

Downloads

Published

2022-09-01

Issue

Section

2022 OLC Conference Special Issue