A Meta-Analysis on the Community of Inquiry Presences and Learning Outcomes in Online and Blended Learning Environments
DOI:
https://doi.org/10.24059/olj.v26i1.2604Keywords:
Community of Inquiry, Teaching Presence, Cognitive Presence, Social Presence, Online Learning, Blended Learning, Meta-AnalysisAbstract
The Community of Inquiry (CoI) framework describes three essential presences (i.e., teaching presence, cognitive presence, and social presence) and how these presences interact in providing an educational experience in online and blended learning environments. This meta-analysis examined 19 empirical studies on the CoI Presences (Teaching Presence, Social Presence, and Cognitive Presence) and their correlations with learning outcomes, including actual learning, perceived learning, and satisfaction. It was found that teaching presence and actual learning were moderately positively correlated, (r = .353). There was a weak correlation between cognitive presence and actual learning, (r = .250) and social presence and actual learning, (r = .199). For the correlation between the presences and perceived learning, cognitive presence and perceived learning was found to be strongly correlated, (r = .663), followed by the moderate correlation between social presence and perceived learning (r = .432), and teaching presence and perceived learning, (r = .392). With respect to satisfaction, the correlation between cognitive presence and satisfaction, (r = .586) and between teaching presence and satisfaction was strong, (r = .510), but the correlation between social presence and satisfaction was moderate, (r = .447). The findings have implications for designers and instructors who design and teach online and blended courses to include these presences.
References
Abdous, M., & Yen, C.-J. (2010). A predictive study of learner satisfaction and outcomes in face-to face, satellite broadcast, and live video-streaming learning environments. The Internet and Higher Education, 13, 248–257.
*Akyol, Z., & Garrison, D. R. (2008). The development of a community of inquiry over time in an online course: Understanding the progression and integration of social, cognitive and teaching presence. Journal of Asynchronous Learning Networks, 12, 3-22.
Akyol, Z., Garrison, D. R., & Ozden, M. Y. (2009). Online and blended communities of inquiry: Exploring the developmental and perceptional differences. International Review of Research in Open and Distance Learning, 10(6), 65–83.
Akyol, Z., Arbaugh, J. B., Cleveland-Innes, M., Garrison, D. R., Ice, P., Richardson, J. C., & Swan, K. (2009). A response to the review of the community of inquiry framework. Journal of distance education, 23(2), 123-135.
*Alaulamie, L. A. (2014). Teaching presence, social presence, and cognitive presence as predictors of students' satisfaction in an online program at a Saudi University (Doctoral dissertation, Ohio University).
Ali, A., & Smith, D. (2015). Comparing social isolation effects on students attrition in online versus face-to-face courses in computer literacy. Issues in Informing Science and Information Technology, 12, 11-20.
Anderson, T., Rourke, L., Garrison, D. R., Archer, W. (2001). Assessing Teaching presence in a Computer Conference Environment. Journal of asynchronous learning networks, 5(2), 1-17.
*Arbaugh, J. B. (2008). Does the community of inquiry framework predict outcomes in online MBA courses?. The International Review of Research in Open and Distributed Learning, 9(2), 1-21
Arbaugh, J.B., Cleveland-Innes, M., Diaz, S.R., Garrison, D.R., Ice, P., Richardson, & Swan, K.P. (2008). Developing a community of inquiry instrument: Testing a measure of the Community of Inquiry framework using a multi-institutional sample. The Internet and higher Education, 11(3-4), 133-136.
Arbaugh, J. B., Bangert, A., & Cleveland-Innes, M. (2010). Subject matter effects and the
Community of Inquiry (CoI) framework: An exploratory study. Internet and Higher
Education, 13(1–2), 37–44.
*Arbaugh, J. B. (2013). Does academic discipline moderate CoI-course outcomes relationships in online MBA courses?. The Internet and Higher Education, 17, 16-28.
Bacon, D. R. (2016). Reporting actual and perceived student learning in education research, Journal of Marketing Education, 38(1), 3-6
Bolliger, D. U., & Inan, F. A. (2012). Development and validation of the online student connectedness survey (OSCS). The International Review of Research in Open and Distributed Learning, 13(3), 41-65.
Bolliger, D. U., & Martin, F. (2018). Instructor and student perceptions of online student engagement strategies. Distance Education, 39(4), 568-583.
Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2009). Introduction to Meta-Analysis. Chichester, West Sussex, UK: John Wiley & Sons.
Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2010). A basic introduction to fixed‐effect and random‐effects models for meta‐analysis. Research synthesis methods, 1(2), 97-111.
Borenstein, M., Hedges, L., Higgins, J., & Rothstein, H. (2014). Comprehensive meta-analysis (Version 3.3.070) [Computer software]. Biostat. https://www.meta-analysis.com/
Carpenter, S. K., Wilford, M. M., Kornell, N., & Mullaney, K. M. (2013). Appearances can be deceiving: Instructor fluency increases perceptions of learning without increasing actual learning. Psychonomic bulletin & review, 20(6), 1350-1356.
Carlon, S., Bennett-Woods, D., Berg, B., Claywell, L., LeDuc, K., Marcisz, N., ... & Zenoni, L. (2012). The community of inquiry instrument: Validation and results in online health care disciplines. Computers & Education, 59(2), 215-221.
Caskurlu, S., Maeda, Y., Richardson, J. C., & Lv, J. (2020). A meta-analysis addressing the relationship between teaching presence and students’ satisfaction and learning. Computers & Education, 157, 103966.
Caskurlu, S. (2018). Confirming the subdimensions of teaching, social, and cognitive presences: A construct validity study. Internet and Higher Education, 39, 1-12.
*Catron, S. D. (2012). An investigation of online educational quality in professional and continuing education using the Community of Inquiry framework. Doctoral Dissertation, University of California, Davis.
*Chen, Y., Gao, Q., Yuan, Q., & Tang, Y. (2019). Discovering MOOC learner motivation and its moderating role. Behaviour & Information Technology, 1-19.
Chen, Y., Lei, J., & Cheng, J. (2019). What if Online Students Take on the Responsibility: Students' Cognitive Presence and Peer Facilitation Techniques. Online Learning, 23(1), 37-61.
*Choy, J. L. F., & Quek, C. L. (2016). Modelling relationships between students’ academic achievement and community of inquiry in an online learning environment for a blended course. Australasian Journal of Educational Technology, 32(4).
Claman, F. L. (2015). The impact of multiuser virtual environments on student engagement. Nurse Education in Practice, 15(1), 13–16.
Croft, N., Dalton, A., & Grant, M. (2010). Overcoming isolation in distance learning: Building a learning community through time and space. Journal for Education in the Built Environment, 5(1), 27-64.
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences, 2nd Edn. New York, NY: Academic Press.
CoI Framework (2020). Community of Inquiry Framework. Retrieved from https://coi.athabascau.ca/coi-model/
CoI Survey (2020). CoI Survey. Retrieved from https://CoI.athabascau.ca/CoI-model/CoI-survey
*Dempsey, P. (2017). The relationship between a community of inquiry and transformative learning. Doctoral Dissertation, Liberty University
Deslauriers, L., McCarty, L. S., Miller, K., Callaghan, K., & Kestin, G. (2019). Measuring actual learning versus feeling of learning in response to being actively engaged in the classroom. Proceedings of the National Academy of Sciences, 116(39), 19251-19257.
Dewey, J. (1933). How we think. Mineola: Dover publications.
Dickersin, K., & Min, Y. I. (1993). NIH clinical trials and publication bias. The Online journal of current clinical trials, 4967-words.
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. Bmj, 315(7109), 629-634.
Fiock, H. S. (2020). Designing a Community of Inquiry in Online Courses. International Review of Research in Open and Distance Learning, 21(1), 135-153.
Galikyan, I., & Admiraal, W. (2019). Students' engagement in asynchronous online discussion: The relationship between cognitive presence, learner prominence, and academic performance. The Internet and Higher Education, 43, 100692.
Garrison, D. R., Anderson, T., & Archer, W. (2000). Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2/3), 87-105.
Garrison, D. R., Anderson, T., & Archer, W. (2001). Critical thinking, cognitive presence, and computer conferencing in distance education. American Journal of distance education, 15(1), 7-23.
Garrison, D. R. (2007). Online community of inquiry review: Social, cognitive, and teaching presence issues. Journal of Asynchronous Learning Networks, 11(1), 61-72.
Garrison, D. R. (2009). Communities of inquiry in online learning: Social, teaching and cognitive presence. In C. Howard et al. (Eds.), Encyclopedia of distance and online learning (2nd ed., pp. 352-355). Hershey, PA: IGI Global.
Garrison, D. R., Anderson, T., & Archer, W. (2010). The first decade of the community of inquiry framework: A retrospective. The internet and higher education, 13(1-2), 5-9.
Garrison, D. R., Cleveland-Innes, M., & Fung, T. S. (2010). Exploring causal relationships among teaching, cognitive and social presence: Student perceptions of the community of inquiry framework. The internet and higher education, 13(1-2), 31-36.
Garrison, D. R. (2011). E-Learning in the 21st Century: A Framework for Research and Practice (2nd Ed.). London: Routledge/Taylor and Francis.
Gašević, D., Adesope, O., Joksimović, S., & Kovanović, V. (2015). Externally-facilitated regulation scaffolding and role assignment to develop cognitive presence in asynchronous online discussions. The Internet and Higher Education, 24, 53-65.
Hattie, J., Rogers, H. J., & Swaminathan, H. (2014). The role of meta-analysis in educational research. In A. D. Reid, E. Hart, & M. Peters (Eds.), A companion to research in education (pp. 197–207). Springer. https://doi.org/10.1007/978-94-007-6809-3_26
Hosler, K. A., & Arend, B. D. (2012). The importance of course design, feedback, and facilitation: student perceptions of the relationship between teaching presence and cognitive presence. Educational Media International, 49(3), 217-229.
Hunter, J. E., & Schmidt, F. L. (2000). Fixed effects vs. random effects meta‐analysis models: Implications for cumulative research knowledge. International Journal of selection and assessment, 8(4), 275-292.
Jan, S. K., Vlachopoulos, P., & Parsell, M. (2019). Social network analysis and learning communities in higher education online learning: A systematic literature review. Learning, 23(1), 249-264.
*Jones, C. R. (2017). Examination of Online Community College Students: Community of Inquiry Theoretical Model (Doctoral dissertation, McKendree University).
Joo, Y. J., Lim, K. Y., & Kim, E. K. (2011). Online university students’ satisfaction and persistence: Examining perceived level of presence, usefulness and ease of use as predictors in a structural model. Computers & Education, 57, 1654–1664/
Kang, M., Liew, B. T., Kim, J., & Park, Y. (2014). Learning presence as a predictor of achievement and satisfaction in online learning environments. International Journal on ELearning, 13(2), 193–208.
Kanuka, H., Rourke, L., & Laflamme, E. (2007). The influence of instructional methods on the quality of online discussion. British Journal of Educational Technology, 38, 260–271.
*Khodabandelou, R., Ab Jalil, H., Ali, W. Z. W., & bin Mohd Daud, S. (2014). Moderation effect of gender on relationship between community of inquiry and perceived learning in blended learning environments. Contemporary Educational Technology, 5(3), 257-271.
Kovanović, V., Joksimović, S., Poquet, O., Hennis, T., Dawson, S., Gašević, D., ... & Siemens, G. (2017, March). Understanding the relationship between technology use and cognitive presence in MOOCs. In Proceedings of the Seventh International Learning Analytics & Knowledge Conference (pp. 582-583).
Kozan, K., & Richardson, J. C. (2014). Interrelationships between and among social, teaching, and cognitive presence. The Internet and higher education, 21, 68-73.
Krathwohl, D.R., Bloom,B.S. and Masia, B. B. (1964).Taxonomy of educational objectives, Book II. Affective domain. New York, NY. David McKay Company, Inc.
Kranzow, J. (2013). Faculty leadership in online education: Structuring courses to impact student satisfaction and persistence. MERLOT Journal of Online Learning and Teaching, 9(1), 131– 139
Kucuk, S., & Sahin, I. (2013). From the perspective of community of inquiry framework: An examination of facebook uses by pre-service teachers as a learning environment.
Turkish Online Journal of Educational Technology, 12(2), 142–156.
Lenhard, W. & Lenhard, A. (2014). Hypothesis Tests for Comparing Correlations. Retrieved from: https://www.psychometrica.de/correlation.html. Bibergau (Germany): Psychometrica. DOI: 10.13140/RG.2.1.2954.1367
*Lee, S. J., & Huang, K. (2018). Online interactions and social presence in online learning. Journal of Interactive Learning Research, 29(1), 113-128.
Lin, S., Hung, T. C., & Lee, C. T. (2015). Revalidate forms of presence in training effectiveness: Mediating effect of self-efficacy. Journal of Educational Computing Research, 53(1), 32-54.
Lowenthal, P. R., & Parscal, T. (2008). Teaching presence online facilitates meaningful learning. The Learning Curve, 3(4), 1-2
*Maddrell, J. A., Morrison, G. R., & Watson, G. S. (2017). Presence and learning in a community of inquiry. Distance Education, 38(2), 245-258.
*Mo, S. K., & Lee, S. (2017). The relationships among the presences of community of inquiry and the perceptions of efl college students in online learning. Multimedia-Assisted Language Learning, 20(2), 11-35.
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Annals of Internal Medicine, 151(4), 264-269.
Moreira, J. A., Ferreira, A. G., & Almeida, A. C. (2013). Comparing communities of inquiry of Portuguese higher education students: One for all or one for each? Open Praxis, 5(2), 165-178.
Olpak, Y. Z., & Cakmak, E. K. (2018). Examining the reliability and validity of a Turkish version of the Community of Inquiry Survey. Online Learning Journal, 22(1), 142-160.
Pellas, N. (2017). An exploration of interrelationships among presence indicators of a community of inquiry in a 3D game-like environment for high school programming courses. Interactive Learning Environments, 25(3), 343-360.
*Place, M. A. (2017). Comparing Online Learning Perceptions of Adult Students: An Application of the Community of Inquiry Framework. Doctoral Dissertation, Widener University.
Redmond, P. (2014). Reflection as an indicator of cognitive presence. E-Learning and Digital Media, 11(1), 46-58.
Redstone, A. E., Stefaniak, J. E., & Luo, T. (2018). MEASURING PRESENCE: A Review of Research Using the Community of Inquiry Instrument. The Quarterly Review of Distance Education, 19(2).
Richardson, J. C., Maeda, Y., Lv, J., & Caskurlu, S. (2017). Social presence in relation to students' satisfaction and learning in the online environment: A meta-analysis. Computers in Human Behavior, 71, 402-417.
Richardson, J.C., Arbaugh, J.C. Cleveland-Innes, M., Ice, P., Swan, K. and Garrison, D.R. (2010). Using the community of inquiry framework to inform effective instructional design. Paper presented at the 2010 AECT Research Symposium: Bloomington, IN, 2010. https://doi.org/10.1007/978-1-4614-1785-9_7.
Richardson, J. C., & Swan, K. P. (2003). Examining social presence in online courses in relation to students’ perceived learning and satisfaction. Journal of Asynchronous Learning Networks, 7, 68–88.
Rockinson-Szapkiw, A. J., Baker, J. D., Neukrug, E., & Hanes, J. (2010). The efficacy of computer mediated communication technologies to augment and support effective
online helping profession education. Journal of Technology in Human Services, 28(3),
–177.
Rockinson-Szapkiw, A. J., & Wendt, J. (2015). Technologies that assist in online group work: A comparison of synchronous and asynchronous computer mediated communication
technologies on students' learning and community. Journal of Educational
Multimedia and Hypermedia, 24(3), 263–279.
*Rockinson-Szapkiw, A. J., Wendt, J., Whighting, M., & Nisbet, D. (2016). The predictive relationship among the community of inquiry framework, perceived learning and online, and graduate students’ course grades in online synchronous and asynchronous courses. International Review of Research in Open and Distributed Learning, 17(3), 18-35.
Rosenthal, R. (1979). The ‘File drawer problem’ and tolerance for null results. Psychol Bull 86: 638–641.
Rosenthal, R. (1995). Writing meta-analytic reviews. Psychological bulletin, 118(2), 183.
Seaman, J. E., Allen, I. E., & Seaman, J. (2018). Grade Increase: Tracking Distance Education in the United States. Babson Survey Research Group.
Shea, P., & Bidjerano, T. (2009a). Cognitive presence and online learner engagement: A cluster analysis of the community of inquiry framework. Journal of Computing in Higher Education, 21(3), 199.
Shea, P., & Bidjerano, T. (2009b). Community of inquiry as a theoretical framework to foster “epistemic engagement” and “cognitive presence” in online education. Computers & Education, 52, 543–553
Shea, P., Li, C., Swan, K. P., & Pickett, A. (2005). Developing learning community in online asynchronous college courses: The role of teaching presence. Journal of Asynchronous Learning Networks, 9, 59–82.
Shin, N. (2003). Transactional presence as a critical predictor of success in distance learning. Distance Education, 24, 69–86.
Sorensen, C. K., & Baylen, D. M. (2009). Learning online: Adapting the seven principles of good practice to a Web-based instructional environment. In A. Orellana, T. L. Hudgins, & M. Samonson (Eds.), The perfect online course: Best practices for designing and teaching (pp. 69-86). Charlotte, NY: Information Age Publishing.
Sterne, J. A., & Egger, M. (2001). Funnel plots for detecting bias in meta-analysis: Guidelines on choice of axis. Journal of Clinical Epidemiology, 54(10), 1046–1055.
Sterne, J. A., & Harbord, R. M. (2004). Funnel plots in meta-analysis. The stata journal, 4(2), 127-141.
Stenbom, S. (2018). A systematic review of the Community of Inquiry survey. The Internet and Higher Education, 39, 22-32.
Swan, K., Shea, P., Richardson, J., Ice, P., Garrison, D. R., Cleveland-Innes, M., & Arbaugh, J. B. (2008). Validating a measurement tool of presence in online communities of inquiry. E-Mentor, 2(24), 1-12.
Swan, K. P., & Shih, L. (2005). On the nature and development of social presence in online course discussions. Journal of Asynchronous Learning Networks, 9, 115–136.
Orwin, R. G. (1983). A fail-safe N for effect size in meta-analysis. Journal of Educational Statistics, 8(2), 157–159. https://doi.org/10.2307/1164923
*van der Merwe, M. D. (2014). Community of inquiry framework: employing instructor-driven measures in search of a relationship among presences and student learning outcomes. International Journal of Learning Technology, 9(3), 304-320.
*van Schyndel, J. L. (2015). Nursing students' perceptions of presence in online courses. Doctoral Dissertation, Indiana University
Wilson, L.C. (2014). Introduction to Meta-Analysis: A Guide for the Novice. Association for Psychological Science. Retrieved online from https://www.psychologicalscience.org/observer/introduction-to-meta-analysis-a-guide-for-the-novice
*Woiwode, K., & Baysingar, M. (2015). Impact of community of inquiry and authentic learning on learning outcomes in online health science education. Master’s Thesis, Western Illinois University.
Xie, K., DeBacker, T.K., & Ferguson, C. (2006). Extending the traditional classroom through online discussion: The role of student motivation, Journal of Educational Computing Research, 34(1), 67-89.
Xie, K., Durrington, V.A., & Yen, L.L. (2011a). Relationship between students’ motivation and their participation in asynchronous online discussions. Journal of Online Learning and Teaching, 7(1), 17-29.
Xie, K., & Ke, F. (2011b). The role of students’ motivation in peer-moderated asynchronous online discussions. British Journal of Educational Technology, 42(6), 916-930.
Xie, K., Miller, N.C., & Allison, J.R. (2013). Toward a social conflict evolution model: Examining the adverse power of conflictual social interaction in online learning. Computers & Education, 63, 404-415.
Xie, K., Lu, L., Cheng, S.L., & Izmirli, S. (2017) The interactions between facilitator identity, conflictual presence, and social presence in online collaborative learning. Distance Education, 38(2), 230-244.
*Yadon, B. C. (2014). Improving online programs and community of inquiry through analysis of discussion boards, instructor self-efficacy, and student satisfaction. Doctoral Dissertation, University of Idaho.
Yu, T., & Richardson, J. C. (2015). Examining reliability and validity of a Korean version of the community of inquiry instrument using exploratory and confirmatory factor analysis. The Internet and Higher Education, 25, 45-52.
Downloads
Published
Issue
Section
License
As a condition of publication, the author agrees to apply the Creative Commons – Attribution International 4.0 (CC-BY) License to OLJ articles. See: https://creativecommons.org/licenses/by/4.0/.
This licence allows anyone to reproduce OLJ articles at no cost and without further permission as long as they attribute the author and the journal. This permission includes printing, sharing and other forms of distribution.
Author(s) hold copyright in their work, and retain publishing rights without restrictions
