The Community of Inquiry Perspective on Teachers’ Role and Students’ Evaluations of Online Project-Based Learning

Authors

  • Pengyue Guo ICLON, Leiden University Graduate School of Teaching, Leiden University
  • Nadira Saab ICLON, Leiden University Graduate School of Teaching, Leiden University
  • Danli Ren Civil Prosecution Research Base of Southeast University, Southeast University
  • Wilfried Admiraal Centre for the Study of Professions, Oslo Metropolitan University

DOI:

https://doi.org/10.24059/olj.v26i4.3193

Keywords:

Online project-based learning, Teacher role, Student evaluation, Teaching presence, Social presence

Abstract

The role of teachers is an important element of online project-based learning courses. Based on the Community of Inquiry framework, this study examined how students’ perceptions of teaching presence, through social presence and cognitive presence, were related to their evaluations of online project-based learning. A 16-week online project-based legal education course was implemented. During the course, students engaged in two small group activities and created two final products. Survey data were collected twice from 38 and 41 students in two course phases. Results from partial least squares analyses revealed that teaching presence was directly related to students’ evaluations in the early stage of the course and indirectly related to students’ evaluations, through the effects of social presence, in the entire course. Practical implications for teachers and suggestions for further studies are provided.

 

References

Abdous, M., & Yen, C.-J. (2010). A predictive study of learner satisfaction and outcomes in face-to-face, satellite broadcast, and live video-streaming learning environments. The Internet and Higher Education, 13(4), 248–257. https://doi.org/10.1016/j.iheduc.2010.04.005

Akyol, Z., & Garrison, D. R. (2008). The development of a community of inquiry over time in an online course: Understanding the progression and integration of social, cognitive and teaching presence. Journal of Asynchronous Learning Networks, 12(3–4), 3–22.

Al-Rawahi, L. S., & Al-Mekhlafi, A. M. (2015). The effect of online collaborative project -based learning on English as a Foreign Language learners’ language performance and attitudes. Learning and Teaching in Higher Education: Gulf Perspectives, 12(2). http://lthe.zu.ac.ae

Anderson, T., Rourke, L., Garrison, D. R., & Archer, W. (2001). Assessing teaching presence in a computer conferencing context. Online Learning, 5(2), 1–17. https://doi.org/10.24059/olj.v5i2.1875

Arbaugh, J. B. (2008). Does the Community of Inquiry Framework Predict Outcomes in Online MBA Courses? International Review of Research in Open and Distance Learning, 9(2). https://doi.org/10.19173/irrodl.v9i2.490

Arbaugh, J. B., Cleveland-Innes, M., Diaz, S. R., Garrison, D. R., Ice, P., Richardson, J. C., & Swan, K. P. (2008). Developing a community of inquiry instrument: Testing a measure of the Community of Inquiry framework using a multi-institutional sample. The Internet and Higher Education, 11(3–4), 133–136. https://doi.org/10.1016/j.iheduc.2008.06.003

Archibald, D. (2010). Fostering the development of cognitive presence: Initial findings using the community of inquiry survey instrument. The Internet and Higher Education, 13(1–2), 73–74. https://doi.org/10.1016/j.iheduc.2009.10.001

Armellini, A., & De Stefani, M. (2016). Social presence in the 21st century: An adjustment to the Community of Inquiry framework. British Journal of Educational Technology, 47(6), 1202–1216. https://doi.org/10.1111/bjet.12302

Baker, C. (2010). The Impact of Instructor Immediacy and Presence for Online Student Affective Learning, Cognition, and Motivation. The Journal of Educators Online, 7(1). https://doi.org/10.9743/JEO.2010.1.2

Balash, C., Richardson, S., Guzzomi, F., & Rassau, A. (2019). Engineering Mechanics: Adoption of project-based learning supported by computer-aided online adaptive assessments overcoming fundamental issues with a fundamental subject. European Journal of Engineering Education. https://doi.org/10.1080/03043797.2019.1664413

Barak, M., & Dori, Y. J. (2005). Enhancing undergraduate students’ chemistry understanding through project-based learning in an it environment. Science Education, 89(1), 117–139. https://doi.org/10.1002/sce.20027

Bell, S. (2010). Project-based learning for the 21st century: Skills for the future. The Clearing House, 83(2), 39–43. https://doi.org/10.1080/00098650903505415

Benbunan-Fich, R., & Arbaugh, J. B. (2006). Separating the effects of knowledge construction and group collaboration in learning outcomes of web-based courses. Information & Management, 43(6), 778–793. https://doi.org/10.1016/j.im.2005.09.001

Blumenfeld, P. C., Soloway, E., Marx, R. W., Krajcik, J. S., Guzdial, M., & Palincsar, A. (1991). Motivating Project-Based Learning: Sustaining the Doing, Supporting the Learning. Educational Psychologist, 26(3 & 4), 369–398. https://doi.org/10.1207/s15326985ep2603&4_8

Boston, W., Díaz, S. R., Gibson, A. M., Ice, P., Richardson, J., & Swan, K. (2009). An exploration of the relationship between indicators of the Community of Inquiry framework and retention in online programs. Journal of Asynchronous Learning Networks, 13(3), 67–83.

Çakiroğlu, Ü., & Erdemir, T. (2019). Online project based learning via cloud computing: Exploring roles of instructor and students. Interactive Learning Environments, 27(4), 547–566. https://doi.org/10.1080/10494820.2018.1489855

Chen, C.-H., & Yang, Y.-C. (2019). Revisiting the effects of project-based learning on students’ academic achievement: A meta-analysis investigating moderators. Educational Research Review, 26, 71–81. https://doi.org/10.1016/j.edurev.2018.11.001

Ching, Y.-H., & Hsu, Y.-C. (2013). Peer feedback to facilitate project-based learning in an online environment. The International Review of Research in Open and Distributed Learning, 14(5), 258–276. https://doi.org/10.19173/irrodl.v14i5.1524

Choo, J., Bakir, N., Scagnoli, N. I., Ju, B., & Tong, X. (2020). Using the Community of Inquiry framework to understand students’ learning experience in online undergraduate business courses. TechTrends, 64, 172–181. https://doi.org/10.1007/s11528-019-00444-9

Chua, K. J. (2014). A comparative study on first-time and experienced project-based learning students in an engineering design module. European Journal of Engineering Education, 39(5), 556–572. https://doi. org/10.1080/03043797.2014.895704

Chua, K. J., Yang, W. M., & Leo, H. L. (2014). Enhanced and conventional project-based learning in an engineering design module. International Journal of Technology and Design Education, 24(4), 437–458. https:// doi.org/10.1007/s10798-013-9255-7

Cleveland-Innes, M., Garrison, D. R., & Vaughan, N. (2019). The Community of Inquiry theoretical framework: Implicaitons for distance educaiton and beyond. In Handbook of Distance Education (Fourth edition, pp. 67–78). Routledge.

Costa-Silva, D., Côrtes, J. A., Bachinski, R. F., Spiegel, C. N., & Alves, G. G. (2018). Teaching cell biology to dental students with a project-based learning approach. Journal of Dental Education, 82(3), 322–331. https://doi.org/10.21815/JDE.018.032

Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (4th ed). Pearson.

Deane, F. P., Podd, J., & Henderson, R. D. (1998). Relationship between self-report and log data estimates of information system usage. Computers in Human Behavior, 14(4), 621–636. https://doi.org/10.1016/S0747-5632(98)00027-2

Dooley, K. E., & Wickersham, L. E. (2007). Distraction, domination, and disconnection in whole-class, online discussions. The Quarterly Review of Distance Education, 8(1), 1–8.

Du, X., de Graaff, E., & Kolmos, A. (Eds.). (2009). Diversity of PBL– PBL learning principles and models. In Research on PBL Practice in Engineering Education (pp. 9–21). Sense Publishers.

Galikyan, I., & Admiraal, W. (2019). Students’ engagement in asynchronous online discussion: The relationship between cognitive presence, learner prominence, and academic performance. The Internet and Higher Education, 43, 100692. https://doi.org/10.1016/j.iheduc.2019.100692

Garrison, D. R., & Akyol, Z. (2013). Toward the development of a metacognition construct for communities of inquiry. The Internet and Higher Education, 17, 84–89. https://doi.org/10.1016/j.iheduc.2012.11.005

Garrison, D. R., & Anderson, T. (2003). E-learning in the 21st century: A framework for research and practice. Taylor & Francis e-Library.

Garrison, D. R., Anderson, T., & Archer, W. (2000). Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2–3), 87–105. https://doi.org/10.1016/S1096-7516(00)00016-6

Garrison, D. R., Anderson, T., & Archer, W. (2001). Critical thinking, cognitive presence, and computer conferencing in distance education. American Journal of Distance Education, 15(1), 7–23. https://doi.org/10.1080/08923640109527071

Garrison, D. R., & Arbaugh, J. B. (2007). Researching the Community of Inquiry framework: Review, issues, and future directions. The Internet and Higher Education, 10(3), 157–172. https://doi.org/10.1016/j.iheduc.2007.04.001

Garrison, D. R., Cleveland-Innes, M., & Fung, T. S. (2010). Exploring causal relationships among teaching, cognitive and social presence: Student perceptions of the community of inquiry framework. The Internet and Higher Education, 13(1–2), 31–36. https://doi.org/10.1016/j.iheduc.2009.10.002

Gašević, D., Adesope, O., Joksimović, S., & Kovanović, V. (2015). Externally-facilitated regulation scaffolding and role assignment to develop cognitive presence in asynchronous online discussions. The Internet and Higher Education, 24, 53–65. https://doi.org/10.1016/j.iheduc.2014.09.006

Gomez-Pablos, V. B., del Pozo, M. M., & Munoz-Repiso, A. G.-V. (2017). Project-based learning (PBL) through the incorporation of digital technologies: An evaluation based on the experience of serving teachers. Computers in Human Behavior, 68, 501–512. https://doi.org/10.1016/j.chb.2016.11.056

Guo, P., Saab, N., Post, L. S., & Admiraal, W. (2020). A review of project-based learning in higher education: Student outcomes and measures. International Journal of Educational Research, 102, 101586. https://doi.org/10.1016/j.ijer.2020.101586

Guo, P., Saab, N., Wu, L., & Admiraal, W. (2021). The Community of Inquiry perspective on students' social presence, cognitive presence, and academic performance in online project-based learning. Journal of Computer Assisted Learning, 1–15. https://doi.org/10.1111/ jcal.12586

Hair, J. F., Ringle, C. M., & Sarstedt, M. (2011). PLS-SEM: Indeed a silver bullet. Journal of Marketing Theory and Practice, 19(2), 139–152. https://doi.org/10.2753/MTP1069-6679190202

Harburg, E., Lewis, D. R., Easterday, M., & Gerber, E. M. (2018). CheerOn: Facilitating online social support for novice project-based learning teams. ACM Transactions on Computer-Human Interaction, 25(6), Article 32. https://doi.org/10.1145/3241043

Helle, L., Tynjälä, P., & Olkinuora, E. (2006). Project-Based Learning in Post-Secondary Education – Theory, Practice and Rubber Sling Shots. Higher Education, 51(2), 287–314. https://doi.org/10.1007/s10734-004-6386-5

Heo, H., Lim, K. Y., & Kim, Y. (2010). Exploratory study on the patterns of online interaction and knowledge co-construction in project-based learning. Computers & Education, 55(3), 1383–1392. https://doi.org/10.1016/j.compedu.2010.06.012

Hou, H.-T., Chang, K.-E., & Sung, Y.-T. (2007). An analysis of peer assessment online discussions within a course that uses project-based learning. Interactive Learning Environments, 15(3), 237–251. https://doi.org/10.1080/10494820701206974

Joo, Y. J., Lim, K. Y., & Kim, E. K. (2011). Online university students’ satisfaction and persistence: Examining perceived level of presence, usefulness and ease of use as predictors in a structural model. Computers & Education, 57(2), 1654–1664. https://doi.org/10.1016/j.compedu.2011.02.008

Ke, F. (2010). Examining online teaching, cognitive, and social presence for adult students. Computers & Education, 55(2), 808–820. https://doi.org/10.1016/j.compedu.2010.03.013

Kokotsaki, D., Menzies, V., & Wiggins, A. (2016). Project-based learning: A review of the literature. Improving Schools, 19(3), 267–277. https://doi.org/10.1177/1365480216659733

Krajcik, J., McNeill, K. L., & Reiser, B. J. (2008). Learning-goals-driven design model: Developing curriculum materials that align with national standards and incorporate project-based pedagogy. Science Education, 92(1), 1–32. https://doi.org/10.1002/sce.20240

Krajcik, J., & Shin, N. (2014). Project-Based Learning. In R. K. Sawyer (Ed.), The Cambridge Handbook of the Learning Sciences (2nd ed., pp. 275–297). Cambridge University Press. https://doi.org/10.1017/CBO9781139519526.018

Leavy, P. (2017). Research design: Quantitative, qualitative, mixed methods, arts-based, and community-based participatory research approaches. The Guilford Press.

Lee, S. J., Ngampornchai, A., Trail-Constant, T., Abril, A., & Srinivasan, S. (2016). Does a case-based online group project increase students’ satisfaction with interaction in online courses? Active Learning in Higher Education, 17(3), 249–260. https://doi.org/10.1177/1469787416654800

Lou, Y., & Kim MacGregor, S. (2004). Enhancing project-based learning through online between-group collaboration. Educational Research and Evaluation, 10(4–6), 419–440. https://doi.org/10.1080/13803610512331383509

Maor, D. (2003). The teacher’s role in developing interaction and reflection in an online learning community. Educational Media International, 40(1–2), 127–138. https://doi.org/10.1080/0952398032000092170

Meisani, D. R., & Rambet, R. D. B. (2017). Teachers’ beliefs regarding language learner autonomy and practices of project-based education: A case study of an indonesian efl teacher. NOBEL: Journal of Literature and Language Teaching, 8(2), 141–149. https://doi.org/10.15642/NOBEL.2017.8.2.141-149

Morales, T. M., Bang, E., & Andre, T. (2013). A one-year case study: Understanding the rich potential of project-based learning in a virtual reality class for high school students. Journal of Science Education and Technology, 22(5), 791–806. https://doi.org/10.1007/s10956-012-9431-7

Papastergiou, M. (2005). Learning to design and implement educational web sites within pre-service training: A project-based learning environment and its impact on student teachers. Learning, Media and Technology, 30(3), 263–279. https://doi.org/10.1080/17439880500250451

Parmelee, D. X., DeStephen, D., & Borges, N. J. (2009). Medical students’ attitudes about team-based learning in a pre-clinical curriculum. Medical Education Online, 14(1). https://doi.org/10.3885/meo.2009.Res00280

Picciano, A. G. (2002). Beyond Student Perceptions: Issues of Interaction, Presence, and Performance in an Online Course. Journal of Asynchronous Learning Networks, 6(1), 24. https://doi.org/10.24059/olj.v6i1.1870

Quintana, R., & Quintana, C. (2020). When classroom interactions have to go online: The move to specifications grading in a project-based design course. Information and Learning Sciences, 121(7/8), 525–532. https://doi.org/10.1108/ILS-04-2020-0119

Reis, A. C. B., Zanette, A. C. D., & Barbalho, S. C. M. (2018). A review of Problem/Project-based learning approach in engineering education: Motivations, results and gaps to overcome. 302–308. https://www.researchgate.net/publication/318715699_A_bibliometric_and_classification_study_of_Project-based_Learning_in_Engineering_Education

Richardson, J. C., & Swan, K. (2003). Examining social presence in online courses in relation to students’ perceived learning and satisfaction. Online Learning, 7(1), 68–88. https://doi.org/10.24059/olj.v7i1.1864

Shadiev, R., Hwang, W.-Y., & Huang, Y.-M. (2015). A pilot study: Facilitating cross-cultural understanding with project-based collaborative learning in an online environment. Australasian Journal of Educational Technology, 31(2), 123–139. https://doi.org/10.14742/ajet.1607

Shea, P., & Bidjerano, T. (2009). Community of inquiry as a theoretical framework to foster “epistemic engagement” and “cognitive presence” in online education. Computers & Education, 52(3), 543–553. https://doi.org/10.1016/j.compedu.2008.10.007

Shea, P., Hayes, S., Vickers, J., Gozza-Cohen, M., Uzuner, S., Mehta, R., Valchova, A., & Rangan, P. (2010). A re-examination of the community of inquiry framework: Social network and content analysis. The Internet and Higher Education, 13, 10–21. https://doi.org/10.1016/j.iheduc.2009.11.002

Shea, P., Li, C. S., Swan, K., & Pickett, A. (2005). Developing learning community in online asynchronous college courses: The role of teaching presence. Online Learning, 9(4), 59–82. https://doi.org/10.24059/olj.v9i4.1779

Shih, W.-L., & Tsai, C.-Y. (2017). Students’ perception of a flipped classroom approach to facilitating online project-based learning in marketing research courses. Australasian Journal of Educational Technology, 33(5), 32–49. https://doi.org/10.14742/ajet.2884

Sidiropoulou, Z., & Mavroidis, I. (2019). The relation between the three dimensions of the Community of Inquiry and the learning styles of students in a distance education programme. International Journal of Emerging Technologies in Learning, 14(23), 180–192. https://doi.org/10.3991/ijet.v14i23.11564

So, H.-J., & Brush, T. A. (2008). Student perceptions of collaborative learning, social presence and satisfaction in a blended learning environment: Relationships and critical factors. Computers & Education, 51(1), 318–336. https://doi.org/10.1016/j.compedu.2007.05.009

Stefanou, C., Stolk, J. D., Prince, M., Chen, J. C., & Lord, S. M. (2013). Self-regulation and autonomy in problem- and project-based learning environments. Active Learning in Higher Education, 14(2), 109–122. https://doi.org/10.1177/1469787413481132

Stozhko, N., Bortnik, B., Mironova, L., Tchernysheva, A., & Podshivalova, E. (2015). Interdisciplinary project-based learning: Technology for improving student cognition. Research in Learning Technology, 23(1), 27577. https://doi.org/10.3402/rlt.v23.27577

Torres, A. S., Sriraman, V., & Ortiz, A. M. (2019). Implementing project based learning pedagogy in concrete industry project management. International Journal of Construction Education and Research, 15(1), 62–79. https://doi.org/10.1080/15578771.2017.1393475

Tsai, M.-H., Chen, K.-L., & Chang, Y.-L. (2019). Development of a project-based online course for BIM learning. Sustainability, 11, 5772. https://doi.org/10.3390/su11205772

Tseng, K.-H., Chang, C.-C., Lou, S.-J., & Chen, W.-P. (2013). Attitudes towards science, technology, engineering and mathematics (STEM) in a project-based learning (PjBL) environment. International Journal of Technology and Design Education, 23(1), 87–102. https://doi.org/10.1007/s10798-011-9160-x

Tu, C.-H. (2001). How Chinese perceive social presence: An examination of interaction in online learning environment. Educational Media International, 38(1), 45–60. https://doi.org/10.1080/09523980010021235

Urbach, N., & Ahlemann, F. (2010). Structural equation modeling in information systems research using partial least squares. Journal of Information Technology Theory and Application, 11(2), 5–40.

Usher, M., & Barak, M. (2018). Peer assessment in a project-based engineering course: Comparing between on-campus and online learning environments. Assessment & Evaluation in Higher Education, 43(5), 745–759. https://doi.org/10.1080/02602938.2017.1405238

van Rooij, S. W. (2009). Scaffolding project-based learning with the project management body of knowledge (PMBOK). Computers & Education, 52(1), 210–219. https://doi.org/10.1016/j.compedu.2008.07.012

Williams, E. A., Duray, R., & Reddy, V. (2006). Teamwork orientation, group cohesiveness, and student learning: A study of the use of teams in online distance education. Journal of Management Education, 30(4), 592–616. https://doi.org/10.1177/1052562905276740

Wu, S.-Y., Hou, H.-T., Hwang, W.-Y., & Liu, E. Z.-F. (2013). Analysis of learning behavior in problem-solving-based and project-based discussion activities within the seamless online learning integrated discussion (SOLID) system. Journal of Educational Computing Research, 49(1), 61–82. https://doi.org/10.2190/EC.49.1.c

Xu, Y., & Liu, W. (2010). A project-based learning approach: A case study in China. Asia Pacific Education Review, 11(3), 363–370. https://doi.org/10.1007/s12564-010-9093-1

Yilmaz, R., Yilmaz, F. G. K., & Keser, H. (2020). Vertical versus shared e‑leadership approach in online project‑based learning: A comparison of self‑regulated learning skills, motivation and group collaboration processes. Journal of Computing in Higher Education. https://doi.org/10.1007/s12528-020-09250-2

Zhang, K., Peng, S. W., & Hung, J. (2009). Online collaborative learning in a project‐based learning environment in Taiwan: A case study on undergraduate students’ perspectives. Educational Media International, 46(2), 123–135. https://doi.org/10.1080/09523980902933425

Downloads

Published

2022-12-01

Issue

Section

Section II