Student Satisfaction and the Future of Online Learning in Higher Education: Lessons from a Natural Experiment
DOI:
https://doi.org/10.24059/olj.v27i1.3224Keywords:
Online learning, Higher education, COVID-19, Selection bias, Virtual campus, Student satisfaction, Faculty engagementAbstract
Although there is substantial research on the effectiveness of online learning at the individual class level, there is little reliable data on how a shift to a mostly or fully virtual campus would impact undergraduates’ satisfaction, engagement, and academic achievement. Until the COVID-19 pandemic, the limited adoption of widespread online learning at selective schools and challenges of selection bias hindered a reliable assessment of such a shift in selective institutions. After the initial period of “emergency remote learning” in 2020, many selective institutions continued widespread online learning in the second year of the pandemic. Treating the expanded deployment of online learning as a natural experiment, the present study assesses the impact of frequent online learning during the spring semester of 2021 on representative samples of undergraduate students at three selective, four-year universities. The study finds that students who participated in classes that met in person at least once a week had higher evaluations of faculty engagement and higher overall levels of academic satisfaction, compared to those who never or rarely participated in an in-person class. This relationship appears less pronounced for Black and Asian students than for White students but does not vary significantly by gender. Although online learning has great potential, these results suggest a need to better understand the conditions that will support an expansion of online learning that can maintain student satisfaction.
References
Alqurashi, E. (2019). Predicting student satisfaction and perceived learning within online learning environments. Distance Education, 40(1), 133-148.
Anderson, N. (2021). The post-pandemic future of college? It’s on campus and online. Retrieved from https://www.washingtonpost.com/education/2021/09/28/post-pandemic-university-online-classes/
Anglin, G. J. (2012). Considering the Future of Brick and Mortar Universities. Journal of Computing in Higher Education, 24(1), 71-73.
Anstine, J., & Skidmore, M. (2005). A Small Sample Study of Traditional and Online Courses with Sample Selection Adjustment. The Journal of Economic Education, 36(2), 107-127.
Bernard, R. M., Abrami, P. C., Lou, Y., Borokhovski, E., Wozney, A. W. L., Wallet, P. A., & Fiset, M. (2004). How Does Distance Education Compare With Classroom Instruction? A Meta-Analysis of the Empirical Literature. Review of Educational Research, 74(3), 379-439.
Bettinger, E. P., Fox, L., Loeb, S., & Taylor, E. S. (2017). Virtual Classrooms: How Online College Courses Affect Student Success. American Economic Review, 107(9), 2855-2875.
Bowen, W. G., Chingos, M. M., Lack, K. A., & Nygren, T. I. (2013). Interactive Learning Online at Public Universities: Evidence from a Six-Campus Randomized Trial. Journal of Policy Analysis and Management, 33(1), 94-111.
Brown, B. W., & Liedholm, C. E. (2002). Can Web Courses Replace the Classroom in Principles of Microeconomics? The American Economic Review, 92(2), 444-448.
Chen, P.-S. D., Gonyea, R., & Kuh, G. (2008). Learning at a Distance: Engaged or Not? Innovate: Journal of Online Education, 4(3), 1552-3233.
Coates, D., Humphreys, B. R., Kane, J., & Vachris, M. A. (2004). ‘‘No significant distance’’ between face-to-face and online instruction: evidence from principles of economics. Economics of Education Review, 23(5), 533-546.
Dinh, L. P., & Nguyen, T. T. (2020). Pandemic, social distancing, and social work education: students’ satisfaction with online education in Vietnam. Social Work Education, 39(8), 1074-1083.
Dumford, A. D., & Miller, A. L. (2018). Online learning in higher education: exploring advantages and disadvantages for engagement. Journal of Computing in Higher Education, 30(3), 452-465.
Fan, X., & Nowell, D. L. (2011). Using Propensity Score Matching in Educational Research. Gifted Child Quarterly, 55(1), 74-79.
Felson, J., & Adamczyk, A. (2021). Online or in Person? Examining College Decisions to Reopen during the COVID-19 Pandemic in Fall 2020. Socius, 7(1), 1-16.
Figlio, D., Rush, M., & Yin, L. (2013). Is It Live or Is It Internet? Experimental Estimates of the Effects of Online Instruction on Student Learning. Journal of Labor Economics, 31(4), 763-784.
Higher Education Research Institute. (2021a). College Senior Survey. Retrieved from https://heri.ucla.edu/college-senior-survey/
Higher Education Research Institute. (2021b). Your First College Year Survey. Retrieved from https://heri.ucla.edu/your-first-college-year-survey/
Hodges, C., Moore, S., Lockee, B., Trust, T., & Bond, A. (2020). The difference between emergency remote teaching and online learning. Retrieved from https://vtechworks.lib.vt.edu/handle/10919/104648
Hurtado, S., Milem, J. F., Clayton-Pedersen, A. R., & Allen, W. R. (1998). Enchancing Campus Climates for Racial/Ethnic Diversity: Educational Policy and Practice. The Review of Higher Education, 21(3), 279-302.
Jaggars, S. S., & Xu, D. (2016). How do online course design features influence student performance? Computers & Education, 95(1), 270-284.
James, S., Swan, K., & Daston, C. (2016). Retention, Progression and the Taking of Online Courses. Online Learning, 20(2), 75-96.
Jung, I., & Rha, I. (2000). Effectiveness and Cost-Effectiveness of Online Education: A Review of the Literature. Educational Technology, 40(4), 57-60.
Kerr, K. G., Tweedy, J., Edwards, K. E., & Kimmel, D. (2017). Shifting to Curricular Approaches to Learning beyond the Classroom. About Campus: Enriching the Student Learning Experience, 22(1), 22-31.
Lack, K. A. (2013). Current Status of Research on Online Learning in Postsecondary Education. Retrieved from https://apo.org.au/node/33886
Madigan, D., & Henderson, K. (2020). Update on fall 2020 Reopening Plans. Retrieved from https://news.northeastern.edu/coronavirus/university-messages/update-on-fall-2020-reopening-plans/
Mazoué, J. G. (2012). The deconstructed campus. Journal of Computing in Higher Education, 24(1), 74-95.
Means, B., & Neisler, J. (2020). Suddenly Online: A National Survey of Undergraduates During the COVID-19 Pandemic. Retrieved from https://digitalpromise.dspacedirect.org/handle/20.500.12265/98
Means, B., Toyama, Y., Murphy, R., Bakia, M., & Jones, K. (2009). Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies Retrieved from Washington, D.C.: www.ed.gov/about/offices/list/opepd/ppss/reports.html
Moore, J. C. (2005). The Sloan consortium quality framework and the five pillars. Retrieved from Newburyport, MA: https://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.115.4238
Morgan, S. L., & Winship, C. (2007). Counterfactuals and Causal Inference: Methods and Principles for Social Research. Cambridge University Press.
Nguyen, T. (2015). The Effectiveness of Online Learning: Beyond No Significant Difference and Future Horizons. Journal of Online Learning and Teaching, 11(2), 309-319.
Office of the President. (2020). Brandeis’ plans for the fall semester. https://www.brandeis.edu/president/letters/2020-06-30-plans-for-the-fall-semester.html
Park, J. J. (2009). Are We Satisfied?: A Look at Student Satisfaction with Diversity at Traditionally White Institutions. The Review of Higher Education, 32(3), 291-320.
Paulsen, J., & McCormick, A. C. (2020). Reassessing Disparities in Online Learner Student Engagement in Higher Education. Educational Researcher, 49(1), 20-29.
Pei, L., & Wu, H. (2019). Does online learning work better than offline learning in undergraduate medical education? A systematic review and meta-analysis. Medical Education Online, 24(1), 1-13.
Rabe-Hemp, C., & Woollen, S. (2009). A comparative analysis of student engagement, learning, and satisfaction in lecture hall and online learning settings. The Quarterly Review of Distance Education, 10(2), 207-218.
Reiffel, J. A. (2020). Propensity Score Matching: The ‘Devil is in the Details’ Where More May Be Hidden than You Know. The American Journal of Medicine, 133(2), 178-181.
Russell, T. L. (Ed.) (1999). The No Significant Difference Phenomenon As Reported in 355 Research Reports, Summaries and Papers. Raleigh, NC: North Carolina State University.
Shrock, S. A. (2012). A reaction to Mazoue’s deconstructed campus. Journal of Computing in Higher Education, 24(1), 104-118.
Spencer, D., & Temple, T. (2021). Examining students’ online course perceptions and comparing student performance outcomes in online and face-to-face classrooms. Online Learning, 25(2), 233-261.
Tsang, J. T. Y., So, M. K. P., Chong, A. C. Y., Lam, B. S. Y., & Chu, A. M. Y. (2021). Higher education during the Pandemic: The predictive factors of learning effectiveness in COVID-19 Online Learning. Education Sciences, 11(446), 1-15.
University Communications. (2020). A new, and different, year begins. https://www.bc.edu/bc-web/bcnews/campus-community/around-campus/bc-reopens.html
Vigdor, N., & Zaveri, M. (2020). Several East Coast universities cancel classes in Coronavirus Response. https://www.nytimes.com/2020/03/08/nyregion/columbia-classes-canceled-coronavirus.html?action=click&module=RelatedLinks&pgtype=Article
Walford, G. (2005). Research ethical guidelines and anonymity. International Journal of Research and Method in Education, 28(1), 83-93.
Wolf, A. (2003). Invented names, hidden distortions in social science. The Chronicle of Higher Education.
Xu, D., & Jaggars, S. S. (2014). Performance Gaps between Online and Face-to-Face Courses: Differences across Types of Students and Academic Subject Areas. The Journal of Higher Education, 85(5), 633-659.
Yen, S.-C., Lo, Y., Lee, A., & Enriquez, J. (2018). Learning online, offline, and in-between: comparing student academic outcomes and course satisfaction in face-to-face, online, and blended teaching modalities. Education and Information Technologies, 23, 2141–2153.
Zhao, Y., Lei, J., & Yan, B. (2005). What makes the difference? A practical analysis of research on the effectiveness of distance education. The Teachers College Record, 107(8), 1836–1884.
Downloads
Published
Issue
Section
License
As a condition of publication, the author agrees to apply the Creative Commons – Attribution International 4.0 (CC-BY) License to OLJ articles. See: https://creativecommons.org/licenses/by/4.0/.
This licence allows anyone to reproduce OLJ articles at no cost and without further permission as long as they attribute the author and the journal. This permission includes printing, sharing and other forms of distribution.
Author(s) hold copyright in their work, and retain publishing rights without restrictions
