Examining Students’ Online Course Perceptions and Comparing Student Performance Outcomes in Online and Face-to-Face Classrooms
DOI:
https://doi.org/10.24059/olj.v25i2.2227Keywords:
instructional format, student outcomes, student perceptionsAbstract
Through the use of existing grade and student survey data, this study investigated online courses offered at a public four-year university. Specifically, the study explored differences in student success rates between online and face-to-face courses for traditional undergraduate students as well as the climate of student perceptions towards online courses. Our general results suggest that students performed better in, and had higher levels of preference toward, traditional face-to-face formats. However, overall perceptions of online courses were positive, with students viewing instructional technologies as reliable and easy to use, as well as reporting that online technologies facilitated prompt feedback, enhanced their problem-solving skills, and met their learning needs. Alongside this, students exhibited positive views towards their instructors’ skill level and use of technology to support academic success. Logistic regression analyses of differences in student success across instructional formats revealed interaction effects with variables of age (nontraditional/traditional), aid status and whether or not courses were taken to fulfill general education or major requirements, suggesting a more complex effect of instructional format across student subpopulations. The variability in the results observed in the current study warrant further exploration before definitive conclusions on the impact of instructional format on student outcomes and perceptions can be made.
References
Alexander, B., Ashford-Rowe, K. Barajas-Murphy, N., Dobbin, G., Knott, J., McCormack, M., Pomerantz, J., Seilhamer, R., & Weber, N. (2019). EDUCAUSE Horizon Report: 2019 Higher Education Edition. EDUCAUSE. Retrieved from https://library.educause.edu/-/media/files/library/2019/4/2019horizonreport.pdf?la=en&hash=C8E8D444AF372E705FA1BF9D4FF0DD4CC6F0FDD1
Allen, I. E., & Seaman, J. (2013). Changing course: Ten years of tracking online education in the United States. Babson Survey Research Group and Quahog Research Group. Retrieved from: http://www.onlinelearningsurvey.com/reports/changingcourse.pdf
Allen, I. E., & Seaman, J. (2016). Online report card: Tracking online education in the United States. Babson Survey Research Group and Quahog Research Group. Retrieved from: https://onlinelearningsurvey.com/reports/onlinereportcard.pdf
Allen, I. E., & Seaman, J. (2017). Digital learning compass: Distance education enrollment report 2017. Retrieved from: http://onlinelearningsurvey.com/reports/digtiallearningcompassenrollment2017.pdf
Allen, I. E., Seaman, J., & Garrett, R. (2007). Blending in: The extent and promise of blended education in the United States. Needham, MA: The Sloan Consortium.
Amro, H. J., Mundy, M. A., & Kupczynski, L. (2015). The effects of age and gender on student achievement in face-to-face and online college algebra classes. Research in Higher Education Journal, 27, 1-22.
Alpert, W. T., Couch, K. A., & Harmon, O. R. (2016). A randomized assessment of online learning. The American Economic Review, 106(5), 378-382.
Ary, E. J., & Brune, C. W. (2011). A comparison of student learning outcomes in traditional and online personal finance courses. MERLOT Journal of Online Learning and Teaching, 7(4), 465-474.
Atchley, T. W., Wingenbach, G., & Akers, C. (2013). Comparison of course completion and student performance through online and traditional courses. The International Review of Research in Open and Distributed Learning, 14(4), 105-116.
Bacolod, M., Mehay, S., & Pema, E. (2018). Who succeeds in distance learning? Evidence from quantile panel data estimation. Southern Economic Journal, 84(4), 1129-1145.
Banoor, R. Y., Rennie, F., & Santally, M. I. (2018). The relationship between quality of student contribution in learning activities and their overall performances in an online course. European Journal of Open, Distance and E-learning, 21(1), 16-31.
Barak, M., Hussein-Farraj, R., & Dori, Y. J. (2016). On-campus or online: Examining self-regulation and cognitive transfer skills in different learning settings. International Journal of Educational Technology in Higher Education, 13(1), 35.
Bates, A. T. (2005). Technology, e-learning and distance education. New York: Routledge.
Bayrak, T., & Gulati, A. (2015). The role of gender on student success. International Journal of Information and Communication Technology Education (IJICTE), 11(4), 1-17.
Beach, M. (2018). When great teaching is not enough: Utilizing student perception to increase retention in online learning. In T. Bastiaens, J. Van Braak, M. Brown, L. Cantoni, M. Castro, R. Christensen, G. Davidson-Shivers, K. DePryck, M. Ebner, M. Fominykh, C. Fulford, S. Hatzipanagos, G. Knezek, K. Kreijns, G. Marks, E. Sointu, E. Korsgaard Sorensen, J. Viteli, J. Voogt, P. Weber, E. Weippl & O. Zawacki-Richter (Eds.), Proceedings of EdMedia: World Conference on Educational Media and Technology (pp. 1940-1944). Amsterdam, Netherlands: Association for the Advancement of Computing in Education (AACE). Retrieved from https://www.learntechlib.org/primary/p/184431/.
Beldarrain, Y. (2006). Distance education trends: Integrating new technologies to foster student interaction and collaboration. Distance Education, 27(2), 139-153.
Bernard, R. M., Abrami, P. C., Lou, Y., Borokhovski, E., Wade, A., Wozney, L., … Huang, B. (2004). How does distance education compare with classroom instruction? A meta-analysis of the empirical literature. Review of Educational Research, 74(3), 379-439.
Bernard, R. M., Borokhovski, E., Schmid, R. F., Tamim, R. M., & Abrami, P. C. (2014). A meta-analysis of blended learning and technology use in higher education: From the general to the applied. Journal of Computing in Higher Education, 26(1), 87-122.
Bettinger, E. P., Fox, L., Loeb, S., & Taylor, E. S. (2017). Virtual classrooms: How online college courses affect student success. American Economic Review, 107(9), 2855-75.
Blau, G., Drennan Jr, R. B., Karnik, S., & Kapanjie, D. (2017). Do technological and course‐related variables impact undergraduates’ perceived favorability and willingness to recommend online/hybrid business courses?. Decision Sciences Journal of Innovative Education, 15(4), 349-369.
Brocato, B. R., Bonanno, A., & Ulbig, S. (2015). Student perceptions and instructional evaluations: A multivariate analysis of online and face-to-face classroom settings. Education and Information Technologies, 20(1), 37-55.
Brown, J. L. (2012). Online learning: A comparison of web-based and land-based courses. Quarterly Review of Distance Education, 13(1), 39-42.
Brown, M. G. (2016). Blended instructional practice: A review of the empirical literature on instructors' adoption and use of online tools in face-to-face teaching. The Internet and Higher Education, 31, 1-10.
Brown, B. W., & Liedholm, C. E. (2002). Can web courses replace the classroom in principles of microeconomics?. American Economic Review, 92(2), 444-448.
Buchanan, T. C., & Palmer, E. (2017). Role immersion in a history course: Online versus face-to-face in Reacting to the Past. Computers & Education, 108, 85-95.
Callister, R. R., & Love, M. S. (2016). A comparison of learning outcomes in skills‐based courses: Online versus face‐to‐face formats. Decision Sciences Journal of Innovative Education, 14(2), 243-256.
Cavanaugh, J. K., & Jacquemin, S. J. (2015). A large sample comparison of grade based student learning outcomes in online vs. face-to-face courses. Online Learning, 19(2), 25-32.
Chan, A. W. K., Sit, J. W. H., Wong, E. M. L., Lee, D. T. F., & Fung, O. W. M. (2016). Case-based web learning versus face-to-face learning: a mixed-method study on University nursing students. Journal of Nursing Research, 24(1), 31-40.
Chen, P., Xiang, J., Sun, Y., Ban, Y., Chen, G., & Huang, R. (2015). Exploring students’ discussion in face to face and online synchronous learning. In G. Chen (Ed.), Emerging issues in smart learning (pp. 183-191). Berlin, Germany: Springer.
Cochran, J. D., Campbell, S. M., Baker, H. M., & Leeds, E. M. (2014). The role of student characteristics in predicting retention in online courses. Research in Higher Education, 55(1), 27-48.
Crews, T. B., Bordonada, T. M., & Wilkinson, K. (2017). Student feedback on Quality Matters standards for online course design. Educause Review. Retrieved from https://er.educause.edu/articles/2017/6/student-feedback-on-quality-matters-standards-for-online-course-design
Cummings, S. M., Chaffin, K. M., & Cockerham, C. (2015). Comparative analysis of an online and a traditional MSW program: Educational outcomes. Journal of Social Work Education, 51(1), 109-120.
Daymont, T., & Blau, G. (2008). Student performance in online and traditional sections of an undergraduate management course. Journal of Behavioral and Applied Management, 9(3), 275-294.
Diebel, P. L., & Gow, L. R. (2009). A comparative study of traditional instruction and distance education formats: student characteristics and preferences. NACTA Journal, 53(2), 8-14.
DiRienzo, C., & Lilly, G. (2014). Online versus face-to-face: Does delivery method matter for undergraduate business school learning?. Business Education & Accreditation, 6(1), 1-11.
Driscoll, A., Jicha, K., Hunt, A. N., Tichavsky, L., & Thompson, G. (2012). Can online courses deliver in-class results? A comparison of student performance and satisfaction in an online versus a face-to-face introductory sociology course. Teaching Sociology, 40(4), 312-331.
Duff, A. (2004). Understanding academic performance and progression of first-year accounting and business economics undergraduates: the role of approaches to learning and prior academic achievement. Accounting Education, 13(4), 409-430.
Dupin-Bryant, P. A. (2004). Pre-entry variables related to retention in online distance education. The American Journal of Distance Education, 18(4), 199-206.
Dutton, J., Dutton, M., & Perry, J. (2002). How do online students differ from lecture students?. Journal of asynchronous learning networks, 6(1), 1-20.
Dziuban, C., Graham, C. R., Moskal, P. D., Norberg, A., & Sicilia, N. (2018). Blended learning: the new normal and emerging technologies. International Journal of Educational Technology in Higher Education, 15(3), 1-16.
Emerson, L., & MacKay, B. (2011). A comparison between paper‐based and online learning in higher education. British Journal of Educational Technology, 42(5), 727-735.
Eom, S. B., & Ashill, N. (2016). The determinants of students’ perceived learning outcomes and satisfaction in university online education: An update. Decision Sciences Journal of Innovative Education, 14(2), 185-215.
Estelami, H. (2014). Determining the drivers of student performance in online business courses. American Journal of Business Education, 7(1), 79-92.
Farruggia, S. P., Han, C. W., Watson, L., Moss, T. P., & Bottoms, B. L. (2018). Noncognitive factors and college student success. Journal of College Student Retention: Research, Theory & Practice, 20(3), 308-327.
Faulconer, E. K., Griffith, J., Wood, B., Acharyya, S., & Roberts, D. (2018). A comparison of online, video synchronous, and traditional learning modes for an introductory undergraduate physics course. Journal of Science Education and Technology, 27(5), 404-411.
Fendler, R. J., Ruff, C., & Shrikhande, M. (2016). Evaluating characteristics of top and bottom performance: Online versus in-class. American Journal of Distance Education, 30(2), 109-120.
Field, A. (2009). Discovering statistics using SPSS. London: Sage.
Flanagan, J. (2012). Online versus face-to-face instruction: Analysis of gender and course format in undergraduate business statistics courses. Academy of Business Research, 2, 93-101.
Galy, E., Downey, C., & Johnson, J. (2011). The effect of using e-learning tools in online and campus-based classrooms on student performance. Journal of Information Technology Education: Research, 10, 209-230.
Ganesh, G., Paswan, A., & Sun, Q. (2015). Are face-to-face classes more effective than online classes? An empirical examination. Marketing Education Review, 25(2), 67-81.
Gering, C. S., Sheppard, D. K., Adams, B. L., Renes, S. L., & Morotti, A. A. (2018). Strengths-based analysis of student success in online courses. Online Learning, 22(3), 55-85.
Greenway, G. A., & Makus, L. D. (2014). Grade performance of face-to-face versus online agricultural economics students. Natural Sciences Education, 43(1), 57-63.
Gundlach, E., Richards, K. A. R., Nelson, D., & Levesque-Bristol, C. (2015). A comparison of student attitudes, statistical reasoning, performance, and perceptions for web-augmented traditional, fully online, and flipped sections of a statistical literacy class. Journal of Statistics Education, 23(1), 1-33.
Hachey, A. C., Wladis, C., & Conway, K. (2015). Prior online course experience and GPA as predictors of subsequent online STEM course outcomes. The Internet and Higher Education, 25, 11-17.
Hailikari, T., Nevgi, A., & Komulainen, E. (2008). Academic self‐beliefs and prior knowledge as predictors of student achievement in Mathematics: A structural model. Educational Psychology, 28(1), 59-71.
Helms, J. L. (2014). Comparing student performance in online and face-to-face delivery modalities. Journal of Asynchronous Learning Networks, 18(1), 147-160.
Howell, S. L., Laws, R. D., & Lindsay, N. K. (2004). Reevaluating course completion in distance education: Avoiding the comparison between apples and oranges. Quarterly Review of Distance Education, 5(4), 243-252.
Howell, S., Williams, P., & Lindsay, N. (2003). Thirty-two trends affecting distance education: An informed foundation for strategic planning. Online Journal of Distance Learning Administration, 6(3). Retrieved from http://www.westga.edu/~distance/ojdla/fall63/howell63.html
Jaggars, S. S., & Xu, D. (2016). How do online course design features influence student performance?. Computers & Education, 95, 270-284.
Johnson, D. M., & Palmer, C. C. (2015). Comparing student assessments and perceptions of online and face-to-face versions of an introductory linguistics course. Online Learning Journal, 19(2).
Kentnor, H. E. (2015). Distance education and the evolution of online learning in the United States. Curriculum and Teaching Dialogue, 17(1), 21-34.
Keramidas, C. G. (2012). Are undergraduate students ready for online learning? A comparison of online and face-to-face sections of a course. Rural Special Education Quarterly, 31(4), 25-32.
Kuo, Y. C., & Belland, B. R. (2016). An exploratory study of adult learners’ perceptions of online learning: Minority students in continuing education. Educational Technology Research and Development, 64(4), 661-680.
Kuo, Y. C., Walker, A. E., Belland, B. R., & Schroder, K. E. (2013). A predictive study of student satisfaction in online education programs. The International Review of Research in Open and Distributed Learning, 14(1), 16-39.
Kuo, Y. C., Walker, A. E., Schroder, K. E., & Belland, B. R. (2014). Interaction, internet self-efficacy, and self-regulated learning as predictors of student satisfaction in online education courses. The Internet and Higher Education, 20, 35-50.
Laerd Statistics (2018). Wilcoxon signed-rank test using Minitab. Retrieved from https://statistics.laerd.com/minitab-tutorials/wilcoxon-signed-rank-test-using-minitab.php
Levy, Y. (2007). Comparing dropouts and persistence in e-learning courses. Computers & education, 48(2), 185-204.
Lu, F., & Lemonde, M. (2013). A comparison of online versus face-to-face teaching delivery in statistics instruction for undergraduate health science students. Advances in Health Sciences Education, 18(5), 963-973.
Maceli, K. M., Fogliasso, C. E., & Baack, D. (2011). Difference of student satisfaction with college professors: The impact of student gender on satisfaction. Academy of Educational Leadership Journal, 15(4).
Manning-Ouellette, A., & Black, K. M. (2017). Learning leadership: A qualitative study on the differences of student learning in online versus traditional courses in a leadership studies program. Journal of Leadership Education, 16(2), 59.
Martin, A. J., Wilson, R., Liem, G. A. D., & Ginns, P. (2013). Academic momentum at university/college: Exploring the roles of prior learning, life experience, and ongoing performance in academic achievement across time. The Journal of Higher Education, 84(5), 640-674.
McCutcheon, K., Lohan, M., Traynor, M., & Martin, D. (2015). A systematic review evaluating the impact of online or blended learning vs. face‐to‐face learning of clinical skills in undergraduate nurse education. Journal of advanced nursing, 71(2), 255-270.
McDonough, C., Roberts, R. P., & Hummel, J. (2014). Online learning: Outcomes and satisfaction among underprepared students in an upper-level psychology course. Online Journal of Distance Learning Administration, 17(3) Retrieved from https://www.westga.edu/~distance/ojdla/fall173/mcdonough_roberts_hummel173.html
McLaren, C. H. (2004). A comparison of student persistence and performance in online and classroom business statistics experiences. Decision Sciences Journal of Innovative Education, 2(1), 1-10.
Means, B., Toyama, Y., Murphy, R., Bakia, M., & Jones, K. (2009). Evaluation of evidence-based practices in online learning: A meta-analysis and review of online learning studies. Washington, DC: US Department of Education.
Morris, L. V., Finnegan, C., & Wu, S. S. (2005). Tracking student behavior, persistence, and achievement in online courses. The Internet and Higher Education, 8(3), 221-231.
Murphy, C. A., & Stewart, J. C. (2017). On-campus students taking online courses: Factors associated with unsuccessful course completion. The Internet and Higher Education, 34, 1-9.
National Center for Education Statistics (n.d.). Nontraditional Undergraduates: Definitions and Data. Retrieved from https://nces.ed.gov/pubs/web/97578e.asp
Neuhauser, C. (2002). Learning style and effectiveness of online and face-to-face instruction. The American Journal of Distance Education, 16(2), 99-113.
O'Connell, K. A., Wostl, E., Crosslin, M., Berry, T. L., & Grover, J. P. (2018). Student ability best predicts final grade in a college algebra course. Journal of Learning Analytics, 5(3), 167-181.
Park, J. H., & Choi, H. J. (2009). Factors influencing adult learners' decision to drop out or persist in online learning. Journal of Educational Technology & Society, 12(4), 207-217.
Platt, C. A., Amber, N. W., & Yu, N. (2014). Virtually the same?: Student perceptions of the equivalence of online classes to face-to-face classes. Journal of Online Learning and Teaching, 10(3), 489-503.
Rabourn, K. E., BrckaLorenz, A., & Shoup, R. (2018). Reimagining student engagement: How nontraditional adult learners engage in traditional postsecondary environments. The Journal of Continuing Higher Education, 66(1), 22-33.
Richardson, J. T. (2012). Face‐to‐face versus online tuition: Preference, performance and pass rates in white and ethnic minority students. British Journal of Educational Technology, 43(1), 17-27.
Ruffalo Noel Levitz (2018). 2018 national student satisfaction and priorities report. Cedar Rapids, Iowa: Ruffalo Noel Levitz. Retrieved from RuffaloNL.com/benchmark.
Sanford, D. (2017). Course format and learning: The moderating role of overall academic performance. The International Journal of Management Education, 15(3), 490-500.
Seaman, J. E., Allen, E. I., & Seaman, J. (2018). Grade increase: Tracking distance education in the United States. Babson Survey Research Group.
Simpson, J. M., & Benson, A. D. (2013). Student perceptions of quality and satisfaction in online education. The Quarterly Review of Distance Education, 14(4), 221–231.
Slover, E., & Mandernach, J. (2018). Beyond online versus face-to-face comparisons: The interaction of student age and mode of instruction on academic achievement. Journal of Educators Online, 15(1), 1-8.
Smith, G. G., & Ferguson, D. (2005). Student attrition in mathematics e-learning. Australasian Journal of Educational Technology, 21(3) 323-334.
Soffer, T., & Nachmias, R. (2018). Effectiveness of learning in online academic courses compared with face‐to‐face courses in higher education. Journal of Computer Assisted Learning, 34(5), 534-543.
Sohn, K., & Romal, J. B. (2015). Meta-analysis of student performance in micro and macro economics: Online vs. face-to-face instruction. Journal of Applied Business & Economics, 17(2), 42-51.
Stater, M. (2009). The impact of financial aid on college GPA at three flagship public institutions. American Educational Research Journal, 46(3), 782–815.
Stoessel, K., Ihme, T. A., Barbarino, M. L., Fisseler, B., & Stürmer, S. (2015). Sociodemographic diversity and distance education: Who drops out from academic programs and why?. Research in Higher Education, 56(3), 228-246.
Tanyel, F., & Griffin, J. (2014). A ten-year comparison of outcomes and persistence rates in online versus face-to-face courses. B> Quest, 1-22.
Urtel, M. G. (2008). Assessing academic performance between traditional and distance education course formats. Educational Technology & Society, 11(1), 322-330.
Vella, E. J., Turesky, E. F., & Hebert, J. (2016). Predictors of academic success in web-based courses: age, GPA, and instruction mode. Quality Assurance in Education, 24(4), 586-600.
Wladis, C., Hachey, A. C., & Conway, K. (2015). Which STEM majors enroll in online courses, and why should we care? The impact of ethnicity, gender, and nontraditional student characteristics. Computers & Education, 87, 285-308.
Woods, K., & Frogge, G. (2017). Preferences and experiences of traditional and nontraditional university students. The Journal of Continuing Higher Education, 65(2), 94-105.
Yang, Y., Cho, Y., Mathew, S., & Worth, S. (2011). College student effort expenditure in online versus face-to-face courses: The role of gender, team learning orientation, and sense of classroom community. Journal of Advanced Academics, 22(4), 619-638.
Yang, Y., Cho, Y. J., & Watson, A. (2015). Classroom motivational climate in online and face-to-face undergraduate courses: The interplay of gender and course format. Journal of Distance Education (Online), 30(1), 1-15
Yen, S. C., Lo, Y., Lee, A., & Enriquez, J. (2018). Learning online, offline, and in-between: comparing student academic outcomes and course satisfaction in face-to-face, online, and blended teaching modalities. Education and Information Technologies, 1-13.
Downloads
Published
Issue
Section
License
As a condition of publication, the author agrees to apply the Creative Commons – Attribution International 4.0 (CC-BY) License to OLJ articles. See: https://creativecommons.org/licenses/by/4.0/.
This licence allows anyone to reproduce OLJ articles at no cost and without further permission as long as they attribute the author and the journal. This permission includes printing, sharing and other forms of distribution.
Author(s) hold copyright in their work, and retain publishing rights without restrictions
