A Cross-institutional Study of Instructional Characteristics and Student Outcomes: Are Quality Indicators of Online Courses Able to Predict Student Success?

Tanya Joosten, Rachel Cusatis, Lindsey Harness


A study was conducted to examine instructional characteristics and their relationship to student outcomes in online courses at a 2-year and 4-year higher educational institution.  Instructional characteristics included learner support, course design and organization, content design and delivery, interactivity (student-instructor and student-student), and assessment and evaluation.  A student survey instrument was created that captures student perceptions of the instructional characteristics of their course, their learning, and their satisfaction with the course.  The data collected from the student survey was merged with data from institutional student information systems (e.g., demographics and course grade).

This article examines the relationship between these instructional characteristics, sometimes referred to as indicators of online course quality, and their relationship to student outcomes for all students and for underrepresented students.  Significant findings from multiple regression analyses are reported.  Additional analyses were conducted to examine differences among underrepresented students (minorities, first-generation, low-income, students with impairments/disabilities) using MANOVA.  No significant differences are reported.  


course quality, quality, interactivity, learner support, course design, content, organization, assessment, evaluation, learning community, student success, learning, performance, satisfaction

Full Text:



Allen, M., Bourhis, J., Burrell, N., & Mabry, E. (2002). Comparing student satisfaction with distance education to traditional classrooms in higher education: A meta-analysis. The American Journal of Distance Education, 16(2), 83-97.

Allen, M., Mabry, E., Mattrey, M., Bourhis, J., Titsworth, S., & Burrell, N. (2004). Evaluating the effectiveness of distance learning: A comparison using meta-analysis. Journal of Communication, 54(3), 402-420.

Allen, I. E., & Seaman, J. (2016). Online report card: Tracking online education in the United States. Babson Survey Research Group.

Barkley, E. F., & Major, C. H. (2015). Learning assessment Techniques: A handbook for college faculty. John Wiley & Sons.

Chickering, A. W. and Gamson, Z. F. (1987). Seven principles for good practice in undergraduate education. American Association of Higher Education Bulletin, 37.

Crawley, A. (2012). Supporting online students: A practical guide to planning, implementing, and evaluating services. John Wiley & Sons.

Dziuban, C. D., Picciano, A. G., Graham, C. R., & Moskal, P. D. (2015). Conducting research in online and blended learning environments: New pedagogical frontiers. Routledge.

Hiltz, S. R. (1988, January). Collaborative learning in a virtual classroom: Highlights of findings. In Proceedings of the 1988 ACM conference on Computer-supported cooperative work (pp. 282-290). ACM.

Hiltz, S. R. (1994). The virtual classroom: Learning without limits via computer networks. Intellect Books.

Hiltz, S. R., & Goldman, R. (Eds.). (2004). Learning together online: Research on asynchronous learning networks. Routledge.

Hiltz, S. R., & Meinke, R. (1989). Teaching sociology in a virtual classroom. Teaching Sociology, 431-446.

Huba, M. & Freed, J (2000). Learner-centered assessment on college campuses: Shifting the focus from teaching to learning. Allyn and Bacon: Needham Heights.

Hung, D., Tan, S. C., & Koh, T. S. (2006). From traditional to constructivist epistemologies: A proposed theoretical framework based on activity theory for learning communities. Journal of Interactive Learning Research, 17(1), 37.

Jaggars, S. S., & Bailey, T. (2010). Effectiveness of fully online courses for college students: Response to a Department of Education meta-analysis. Community College Research Center, Columbia University.

Joosten, T., (2012). Social media for educators. San Francisco: Wiley.

Joosten, T. (2015). Thinking systemically: A study of course communication and social processes in face-to-face and online courses (Doctoral dissertation, The University of Wisconsin-Milwaukee).

Joosten, T., & Reddy, D. (2015, October 1st). Distance education and technological advancements research toolkit. National Research Center for Distance Education and Technological Advancements (DETA). Retrieved from: http://uwm.edu/deta/toolkits/.

Ko, S., & Rossen, S. (2010). Teaching online: A practical guide. Routledge.

Lehman, R. M., & Conceição, S. C. O. (2010). Creating a sense of presence in online teaching: How to ‘be there’ for distance learners. San Francisco: Jossey-Bass.

Lehman, R. M., & Conceição, S. C. O. (2014). Motivating and retaining online students: Research-based strategies that work. San Francisco: Jossey-Bass.

Moore, M. G. (1989). Editorial: Three types of interaction. American Journal of Distance Education. 3(2), 1-7.

Moore, J. C. (2009). A synthesis of Sloan-C effective practices. Journal of Asynchronous Learning Networks, 13(4), 73-82.

Moore, M. G., & Kearsley, G. (2011). Distance education: A systems view of online learning. Cengage Learning.

Palloff, R. M., & Pratt, K. (2003). The virtual student: A profile and guide to working with online learners. John Wiley & Sons.

Palloff, R. M., & Pratt, K. (2008). Assessing the online learner: Resources and strategies for faculty. John Wiley & Sons.

Picciano, A. G. (2002). Beyond student perceptions: Issues of interaction, presence, and performance in an online course. Journal of Asynchronous Learning Networks, 6(1), 21-40.

Ralston-Berg, P. (2014). Surveying student perspectives of quality: Value of QM rubric items. Internet Learning, 3(1), 11.

Sener, J. (2006). Quality Matters: Inter-institutional quality improvement for online courses. Journal of Asynchronous Learning Networks, 10(1), 69-80.

Shattuck, K. (2007). Quality Matters: Collaborative program planning at a state level. Online Journal of Distance Learning Administration, 10(3).

Vai, M., & Sosulski, K. (2015). Essentials of online course design: A standards-based guide. Routledge.

DOI: http://dx.doi.org/10.24059/olj.v23i4.1432

Copyright (c) 2019 Tanya Joosten, Rachel Cusatis, Lindsey Harness

License URL: https://creativecommons.org/licenses/by/4.0/