A Cross-institutional Study of Instructional Characteristics and Student Outcomes: Are Quality Indicators of Online Courses Able to Predict Student Success?

Authors

  • Tanya Joosten University of Wisconsin - Milwaukee
  • Rachel Cusatis University of Wisconsin - Milwaukee
  • Lindsey Harness University of Wisconsin - Milwaukee

DOI:

https://doi.org/10.24059/olj.v23i4.1432

Keywords:

course quality, quality, interactivity, learner support, course design, content, organization, assessment, evaluation, learning community, student success, learning, performance, satisfaction

Abstract

A study was conducted to examine instructional characteristics and their relationship to student outcomes in online courses at a 2-year and 4-year higher educational institution.  Instructional characteristics included learner support, course design and organization, content design and delivery, interactivity (student-instructor and student-student), and assessment and evaluation.  A student survey instrument was created that captures student perceptions of the instructional characteristics of their course, their learning, and their satisfaction with the course.  The data collected from the student survey was merged with data from institutional student information systems (e.g., demographics and course grade).

This article examines the relationship between these instructional characteristics, sometimes referred to as indicators of online course quality, and their relationship to student outcomes for all students and for underrepresented students.  Significant findings from multiple regression analyses are reported.  Additional analyses were conducted to examine differences among underrepresented students (minorities, first-generation, low-income, students with impairments/disabilities) using MANOVA.  No significant differences are reported.  

Author Biographies

Tanya Joosten, University of Wisconsin - Milwaukee

Senior Scientist, Director of Digital Learning Research and Development, Co-Director of the National Research Center for Distance Education and Technological Advancements, Academic Affairs

Rachel Cusatis, University of Wisconsin - Milwaukee

Research Instrumentation Innovator at the National Research Center for Distance Education and Technological Advancements at the University of Wisconsin - Milwaukee and Postdoctoral Research Fellow at the Medical College of Wisconsin.

Lindsey Harness, University of Wisconsin - Milwaukee

Research Instrumentation Innovator at the National Research Center for Distance Education and Technological Advancements at the University of Wisconsin - Milwaukee and Assistant Professor at Alverno College.

References

Allen, M., Bourhis, J., Burrell, N., & Mabry, E. (2002). Comparing student satisfaction with distance education to traditional classrooms in higher education: A meta-analysis. The American Journal of Distance Education, 16(2), 83-97.

Allen, M., Mabry, E., Mattrey, M., Bourhis, J., Titsworth, S., & Burrell, N. (2004). Evaluating the effectiveness of distance learning: A comparison using meta-analysis. Journal of Communication, 54(3), 402-420.

Allen, I. E., & Seaman, J. (2016). Online report card: Tracking online education in the United States. Babson Survey Research Group.

Barkley, E. F., & Major, C. H. (2015). Learning assessment Techniques: A handbook for college faculty. John Wiley & Sons.

Chickering, A. W. and Gamson, Z. F. (1987). Seven principles for good practice in undergraduate education. American Association of Higher Education Bulletin, 37.

Crawley, A. (2012). Supporting online students: A practical guide to planning, implementing, and evaluating services. John Wiley & Sons.

Dziuban, C. D., Picciano, A. G., Graham, C. R., & Moskal, P. D. (2015). Conducting research in online and blended learning environments: New pedagogical frontiers. Routledge.

Hiltz, S. R. (1988, January). Collaborative learning in a virtual classroom: Highlights of findings. In Proceedings of the 1988 ACM conference on Computer-supported cooperative work (pp. 282-290). ACM.

Hiltz, S. R. (1994). The virtual classroom: Learning without limits via computer networks. Intellect Books.

Hiltz, S. R., & Goldman, R. (Eds.). (2004). Learning together online: Research on asynchronous learning networks. Routledge.

Hiltz, S. R., & Meinke, R. (1989). Teaching sociology in a virtual classroom. Teaching Sociology, 431-446.

Huba, M. & Freed, J (2000). Learner-centered assessment on college campuses: Shifting the focus from teaching to learning. Allyn and Bacon: Needham Heights.

Hung, D., Tan, S. C., & Koh, T. S. (2006). From traditional to constructivist epistemologies: A proposed theoretical framework based on activity theory for learning communities. Journal of Interactive Learning Research, 17(1), 37.

Jaggars, S. S., & Bailey, T. (2010). Effectiveness of fully online courses for college students: Response to a Department of Education meta-analysis. Community College Research Center, Columbia University.

Joosten, T., (2012). Social media for educators. San Francisco: Wiley.

Joosten, T. (2015). Thinking systemically: A study of course communication and social processes in face-to-face and online courses (Doctoral dissertation, The University of Wisconsin-Milwaukee).

Joosten, T., & Reddy, D. (2015, October 1st). Distance education and technological advancements research toolkit. National Research Center for Distance Education and Technological Advancements (DETA). Retrieved from: http://uwm.edu/deta/toolkits/.

Ko, S., & Rossen, S. (2010). Teaching online: A practical guide. Routledge.

Lehman, R. M., & Conceição, S. C. O. (2010). Creating a sense of presence in online teaching: How to ‘be there’ for distance learners. San Francisco: Jossey-Bass.

Lehman, R. M., & Conceição, S. C. O. (2014). Motivating and retaining online students: Research-based strategies that work. San Francisco: Jossey-Bass.

Moore, M. G. (1989). Editorial: Three types of interaction. American Journal of Distance Education. 3(2), 1-7.

Moore, J. C. (2009). A synthesis of Sloan-C effective practices. Journal of Asynchronous Learning Networks, 13(4), 73-82.

Moore, M. G., & Kearsley, G. (2011). Distance education: A systems view of online learning. Cengage Learning.

Palloff, R. M., & Pratt, K. (2003). The virtual student: A profile and guide to working with online learners. John Wiley & Sons.

Palloff, R. M., & Pratt, K. (2008). Assessing the online learner: Resources and strategies for faculty. John Wiley & Sons.

Picciano, A. G. (2002). Beyond student perceptions: Issues of interaction, presence, and performance in an online course. Journal of Asynchronous Learning Networks, 6(1), 21-40.

Ralston-Berg, P. (2014). Surveying student perspectives of quality: Value of QM rubric items. Internet Learning, 3(1), 11.

Sener, J. (2006). Quality Matters: Inter-institutional quality improvement for online courses. Journal of Asynchronous Learning Networks, 10(1), 69-80.

Shattuck, K. (2007). Quality Matters: Collaborative program planning at a state level. Online Journal of Distance Learning Administration, 10(3).

Vai, M., & Sosulski, K. (2015). Essentials of online course design: A standards-based guide. Routledge.

Downloads

Published

2019-12-01

Issue

Vol. 23 No. 4 (2019)

Section

Section II

License

As a condition of publication, the author agrees to apply the Creative Commons – Attribution International 4.0 (CC-BY) License to OLJ articles. See: https://creativecommons.org/licenses/by/4.0/.

This licence allows anyone to reproduce OLJ articles at no cost and without further permission as long as they attribute the author and the journal. This permission includes printing, sharing and other forms of distribution.

Author(s) hold copyright in their work, and retain publishing rights without restrictions