ONLINE LEARNING AND TIME-ON-TASK: IMPACT OF PROCTORED VS. UN-PROCTORED TESTING

Gregory S. Wellman, Henryk Marcinkiewicz

Abstract


The purpose of this study was to evaluate the impact of proctored versus un-proctored testing on practice time and learning for a self-study, online course in medical terminology. Participants included 120 college students in a pharmacy curriculum. Subjects were randomized to one of three groups utilizing textbook with proctored assessment, online instruction with proctored assessment, or online instruction with un-proctored assessment. A pre-test and post-test was administered to all three groups to evaluate learning. Content page “hits” and practice quiz access was tracked for participants. Learning, as defined by pre/post-test change score, was greatest in the presence of proctored assessment (online and text) (p = 0.027). In addition, use of practice quizzes had a stronger relative correlation with learning (r = 0.401; p<0.001) when compared to content page “hits” (r = 0.257; p = 0.024). Online course content paired with meaningful time-on-task (e.g. practice quizzes) was most effective when paired with proctored assessment.


Keywords


Distance learning,Computer-mediated instruction,Proctored testing,Un-proctored testing

Full Text:

PDF

References


Gilbert, T. F. Human competence: Engineering Worthy Performance. New York: McGraw-Hill, 1978.

Chickering, A. W., Gamson, Z. F. “Seven Principles for Practice in Undergraduate Education.” AAHE Bulletin: 3–7, March, 1987.

Long, D. R. “Time-on-task in Beginning Students of Spanish at the University Level: A Case Study,” Paper presented at the Annual Meeting of the American Council on the Teaching of Foreign Languages. ERIC Document Reproduction Service No. ED 239 514. San Francisco, CA, November 1983.

US Department of Education, Office of Educational Research and Improvement. “A Preliminary Study of the Feasibility and Utility for National Policy of Instructional ‘Good Practice’ Indicators in Undergraduate Education.” ERIC Document Reproduction Service No. ED 372 718. Washington, DC: U.S. Government Printing Office, 1994.

Pintrich, P. R. “A Process-oriented View of Student Motivation and Cognition”. In: Stark, J, Mets, L. (Eds.), Improving Teaching and Learning Through Research, 65–79. San Francisco, CA: Jossey-Bass, 1988.

Black, S. “Engaging the Disengaged.” The American School Board Journal 190(12): 58–60, December 2003.

Reynold, A. J., and Walberg, H. J. “A Structural Model of Science Achievement.” Journal of Educational Psychology 83(1): 97–107, 1991.

Admiraal, W., Wubbels, T., and Pilot, A. “College Teaching in Leagal Eduation: Teaching Method, Students’ Time-on-Task, and Achievement.” Research in Higher Education 40(6): 687–704, 1998.

Hulstijn, J. H., and Laufer, B. “Some Empirical Evidence for the Involvement Load Hypothesis in Vocabulary Acquisition.” Language Learning 51(3): 539–558, September 2001.

Fyock, J. J. “Adult Supervision in the Distance Learning Classroom: Is It Necessary?” T.H.E. Journal 23(4): 89–91, November 1995.

Underwood, J., and Szabo, A. “Academic Offences and E-Learning: Individual Propensities In Cheating.” British Journal of Educational Technology 34(4): 467–77, 2003.

Gibbons, A., Mize, C. D., and Rogers, K. L. “That’s My Story and I’m Sticking To It: Promoting Academic Integrity in the Online Environment,” Association for the Advancement of Computing in Education. Presented at the 2002 World Conference on Educational Multimedia, Hypermedia & Telecommunications, Denver, Colorado, June 24–29, 2002.

Matthew D. “How is Assessment Being Done in Distance Learning.” Presented at the NAU/web.98 Conference, Flagstaff, Arizona, May 28–30, 1998.

Shyles, L. “Authenticating, Identifying, and Monitoring Learners in the Virtual Classroom: Academic Integrity in Distance Learning.” Presented at the 88th Annual Meeting of the National Communication Association, New Orleans, Louisiana, November 21–24, 2002.

McCabe, D. L., Trevino L. K., and Butterfield, K. D. “Cheating in Academic Institutions: A Decade of Research, Ethics & Behavior.” 11(3): 219–232, July 2001.

Diekhoff, G. M., LaBeff, E. E., and Clark, R. E., et. al. “College Cheating: Ten Years Later.” Research in Higher Education 37(4): 487–502, 1996.

Ferrell, C. M., and Ferguson, W. F. “Assessing Graduate Education Students’ Propensity Toward Academic Misconduct.” Paper presented at the Annual Meeting of the American Educational Research Association. ERIC Document Reproduction Service No. ED 360 370. Atlanta, GA: April, 1993.

Green, A. S. and Saxe, L. “Everybody (else) Does It: Academic Cheating.” Paper presented at the Annual Meeting of the Eastern Psychological Association, ERIC Document Reproduction Service No. ED 347 931. Boston, MA: April, 1992.

Genereux, R. L. and McLeod B. A. “Circumstances Surrounding Cheating: A Questionnaire Study of College Students.” Research in Higher Education 36(6): 1995.

Whitley, B. E. “Factors Associated with Cheating Among College Students.” Research in Higher Education 39(3): 1998.

McCabe D. L. and Trevino, L. K. “Individual and Contextual Influences on Academic Dishonesty: A Multicampus Investigation.” Research in Higher Education 38(3): 1997.




DOI: http://dx.doi.org/10.24059/olj.v8i4.1813