Jia Shen, Michael Bieber


This paper presents longitudinal evaluation results for an online participatory examination process in an information systems course over three semesters. The exam process includes students making up questions, answering other students’ questions, grading answers to questions they author, and appealing the grades. The surveys following each exam elicited students’ feedback, and an experiment compared the participatory exam with the traditional exam in the third semester. Survey results reveal that the majority of students have favorable attitudes towards the participatory exam, and would recommend the participatory examination for future courses. Students in the participatory exam enjoyed the process significantly more than students in the traditional exam, and have higher overall preference for the exam mode, although their perceived learning and perceived fairness in grading are lower than with the
traditional exam. Discussion and future research on this topic are also presented.


Examination,Participatory Examination,Peer Assessment,ALN,Asynchronous Learning Networks,Collaborative Learning,Constructivism

Full Text:



Hiltz, S. R. The Virtual Classroom: Learning without Limits Via Computer Networks. Norwood, NJ: Ablex, 1994.

Allen, I. E. and J. Seaman. Sizing the Opportunity: The Quality and Extent of Online Education in the United States 2002 and 2003. Needham, MA: Sloan-C, 2003. Online:

Castro, M., A. Lopez-Rey, C. M. Perez-Molina, et al. Examples of Distance Learning Projects in the European Communi-ty. IEEE Transactions on Education 44(4): 406–411, 2001.

Hiltz, S. R. and R. Goldman, eds. Learning Together Online: Research on Asynchronous Learning Networks. Mahwah, NJ: Lawrence Erlbaum Associates, 2005.

Curtis, D. D. and M. J. Lawson. Exploring Collaborative Online Learning. Journal of Asynchronous Learning Networks 5(1): 2001.

Jonassen, D. H. Thinking Technology. Educational Technology: 35–37, January 2003.

Vygotsky, L. Mind in Society: The Development of Higher Psychological Processes. Cambridge: Harvard University Press, 1978.

Leidner, D. E. and S. L. Jarvenpaa. The use of information technology to enhance management school education: A theo-retical view. MIS Quarterly 19(3): 265–291, 1995.

Huba, M. E. and J. E. Freed. Learner-Centered Assessment on College Campuses: Shifting the Focus from Teaching to Learning, 1st ed. Pearson Allyn & Bacon, 1999.

Angelo, T. A. and K. P. Cross. Classroom Assessment Techniques: A Handbook for College Teachers, 2nd ed., 448. Jossey-Bass: 1993.

Kwok, R. C. W. and K. Ma. Use of a Group Support System for Collaborative Assessment. Computers & Education 32(2): 109–125, 1999.

Wilson, E. V. Examnet Asynchronous Learning Network: Augmenting Face-to-Face Course with Student-Developed Exam Questions. Computers & Education 42: 87–107, 2004.

Shindler, J. Examining the Soundness of Collaborative Essay Exams in Teacher Education Courses. National Forum of Teacher Education Journal 12(3): 2003.

Liu, E. Z.-F., S. S. J. Lin, C.-H. Chiu, et al. Web-Based Peer Review: The Learner as Both Adapter and Reviewer. IEEE Transactions on Education 44(3): 246–251, 2001.

Shen, J., K.-E. Cheng, M. Bieber, et al. Traditional in-Class Examination vs. Collaborative Online Examination in Asyn-chronous Learning Networks: Field Evaluation Results. Americas Conference on Information Systems 2004. New York City, NY: 2004.

Shen, J., S. R. Hiltz, K.–E. Cheng, et al. Collaborative Examinations for Asynchronous Learning Networks: Evaluation Results. Proceedings of the 34th Hawaii International Conference on Systems Sciences. Maui, Hawaii: IEEE Computer Society Press, 2001.

Shen, J., K.-E. Cheng, Y. Cho, et al. Evaluation of an On-Line Collaborative Examination Process. Proceedings of the 2000 Americas Conference on Information Systems. California, 2000.

Shen, J. Collaborative Examinations in Asynchronous Learning Networks: Field Experiments on Collaborative Learning Through Online Assessments, Ph.D. Dissertation, Department of Information Systems, NJIT, May 2005.

Wu, D., M. Bieber, S. R. Hiltz, et al. Constructivist Learning with Participatory Examinations. Proceedings of the HICSS 37th Hawaii International Conference on Systems Sciences. Big Island, Hawaii: IEEE Computer Society Press, CD-Rom, 2004.

Leidner, D., and M. Fuller. Improving student learning of conceptual information: GSS supported collaborative learning vs. individual constructive learning. Decision Support Systems 20: 149–163.

McConnell, D. Examining a Collaborative Assessment Processes in Networked Lifelong Learning. Journal of Computer Assisted Learning 15(3): 232–243.

Benbunan-Fich, R., S. R. Hiltz, and L. Harasim. The Online Interaction Learning Model: An Integrated Theoretical Framework for Learning Networks. In Hiltz, S. R. and R. Goldman (eds.), Learning Together Online: Research on Asyn-chronous Learning Networks. Mahwah, NJ: Lawrence Erlbaum Associates, 2004.

Topping, K. J. Peer Assessment between Students in College and University. Review of Educational Research 68(3): 249–276, 1998.

Falchikov, N. and J. Goldfinch. Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks. Review of Educational Research 70(3): 287–322, 2000.

Karoly, L. A. and C. W. A. Panis. The 21st Century at Work: Forces Shaping the Future Workforce and Workplace in the United States. RAND Labor and Population, 2003.

Harasim, L. On-Line Education: Perspectives on a New Environment. New York: Praeger, 1990.

Hiltz, S. R. The Virtual Classroom: Using Computer-Mediated Communication for University Teaching. Journal of Communication 36(2): 95–104. 1986.

Picciano, A. G. Beyond Student Perceptions: Issues of Interaction, Presence, and Performance in an Online Course. Journal of Asynchronous Learning Networks 6(1): 21–40, 2002.

Swan, K. and P. J. Shea. The Development of Virtual Learning Communities In Hiltz, S.R. and Goldman (eds.), Learning Together Online: Research on Asynchronous Learning Networks. Mahwah, NJ: Lawrence Erlbaum Associates, 2004.


Copyright (c) 2019 Jia Shen, Michael Bieber