The  Impact of Online Exams on the Quality of Distance Learners' Exam and Exam Revision Experience: Perspectives from The Open University UK

Simon Cross; Maria Aristeidou; Klaus-Dieter Rossade; Carlton Wood; Andrew Brasher

doi:10.24059/olj.v27i2.3761

Authors

Simon Cross The Open University, UK http://orcid.org/0000-0001-8741-8503
Maria Aristeidou
Klaus-Dieter Rossade
Carlton Wood
Andrew Brasher

DOI:

https://doi.org/10.24059/olj.v27i2.3761

Keywords:

online exams, conventional exams, revising for exams, student perceptions, assessment experience, anxiety, age, gender, exam rooms, distance learning

Abstract

This paper reports findings from a research study at The Open University, UK into the quality of distance learners’ online exam experience and the differences in experience between online (pandemic) and in-person (pre-pandemic) modes of examination. Our research responds to the ongoing need for greater insight into the exam experience and is uniquely positioned in two ways. First, we made use of a robust reference dataset collected before the COVID-19 pandemic and compared this with a second survey administered a year after the pandemic started; second, we asked students about their experience preparing and revising for the exam as well as the exam itself. Exam revision represents an important transitional period for learners. Our results show that, overall, the shift to online remote exams did not impact the quality of distance learners’ experience of revising for exams or taking the exam itself. We found no significant change in the revision experience across six of eight measures, including the learning benefits of learning while revising, enjoyment, and support. However, students reported feeling less anxious when revising for online exams. The quality of the exam experience itself was largely unaffected by the move from in-person to online remote exams. No significant differences were found for seven of the nine measures of exam experience. However, we found satisfaction with the exam environment was significantly higher for online exams and that learners felt the online exam was harder than they expected. Age and gender differences are also explored.

References

Afacan Adanır, G., Ismailova, R., Omuralev, A. & Muhametjanova, G. (2020). Learners’ Perceptions of Online Exams: A Comparative Study in Turkey and Kyrgyzstan. International Review of Research in Open and Distance Learning, 21(3), pp. 1–17. https://doi.org/10.19173/irrodl.v21i3.4679

Ahmad, I., Gul, R. & Zeb, M. (2022). A Qualitative Inquiry of University Student’s Experiences of Exam Stress and Its Effect on Their Academic Performance. Human Arenas [Preprint]. https://doi.org/10.1007/s42087-022-00285-8

Aristeidou, M. & Cross, S. (2021). Disrupted distance learning: the impact of Covid-19 on study habits of distance learning university students. Open Learning: The Journal of Open, Distance and e-learning, 36(3) 263–282. https://doi.org/10.1080/02680513.2021.1973400

Bevitt, S. (2015). Assessment innovation and student experience: a new assessment challenge and call for a multi-perspective approach to assessment research. Assessment and Evaluation in Higher Education, 40(1), pp. 103-119

Böhmer, C., Feldmann, N., & Ibsen, M. (2018). E-exams in engineering education — online testing of engineering competencies: Experiences and lessons learned. Paper presented at the 2018 IEEE Global Engineering Education Conference (EDUCON). doi: https://doi.org/10.1109/EDUCON.2018.8363281

Cross, S., Whitellock, D. and Mittelmeier, J. (2016). Does the quality of quantity of exam revision impact on student satisfaction and performance in the exam itself? Perspectives from undergraduate distance learners. EDULEARN16 Proceedings, IATED Academy, pp. 5052-5061. Available at: https://oro.open.ac.uk/46937/

Dominguez Figaredo, Ines Gil Jaurena, & Javier Morentin Encina. (2022). The Impact of Rapid Adoption of Online Assessment on Students’ Performance and Perceptions: Evidence from a Distance Learning University. Electronic Journal of e-Learning, 20(3), pp224–241. https://doi.org/10.34190/ejel.20.3.2399

Dermo, J. (2009). e-Assessment and the student learning experience: A survey of student perceptions of e-assessment. British journal of educational technology, 40(2), pp. 203–214. https://doi.org/10.1111/j.1467-8535.2008.00915.x

Elmehdi (2019) Online Summative Assessment and Its Impact on Students’ Academic Performance, Perception and Attitude Towards Online Exams: University of Sharjah Study Case

Eltahir, M.E., Alsalhi, N.R. and Al-Qatawneh, S.S. (2022). Implementation of E-exams during the COVID-19 pandemic: A quantitative study in higher education. PloS one, 17(5), pp. e0266940–e0266940. https://doi.org/10.1371/journal.pone.0266940

Entwishtle, N. and Entwistle, D. (2003). Preparing for Examinations: The interplay of memorizing and understanding, and the development of knowledge objects. Higher Education Research and Development, 22(1), 19-41.

Falchikov, N., and D. Boud (2007). Assessment and Emotion, the Impact of Being Assessed. In Rethinking Assessment in Higher Education, Learning for the Longer Term, D. Boud and N. Falchikov (eds), pp. 144–156. Abingdon: Routledge.

Gibbs, G. and Dunbar-Goddet, H. (2007). The Effects of Programme Assessment Environments on Student Learning. Oxfordshire, York: Higher Education Academy.

Hillier, M. (2014). The very idea of e-exams: student (pre)conceptions. ASCILITE 2014, Dunedin, New Zealand. Available at: https://ascilite.org/conferences/dunedin2014/files/fullpapers/91-Hillier.pdf

Ilgaz, H. & Afacan Adanir, G. (2019). Providing online exams for online learners: does it really matter for them? Education and Infomation Technologies, 25(2), pp. 1255-1269. https://doi.org/10.1007/s10639-019-10020-6

James R. (2016). Tertiary student attitudes to invigilated, online summative examinations. International Journal of Educational Technology in Higher Education, 13(19), pp. 1–13.

Khan, M.A., Vivek, V., Khojah, M., Nabi, M.K., Paul, M. & Minhaj, S.M. (2021). Learners’ Perspective towards E-Exams during COVID-19 Outbreak: Evidence from Higher Educational Institutions of India and Saudi Arabia. International journal of environmental research and public health, 18(12), p. 6534–. https://doi.org/10.3390/ijerph18126534.

Oppenheim, A. N. (1992). Questionnaire design, interviewing and attitude measurement. London: Continuum International.

Patael, Shamir, J., Soffer, T., Livne, E., Fogel‐Grinvald, H., & Kishon‐Rabin, L. (2022). Remote proctoring: Lessons learned from the COVID‐19 pandemic effect on the large scale on‐line assessment at Tel Aviv University. Journal of Computer Assisted Learning, 38(6), 1554–1573. Available at: https://doi.org/10.1111/jcal.12746

Payne, E. and Brown, G. (2011). Communication and practice with examination criteria. Does this influence performance in examinations? Assessment and Evaluation in Higher Education, 36(6), 619-626.

Reedy, A., Pfitzner, D., Rook ,L. & Ellis, L. (2021). Responding to the COVID-19 emergency: student and academic staff perceptions of academic integrity in the transition to online exams at three Australian universities. International journal for educational integrity, 17(1), pp. 1–32. https://doi.org/10.1007/s40979-021-00075-9

Stowell, J.R. and Bennett, D. (2010) ‘Effects of Online Testing on Student Exam Performance and Test Anxiety’, Journal of educational computing research, 42(2), pp. 161–171. https://doi.org/10.2190/EC.42.2.b

Universities UK (2022). Lessons from the pandemic: making the most of technologies in teaching. Available at: https://www.universitiesuk.ac.uk/what-we-do/policy-and-research/publications/lessons-pandemic-making-most

Vattøy. K.-D., Gamlem, S.M. & Rogne, W.M. (2021). Examining students’ feedback engagement and assessment experiences: a mixed study. Studies in Higher Education, 46(11), pp. 2325-2337.

Whitelock, D., Herodotou, C., Cross, S., & Scanlon, E. (2021). Open Voices on Covid-19: Covid challenges and opportunities driving the research agenda. Open Learning: The Journal of Open, Distance and E-learning, 36(3), pp. 201-211. https://doi.org/10.1080/02680513.2021.1985445