Towards responsible AI-augmented evidence synthesis  in Open, Distance, and Digital Education (ODDE)

Olaf Zawacki-Richter; Florence Martin; Melissa Bond; Richard E. West

doi:10.24059/olj.v30iSI2.6749

Authors

Olaf Zawacki-Richter University of Oldenburg https://orcid.org/0000-0003-1482-8303
Florence Martin North Carolina State University
Melissa Bond University College London
Richard E. West Brigham Young University

DOI:

https://doi.org/10.24059/olj.v30iSI2.6749

Abstract

This editorial introduces the special issue on evidence synthesis in open, distance, and digital education (ODDE), highlighting the growing importance of rigorous, transparent, and reproducible approaches to research synthesis. It considers emerging opportunities and challenges associated with artificial intelligence in evidence synthesis and proposes five principles for responsible AI-augmented review practices emphasizing methodological rigor, transparency, validation, human scholarly judgment, and reproducibility. The editorial also situates the special issue’s contributions within broader developments in evidence synthesis, including AI and self-regulated learning, learner success and support, theoretical developments in ODDE, and methodological advances.

References

Bond, M. (2024). Quality of evidence synthesis tool (QuEST). Zenodo. https://doi.org/10.5281/zenodo.14211692

Buntins, K., Bedenlier, S., Marín, V., Händel, M., & Bond, M. (2023). Methodological Approaches to Evidence Synthesis in Educational Technology. MedienPädagogik: Zeitschrift für Theorie und Praxis der Medienbildung, 54, 167–191. https://doi.org/10.21240/mpaed/54/2023.12.20.X

Burgard, T., & Bittermann, A. (2023). Reducing literature screening workload with machine learning: A systematic review of tools and their performance. Hotspots in Psychology, 231(1), 3–15. https://doi.org/10.1027/2151-2604/a000509

Centre for Reviews and Dissemination (UK). (1995). Database of Abstracts of Reviews of Effects (DARE): Quality-assessed Reviews. https://www.ncbi.nlm.nih.gov/books/NBK285222 . Accessed 4 January 2023.

Eisele-Metzger, A., Bond, M., Gopal, I., Lieberum, J., Mansilla, C., Siemens, W., … Metzendorf, M. (2026, February 23). Large Language Models to support conducting systematic reviews: Protocol for a living scoping review. https://doi.org/10.17605/OSF.IO/7QHM2

Farotimi, O., Dunn, A., Van Lissa, C. J., Polanin, J. R., Mavridis, D., & Pigott, T. D. (2026). Guidance for manuscript submissions testing the use of generative AI for systematic review and meta-analysis. Research Synthesis Methods, 17(2), 237–239. https://doi.org/10.1017/rsm.2025.10058

Flemyng, E., Norl-Storr, A., Macura, B., Gartlehner, G., Thomas, J., Meerpohl, J. J., Jordan, Z., Minx, J., Eisele-Metzger, A., Hamel, C., Jemioło, P., Porritt, K., & Grainger, M. (2025). Position statement on artificial intelligence (AI) use in evidence synthesis across Cochrane, the Campbell Collaboration, JBI and the Collaboration for Environmental Evidence 2025. Cochrane Database Systematic Reviews. https://doi.org/10.1002/14651858.ED000178

Forsström, S., Bond, M., & Njå, M. (2026). A meta review of programming and robotics in schools. Review of Education, 14, e70231. https://doi.org/10.1002/rev3.70231

Gough, D., Oliver, S., & Thomas, J. (2017). An introduction to systematic reviews (2nd edition). Sage Publishing.

Jansen, T., Liebenow, L. W., Schaller, N.-J., Hattie, J., & Möller, J. (2026). Automated Data Extraction by Large Language Models: Assessing Accuracy in Comparison to Human Experts Using the Example of Visible Learning. Educational Psychology Review, 38(1), 38. https://doi.org/10.1007/s10648-026-10136-5

Karlstrøm, H. (2024). Uses of artificial intelligence and machine learning in systematic reviews of education research. London Review of Education, 22(1). https://doi.org/10.14324/LRE.22.1.40

Lazaros, K., Vrahatis, A. G., & Kotsiantis, S. (2026). Human-in-the-loop artificial intelligence: A systematic review of concepts, methods, and applications. Entropy, 28(4), 377. https://doi.org/10.3390/e28040377

Martin, F. (2025). Systematic reviews in educational research: A practical guide for research synthesis. Sage Publishing.

Martin, F., Dennen, V. P., & Bonk, C. J. (2023). Systematic reviews of research on online learning: An introductory look and review. Online Learning Journal, 27(1), 1-14.

Scheelbeek, P., Bond, M., Callaghan, M., Minx, J. C., Hadida, G., O'Mara-Eves, A., Thomas, J., McDonald, S., & Schuster, T. (2024). Digital evidence synthesis tools for climate & health. The Wellcome Trust. https://doi.org/10.21955/wellcomeopenres.1115400.1

Seifi, A., & Seyfi, A. (2026). Hallucination Rate of Peer-Reviewed Citations Generated by Large Language Models in Neurocritical Care. Critical Care Explorations, 8(9), e1474. https://doi.org/10.1097/CCE.0000000000001474

Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J. et al. (2017). AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both BMJ, 358. https://doi.org/10.1136/bmj.j4008

Thomas, J., Flemyng, E., Noel-Storr, A. (2026). Responsible AI in Evidence SynthEsis (RAISE): guidance and recommendations. https://doi.org/10.17605/OSF.IO/FWAUD

West, R. E., & Martin, F. (2024). What type of paper are you writing? A taxonomy of review and theory scholarship distinguished by their summary and advocacy arguments. Educational Technology Research and Development, 72, 2443–2476. https://doi.org/10.1007/s11423-023-10233-0

Xiao, J. (2018). On the margins or at the center? Distance education in higher education. Distance Education, 39(2), 259–274. https://doi.org/10.1080/01587919.2018.1429213

Zawacki‐Richter, O., Cefa, B., & Bai, J. Y. H. (2025). Towards reproducible systematic reviews in Open, Distance, and Digital Education—An umbrella mapping review. Review of Education, 13(1), e70031. https://doi.org/10.1002/rev3.70031

Zawacki-Richter, O., & Jung, I. (Eds). (2023). Handbook of Open, Distance, and Digital Education. Springer. https://link.springer.com/referencework/10.1007/978-981-19-0351-9

Zawacki-Richter, O., Kerres, M., Bedenlier, S., Bond, M., & Buntins, K. (Eds). (2020). Systematic reviews in educational research: Methodology, perspectives and application. Springer. http://link.springer.com/10.1007/978-3-658-27602-7