A Ten-Year Review of Online Learning Research through Co-Citation Analysis

Hyejin Park, Peter Shea


This study reviewed research trends in online-, distance-, and blended learning over the past ten years through co-citation analysis. The related peer-reviewed research articles in the Web of Science were obtained, and the references in the articles were analyzed. The result showed that literature review and meta-analysis studies on distance education and studies on learners’ discourse in asynchronous discussion were frequently cited in the first half of the ten years. In the second phase, the focus moved to online learners' satisfaction and self-regulation, informal learning, and learning through MOOCs. The Community of Inquiry framework was continually researched. Overall, this study identified features and changes in research trends in online learning. As the first study to present a co-citation analysis of literature in the field, this paper provides a unique contribution to our understanding of publications, researchers, and research themes in online education.


Research Review, Online Learning, Distance Learning, Blended Learning, Co-Citation Analysis

Full Text:



Akyol, Z., & Garrison, D. (2008). The development of a community of inquiry over time in an online course: Understanding the progression and integration of social, cognitive and teaching presence. Journal of Asynchronous Learning Networks, 12(2-3), 3-23.

Akyol, Z., & Garrison, D. (2011). Assessing metacognition in an online Community of Inquiry. The Internet and Higher Education, 14(3), 183-190.

American Journal of Distance Education. (2018). Retrieved April 24th, 2018, from https://www.tandfonline.com/loi/hajd20

Arbaugh, J., Cleveland-Innes, M., Diaz, S., Garrison, D., Ice, P., Richardson, J., & Swan, K. (2008). Developing a community of inquiry instrument: Testing a measure of the Community of Inquiry framework using a multi-institutional sample. Internet and Higher Education, 11(3-4), 133-136.

Balfour, S. (2013). Assessing writing in MOOCs: Automated essay scoring and calibrated peer review™. Research & Practice in Assessment, 8(1), 40-48.

Bernard, R., Abrami, P., Lou, Y., Borokhovski, E., Wade, A., Wozney, L.,…Huang, B. (2004). How does distance education compare with classroom instruction? A meta- analysis of the empirical literature. Review of Educational Research, 74(3), 379-439.

Berners-Lee, T., Cailliau, R., & Groff, J.-F. (1992). The world-wide web. Computer Networks and ISDN Systems 25, 454-459.

Bradea, I., Delcea, C., & Paun, R. (2015). Healthcare risk management analysis—A bibliometric approach. Journal of Eastern Europe Research in Business & Economics. DOI: 10.5171/2015.169472

Breslow, L., Pritchard, D., DeBoer, J., Stump, G., Ho, A., & Seaton, D. (2013). Studying learning in the worldwide classroom research into edX's first MOOC. Research & Practice in Assessment, 8, 13-25.

Case, D., & Higgins, G. (2000). How can we investigate citation behavior? A study of reasons for citing literature in communication. Journal of the American society for information science and technology, 51(7), 635-645.

Chen, C. (2006). CiteSpace II: Detecting and visualizing emerging trends and transient patterns in scientific literature. Journal of the American Society for Information Science and Technology, 57(3), 359-377.

Chen, C. (2017). Science mapping: A systematic review of the literature. Journal of Data and Information Science 2(2), 1-40.

Chen, C., Ibekwe-SanJuan, F., & Hou, J. (2010). The structure and dynamics of co-citation clusters: A multiple-perspective co-citation analysis. Journal of the American Society for Information Science and Technology 61(7), 1386-1409.

Computers & Education. (2018). Retrieved April 24th, 2018, from https://www.sciencedirect.com/journal/computers-and-education/vol/97/suppl/C

Cook, D., Levinson, A., Garside, S., Dupras, D., Erwin, P., & Montori, V. (2008). Internet-based learning in the health professions. A meta-analysis. JAMA, 300(10), 1181- 1196.

Dabbagh, N., & Kitsantas, A. (2012). Personal learning environments, social media, and self- regulated learning: A natural formula for connecting formal and informal learning. The Internet and Higher Education, 15(1), 3-8.

De Wever, B., Schellens, T., Valcke, M., & Keer, H. (2006). Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review. Computers & Education, 46(1), 6-28.

Distance Education. (2018). Retrieved April 24th, 2018, from https://www.tandfonline.com/toc/cdie20/current

Educational Technology Research and Development. (2018). Retrieved April 24th, 2018, from https://link.springer.com/journal/11423

Educational Technology & Society. (2018). Retrieved April 24th, 2018, from https://www.j-ets.net

Fini, A. (2009). The technological dimension of a Massive Open Online Course: The case of the CCK08 course tools. International Review of Research in Open and Distance Learning, 10(5). Retrieved May 4th, 2018 from http://www.irrodl.org/index.php/irrodl/article/view/643/1402.

Garfield, E. (1955). Citation indexes to science: a new dimension in documentation through association of ideas. Science, 122, 108-111.

Garfield, E. (1996). How can impact factors be improved? BMJ, 313, 411-413.

Garrison, D., & Akyol, Z. (2013). Toward the development of a metacognitive construct for communities of inquiry. The Internet and Higher Education, 17, 84-89.

Garrison, D., & Anderson, T. (2003). E-learning in the 21st century: A framework for research and practice. New York, NY: Routledge.

Garrison, D., Anderson, T., & Archer, W. (2000). Critical inquiry in a text-based environment: Computer conferencing in higher education. The internet and Higher Education, 2(2-3), 87-105.

Garrison, D., & Arbaugh, J. (2007). Researching the community of inquiry framework: Review, issues, and future directions. The Internet and Higher Education, 10(3), 157-172.

Garrison, D., & Cleveland-Innes, M. (2005). Facilitating cognitive presence in online learning: Interaction is not enough. The American Journal of Distance Education, 19(3), 133-148.

Gmur, M. (2003). Co-citation analysis and the search for invisible colleges: A methodological evaluation. Scientometrics, 57(1), 27-57.

Holmberg, B. (2005). The evolution, principles and practices of distance education. Oldenburg: Bibliotheks und informationssystem der Univ.

Harasim, L. (2000). Shift happens: Online education as a new paradigm in learning. Internet and Higher Education, 3(1-2), 41-61.

Hrastinski, S. (2009). A theory of online learning as online participation. Computers & Education, 52(1), 78-82.

IRRODL. (2018). Retrieved April 24th, 2018, from http://www.irrodl.org

JAMA. (2018). Retrieved April 24th, 2018, from https://jamanetwork.com/journals/jama

Kuo, H.-K., & Yang, C. (2012). An intellectual structure of activity-based costing: a co-citation analysis. The Electronic Library 32(1), 31-46.

Larreamendy-Joerns, J., & Leinhardt, G. (2006). Going the distance with online education. Review of Educational Research, 74(4), 567-605.

Liang, Y., Liu, Z., Yang, Z., & Wang, X. (2008). Knowledge mapping of citation analysis domains, In Proceedings of the 4th International Conference on Webometrics, Informetrics and Scientometrics & 9th COLLNET Meeting. Berlin, German: The COLNET Journal of Scientometrics and Information Management.

Liyanagunawardena, T., Adams, A., & Williams, S. (2013). MOOCs: A systematic study of the published literature 2008-2012. The International Review of Research in Open and Distributed Learning, 13(3).

Madge, C., Meek, J., Wellens, J., & Hooley, T. (2009). Facebook, social integration and informal learning at university: ‘It is more for socialising and talking to friends about work than for actually doing work’. Learning, Media and Technology, 34(2), 141- 155.

McAuley, A., Stewart, B., Siemens, G., & Cormier, D. (2010). The MOOC Model for Digital Practice. Retrieved September 15, 2018, from https://oerknowledgecloud.org/sites/oerknowledgecloud.org/files/MOOC_Final.pdf

Merton, R. K. (1973). The sociology of science: Theoretical and empirical investigations. University of Chicago Press: Chicago.

Meyer, J. P., & Zhu, S. (2013). Fair and equitable measurement of student learning in MOOCs: An introduction to item response theory, scale linking, and score equating. Research & Practice in Assessment, 8(1), 26-39.

ODLAA. (2018). Retrieved April 24th, 2018, from https://odlaa.org/

O’Reilly, U.-M., & Veeramachaneni, K. (2014). Technology for mining in the big data of MOOCs. Research & Practice in Assessment, 9(2), 29-37.

Ozcınar, H. (2015). Mapping teacher education domain: A document co-citation analysis from 1992 to 2012. Teaching and Teacher Education, 47, 42-61.

Paechter, M., Maier, B., & Macher, D. (2010). Students’ expectations of, and experiences in e-learning: Their relation to learning achievements and course satisfaction. Computers & Education, 54(1), 222-229.

Palmblad, M., & Eck, N. (2018). Bibliometric analyses reveal patterns of collaboration between ASMS members. Journal of the American Society for Mass Spectrometry, 29(3), 447-454.

Park, H. W., Yoon, J., & Leydesdorff, L. (2016). The normalization of co-authorship networks in the bibliometric evaluation: The government stimulation programs of China and Korea. Scientometrics, 109(2), 1017-1036.

Pensa-Shaff, J., & Nicholls, C. (2004). Analyzing student interactions and meaning construction in computer bulletin board discussions. Computers & Education, 43(3), 243-265.

Research & Practice in Assessment. (2018). Retrieved April 24th, 2018, from http://www.rpajournal.com/

Richardson, J., & Swan, K. (2003). Examining social presence in online courses in relation to students’ perceived learning and satisfaction.

Journal of Asynchronous Learning Networks, 7(1), 68-88.

Rita, K. (2011). The challenges to connectivist learning on open online networks: Learning experiences during a Massive Open Online Course. International Review of Research in Open and Distance Learning, 12(3), 19-37.

Sandeen, C. (2013). Assessment’s place in the new MOOC world. Research & Practice in Assessment, 8(1), 5-12.

Schrire, S. (2006). Knowledge building in asynchronous discussion groups: Going beyond quantitative analysis. Computers & Education, 46(1), 49-70.

Siemens, G., Gašević, D., & Dawson, S. (2015). Preparing for the digital university: a review of the history and current state of distance, blended, and online learning. Retrieved May 15th, 2018, from http://linkresearchlab.org/PreparingDigitalUniversity.pdf

Small, H. (1973). Co-citation in the scientific literature: a new measure of the relationship between two documents. Journal of the American Society for Information Science, 24(4), 265-269.

Sun, P.-C., Tsai, R., Finger, G., Chen, Y.-Y., & Yeh, D. (2008). What drives a successful e-Learning? And empirical investigation of the critical influencing learner satisfaction. Computers & Education, 50(4), 1183-1202.

Tallent-Runnels, M. K., Thomas, J. A., Lan, W. Y., Cooper, S., Ahern, T. C., Shaw, S. M., & Liu, X. (2006). Teaching courses online: A review of the research. Review of Educational Research, 76(1), 93-135.

Tang, K.-Y., Tsai, C.-C., & Lin, T.-C. (2014). Contemporary intellectual structure of CSCL research (2006-2013): a co-citation network analysis with an education focus. International Journal of Computer-Supported Collaborative Learning, 9(3), 335-363.

Tang, K.-Y., Wang, C.-Y., Chang, H.-Y., Chen, S., Lo, H.-C., & Tsai, C.-C. (2015). The intellectual structure of metacognitive scaffolding in science education: A co-citation network analysis. International Journal of Science and Math Education 14(2), 249-262.

The Internet and Higher Education. (2018). Retrieved 24th, 2018, from https://www.journals.elsevier.com/the-internet-and-higher-education/

Thelwall, M. (2007). Bibliometrics to webometrics. Journal of Information Science, 34(4), 1-18.

Yuan, L., & Powell, S. (2013). MOOCs and Open Education: Implications for Higher Education. CETIS White Paper. Retrieved May 4th, 2018, from http://publications.cetis.org.uk/2013/667.

Zhao, D., & Strotmann, A. (2008). Author bibliographic coupling: Another approach to citation‐based author knowledge network analysis. Proceedings of the Association for Information Science and Technology, 45(1), 1-10.

Author et al. (2009).

Author et al. (2010).

Author et al. (2011).

Author et al. (2017).

DOI: http://dx.doi.org/10.24059/olj.v24i2.2001

Copyright (c) 2020 Hyejin Park, Peter Shea

License URL: https://creativecommons.org/licenses/by/4.0/