A Generalizable Framework for Multi-Scale Auditing of Digital Learning Provision in Higher Education
DOI:
https://doi.org/10.24059/olj.v22i2.1229Keywords:
Development, Administration, Online learningAbstract
It is increasingly important that higher education institutions can audit and evaluate the scope and efficacy of their digital learning resources across various scales. To-date there has been little effort to address this need for a validated, appropriate and simple to execute method that will facilitate such an audit; whether it be at the scale of an individual programme, department, faculty or institution. The data are of increasing value to ensure institutions maintain progress and equity in the student experience as well as for deployment and interpretation of learning analytics. This study presents a generalizable framework for auditing digital learning provision in higher education curricula. The framework is contextualized using a case study in which the audit is conducted across a single faculty in a research-intensive U.K. university. This work provides academics and higher education administrators with key principles and considerations as well as example aims and outcomes.
References
Adams Becker, S., Cummins, M., Davis, A., Freeman, A., Hall Giesinger, C., & Ananthanarayanan, V. (2017). NMC Horizon Report: 2017 Higher Education Edition. Austin, Texas: The New Media Consortium.
Alpert, D. & Bitzer, D. L. (1970). Advances in computer-based education. Science, 167, 1582-1590.
Bailey, E. G., Jensen, J., Nelson, J., Wiberg, H. K., & Bell, J. D. (2017). Weekly Formative Exams and Creative Grading Enhance Student Learning in an Introductory Biology Course. CBE-Life Sciences Education, 16, 2.
Bigum, C., & Rowan, L. (2008). Landscaping on shifting ground: teacher education in a digitally transforming world. Asia‐Pacific Journal of Teacher Education, 36, 245-255.
Birch, H. J. (2017). Potential of SoundCloud for mobile learning in music education: a pilot study. International Journal of Mobile Learning and Organisation, 11, 30-40.
Blackboard. Blackboard Learn. (2017). Retrieved January 21, 2017, from http://anz.blackboard.com/learning-management-system/blackboard-learn.aspx.
Boulos, M. N. K., Maramba, I., & Wheeler, S. (2006). Wikis, blogs and podcasts: a new generation of Web-based tools for virtual collaborative clinical practice and education. BMC medical education, 6, 41.
Brown, B., Jacobsen, M., & Lambert, D. (2014). Learning Technologies in Higher Education. In P. Preciado Babb (Ed.), Proceedings of the IDEAS: Rising to Challenge Conference. Calgary, Canada: Werklund School of Education, University of Calgary.
Buckingham, D. (2013). Beyond technology: Children's learning in the age of digital culture. (1st ed.). London: John Wiley & Sons.
Business, Innovation and Skills Committee, House of Commons. (2016). Teaching Excellence Framework: Assessing Quality In Higher Education 2016. (1st ed.). London: House of Commons Business, Innovation and Skills Committee.
Christensen, G., Steinmetz, A., Alcorn, B., Bennett, A., Woods, D., & Emanuel, E. J. (2013). The MOOC phenomenon: Who takes massive open online courses and why? Retrieved March 23, 2017, from http://dx.doi.org/10.2139/ssrn.2350964.
Collins, J. L., Cook-Cottone, C. P., Robinson, J. S., & Sullivan, R. R. (2004). Technology and new directions in professional development: Applications of digital video, peer review, and self-reflection. Journal of Educational Technology Systems, 33, 131-146.
Davies, S., Mullan, J., & Feldman, P. (2017). Rebooting learning for the digital age: What next for technology-enhanced higher education?. Higher Education policy institute. Retrieved April 28, 2017 from http://www.hepi.ac.uk/.
Fink, L. D. (2003). Creating Significant Learning Experiences. (1st ed.). San Francisco, California: Jossey-Bass, a Wiley imprint.
Garrison, D. R. & Kanuka, H. (2004). Blended learning: Uncovering its transformative potential in higher education. The internet and higher education, 7, 95-105.
Garrison, D. R., & Vaughan, N. D. (2008). Blended learning in higher education: Framework, principles, and guidelines. (1st Ed.). London: John Wiley & Sons.
Gilbert, J., Morton, S., & Rowley, J. (2007). e‐Learning: The student experience. British Journal of Educational Technology, 38, 560-573.
Golden, S., McCrone, T., Walker, M. & Rudd, P. (2006). Impact of e-learning in further education: Survey of scale and breadth. National Foundation for Educational Research: Research Report, 745, 1-91.
Gow, L., & Kember, D. (1990). Does higher education promote independent learning? Higher Education, 19, 307-322.
Grow, G. O. (1991). Teaching learners to be self-directed. Adult education quarterly, 41, 125-149.
Hill, J. R., & Hannafin, M. J. (2001). Teaching and learning in digital environments: The resurgence of resource-based learning. Educational Technology Research and Development, 49, 37-52.
Hiltz, S. R., & Turoff, M. (2005). Education goes digital: The evolution of online learning and the revolution in higher education. Communications of the ACM, 48, 59-64.
Horn, M. B., Staker, H., & Christensen, C. M. (2015). Blended. (1st ed.). San Francisco, CA: Jossey-Bass, a Wiley imprint.
Jeno, L. M., Grytnes, J. A., & Vandvik, V. (2017). The effect of a mobile-application tool on biology students' motivation and achievement in species identification: A Self-Determination Theory perspective. Computers & Education, 107, 1-12.
Kemp, B., & Jones, C. (2007). Academic use of digital resources: Disciplinary differences and the issue of progression revisited. Educational Technology & Society, 10, 52-60.
Kennedy, G. E., Judd, T. S., Churchward, A., Gray, K., & Krause, K. L. (2008). First year students' experiences with technology: Are they really digital natives? Australasian journal of educational technology, 24, 108-122.
Kiili, K. (2005). Digital game-based learning: Towards an experiential gaming model. The Internet and higher education, 8, 13-24.
Kim, K. J., & Bonk, C. J. (2006). The future of online teaching and learning in higher education. Educause quarterly, 29, 22-30.
Kolb, A. Y., & Kolb, D. A. (2005). Learning styles and learning spaces: Enhancing experiential learning in higher education. Academy of management learning & education, 4, 193-212.
Kop, R. (2011). The challenges to connectivist learning on open online networks: Learning experiences during a massive open online course. The International Review Of Research In Open And Distributed Learning, 12, 19-38.
Labarchives. Manage, Engage, Monitor, and Evaluate your Students’ Lab Work. (2017). Retrieved January 21, 2017, from http://www.labarchives.com/classroom-edition/.
Lapowsky, I. (2015). What schools must learn from LA’s ipad debacle. Wired. Retrieved May 11, 2017, from https://www.wired.com/2015/05/los-angeles-edtech/.
Laru, J., Järvelä, S., & Clariana, R. B. (2012). Supporting collaborative inquiry during a biology field trip with mobile peer-to-peer tools for learning: a case study with K-12 learners. Interactive Learning Environments, 20, 103-117.
Laurillard, D. (2002). Rethinking University Education: A conversational framework for the effective use of learning technologies. (1st Ed.). London: RoutledgeFalmer.
Leacock, T. L., & Nesbit, J. C. (2007). A framework for evaluating the quality of multimedia learning resources. Educational Technology & Society, 10, 44-59.
Littlejohn, A. & Pegler, C. (2007). Preparing For Blended E-Learning. (1st ed.). London: Routledge.
Manches, A., Bligh, B., & Luckin, R. (2012), Decoding learning: the proof, promise and potential of digital education. Retrieved January 30, 2017, from http://apo.org.au/node/32254.
McGarr, O. (2009). A review of podcasting in higher education: Its influence on the traditional lecture. Australasian Journal of Educational Technology, 25, 309-321.
McGee, P., & Reis, A. (2012). Blended course design: A synthesis of best practices. Journal of Asynchronous Learning Networks, 16, 7-22.
Mitchell, A., & Honore, S. (2007) Criteria for successful blended learning. Industrial and Commercial Training, 39, 143-149.
O'Flaherty, J., & Phillips, C. (2015). The use of flipped classrooms in higher education: A scoping review. The Internet and Higher Education, 25, 85-95.
Oppenheimer, T. (2003). The flickering mind: The false promise of technology in the classroom and how learning can be saved. (1st ed.). New York: Random House.
Pahinis, K., Stokes, C. W., Walsh, T. F., Tsitrou, E., & Cannavina, G. (2008). A blended learning course taught to different groups of learners in a dental school: follow-up evaluation. Journal of dental education, 72, 1048-1057.
Papastergiou, M. (2009). Digital game-based learning in high school computer science education: Impact on educational effectiveness and student motivation. Computers & Education, 52, 1-12.
Pratt, D. D. (1988). Andragogy as a relational construct. Adult Education Quarterly, 38, 160-172.
R Core Team (2016). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved September 1, 2016, from https://www.R-project.org/.
Reiser, R. A. (2017). Eight Trends Affecting the Field of Instructional Design and Technology: Opportunities and Challenges. In F-Q. Lai, J. D. Lehman (Eds.), Learning and Knowledge Analytics in Open Education. Switzerland: Springer International Publishing.
Sclater, N., & Mullan, J. (2017). Learning Analytics and Student Success – Assessing the evidence. Jisc briefing. Retrieved April 29, 2017, from http://www.jisc.ac.uk/.
Sheehan, M. C., & Mihailidis, P. (2007). Deans of change: keeping their schools current with the digital revolution, raising enough money to make that happen and putting together diverse staffs are among the challenges facing the people who run the nation's journalism and mass communication schools. American Journalism Review, 29, 40-44.
Song, L., & Hill, J. R. (2007). A conceptual model for understanding self-directed learning in online environments. Journal of Interactive Online Learning, 6, 27-42.
Traxler, J. & Kukulska-Hulme, A. (2005). Evaluating Mobile Learning: Reflections on Current Practice. Retrieved January 30, 2017, from http://oro.open.ac.uk/12819/1/mlearn05_Traxler%26Kukulska-Hulme.pdf.
Wagner, E. D. (2006). On designing interaction experiences for the next generation of blended learning. In Bonk, C. J., & Graham, C. R. (Eds.), The Handbook of Blended Learning. Global Perspectives. Local Designs. London: John Wiley & Sons.
Weigel, V. B. (2002). Deep Learning for a Digital Age: Technology's Untapped Potential To Enrich Higher Education. (1st Ed.). San Francisco, CA: Jossey-Bass.
Wong, L. (2013). Student engagement with online resources and its impact on learning outcomes. Journal of Information Technology Education, 12, 129-146.
Downloads
Published
Issue
Section
License
As a condition of publication, the author agrees to apply the Creative Commons – Attribution International 4.0 (CC-BY) License to OLJ articles. See: https://creativecommons.org/licenses/by/4.0/.
This licence allows anyone to reproduce OLJ articles at no cost and without further permission as long as they attribute the author and the journal. This permission includes printing, sharing and other forms of distribution.
Author(s) hold copyright in their work, and retain publishing rights without restrictions
