Using Design-Based Research in Higher Education Innovation

Cristi Ford, Darragh McNally, Kate Ford


This paper discusses the design-based research approach used by the Center for Innovation in Learning and Student Success at the University of Maryland (CILSS), University College. CILSS is a laboratory for conducting applied research that focuses on continuous improvements to the university's instruction of curriculum, learning models, and student support to identify promising innovations for underserved populations in adult higher education; to drive adoption of next-generation transformational online learning; to develop new educational models based on learning science, cutting edge technology, and improved instructional methods; to help more UMUC adult students succeed by increasing retention and graduating more students in shorter time frames (thus reducing their costs). As such, leveraging technology and pedagogy in innovative ways is key to the Center's work. CILSS serves as the research and development arm for the university, promoting innovative ideas and breakthroughs in learning.


The paper details one interpretation of design-based research (DBR) and how it can be applied by an innovation center working within a university for program evaluation. This paper also posits that the conceptual framework and assumptions of andragogy (Knowles, 1984) has applicable relevance to the instructional shifts that include adaptive learning in the curriculum. A review of the literature on DBR explores the central features of this approach. A review of andragogy as the conceptual framework for this paper highlights what we believe to be the central features of the evaluation approach of adaptive learning software. We then present the model used by CILSS when designing and testing a pilot project. To illustrate the approach, we provide the example of a recent pilot that uses the adaptive learning software RealizeIt in UMUC’s Principles of Accounting I course, a course that traditionally has lower than average success rates.


Design Based Research; Innovation; Continuous Improvement; Adaptive Learning; Evaluation; Adult Learners

Full Text:




Anderson, T., & Shattuck, J. (2012). Design-based research a decade of progress in education research? Educational Researcher, 41(1), 16–25. Retrieved from

Bannan, B. (2013) The Integrative Learning Design Framework: An illustrated example from the domain of instructional technology. In T. Plomp & N. Nieveen (Eds.), Educational design research - Part A: An introduction (pp. 114–133). Enschede, The Netherlands: Netherlands Institute for Curriculum Development. Retrieved from

Barab, S. (2006). Design-based research: A methodological Toolkit for the learning scientist. In R. K. Sawyer (Eds.) , The Cambridge handbook of: The learning sciences (pp. 153-169). New York, NY, US: Cambridge University Press.

Blondy, L. C. (2007). Evaluation and application of andragogical assumptions to the adult online learning environment. Journal of Interactive Online Learning, 6(2), 116-130. Retrieved from

Brown, A. (1992). Design experiments: Theoretical and methodological challenges in creating complex interventions in classroom settings. Journal of the Learning Sciences, 2(2), 141–178. Retrieved from

Brunswik, E. (1956). Perception and the representative design of psychological experiments (2nd ed.). Berkeley, CA: University of California Press.

Campbell, D. T., & Stanley, J. C. (1971). Experimental and quasi-exprimental designs for research (Vol. 4). Rand McNally.

Cercone, K. (2008). Characteristics of adult learners with implications for online learning design. AACE Journal, 16(2), 137-159. Retrieved from

Collins, A. (1992). Toward a design science of education. In E. Lagemann & L. Shulman (Eds.), Issues in education research: problems and possibilities (pp. 15-22). San Francisco, CA: Jossey- Bass.

Collins, A., Joseph, D., & Bielaczyc, K. (2004). Design research: Theoretical and methodological issues. The Journal of the Learning Sciences, 13(1), 15–42. Retrieved from

Dede, C. (2004). If design-based research is the answer, what is the question? A commentary on Collins, Joseph, and Bielaczyc; diSessa and Cobb; and Fishman, Marx, Blumenthal, Krajcik, and Soloway in the JLS special issue on design-based research. The Journal of the Learning Sciences, 13(1), 105–114. Retrieved from

The Design-Based Research Collective. (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5-8. Retrieved from

Duffy, T. M., & Kirkley, J. R. (2004). Learning theory and pedagogy applied in distance learning: The case of Cardean University. In T. M. Duffy & J. R. Kirkley (Eds.), Learner-Centered Theory and Practice in Distance Education: Cases from Higher Education (pp. 107-141). New York, NY: Routledge.

Dziuban, C., Moskal, P., Cassisi, J., & Fawcett, A. (2016). Adaptive learning in psychology: Wayfinding in the digital age. Online Learning, 20(3). Retrieved from

Easterday, M., Rees Lewis, D., & Gerber, E. (2014). Design-based research process: Problems, phases, and applications. In Proc. of International Conference of Learning Sciences (Vol. 14). Retrieved from

Fishman, B. J., Penuel, W. R., Allen, A.-R., Cheng, B. H., & Sabelli, N. (2013). Design-based implementation research: An emerging model for transforming the relationship of research and practice. Yearbook of the National Society for the Study of Education, 112(2), 136-156. Retrieved from

Henrick, E., Cobb, P., & Jackson, K. (2015). Educational design research to support system-wide instructional improvement. In A. Bikner-Ahsbahs, C. Knipping, & N. Presmeg (Eds.), Approaches to qualitative research in mathematics education (pp. 497–530). New York NY: Springer. Retrieved from

Holton, E. F., Swanson, R. A., & Naquin, S. S. (2001). Andragogy in practice: Clarifying the andragogical model of adult learning. Performance Improvement Quarterly, 14(1), 118-143. Retrieved from

Kelly, A. E. (2013). When is design research appropriate? In T. Plomp & N. Nieveen (Eds.), Educational design research - Part A: An introduction (pp. 134-151). Enschede, The Netherlands: Netherlands Institute for Curriculum Development. Retrieved from

Knowles, M. (1973). The adult learner: A neglected species. Houston, TX: Gulf. Retrieved from

Knowles, M. (1984). Andragogy in action. San Francisco, CA: Jossey-Bass.

Knowles, M. (1996). Andragogy: an emerging technology for adult learning. London: Routledge. Retrieved from

Knowles, M. S., Holton, E. F., III, & Swanson, R. A. (2014). The adult learner: The definitive classic in adult education and human resource development. New York, NY: Routledge.

Lewis, C. (2015). What is improvement science? Do we need it in education? Educational Researcher, 44(1), 54–61. Retrieved from

McAuliffe, M., Hargreaves, D., Winter, A., & Chadwick, G. (2009). Does pedagogy still rule?. Australasian Journal of Engineering Education, 15(1), 13-18. Retrieved from

McKenney, S., & Reeves, T. C. (2014). Educational design research. In J. M. Spector, M.D. Merrill, J. Elen, & M. J. Bishop (Eds.), Handbook of research on educational communications and technology (pp. 131–140). New York, NY: Springer. Retrieved from