Adaptive Learning in Psychology: Wayfinding in the Digital Age

Charles Dziuban, Patsy Moskal, Jeffrey Cassisi, Alexis Fawcett

Abstract


This paper presents the results of a pilot study investigating the use of the Realizeit adaptive learning platform to deliver a fully online General Psychology course across two semesters. Through mutual cooperation, UCF and vendor (CCKF) researchers examined students’ affective, behavioral, and cognitive reactions to the system. Student survey results indicated that students found the system easy to use and were generally positive about their seamless transition to adaptive learning. While the majority of students were successful, learning outcome metrics utilizing Realizeit indices indicated a potential for early prediction of students who are likely to be at risk in this environment. Recommendations are presented for the benefits of cooperative research between users and vendors.

Keywords


Adaptive learning, online learning; course design; educational technologies

Full Text:

PDF

References


Anderson, R. D., & Rubin, H. (1956). Statistical inference in factor analysis. Proceedings of the Third Berkeley Symposium of Mathematical Statistics and Probability, 5, 111-150.

Association of Public & Land-Grant Universities. Personalizing Learning with Adaptive Courseware. Retrieved from http://www.aplu.org/projects-and-initiatives/personalized-learning-consortium/plc-projects/plc-adaptive-courseware/

Bates, M. J. (1989). The design of browsing and berrypicking techniques for the online search interface. Online Information Review, 13(5), 407-424. Retrieved from http://comminfo.rutgers.edu/~tefko/Courses/e530/Readings/Bates_Berrypicking.pdf

Bill & Melinda Gates Foundation. (2014, November). Early progress: Interim research on personalized learning. Retrieved from http://collegeready.gatesfoundation.org/wp-content/uploads/2015/06/Early-Progress-on-Personalized-Learning-Full-Report.pdf

Bowker, G. C., & Star, S. L. (2000). Sorting things out: Classification and its consequences. Cambridge, MA: The MIT Press.

Boyd, d. (2014). It’s complicated: The social lives of networked teens. Yale University Press.

Brown, J. (2015). Personalizing Post-Secondary Education: An Overview of Adaptive Learning Solutions for Higher Education. Retrieved from http://www.sr.ithaka.org/wp-content/uploads/2015/08/SR_Report_Personalizing_Post_Secondary_Education_31815_0.pdf

Carpman, J. R., & Grant, M. A. (2012). Directional sense: How to find your way around. Boston, MA: Institute for Human Centered Design.

Carroll, J. B. (1963). A model of school learning. Teachers College Record, 64, 723-733.

Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334. Retrieved from http://psych.colorado.edu/~carey/courses/psyc5112/readings/alpha_cronbach.pdf

de Ayala, R. J. (2009). The theory and practice of item response theory. New York, NY: The Guilford Press.

DeMars, C. (2010). Item response theory: Understanding statistics measurement. New York, NY: Oxford University Press, Inc.

Diamond, J. M. (1997). Guns, germs, and steel. New York, NY: W.W. Norton & Company, Inc.

Dziuban, C. D., & Shirkey, E. C. (1974). When is a correlation matrix appropriate for factor analysis? Some decision rules. Psychological Bulletin, 81(6), 358. doi: 10.1037/h0036316

Dziuban, C. D. & Shirkey, E. C. (1993, November). S.D. 50 —A sequential psychometric criterion for the number of common factors. Presented at the Annual Conference for Florida Educational Research Association, Destin, Florida.

Forrester, J. W. (1991). System dynamics and the lessons of 35 years. In K. B. D. Greene

(Ed.), Systems-based approach to policymaking. Norwall, MA: Kluwer Academic.

Hall, S. S. (2004). I, Mercator. In K. Harman (Ed.), You are here: Personal geographies and other maps of the imagination (pp. 15-19). New York, NY: Princeton Architectural Press.

Morville, P. (2005). Ambient findablity: What we find changes who we become. Cambridge: O’Reilly.

Hartigan, J. A., & Wong, M. A.. (1979). Algorithm AS 136: A K-Means Clustering Algorithm. Journal of the Royal Statistical Society. Series C (applied Statistics), 28(1), 100—108. http://doi.org/10.2307/2346830

Hill, B. D. (2011). The sequential Kaiser-Meyer-Olkin procedure as an alternative for determining the number of factors in common-factor analysis: A Monte Carlo simulation (Doctoral dissertation, Oklahoma State University). Retrieved from http://login.ezproxy.net.ucf.edu/login?url=http://search.proquest.com/docview/898980750?accountid=10003

Hedges, L. V. (1981). Distribution theory for Glass’s estimator of effect size and related estimators. Journal of Educational Statistics, 6, 107-128. doi:10.3102/10769986006002107

Hendrickson, A. E., & White, P. O. (1964). Promax: A quick method for rotation to oblique simple structure. British Journal of Statistical Psychology, 17(1), 65-70. Retrieved from http://onlinelibrary.wiley.com/doi/10.1111/j.2044-8317.1964.tb00244.x/pdf

Howlin, C, & Lynch, D. (2014). A framework for the delivery of personalized adaptive content. Web and Open Access to Learning (ICWOAL), 2014 International Conference on, Dubai, pp. 1-5. doi: 10.1109/ICWOAL.2014.7009203

Illich, I. (1972). Deschooling Society. London, England: Marion Boyars.

Johnson, S. (2004). How we got to now: Six innovations that made the modern world. New York: Riverhead.

Johnson, S. (2006). The ghost map: The story of London's most terrifying epidemic, and how it changed science, cities, and the modern world. New York: Riverhead.

Johnson, S. (2010). Where good ideas come from: The natural history of innovation. New York, NY: Riverhead Books.

Kaiser, H. F., & Rice, J. (1974). Little Jiffy, Mark IV. Educational and Psychological Measurement, 34, 111—117.

Lazarsfeld, P. F. (1995). Recent developments in latent structure analysis. Sociometry and the Science of Man, 18(4), 391-403).

Levitt, S. D., & Dubner, S. J. (2014). Think like a freak. New York, NY: HarperCollins.

Levy, J. C. (2013). Adaptive learning and the human condition. Upper Saddle River, NJ: Person Education, Inc.

Lord, F. M., & Novick, M. R. (2008). Statistical theories of mental test scores. USA: Information Age Publishing Inc.

National Counncil of State Board of Nursing. (2016). Retrieved from https://www.ncsbn.org/index.htm

National DETA Research Center. (2014, November 20). DETA grant summary. Retrieved from http://uwm.edu/deta/grant-summary/

Morville, P. (2005). Ambient findability: What we find changes who we become. Sebastopol,

CA: O’Reilly Media, Inc.

Mulaik, S.A. (2009). The foundations of factor analysis, second edition. London, United Kingdom: Chapman and Hall.

Online Learning Consortium. Digital Learning Innovation Award. Retrieved from http://onlinelearningconsortium.org/about/digital-learning-innovation-award/

Pacheco, E. (2014, October 14). Online Learning Consortium awarded adaptive learning grant. Retrieved from: http://onlinelearningconsortium.org/news_item/online-learning-consortium-awarded-adaptive-learning-grant/

Rasch, G. (1998, September). A mathematical theory of objectivity and its consequences for model construction. European Meeting on Statistics, Economics and Management Science.

Schulz, K. (2010). Being wrong: Adventures in the margin of error. New York, NY: HarperCollins.

Senge, P. M., & Roth, G. (1999). The dance of change: The challenges to sustaining momentum in a learning organization (the fifth discipline). New York, NY: Doubleday.

Silver, N. (2012). The signal and the noise: Why so many predictions fail–but some don’t. New York, NY: The Penguin Press.

Turchi, P. (2009). Maps of the imagination: The writer as cartographer. San Antonio, TX: Trinity University Press.

Tyton Partners. (2013). Learning to Adapt: A Case for Accelerating Adaptive Learning in Higher Education. Retrieved from http://tytonpartners.com/tyton-wp/wp-content/uploads/2015/01/Learning-to-Adapt_Case-for-Accelerating-AL-in-Higher-Ed.pdf

Tyton Partners. (2016). Learning to Adapt 2.0: The Evolution of Adaptive Learning in Higher Education. Retrieved from http://tytonpartners.com/tyton-wp/wp-content/uploads/2016/04/Tyton-Partners-Learning-to-Adapt-2.0-FINAL.pdf

Zmuda, A., Curtis, G., & Ullman, D. (2015). Learning personalized: The evolution of the contemporary classroom. San Francisco, CA: John Wiley & Sons, Inc.




DOI: http://dx.doi.org/10.24059/olj.v20i3.972