Adaptive Learning in Psychology: Wayfinding in the Digital Age

Authors

  • Charles Dziuban University of Central Florida
  • Patsy Moskal University of Central Florida
  • Jeffrey Cassisi University of Central Florida
  • Alexis Fawcett University of Central Florida

DOI:

https://doi.org/10.24059/olj.v20i3.972

Keywords:

Adaptive learning, online learning, course design, educational technologies

Abstract

This paper presents the results of a pilot study investigating the use of the Realizeit adaptive learning platform to deliver a fully online General Psychology course across two semesters. Through mutual cooperation, UCF and vendor (CCKF) researchers examined students’ affective, behavioral, and cognitive reactions to the system. Student survey results indicated that students found the system easy to use and were generally positive about their seamless transition to adaptive learning. While the majority of students were successful, learning outcome metrics utilizing Realizeit indices indicated a potential for early prediction of students who are likely to be at risk in this environment. Recommendations are presented for the benefits of cooperative research between users and vendors.

Author Biography

Patsy Moskal, University of Central Florida

Patsy D. Moskal is the Associate Director for the Research Initiative for Teaching Effectiveness at the University of Central Florida (UCF). Since 1996, she has served as the liaison for faculty research of distributed learning and teaching effectiveness at UCF. Patsy specializes in statistics, graphics, program evaluation, and applied data analysis. She has extensive experience in research methods including survey development, interviewing, and conducting focus groups and frequently serves as an evaluation consultant to school districts, and industry and government organizations. She has also served as a co-principal investigator on grants including the National Science Foundation, the Alfred P. Sloan Foundation and Gates-Foundation-funded Next Generation Learning Challenges (NGLC). She frequently serves as a reviewer for conferences and journals and also for Department of Education and National Science Foundation SBIR/STTR proposals. Patsy has co-authored numerous articles and chapters on blended and online learning and frequently presents on these topics. In 2011 she was named a Sloan-C Fellow “In recognition of her groundbreaking work in the assessment of the impact and efficacy of online and blended learning.” Patsy’s most recent book, with co-authors, Dziuban, Picciano and Graham, Conducting research in online and blended learning environments: New pedagogical frontiers was published in 2015.

References

Anderson, R. D., & Rubin, H. (1956). Statistical inference in factor analysis. Proceedings of the Third Berkeley Symposium of Mathematical Statistics and Probability, 5, 111-150.

Association of Public & Land-Grant Universities. Personalizing Learning with Adaptive Courseware. Retrieved from http://www.aplu.org/projects-and-initiatives/personalized-learning-consortium/plc-projects/plc-adaptive-courseware/

Bates, M. J. (1989). The design of browsing and berrypicking techniques for the online search interface. Online Information Review, 13(5), 407-424. Retrieved from http://comminfo.rutgers.edu/~tefko/Courses/e530/Readings/Bates_Berrypicking.pdf

Bill & Melinda Gates Foundation. (2014, November). Early progress: Interim research on personalized learning. Retrieved from http://collegeready.gatesfoundation.org/wp-content/uploads/2015/06/Early-Progress-on-Personalized-Learning-Full-Report.pdf

Bowker, G. C., & Star, S. L. (2000). Sorting things out: Classification and its consequences. Cambridge, MA: The MIT Press.

Boyd, d. (2014). It’s complicated: The social lives of networked teens. Yale University Press.

Brown, J. (2015). Personalizing Post-Secondary Education: An Overview of Adaptive Learning Solutions for Higher Education. Retrieved from http://www.sr.ithaka.org/wp-content/uploads/2015/08/SR_Report_Personalizing_Post_Secondary_Education_31815_0.pdf

Carpman, J. R., & Grant, M. A. (2012). Directional sense: How to find your way around. Boston, MA: Institute for Human Centered Design.

Carroll, J. B. (1963). A model of school learning. Teachers College Record, 64, 723-733.

Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334. Retrieved from http://psych.colorado.edu/~carey/courses/psyc5112/readings/alpha_cronbach.pdf

de Ayala, R. J. (2009). The theory and practice of item response theory. New York, NY: The Guilford Press.

DeMars, C. (2010). Item response theory: Understanding statistics measurement. New York, NY: Oxford University Press, Inc.

Diamond, J. M. (1997). Guns, germs, and steel. New York, NY: W.W. Norton & Company, Inc.

Dziuban, C. D., & Shirkey, E. C. (1974). When is a correlation matrix appropriate for factor analysis? Some decision rules. Psychological Bulletin, 81(6), 358. doi: 10.1037/h0036316

Dziuban, C. D. & Shirkey, E. C. (1993, November). S.D. 50 –A sequential psychometric criterion for the number of common factors. Presented at the Annual Conference for Florida Educational Research Association, Destin, Florida.

Forrester, J. W. (1991). System dynamics and the lessons of 35 years. In K. B. D. Greene

(Ed.), Systems-based approach to policymaking. Norwall, MA: Kluwer Academic.

Hall, S. S. (2004). I, Mercator. In K. Harman (Ed.), You are here: Personal geographies and other maps of the imagination (pp. 15-19). New York, NY: Princeton Architectural Press.

Morville, P. (2005). Ambient findablity: What we find changes who we become. Cambridge: O’Reilly.

Hartigan, J. A., & Wong, M. A.. (1979). Algorithm AS 136: A K-Means Clustering Algorithm. Journal of the Royal Statistical Society. Series C (applied Statistics), 28(1), 100–108. http://doi.org/10.2307/2346830

Hill, B. D. (2011). The sequential Kaiser-Meyer-Olkin procedure as an alternative for determining the number of factors in common-factor analysis: A Monte Carlo simulation (Doctoral dissertation, Oklahoma State University). Retrieved from http://login.ezproxy.net.ucf.edu/login?url=http://search.proquest.com/docview/898980750?accountid=10003

Hedges, L. V. (1981). Distribution theory for Glass’s estimator of effect size and related estimators. Journal of Educational Statistics, 6, 107-128. doi:10.3102/10769986006002107

Hendrickson, A. E., & White, P. O. (1964). Promax: A quick method for rotation to oblique simple structure. British Journal of Statistical Psychology, 17(1), 65-70. Retrieved from http://onlinelibrary.wiley.com/doi/10.1111/j.2044-8317.1964.tb00244.x/pdf

Howlin, C, & Lynch, D. (2014). A framework for the delivery of personalized adaptive content. Web and Open Access to Learning (ICWOAL), 2014 International Conference on, Dubai, pp. 1-5. doi: 10.1109/ICWOAL.2014.7009203

Illich, I. (1972). Deschooling Society. London, England: Marion Boyars.

Johnson, S. (2004). How we got to now: Six innovations that made the modern world. New York: Riverhead.

Johnson, S. (2006). The ghost map: The story of London's most terrifying epidemic, and how it changed science, cities, and the modern world. New York: Riverhead.

Johnson, S. (2010). Where good ideas come from: The natural history of innovation. New York, NY: Riverhead Books.

Kaiser, H. F., & Rice, J. (1974). Little Jiffy, Mark IV. Educational and Psychological Measurement, 34, 111–117.

Lazarsfeld, P. F. (1995). Recent developments in latent structure analysis. Sociometry and the Science of Man, 18(4), 391-403).

Levitt, S. D., & Dubner, S. J. (2014). Think like a freak. New York, NY: HarperCollins.

Levy, J. C. (2013). Adaptive learning and the human condition. Upper Saddle River, NJ: Person Education, Inc.

Lord, F. M., & Novick, M. R. (2008). Statistical theories of mental test scores. USA: Information Age Publishing Inc.

National Counncil of State Board of Nursing. (2016). Retrieved from https://www.ncsbn.org/index.htm

National DETA Research Center. (2014, November 20). DETA grant summary. Retrieved from http://uwm.edu/deta/grant-summary/

Morville, P. (2005). Ambient findability: What we find changes who we become. Sebastopol,

CA: O’Reilly Media, Inc.

Mulaik, S.A. (2009). The foundations of factor analysis, second edition. London, United Kingdom: Chapman and Hall.

Online Learning Consortium. Digital Learning Innovation Award. Retrieved from http://onlinelearningconsortium.org/about/digital-learning-innovation-award/

Pacheco, E. (2014, October 14). Online Learning Consortium awarded adaptive learning grant. Retrieved from: http://onlinelearningconsortium.org/news_item/online-learning-consortium-awarded-adaptive-learning-grant/

Rasch, G. (1998, September). A mathematical theory of objectivity and its consequences for model construction. European Meeting on Statistics, Economics and Management Science.

Schulz, K. (2010). Being wrong: Adventures in the margin of error. New York, NY: HarperCollins.

Senge, P. M., & Roth, G. (1999). The dance of change: The challenges to sustaining momentum in a learning organization (the fifth discipline). New York, NY: Doubleday.

Silver, N. (2012). The signal and the noise: Why so many predictions fail—but some don’t. New York, NY: The Penguin Press.

Turchi, P. (2009). Maps of the imagination: The writer as cartographer. San Antonio, TX: Trinity University Press.

Tyton Partners. (2013). Learning to Adapt: A Case for Accelerating Adaptive Learning in Higher Education. Retrieved from http://tytonpartners.com/tyton-wp/wp-content/uploads/2015/01/Learning-to-Adapt_Case-for-Accelerating-AL-in-Higher-Ed.pdf

Tyton Partners. (2016). Learning to Adapt 2.0: The Evolution of Adaptive Learning in Higher Education. Retrieved from http://tytonpartners.com/tyton-wp/wp-content/uploads/2016/04/Tyton-Partners-Learning-to-Adapt-2.0-FINAL.pdf

Zmuda, A., Curtis, G., & Ullman, D. (2015). Learning personalized: The evolution of the contemporary classroom. San Francisco, CA: John Wiley & Sons, Inc.

Downloads

Published

2016-07-08

Issue

Section

Invited Papers / 2015 OLC Conference Special Issue