The PAR Framework Proof of Concept: Initial Findings from a Multi-Institutional Analysis of Federated Postsecondary Data

Authors

  • Philip Ice American Public University System
  • Sebastián Díaz West Virginia University
  • Karen Swan University of Illinois Springfield
  • Melissa Burgess American Public University System
  • Mike Sharkey The Apollo Group (University of Phoenix)
  • Jonathan Sherrill Colorado Community College System
  • Daniel R. Huston Rio Salado College
  • Hae Okimoto University of Hawaii System

DOI:

https://doi.org/10.24059/olj.v16i3.277

Keywords:

retention, progression, completion, online learning, postsecondary, predictive analytics, data repositories

Abstract

Despite high enrollment numbers, postsecondary completion rates have generally remained unchanged for the past 30 years and half of these students do not attain a degree within six years of initial enrollment. Although online learning has provided students with a convenient alternative to face-to-face instruction, there remain significant questions regarding online learning program quality, particularly when considering patterns of student retention and progression. By aggregating student and course data into one dataset, six postsecondary institutions worked together toward determining factors that contribute to retention, progression, and completion of online learners with specific purposes: (1) to reach consensus on a common set of variables among the six institutions that inform student retention, progression and completion; (2) to explore advantages and/or disadvantages of particular statistical and methodological approaches to assessing factors related to retention, progression and completion. In the relatively short timeframe of the study, 33 convenience variables informing retention, progression, and completion were identified and defined by the six participating institutions. This initiative, named the Predictive Analytics Reporting Framework (PAR) and the initial statistical analyses utilized are described in this paper.

Author Biographies

Philip Ice, American Public University System

Phil Ice, Ed.D., is the VP of Research and Development at American Public University System (APUS). His research is focused on the impact of new and emerging technologies on cognition in online learning environments. Work in this area has brought him international recognition in the form of three Sloan-C Effective Practice of the Year Awards (2007, 2009 and 2010 ) and the AliveTek/DLA Innovation on Online Distance Learning Administration Award. Sloan-C has also recognized Phil through awarding a team he lead at APUS with the Gomory Award for Data Driven Quality Improvement in 2009. He has been recognized by industry through membership in Adobe's Education Leaders Group and Adobe's Higher Education Advisory Board, as well as a recipient of the Adobe Higher Education Leaders Impact Award, 2010. Phil's vision for the future of technology in higher education is also demonstrated by his inclusion on the advisory council for the 2011 and 2012 NMC / ELI Horizon Reports.

Sebastián Díaz, West Virginia University

Sebastian Diaz, Ph.D., J.D. serves as Associate Professor and Strategic Planning and Evaluation Consultant for International Student Affairs & Global Services at West Virginia University. His research focuses on developing measures and evaluation methodologies germane to Intellectual Capital and Knowledge Management. Before entering the tenure-track, Sebastian worked as a medical educator at both allopathic and osteopathic institutions.

Karen Swan, University of Illinois Springfield

Karen Swan is the Stukel Professor of Educational Leadership at the University of Illinois Springfield (UIS) and a research associate in the UIS Center for Online Learning, Research and Service. Her research has been in the area of media, technology and learning; she has authored or co-authored over 100 publications, several hypermedia programs and two books on such topics. Her current research interests include online learning, ubiquitous computing and learning analytics. Dr. Swan received the 2006 Sloan Consortium award for Outstanding Achievement in Online Learning by an Individual and in 2010 was inducted into the first class of Sloan-C Fellows. She also received the 2010 Distinguished Alumnus award from Teachers College, Columbia University, her alma mater.

Melissa Burgess, American Public University System

Melissa L. Burgess, Ed.D., is the Director of Research Methodology at American Public University System (APUS). Her research interests focus on both higher education and K-12 sectors, specifically focusing on online curriculum design, implementation, and assessment to include the following platforms and tools: (1) on-demand; (2) learning management systems; (3) multi-user virtual environments; (4) collaborative media; (5) transformed social interactions and digital literacy through gaming platforms; (6) data visualization as a resource for shaping educational research; (7) predictive analytics as a tool for assessing individual student learning; and (8) adaptive or personalized learning environments.

Mike Sharkey, The Apollo Group (University of Phoenix)

Mike Sharkey is the Director of Academic Analytics for the Apollo Group. Mike has been with the Apollo Group (and its flagship institution, the University of Phoenix) since 2002. He has served in a variety of roles all focusing on learning tools and technologies. His current role involves utilizing data analysis and predictive analytics in order to help improve student outcomes. Mike is also a part-time instructor at the university teaching courses in technical communications and business. Prior to joining the Apollo Group, Mike was a manager for Deloitte Consulting in their high-tech manufacturing practice. He has consulted with firms including 3Com, Toshiba, Silicon Graphics, and Ingersoll-Rand. Mike has also held positions with two startup technology firms and an enterprise software applications company. Mike holds a Bachelor’s degree in Mathematics from Lafayette College and an MBA from the University of Arizona.

Jonathan Sherrill, Colorado Community College System

Jonathan Sherrill, MSCIT, is a Data Analyst Professional at the Colorado Community Colleges Online. He combines experience in instruction, computer science, and statistics to tease out retention factors for online students and study the effectiveness of interventions. When he’s not in front of the computer he likes to slog through mud in obstacle course races and buy exotic Groupons.

Daniel R. Huston, Rio Salado College

Daniel R. Huston, M.A., is the Coordinator of Strategic Systems at Rio Salado College. His work and research focuses on actionable analytics, assessment and predictive modeling.

Hae Okimoto, University of Hawaii System

Hae Okimoto, Ph.D., is the Director of Academic Technologies for the University of Hawaii System, responsible for distance learning and the integration of learning technologies in traditional courses, the student information system (Ellucian), and the learning management system (Sakai). Hae began her professional career in student affairs, therefore her research interests have always been in how the application of technology can improve student success and student progress toward their goals. As the public education system in Hawaii, the University of Hawaii System includes 10 campuses and dozens of educational, training and research centers across the Hawaiian Islands.

Published

2012-06-18

Issue

Section

Learning Analytics: Special Issue