Self-Reflection and Math Performance in an Online Learning Environment
DOI:
https://doi.org/10.24059/olj.v21i4.1249Keywords:
self-reflection, learning mathematics, online learning, K-12Abstract
According to recent reports, K-12 full-time virtual school students have shown lower performance in math than their counterparts in regular brick-and-mortar schools. However, research is lacking in what kind of programmatic interventions virtual schools might be particularly well-suited to provide to improve math learning. Engaging students in self-reflection is a potentially promising pedagogical approach for supporting math learning. Nonetheless, it is unclear how models for math learning in regular classrooms translate in an online environment. The purpose of this study was to (a) analyze rich assessment data from virtual schools to explore the association between self-reflection and math performance, (b) compare the patterns found in student self-reflection across elementary, middle, and high school levels, and (c) examine whether providing opportunities for self-reflection had positive impact on learning in a virtual learning environment. In this study, the self-reflection assessments were developed and administered multiple times within several math courses during the 2014-2015 school year. These assessments included 4-7 questions that ask students to reflect on their understanding of the knowledge and skills they learned in the preceding lessons and units. Using these assessments, multiple constructs and indicators were measured, which include confidence about the topic knowledge/understanding, general feelings towards math, accuracy of self-judgment against actual test performance, and frequency of self-reflection. Through a series of three retrospective studies, data were collected from full-time virtual school students who took three math courses (one elementary, one middle, and one high school math course) in eight virtual schools in the United States during the 2013-2014 and 2014-2015 school years. The results showed that (a) participation in self-reflection varied by grade, unit test performance level, and course/topic difficulty; (b) more frequent participation in self-reflection and higher self-confidence level were associated with higher final course performance; and (c) self-reflection, as was implemented here, showed limited impact for more difficult topics, higher grade courses, and higher performing students. Implications for future research are provided.
References
Adams, R. J., Wilson, M., & Wu, M. (1997). Multilevel item response models: An approach to errors in variables regression. Journal of Educational and Behavioral Statistics, 22, 47-76.
Adams, R. J., & Wu, M. L. (2007). The mixed-coefficients multinomial logit model. A generalized form of the Rasch model. In M. von Davier & C. H. Carstensen (Eds.): Multivariate and mixture distribution Rasch models: Extensions and applications (pp. 55-76). New York: Springer.
Ahn, J. (2016). Enrollment and Achievement in Ohio's Virtual Charter Schools. Thomas B. Fordham Institute.
Atkins, S., & Murphy, K. (1993). Reflection: A review of the literature. Journal of Advanced Nursing, 18, 1188-1192.
Authors. (2016).
Bandura, A. (1997). Self-efficacy: The exercise of control. Macmillan.
Barbour, M.K. (2015). Section II: Limited Evidence, Little Guidance: Research to Guide Virtual School Policy. In A. Molnar (ed.). Virtual Schools in the U.S. 2015: Politics, Performance, Policy, and Research Evidence. Boulder, CO: National Education Policy Center.
Bixler, B. A. (2008). The effects of scaffolding student’s problem-solving process via question prompts on problem solving and intrinsic motivation in an online learning environment. PhD dissertation, The Pennsylvania State University, State College, Pennsylvania.
Bol, L., & Hacker, D. J. (2001). A comparison of the effects of practice tests and traditional review on performance and calibration. The Journal of experimental education, 69(2), 133-151.
Boud, D., Keogh, R., Walker, D. (1985). What is reflection in learning? In D. Boud, R. Keogh, & D. Walker (Eds.), Reflection: Turning experience into learning (pp. 7-17): London: Kogan.
Campillo, M., Zimmerman, B. J., & Hudesman, J. (1999). Enhancing academic study skill, self-efficacy, and achievement through self-regulatory training. In annual meeting of the American Psychological Association, Boston, MA.
Chen, P., & Zimmerman, B. (2007). A cross-national comparison study on the accuracy of self-efficacy beliefs of middle-school mathematics students. The Journal of Experimental Education, 75(3), 221-244.
Chi, M. T., Bassok, M., Lewis, M. W., Reimann, P., & Glaser, R. (1989). Self‐explanations: How students study and use examples in learning to solve problems. Cognitive science, 13(2), 145-182.
Dabbagh, N., & Kitsantas, A. (2012). Personal Learning Environments, social media, and self-regulated learning: A natural formula for connecting formal and informal learning. The Internet and higher education, 15(1), 3-8.
Davis, E. A. (2003). Prompting middle school science students for productive reflection: Generic and directed prompts. Journal of the Learning Sciences, 12(1), 91-142.
Dewey, J. (1933). How we think: A restatement of the relation of reflective thinking to the educative process. Boston; New York, D. C. Heath and Co.
Ertmer, P. A., Newby, T. J., & MacDougall, M. (1996). Students’ responses and approaches to case-based instruction: The role of reflective self-regulation. American Educational Research Journal, 33(3), 719-752.
Fisher, M., & Baird, D. E. (2005). Online learning design that fosters student support, self-regulation, and retention. Campus-Wide Information Systems, 22(2), 88-107.
Ho, D. E., Imai, K., King, G., Stuart, E. A. (2011). MatchIt: Nonparametric Preprocessing for Parametric Causal Inference. Journal of Statistical Software, Vol. 42, No. 8, pp. 1-28. URL http://www.jstatsoft.org/v42/i08/
Horn, M. (2016, August 25). Harnessing Benefits, Reining in Downsides of Virtual Schools. Forbes. Retrieved from http://www.forbes.com/sites/michaelhorn/2016/08/25/harnessing-benefits-reigning-in-downsides-of-virtual-schools
Huerta, L., Shafer, S. R., Barbour, M.K., Miron, G., Gulosino, C. (2015). Virtual Schools in the U.S. 2015: Politics, Performance, Policy, and Research Evidence. Boulder, CO: National Education Policy Center.
Jurdak, M., & Abu Zein, R. (1998). The effect of journal writing on achievement in and attitudes toward mathematics. School Science and Mathematics, 98(8), 412-419.
Kiefer, T., Robitzsch, A. & Wu, M. (2016). TAM: Test Analysis Modules. R package version 1.995-0. https://CRAN.R-project.org/package=TAM
Kitsantas, A., Reiser, B., & Doster, J. (2004). Goal setting, cues, and evaluation during acquisition of procedural skills: Empowering students’ learning during independent practice. Journal of Experimental Education, 72(4), 269-287.
Klassen, R. (2002). A question of calibration: A review of the self-efficacy beliefs of students with learning disabilities. Learning Disability Quarterly, 25(2), 88-102.
Labuhn, A. S., Zimmerman, B. J., & Hasselhorn, M. (2010). Enhancing students’ self-regulation and mathematics performance: The influence of feedback and self-evaluative standards. Metacognition and Learning,5(2), 173-194.
Lai, T. L. (2006). The effect of using peer discussion, learning journals and question prompts to support reflection in a distance learning environment. Doctoral dissertation, The Pennsylvania State University.
Lai, T. L., & Land, S. M. (2009). Supporting reflection in online learning environments. In Educational media and technology yearbook (pp. 141-154). Springer US.
Lin, X., Hmelo, C., Kinzer, C. K., & Secules, T. J. (1999). Designing technology to support reflection. Educational Technology Research and Development, 47(3), 43-62.
May, D. B., & Etkina, E. (2002). College physics students’ epistemological self-reflection and its relationship to conceptual learning. American Journal of Physics, 70(12), 1249-1258.
Means, B., Toyama, Y., Murphy, R., Bakia, M., & Jones, K. (2009). Evaluation of evidence-based practices in online learning: A meta-analysis and review of online learning studies. US Department of Education.
Mezirow, J. (1990). Fostering critical reflection in adulthood: A guide to transformative and emancipatory learning (1st ed.). San Francisco: Jossey-Bass Publishers.
Meel, D. E. (1999). Email dialogue journals in a college calculus classroom: A look at the implementation and benefits. Journal of Computers in Mathematics and Science Teaching, 18(4), 387-414.
Miron, G. & Gulosino, C. (2016). Virtual Schools Report 2016: Directory and Performance Review. Boulder, CO: National Education Policy Center.
Moon, J. A. (1999). Reflection in learning and professional development: Theory and practice. London: Kogan Page.
Pajares, F. (1996). Self-efficacy beliefs in academic settings. Review of educational research, 66(4), 543-578.
Perels, F., Dignath, C., & Schmitz, B. (2009). Is it possible to improve mathematical achievement by means of self-regulation strategies? Evaluation of an intervention in regular math classes. European Journal of Psychology of Education, 24(1), 17-31.
Piaget, J. (2001). Studies in reflecting abstraction. Hove, UK: Psychology Press.
Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 41-55.
Rubin, D. B. (1973). The use of matched sampling and regression adjustment to remove bias in observational studies. Biometrics, 185-203.
Schön, D. A. (1983). The reflective practitioner: How professionals think in action. New York: Basic Books.
Schoenfeld, A. H. (1985). Metacognitive and epistemological issues in mathematical understanding. Teaching and learning mathematical problem solving: Multiple research perspectives, 361-380.
Schunk, D. H. (1996). Goal and self-evaluative influences during children’s cognitive skill learning. American educational research journal, 33(2), 359-382.
Schunk, D. H., & Ertmer, P. A. (1999). Self-regulatory processes during computer skill acquisition: Goal and self-evaluative influences. Journal of Educational Psychology, 91(2), 251.
Shute, V. J. (2007). Focus on formative feedback. ETS Research Report Series, 2007(1).
Smith, M. K. (2001, 2011). ‘Donald Schön: learning, reflection and change’, the encyclopedia of informal education. [Retrieved from www.infed.org/thinkers/et-schon.htm.].
Woodworth, J. L., Raymond, M. E., Chirbas, K., Gonzalez, M., Negassi, Y., Snow, W., & Van Donge, C. (2015). Online charter school study. Stanford, CA: Center for Research on Education Outcomes.
Zimmerman, B. J. (2000). Attainment of self-regulation: A social cognitive perspective. In M. Boekaerts, P. Pintrich, & M. Zeidner (Eds.), Self-regulation: Theory, research, and applications (pp. 13–39). Orlando, FL: Academic Press.
Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory into practice, 41(2), 64-70.
Zimmerman, B. J., Moylan, A., Hudesman, J., White, N., & Flugman, B. (2011). Enhancing self-reflection and mathematics achievement of at-risk urban technical college students. Psychological Test and Assessment Modeling, 53(1), 141-160.
Downloads
Published
Issue
Section
License
As a condition of publication, the author agrees to apply the Creative Commons – Attribution International 4.0 (CC-BY) License to OLJ articles. See: https://creativecommons.org/licenses/by/4.0/.
This licence allows anyone to reproduce OLJ articles at no cost and without further permission as long as they attribute the author and the journal. This permission includes printing, sharing and other forms of distribution.
Author(s) hold copyright in their work, and retain publishing rights without restrictions
