Learner perceptions of the feedback process in the online component of a blended course

Anna Moni

doi:10.24059/olj.v28i2.3967

Authors

Anna Moni Deree - The American College of Greece; Education and ICT (E-learning) Program, Open University of Catalunya, 08018 Barcelona, Spain https://orcid.org/0000-0002-6352-8414

DOI:

https://doi.org/10.24059/olj.v28i2.3967

Keywords:

Blended course, higher education, feedback process, survey, learner perceptions

Abstract

Despite extensive research on feedback models, there is still sparse empirical evidence of their validity and application in higher education learning settings, whether online, hybrid, or face-to-face. Understanding how a feedback framework, integrated in the instructional cycle, is perceived by the learners can provide empirical support about its intended purpose and effectiveness. Recent reviews of research on student perceptions of feedback in different learning environments have revealed the need to research feedback as a process with the use of a more solid methodological approach. The aim of the present descriptive survey study is to investigate learners’ perceptions of an established feedback model, a Matrix of Feedback for Learning (Brooks et al., 2019), in the asynchronous online component of an undergraduate blended course. More specifically, the impact of its application on learners’ encounters with three types of feedback (feed-up, feed-back and feed-forward) and three levels of feedback (task, process and self-regulatory) is explored. A 36-item survey, previously piloted and preliminarily validated, was used to explore learners’ perceptions (N=135) of the three feedback types and levels. Approximately 68% of responses showed that students recognized feedback and the possibilities to use and act on feedback as helpful to their learning. This present survey supports a line of research on feedback model validation in online learning environments while offering meaningful insights from the learners that can inform both course design and interventions to support engagement with feedback.

References

Arts, J. G., Jaspers, M., & Joosten-ten Brinke, D. (2021). Enhancing written feedback: The use of a cover sheet influences feedback quality. Cogent Education, 8(1), 1-18. https://doi.org/10.1080/2331186X.2021.1901641.

Ashford, S.J. (1986). Feedback-seeking in individual adaptation: A resource perspective. Academy of Management Journal, 29, 465-487.

Ashford, S.J., Blatt R., & VandeWalle, D. (2003). Reflections on the looking glass: A review of research on feedback-seeking behavior in organizations. Journal of Management, 29, 773-799.

Bacchus, R., Colvin, E., Bronwen Knight, E., & Ritter, L. (2019). When rubrics aren’t enough: Exploring exemplars and student rubric co-construction. Journal of Curriculum and Pedagogy, 17, 1-14. https://doi.org/10.1080/15505170.2019.1627617

Baka, A., Figgou, L., & Triga, V. (2012). 'Neither agree, nor disagree': A critical analysis of the middle answer category in Voting Advice Applications. International Journal of Electronic Governance,

5, 244-263. https://doi.org/10.1504/IJEG.2012.051306

Beltran, J. (2021). Students’ perception on the presence of effective feedback practices in online distance learning. [Master dissertation, Ateneo De Manila University]. Education Resources Information Center. https://doi.org/10.13140/RG.2.2.22342.40009

Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5–31. https://doi.org/10.1007/s11092-008-9068-5

Boud, D., & Molloy, E. (2013). Rethinking models of feedback for learning: The challenge of design. Assessment & Evaluation in Higher Education, 38(6), 698–712. https://doi.org/10.1080/02602938.2012.691462

Brooks, C., Carroll, A., Gillies, R. M., & Hattie, J. (2019). A matrix of feedback for learning. Australian Journal of Teacher Education, 44(4), 14–32. https://doi.org/10.14221/ajte.2018v44n4.2

Carless, D. (2006). Differing perceptions in the feedback process, Studies in Higher Education, 31(2), 219-233. https://doi.org/10.1080/03075070600572132

Carless, D. (2015). Excellence in university assessment: Learning from award-winning practice (1st ed.). Routledge. https://doi.org/10.4324/9781315740621

Carless, D., Chan, K., To, J., Lo, M.t & Barrett, E. (2018). Developing students' capacities for evaluative judgement through analyzing exemplars. In Boud, D., Ajjawi, R., Dawson, P. & Tai, J. (Eds), Developing evaluative judgement in higher education: assessment for knowing and producing quality work. Routledge. https://doi.org/10.4324/9781315109251-12

Carless, D. (2022). Feedback for student learning in higher education. In Tierney, R. Rizvi, F., Ercikan, K. & Smith, G. Eds), International Encyclopedia of Education (4th Ed.). Elsevier. http://dx.doi.org/10.1016/b978-0-12-818630-5.14066-7

Carless, D., & Boud, D. (2018). The development of student feedback literacy: Enabling uptake of feedback. Assessment & Evaluation in Higher Education, 43(8), 1315–1325.

https://doi.org/10.1080/02602938.2018.1463354

Chan, Y.M. (2020). Video instructions as support for beyond classroom learning. Procedia Social and Behavioral Sciences, 9 (2010) 1313–1318. Elsevier

https://doi.org/10.1016/j.sbspro.2010.12.326

Clarke, S. (2008). Active learning through formative assessment. Hodder Education.

Dawson, S., Pardo, A., Kia, F.S. & Panadero, E. (2023). An integrated model of feedback and assessment: From fine grained to holistic programmatic review. In 13th International learning analytics and knowledge conference 2023 (pp.1-6). https://doi.org/10.1145/3576050.3576074

Elder, B. L., & Brooks, D. W. (2008). Simple versus elaborate feedback in a nursing science course. Journal of Science Education and Technology, 17(4), 334–340. https://doi.org/10.1007/s10956-008-9103-9

Esterhazy, R. (2018). Productive feedback practices in higher education. Investigating social and epistemic relations in two undergraduate courses. [Doctoral thesis, University of Oslo]

Esterhazy, R. (2019). Re-conceptualizing feedback through a sociocultural lens. In M. Henderson, R., Ajjawi, D. Boud, & E. Molloy (Eds.), The impact of feedback in higher education. Springer International Publishing.

Evans, C. (2013). Making sense of assessment feedback in higher education. Review of Educational Research, 83(1), 70–120. https://doi.org/10.3102/0034654312474350

Handley, K., Price, M., & Millar, J. (2011). Beyond “doing time”: Investigating the concept of student engagement with feedback. Oxford Review of Education, 37, 543–560. https://doi.org/10.1080/03054985.2011.604951

Harlacher, J. (2016). An educator’s guide to questionnaire development (REL 2016–108). Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Central. https://ies.ed.gov/ncee/rel/regions/central/pdf/CE5.3.2-An-Educators-Guide-to-Questionnaire-Development.pdf

Harris, L. R., Brown, G. T. L., & Harnett, J. A. (2015). Analysis of New Zealand primary and secondary student peer- and self-assessment comments: Applying Hattie and Timperley’s feedback model. Assessment in Education: Principles, Policy & Practice, 22(2), 265-281, https://doi.org/10.1080/0969594X.2014.976541

Hattie, J. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Routledge.

Hattie, J. (2023). Visible learning: The sequel (1st ed.). Taylor and Francis.

Hattie, J., & Anderman, E. (2019). Visible learning guide to student achievement (1st ed.). Taylor & Francis.

Hattie, J., & Clarke, S. (2018). Visible learning: Feedback (1st ed.). Taylor & Francis.

Hattie, J., Gan, M., & Brooks, C. (2017). Instruction based on feedback. In R. E. Mayer & P.A. Alexander (Eds.), Handbook of research on learning and instruction (2nd ed.). (pp.290-324). Routledge.

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77 (1), 81–112. https://doi.org/10.3102/003465430298487

Hawe, E., Lightfoot, U. & Dixon, H. (2017). First-year students working with exemplars: promoting self-efficacy, self-monitoring and self-regulation. Journal of Further and Higher Education. 1-15. https://doi.org/10.1080/0309877X.2017.1349894.

Henderson, M., Ajjawi, R., Boud, D., & Molloy, E. (2019). The impact of feedback in higher education. Palgrave. https://doi.org/10.1007/978-3-030-25112-3

Hoidn, S. (2016). Student-centered learning environments in higher education classrooms. Palgrave Macmillan.

Hounsell, D., McCune, V., Hounsell, J., & Litjens, J. (2008). The quality of guidance and feedback to students. Higher Education Research and Development, 27(1), 55-67.

https://doi.org/10.1080/07294360701658765

Jonsson, A., & Panadero, E. (2018). Facilitating students’ active engagement with feedback. In A. Lipnevich & J. Smith (Eds.), The Cambridge handbook of instructional feedback (pp. 531-553). Cambridge University Press. https://doi.org/10.1017/9781316832134.026

Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2), 254-284. https://doi.org/10.1037/0033-2909.119.2.254

Kulhavy, R. W., & Stock, W. A. (1989). Feedback in written instruction: The place of response certitude. Educational Psychology Review, 1(4), 279–308. https://doi.org/10.1007/BF01320096

Linnenbrink, E. A., & Pintrich, P. R. (2002). Achievement goal theory and affect: An asymmetrical bidirectional model. Educational Psychologist, 37(2), 69–78. https://doi.org/10.1207/S15326985EP3702_2

Lipnevich, A. A., Berg, D., & Smith, J. K. (2016). “Toward a model of student response to feedback.” In Brown, G.T.L., & Harris, L. (Eds.,), Human factors and social conditions in assessment (pp. 169–185). Routledge.

Lipnevich, A. A., McCallen, L. N., & Smith, J. K. (2013). Perceptions of the effectiveness of feedback: School leaders’ perspectives. Assessment Matters, 5, 74–93. https://doi.org/10.18296/am.0109

Lipnevich, A. A., & Panadero, E. (2021). A review of feedback models and theories: Descriptions, definitions, and conclusions. Frontiers in Education, (6), 720195. https://doi.org/10.3389/feduc.2021.720195

Lipnevich, A. A., & Panadero, E. (2022). A review of feedback models and typologies: Towards an integrative model of feedback elements. Educational Research Review, 35, 1-22.

https://doi.org/10.1016/j.edurev.2021.100416

Lipnevich, A. A., & Smith, J. K. (2009). “I really need feedback to learn”: Students’ perspectives on the effectiveness of the differential feedback messages. Educational Assessment, Evaluation and Accountability, 21(4), 347–367. https://doi.org/10.1007/s11092-009-9082-2

Lipnevich, A. A., & Smith, J. K. (Eds.) (2018). The Cambridge handbook of instructional feedback. Cambridge University Press.

Little, T., Dawson, P., Boud, D. & Tai, J. (2023). Can students’ feedback literacy be improved? A scoping review of interventions. Assessment & Evaluation in Higher Education, 1-14. https://doi.org/10.1080/02602938.2023.2177613.

Long, M. H., & Doughty, C. (2009). The handbook of language teaching. Wiley & Blackwell

Lui, A. M., & Andrade, H.L. (2022). Inside the next black box: Examining students’ responses to teacher feedback in a formative assessment context. Frontiers in Education. 7:751549. rhttps://doi.org/10.3389/feduc.2022.751549

Malecka, B., Boud, D., & Carless, D. (2020). Eliciting, processing and enacting feedback: Mechanisms for embedding student feedback literacy within the curriculum. Teaching in Higher Education, 27(7), 908–922. https://doi.org/10.1080/13562517.2020.1754784

McTighe, J., & Willis, J. (2019). Upgrade your teaching. ASCD.

Moni, A. (2023). Enabling students’ uptake of feedback. In A. Visvizi, M. D. Lytras, & H. J. Al-Lail (Eds.), Moving Higher Education Beyond Covid-19: Innovative and technology-enhanced approaches to teaching and learning (Emerald Studies in Higher Education, Innovation and Technology) (pp. 129-145). Emerald Publishing Limited. https://doi.org/10.1108/978-1-80382-517-520231008.

Nicol, D. J., & MacFarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31, 199–218. https://doi.org/10.1080/03075070600572090

Nieminen, J. H., Tai, J., Boud, D., & Henderson, M. (2022). Student agency in feedback: Beyond

the individual. Assessment & Evaluation in Higher Education, 47(1), 95–108. https://doi.org/10.1080/02602938.2021.1887080

Panadero, E., & Lipnevich, A. A. (2023). A review of feedback models and typologies: Towards an integrative model of feedback elements, Educational Research Review, 35, 100416.

https://doi.org/10.1016/j.edurev.2021.100416

Patton, M. (2015). Qualitative research and evaluation methods (4th ed.). Sage.

Pokorny, H., & Pickford, P. (2010). Complexity, cues and relationships: Student perceptions of feedback. Active Learning in Higher Education, 11(1), 21–30. https://doi.org/10.1177/1469787409355872

Online learning consortium course design review scorecard (OLC OSCQR), (2021). https://onlinelearningconsortium.org/consult/oscqr-course-design-review/

Quality matters higher education rubric (QM), (2023). https://www.qualitymatters.org/qa-resources/rubric-standards/higher-ed-rubric

Sadler, D. R. (2010). Feedback: developing student capability in complex appraisal. Assessment & Evaluation in Higher Education, 35 (5): 535-550. https://doi.org/10.1080/02602930903541015

Sadler I., Reimann N., Sambell K. (2022). Feedforward practices: a systematic review of the literature. Assessement and Evaluation in Higher Education, 47(1), 1–16. https://doi.org/10.1080/02602938.2022.2073434

Sharma, R. (2011). A step-by-step guide to students: How to avoid plagiarism. International Journal of Ethics, 7(1), 9-18.

Scherer R., Nilsen T., & Jansen M, (2016). Evaluating individual students’ perceptions of instructional quality: An investigation of their factor structure, measurement invariance, and relations to educational outcomes. Frontiers in Psychology, 7, 110. https://doi.org/10.3389/fpsyg.2016.00110

Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153-189. https://doi.org/10.3102/0034654307313795

Stein, J., & Graham, C. R. (2020). Essentials for blended learning. A standards-based guide (2nd ed.). Routledge.

Van der Kleij, F.M., Lipnevich, A.A. (2021). Student perceptions of assessment feedback: a critical scoping review and call for research. Educational Assessment, Evaluation and Accountability 33, 345–373. https://doi.org/10.1007/s11092-020-09331-x

Vardi, I. (2013). Effectively feeding forward from one written assessment task to the next. Assessment and Evaluation in Higher Education, 38(5), 599–610. https://doi.org/10.1080/02602938.2012.670197

Wang, T., & Li, L. Y. (2011). ‘Tell me what to do’ vs. ‘guide me through it’: Feedback experiences of international doctoral students. Active Learning in Higher Education, 12(2), 101–112. https://doi.org/10.1177/ 1469787411402438

Wiggins, G. (1996). What is a rubric? A dialogue on design and use. In: R. E. Blum and J. A. Arter (Eds), Student Performance assessment in an era of restructuring (pp. 1-13). Association for Supervision and Curriculum

Wiggins, G., & McTighe, J. (2005). Understanding by design. ASCD.

Winstone, N.E. (2022). Characterizing feedback cultures in higher education: An analysis of strategy documents from 134 UK universities. Higher Education, 84, 1107–1125. https://doi.org/10.1007/s10734-022-00818-8

Winstone, N., & Carless, D. (2020). Designing effective feedback processes in higher education: A learning-focused approach (1st ed.). Routledge. https://doi.org/doi.org/10.4324/9781351115940

Winstone, N. E., Nash, R. A., Parker, M., & Rowntree, J. (2017). Supporting learners’ agentic engagement with feedback: a systematic review and a taxonomy of recipience processes. Educational Psychologist, 52, 17–37. https://doi.org/10.1080/00461520.2016.1207538