The Scale of Online Course Anxiety: Assessing College Students’ Anxiety in Online Courses

Xinyang Li, William Lan, Amanda Williams

Abstract


The purpose of this study was to develop an instrument to measure student online course anxiety, a factor that detrimentally affects student learning in the online environment. Based on Keegan’s theoretical framework that identified fundamental differences between online education and traditional education, the instrument of Scale of Online Course Anxiety (SOCA) was developed and tested with a sample of 170 students from a 4-year higher educational institution. The total score and the four subscale scores show high reliability. Confirmatory Factor Analysis exhibited solid goodness of fit between SOCA items and the factor structure hypothesized in previous literature. Evidence of divergent validity shows SOCA differentiates the state anxiety and trait anxiety as expected. Limitations and possible topics for future research are also discussed.

 


Keywords


Online Course Anxiety; Instrument Development; Confirmatory Factor Analysis; Postsecondary Institution

Full Text:

PDF

References


Abdous, M. H. (2019). Influence of satisfaction and preparedness on online students’ feelings of anxiety. The Internet and Higher Education, 41, 34–44. https://doi.org/10.1016/j.iheduc.2019.01.001

Adedoyin, O. B., & Soykan, E. (2020). Covid-19 pandemic and online learning: The challenges and opportunities. Interactive Learning Environments, 1–13. https://doi.org/10.1080/10494820.2020.1813180

Adnan, M., & Anwar, K. (2020). Online learning amid the COVID-19 pandemic: Students’ perspectives. Journal of Pedagogical Sociology and Psychology, 2(1), 45–51.

Alibak, M., Talebi, H., & Neshat-Doost, H. T. (2019). Development and validation of a test anxiety inventory for online learning students. Journal of Educators Online, 16(2).

Al-Shboul, M. M., Ahmad, I. S., Nordin, M. S., & Rahman, Z. A. (2013). Foreign language reading anxiety in a Jordanian EFL context: A qualitative study. English Language Teaching, 6(6), 38–56. https://doi.org/10.5539/elt.v6n6p38

Baloglu, M., Deniz, M. E., & Kesici, S. (2011). A descriptive study of individual and cross-cultural differences in statistics anxiety. Learning and Individual Differences, 21(4), 387–391. https://doi.org/10.1016/j.lindif.2011.03.003

Beck, A. T. (1985). Theoretical perspectives on clinical anxiety. In A. H. Tuma & J. D. Maser (Eds.), Anxiety and the anxiety disorders (p. 183–196). Lawrence Erlbaum Associates, Inc.

Beck, A. T., & Clark, D. A. (1997). An information processing model of anxiety: Automatic and strategic processes. Behaviour Research and Therapy, 35(1), 49–58. https://doi.org/10.1016/S0005-7967(96)00069-1

Beck, A. T., & Rush, A. J. (1985). A cognitive model of anxiety formation and anxiety resolution. Issues in Mental Health Nursing, 7(1–4), 349–365. https://doi.org/10.3109/01612848509009461

Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238. https://doi.org/10.1037/0033-2909.107.2.238

Bentler, P. M., & Chou, C. P. (1987). Practical issues in structural modeling. Sociological Methods & Research, 16(1), 78–117. https://doi.org/10.1177/0049124187016001004

Bernard, R., Abrami, P., Lou, Y., & Borokhovski, E. (2004). A methodological morass? How we can improve quantitative research in distance education. Distance Education, 25(2), 175–198. https://doi.org/10.1080/0158791042000262094

Besser, A., Flett, G. L., & Zeigler-Hill, V. (2020). Adaptability to a sudden transition to online learning during the COVID-19 pandemic: Understanding the challenges for students. Scholarship of Teaching and Learning in Psychology. http://dx.doi.org/10.1037/stl0000198

Bolliger, D. U., & Halupa, C. (2012). Student perceptions of satisfaction and anxiety in an online doctoral program. Distance Education, 33(1), 81–98. https://doi.org/10.1080/01587919.2012.667961

Boomsma, A. (1985). Nonconvergence, improper solutions, and starting values in lisrel maximum likelihood estimation. Psychometrika, 50(2), 229–242. https://doi.org/10.1007/BF02294248

Brewer, M. B., & Crano, W. D. (2000). Research design and issues of validity. In H. T. Reis & C. M. Judd (Eds), Handbook of research methods in social and personality psychology (p. 3–16). Cambridge University Press.

Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230–258. https://doi.org/10.1177/0049124192021002005

Cassady, J. C. (2004). The influence of cognitive test anxiety across the learning-testing cycle. Learning and Instruction, 14(6), 569–592. https://doi.org/10.1016/j.learninstruc.2004.09.002

Celik, V., & Yesilyurt, E. (2013). Attitudes to technology, perceived computer self-efficacy and computer anxiety as predictors of computer supported education. Computers and Education, 60(1), 148–158. https://doi.org/10.1016/j.compedu.2012.06.008

Conneely, S., & Hughes, B. M. (2010). Test anxiety and sensitivity to social support among college students: Effects on salivary cortisol. Cognition, Brain, Behavior, 14(4), 295.

Cruise, R. J., Cash, R. W., & Bolton, D. L. (1985). Development and validation of an instrument to measure statistical anxiety [Conference presentation]. Annual Meeting of the American Statistical Association Statistics Education Section, Las Vegas, Nevada, United States.

DeVaney, T. A. (2010). Anxiety and attitude of graduate students in on-campus vs. online statistics courses. Journal of Statistics Education, 18(1). https://doi.org/10.1080/10691898.2010.11889472

Dunn, K. (2014). Why wait? The influence of academic self-regulation, intrinsic motivation, and statistics anxiety on procrastination in online statistics. Innovative Higher Education, 39(1), 33–44. https://doi.org/10.1007/s10755-013-9256-1

Enders, C. K. (2010). Applied missing data analysis. Guilford Press.

Eryilmaz, M., & Cigdemoglu, C. (2019). Individual flipped learning and cooperative flipped learning: Their effects on students’ performance, social, and computer anxiety. Interactive Learning Environments, 27(4), 432–442.

Eysenck, H. J. (1955). A dynamic theory of anxiety and hysteria. The Journal of Mental Science, 101(422), 28–51.

Eysenck, H. J., & Rachman, S. (2013). The causes and cures of neurosis: An introduction to modern behaviour therapy based on learning theory and the principles of conditioning. Routledge.

Garrison, D. R. (2000). Theoretical challenges for distance education in the 21st century: A shift from structural to transactional issues. International Review of Research in Open and Distance Learning, 1(1), 1–17. https://doi.org/10.19173/irrodl.v1i1.2

Gravetter, F. J., & Forzano, L. A. B. (2018). Research methods for the behavioral sciences. Cengage Learning.

Grupe, D. W., & Nitschke, J. B. (2013). Uncertainty and anticipation in anxiety: An integrated neurobiological and psychological perspective. Nature Reviews Neuroscience, 14(7), 488–501. https://doi.org/10.1038/nrn3524

Gwet, K. L. (2014). Handbook of inter-rater reliability: the definitive guide to measuring the extent of agreement among raters: [a handbook for researchers, practitioners, teachers & students]. In Gaithersburg, MD: STATAXIS Publishing Company.

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2009). Multivariate data analysis (7th ed.). Prentice Hall.

Hardesty, D. M., & Bearden, W. O. (2004). The use of expert judges in scale development: Implications for improving face validity of measures of unobservable constructs. Journal of Business Research, 57(2), 98–107.

Hauser, R., Paul, R., & Bradley, J. (2012). Computer self-efficacy, anxiety, and learning in online versus face to face medium. Journal of Information Technology Education: Research, 11(1), 141–154. https://doi.org/10.28945/1633

Hilliard, J., Kear, K., Donelan, H., & Heaney, C. (2020). Students’ experiences of anxiety in an assessed, online, collaborative project. Computers & Education, 143, 103675. https://doi.org/10.1016/j.compedu.2019.103675

Hinkin, T. R. (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1(1), 104–121. https://doi.org/10.1177/109442819800100106

Horwitz, E. K., Horwitz, M. B., & Cope, J. (1986). Foreign language classroom anxiety. The Modern Language Journal, 70(2), 125–132. https://www.jstor.org/stable/pdf/327317.pdf

Hoyle, R. H., & Panter, A. T. (1995). Writing about structural equation models. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 158–176). Sage.

Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

Integrated Postsecondary Educational Data System. (2019). Spring 2017 and spring 2018, fall enrollment component. Digest of Education Statistics. https://nces.ed.gov/programs/digest/d19/tables/dt19_311.15.asp

Keegan, D. J. (1980). On defining distance education. Distance Education, 1(1), 13–36. https://doi.org/10.1080/0158791800010102

Keegan, D. (2013). Foundations of distance education. (3rd ed). Routledge.

Kline, R. B. (2005). Principles and practice of structural equation modeling (2nd ed.). Guilford Press.

Kline, R. B. (2015). Principles and practice of structural equation modeling. Guilford Press.

Koerner, N., & Dugas, M. J. (2006). A cognitive model of generalized anxiety disorder: The role of intolerance of uncertainty. In G. C. Davey & A. Wells (Eds.), Worry and its psychological disorders: Theory, assessment and treatment, (p. 201–216). John Wiley & Sons.

Krusche, A., Cyhlarova, E., & Williams, J. M. G. (2013). Mindfulness online: An evaluation of the feasibility of a web-based mindfulness course for stress, anxiety and depression. BMJ Open, 3(11). https://doi.org/10.1136/bmjopen-2013-003498

Lee, K. (2017). Rethinking the accessibility of online higher education: A historical review. The Internet and Higher Education, 33, 15–23. https://doi.org/10.1016/j.iheduc.2017.01.001

Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382–385. https://doi.org/10.1097/00006199-198611000-00017

Martin, S., & Valdivia, I. M. A. (2017). Students’ feedback beliefs and anxiety in online foreign language oral tasks. International Journal of Educational Technology in Higher Education, 14(1), 1–15. https://doi.org/10.1186/s41239-017-0056-z

Montelpare, W. J., & Williams, A. (2000). Web-based learning: Challenges in using the Internet in the undergraduate curriculum. Education and Information Technologies, 5(2), 85–101. https://doi.org/10.1023/A:1009647400624

Mowrer, O. H. (1939). A stimulus-response analysis of anxiety and its role as a reinforcing agent. Psychological Review, 46(6), 553. https://doi.org/10.1037/h0054288

Moore, J. L., Dickson-Deane, C., & Galyen, K. (2011). E-Learning, online learning, and distance learning environments: Are they the same? Internet and Higher Education, 14(2), 129–135. https://doi.org/10.1016/j.iheduc.2010.10.001

Moore, M. G. (1993). Theory of transactional distance. Theoretical Principles of Distance Education, 1, 22–38.

Moore, M. G., & Kearsley, G. (2011). Distance education: A systems view of online learning. Cengage Learning.

Muthén, L. K., & Muthén, B. O. (2017). Mplus user’s guide. (8th ed.). Muthén & Muthén.

Muris, P., Merckelbach, H., van Brakel, A., Mayer, B., & van Dongen, L. (1998). The Screen for Child Anxiety Related Emotional Disorders (SCARED): Relationship with anxiety and depression in normal children. Personality and Individual Differences, 24(4), 451–456.

National Center for Educational Statistics. (2018a). 2003–04, 2007–08, 2011–12, and 2015-16 National Postsecondary Student Aid Study. Retrieved from https://nces.ed.gov/programs/digest/d18/tables/dt18_311.22.asp

National Center for Educational Statistics. (2018b). 2003–04, 2007–08, 2011–12, and 2015–16 National Postsecondary Student Aid Study. https://nces.ed.gov/programs/digest/d18/tables/dt18_311.32.asp

Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002). Academic emotions in students’ self-regulated learning and achievement: A program of qualitative and quantitative research. Educational Psychologist, 37(2), 91–105. https://doi.org/10.1207/S15326985EP3702_4

Picciano, A. G. (2002). Beyond student perceptions: Issues of interaction, presence, and performance in an online course. Journal of Asynchronous Learning Network, 6(1), 21–40.

Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing and Health, 29(5), 489-497. https://doi.org/10.1002/nur.20147

Rosen, L. D., & Weil, M. M. (1995). Computer availability, computer experience and technophobia among public school teachers. Computers in Human Behavior, 11(1), 9–31. https://doi.org/10.1016/0747-5632(94)00018-D

Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. http://www.jstatsoft.org/v48/i02/

Saadé, R. G., & Kira, D. (2007). Mediating the impact of technology usage on perceived ease of use by anxiety. Computers and Education, 49(4), 1189–1204. https://doi.org/10.1016/j.compedu.2006.01.009

Saddik, B., Hussein, A., Sharif-Askari, F. S., Kheder, W., Temsah, M. H., Koutaich, R. A., Haddad, E. S., Al-Roub, N. M., Marhoon, F. A., Hamid, Q., & Halwani, R. (2020). Increased levels of anxiety among medical and non-medical university students during the COVID-19 pandemic in the United Arab Emirates. Risk Management and Healthcare Policy. 13, 2395–2406. https://doi.org/10.2147/RMHP.S273333

Salkovskis, P. M. (1985). Obsessional-compulsive problems: A cognitive-behavioural analysis. Behaviour Research and Therapy, 23(5), 571–583. https://doi.org/10.1016/0005-7967(85)90105-6

Salkovskis, P. M., & Warwick, H. M. C. (1986). Morbid preoccupations, health anxiety and reassurance: A cognitive-behavioural approach to hypochondriasis. Behaviour Research and Therapy, 24(5), 597–602. https://doi.org/10.1016/0005-7967(86)90041-0

Schafer, J. L. (1999). Multiple imputation: A primer. Statistical Methods in Medical Research, 8(1), 3–15.

Schau, C., Stevens, J., Dauphinee, T. L., & Vecchio, A. Del. (1995). The development and validation of the survey of attitudes toward Statistics. Educational and Psychological Measurement, 55(5), 868–875. https://doi.org/10.1177/0013164495055005022

Sim, J., & Wright, C. C. (2005). The kappa statistic in reliability studies: Use, interpretation, and sample size requirements. Physical Therapy, 85(3), 257–268. https://doi.org/10.1093/ptj/85.3.257

Singh, V., & Thurman, A. (2019). How many ways can we define online learning? A systematic literature review of definitions of online learning (1988–2018). American Journal of Distance Education, 33(4), 289–306. https://doi.org/10.1080/08923647.2019.1663082

Steiger, J. H., & Lind, J. C. (1980, May). Statistically based tests for the number of common factors. [Conference presentation]. Annual Spring Meeting of the Psychometric Society, Iowa City, Iowa, United States.

Stowell, J., & Bennett, D. (2010). Effects of online testing on student exam performance and test anxiety. Journal of Educational Computing Research, 42(2), 161–171. https://doi.org/10.2190/EC.42.2.b

Strauss, A., & Corbin, J. (1998). Basics of qualitative research techniques. Sage.

Spielberger, C. D. (1966). Theory and research on anxiety. Anxiety and Behavior, 1(3). https://doi.org/10.1016/b978-1-4832-3131-0.50006-8

Spielberger, C. D., Gorsuch, R. L., Lushene, R., Vagg, P. R., & Jacobs, G. A. (1983). Manual for the state-trait anxiety inventory. Consulting Psychologists Press.

Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1–10. https://doi.org/10.1007/BF02291170

Unger, S., & Meiran, W. (2020). Student attitudes towards online education during the COVID-19 viral outbreak of 2020: Distance learning in a time of social distance. International Journal of Technology in Education and Science, 4(4), 256–266.

van Buuren S, Groothuis-Oudshoorn K (2011). mice: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45(3), 1–67. https://www.jstatsoft.org/v45/i03/

Wang, C., Zhao, H., & Zhang, H. (2020). Chinese college students have higher anxiety in new semester of online learning during COVID-19: A machine learning approach. Frontiers in Psychology, 11, 3465. https://doi.org/10.3389/fpsyg.2020.587413

Wombacher, K. A., Harris, C. J., Buckner, M. M., Frisby, B., & Limperos, A. M. (2017). The effects of computer-mediated communication anxiety on student perceptions of instructor behaviors, perceived learning, and quiz performance. Communication Education, 66(3), 299–312. https://doi.org/10.1080/03634523.2016.1221511

Yang, Z., Asbury, K., & Griffiths, M. D. (2019). An exploration of problematic smartphone use among Chinese university students: Associations with academic anxiety, academic procrastination, self-regulation and subjective wellbeing. International Journal of Mental Health and Addiction, 17(3), 596–614. https://doi.org/10.1007/s11469-018-9961-1

Young, D. J. (1991). Creating a low‐anxiety classroom environment: What does language anxiety research suggest? The Modern Language Journal, 75(4), 426–437. https://doi.org/10.1111/j.1540-4781.1991.tb05378.x

Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A. R. (2015). Design and implementation content validity study: Development of an instrument for measuring patient-centered communication. Journal of Caring Sciences, 4(2), 165–178.




DOI: http://dx.doi.org/10.24059/olj.v25i4.2505



Copyright (c) 2021 Xinyang Li, Amanda Williams, William Lan

License URL: https://creativecommons.org/licenses/by/4.0/