The Scale of Online Course Anxiety: Assessing College Students’ Anxiety in Online Courses
DOI:
https://doi.org/10.24059/olj.v25i4.2505Keywords:
Online Course Anxiety, Instrument Development, Confirmatory Factor Analysis, Postsecondary InstitutionAbstract
The purpose of this study was to develop an instrument to measure student online course anxiety, a factor that detrimentally affects student learning in the online environment. Based on Keegan’s theoretical framework that identified fundamental differences between online education and traditional education, the instrument of Scale of Online Course Anxiety (SOCA) was developed and tested with a sample of 170 students from a 4-year higher educational institution. The total score and the four subscale scores show high reliability. Confirmatory Factor Analysis exhibited solid goodness of fit between SOCA items and the factor structure hypothesized in previous literature. Evidence of divergent validity shows SOCA differentiates the state anxiety and trait anxiety as expected. Limitations and possible topics for future research are also discussed.
References
Abdous, M. H. (2019). Influence of satisfaction and preparedness on online students’ feelings of anxiety. The Internet and Higher Education, 41, 34–44. https://doi.org/10.1016/j.iheduc.2019.01.001
Adedoyin, O. B., & Soykan, E. (2020). Covid-19 pandemic and online learning: The challenges and opportunities. Interactive Learning Environments, 1–13. https://doi.org/10.1080/10494820.2020.1813180
Adnan, M., & Anwar, K. (2020). Online learning amid the COVID-19 pandemic: Students’ perspectives. Journal of Pedagogical Sociology and Psychology, 2(1), 45–51.
Alibak, M., Talebi, H., & Neshat-Doost, H. T. (2019). Development and validation of a test anxiety inventory for online learning students. Journal of Educators Online, 16(2).
Al-Shboul, M. M., Ahmad, I. S., Nordin, M. S., & Rahman, Z. A. (2013). Foreign language reading anxiety in a Jordanian EFL context: A qualitative study. English Language Teaching, 6(6), 38–56. https://doi.org/10.5539/elt.v6n6p38
Baloglu, M., Deniz, M. E., & Kesici, S. (2011). A descriptive study of individual and cross-cultural differences in statistics anxiety. Learning and Individual Differences, 21(4), 387–391. https://doi.org/10.1016/j.lindif.2011.03.003
Beck, A. T. (1985). Theoretical perspectives on clinical anxiety. In A. H. Tuma & J. D. Maser (Eds.), Anxiety and the anxiety disorders (p. 183–196). Lawrence Erlbaum Associates, Inc.
Beck, A. T., & Clark, D. A. (1997). An information processing model of anxiety: Automatic and strategic processes. Behaviour Research and Therapy, 35(1), 49–58. https://doi.org/10.1016/S0005-7967(96)00069-1
Beck, A. T., & Rush, A. J. (1985). A cognitive model of anxiety formation and anxiety resolution. Issues in Mental Health Nursing, 7(1–4), 349–365. https://doi.org/10.3109/01612848509009461
Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238. https://doi.org/10.1037/0033-2909.107.2.238
Bentler, P. M., & Chou, C. P. (1987). Practical issues in structural modeling. Sociological Methods & Research, 16(1), 78–117. https://doi.org/10.1177/0049124187016001004
Bernard, R., Abrami, P., Lou, Y., & Borokhovski, E. (2004). A methodological morass? How we can improve quantitative research in distance education. Distance Education, 25(2), 175–198. https://doi.org/10.1080/0158791042000262094
Besser, A., Flett, G. L., & Zeigler-Hill, V. (2020). Adaptability to a sudden transition to online learning during the COVID-19 pandemic: Understanding the challenges for students. Scholarship of Teaching and Learning in Psychology. http://dx.doi.org/10.1037/stl0000198
Bolliger, D. U., & Halupa, C. (2012). Student perceptions of satisfaction and anxiety in an online doctoral program. Distance Education, 33(1), 81–98. https://doi.org/10.1080/01587919.2012.667961
Boomsma, A. (1985). Nonconvergence, improper solutions, and starting values in lisrel maximum likelihood estimation. Psychometrika, 50(2), 229–242. https://doi.org/10.1007/BF02294248
Brewer, M. B., & Crano, W. D. (2000). Research design and issues of validity. In H. T. Reis & C. M. Judd (Eds), Handbook of research methods in social and personality psychology (p. 3–16). Cambridge University Press.
Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230–258. https://doi.org/10.1177/0049124192021002005
Cassady, J. C. (2004). The influence of cognitive test anxiety across the learning-testing cycle. Learning and Instruction, 14(6), 569–592. https://doi.org/10.1016/j.learninstruc.2004.09.002
Celik, V., & Yesilyurt, E. (2013). Attitudes to technology, perceived computer self-efficacy and computer anxiety as predictors of computer supported education. Computers and Education, 60(1), 148–158. https://doi.org/10.1016/j.compedu.2012.06.008
Conneely, S., & Hughes, B. M. (2010). Test anxiety and sensitivity to social support among college students: Effects on salivary cortisol. Cognition, Brain, Behavior, 14(4), 295.
Cruise, R. J., Cash, R. W., & Bolton, D. L. (1985). Development and validation of an instrument to measure statistical anxiety [Conference presentation]. Annual Meeting of the American Statistical Association Statistics Education Section, Las Vegas, Nevada, United States.
DeVaney, T. A. (2010). Anxiety and attitude of graduate students in on-campus vs. online statistics courses. Journal of Statistics Education, 18(1). https://doi.org/10.1080/10691898.2010.11889472
Dunn, K. (2014). Why wait? The influence of academic self-regulation, intrinsic motivation, and statistics anxiety on procrastination in online statistics. Innovative Higher Education, 39(1), 33–44. https://doi.org/10.1007/s10755-013-9256-1
Enders, C. K. (2010). Applied missing data analysis. Guilford Press.
Eryilmaz, M., & Cigdemoglu, C. (2019). Individual flipped learning and cooperative flipped learning: Their effects on students’ performance, social, and computer anxiety. Interactive Learning Environments, 27(4), 432–442.
Eysenck, H. J. (1955). A dynamic theory of anxiety and hysteria. The Journal of Mental Science, 101(422), 28–51.
Eysenck, H. J., & Rachman, S. (2013). The causes and cures of neurosis: An introduction to modern behaviour therapy based on learning theory and the principles of conditioning. Routledge.
Garrison, D. R. (2000). Theoretical challenges for distance education in the 21st century: A shift from structural to transactional issues. International Review of Research in Open and Distance Learning, 1(1), 1–17. https://doi.org/10.19173/irrodl.v1i1.2
Gravetter, F. J., & Forzano, L. A. B. (2018). Research methods for the behavioral sciences. Cengage Learning.
Grupe, D. W., & Nitschke, J. B. (2013). Uncertainty and anticipation in anxiety: An integrated neurobiological and psychological perspective. Nature Reviews Neuroscience, 14(7), 488–501. https://doi.org/10.1038/nrn3524
Gwet, K. L. (2014). Handbook of inter-rater reliability: the definitive guide to measuring the extent of agreement among raters: [a handbook for researchers, practitioners, teachers & students]. In Gaithersburg, MD: STATAXIS Publishing Company.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2009). Multivariate data analysis (7th ed.). Prentice Hall.
Hardesty, D. M., & Bearden, W. O. (2004). The use of expert judges in scale development: Implications for improving face validity of measures of unobservable constructs. Journal of Business Research, 57(2), 98–107.
Hauser, R., Paul, R., & Bradley, J. (2012). Computer self-efficacy, anxiety, and learning in online versus face to face medium. Journal of Information Technology Education: Research, 11(1), 141–154. https://doi.org/10.28945/1633
Hilliard, J., Kear, K., Donelan, H., & Heaney, C. (2020). Students’ experiences of anxiety in an assessed, online, collaborative project. Computers & Education, 143, 103675. https://doi.org/10.1016/j.compedu.2019.103675
Hinkin, T. R. (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1(1), 104–121. https://doi.org/10.1177/109442819800100106
Horwitz, E. K., Horwitz, M. B., & Cope, J. (1986). Foreign language classroom anxiety. The Modern Language Journal, 70(2), 125–132. https://www.jstor.org/stable/pdf/327317.pdf
Hoyle, R. H., & Panter, A. T. (1995). Writing about structural equation models. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 158–176). Sage.
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Integrated Postsecondary Educational Data System. (2019). Spring 2017 and spring 2018, fall enrollment component. Digest of Education Statistics. https://nces.ed.gov/programs/digest/d19/tables/dt19_311.15.asp
Keegan, D. J. (1980). On defining distance education. Distance Education, 1(1), 13–36. https://doi.org/10.1080/0158791800010102
Keegan, D. (2013). Foundations of distance education. (3rd ed). Routledge.
Kline, R. B. (2005). Principles and practice of structural equation modeling (2nd ed.). Guilford Press.
Kline, R. B. (2015). Principles and practice of structural equation modeling. Guilford Press.
Koerner, N., & Dugas, M. J. (2006). A cognitive model of generalized anxiety disorder: The role of intolerance of uncertainty. In G. C. Davey & A. Wells (Eds.), Worry and its psychological disorders: Theory, assessment and treatment, (p. 201–216). John Wiley & Sons.
Krusche, A., Cyhlarova, E., & Williams, J. M. G. (2013). Mindfulness online: An evaluation of the feasibility of a web-based mindfulness course for stress, anxiety and depression. BMJ Open, 3(11). https://doi.org/10.1136/bmjopen-2013-003498
Lee, K. (2017). Rethinking the accessibility of online higher education: A historical review. The Internet and Higher Education, 33, 15–23. https://doi.org/10.1016/j.iheduc.2017.01.001
Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382–385. https://doi.org/10.1097/00006199-198611000-00017
Martin, S., & Valdivia, I. M. A. (2017). Students’ feedback beliefs and anxiety in online foreign language oral tasks. International Journal of Educational Technology in Higher Education, 14(1), 1–15. https://doi.org/10.1186/s41239-017-0056-z
Montelpare, W. J., & Williams, A. (2000). Web-based learning: Challenges in using the Internet in the undergraduate curriculum. Education and Information Technologies, 5(2), 85–101. https://doi.org/10.1023/A:1009647400624
Mowrer, O. H. (1939). A stimulus-response analysis of anxiety and its role as a reinforcing agent. Psychological Review, 46(6), 553. https://doi.org/10.1037/h0054288
Moore, J. L., Dickson-Deane, C., & Galyen, K. (2011). E-Learning, online learning, and distance learning environments: Are they the same? Internet and Higher Education, 14(2), 129–135. https://doi.org/10.1016/j.iheduc.2010.10.001
Moore, M. G. (1993). Theory of transactional distance. Theoretical Principles of Distance Education, 1, 22–38.
Moore, M. G., & Kearsley, G. (2011). Distance education: A systems view of online learning. Cengage Learning.
Muthén, L. K., & Muthén, B. O. (2017). Mplus user’s guide. (8th ed.). Muthén & Muthén.
Muris, P., Merckelbach, H., van Brakel, A., Mayer, B., & van Dongen, L. (1998). The Screen for Child Anxiety Related Emotional Disorders (SCARED): Relationship with anxiety and depression in normal children. Personality and Individual Differences, 24(4), 451–456.
National Center for Educational Statistics. (2018a). 2003–04, 2007–08, 2011–12, and 2015-16 National Postsecondary Student Aid Study. Retrieved from https://nces.ed.gov/programs/digest/d18/tables/dt18_311.22.asp
National Center for Educational Statistics. (2018b). 2003–04, 2007–08, 2011–12, and 2015–16 National Postsecondary Student Aid Study. https://nces.ed.gov/programs/digest/d18/tables/dt18_311.32.asp
Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002). Academic emotions in students’ self-regulated learning and achievement: A program of qualitative and quantitative research. Educational Psychologist, 37(2), 91–105. https://doi.org/10.1207/S15326985EP3702_4
Picciano, A. G. (2002). Beyond student perceptions: Issues of interaction, presence, and performance in an online course. Journal of Asynchronous Learning Network, 6(1), 21–40.
Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing and Health, 29(5), 489-497. https://doi.org/10.1002/nur.20147
Rosen, L. D., & Weil, M. M. (1995). Computer availability, computer experience and technophobia among public school teachers. Computers in Human Behavior, 11(1), 9–31. https://doi.org/10.1016/0747-5632(94)00018-D
Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. http://www.jstatsoft.org/v48/i02/
Saadé, R. G., & Kira, D. (2007). Mediating the impact of technology usage on perceived ease of use by anxiety. Computers and Education, 49(4), 1189–1204. https://doi.org/10.1016/j.compedu.2006.01.009
Saddik, B., Hussein, A., Sharif-Askari, F. S., Kheder, W., Temsah, M. H., Koutaich, R. A., Haddad, E. S., Al-Roub, N. M., Marhoon, F. A., Hamid, Q., & Halwani, R. (2020). Increased levels of anxiety among medical and non-medical university students during the COVID-19 pandemic in the United Arab Emirates. Risk Management and Healthcare Policy. 13, 2395–2406. https://doi.org/10.2147/RMHP.S273333
Salkovskis, P. M. (1985). Obsessional-compulsive problems: A cognitive-behavioural analysis. Behaviour Research and Therapy, 23(5), 571–583. https://doi.org/10.1016/0005-7967(85)90105-6
Salkovskis, P. M., & Warwick, H. M. C. (1986). Morbid preoccupations, health anxiety and reassurance: A cognitive-behavioural approach to hypochondriasis. Behaviour Research and Therapy, 24(5), 597–602. https://doi.org/10.1016/0005-7967(86)90041-0
Schafer, J. L. (1999). Multiple imputation: A primer. Statistical Methods in Medical Research, 8(1), 3–15.
Schau, C., Stevens, J., Dauphinee, T. L., & Vecchio, A. Del. (1995). The development and validation of the survey of attitudes toward Statistics. Educational and Psychological Measurement, 55(5), 868–875. https://doi.org/10.1177/0013164495055005022
Sim, J., & Wright, C. C. (2005). The kappa statistic in reliability studies: Use, interpretation, and sample size requirements. Physical Therapy, 85(3), 257–268. https://doi.org/10.1093/ptj/85.3.257
Singh, V., & Thurman, A. (2019). How many ways can we define online learning? A systematic literature review of definitions of online learning (1988–2018). American Journal of Distance Education, 33(4), 289–306. https://doi.org/10.1080/08923647.2019.1663082
Steiger, J. H., & Lind, J. C. (1980, May). Statistically based tests for the number of common factors. [Conference presentation]. Annual Spring Meeting of the Psychometric Society, Iowa City, Iowa, United States.
Stowell, J., & Bennett, D. (2010). Effects of online testing on student exam performance and test anxiety. Journal of Educational Computing Research, 42(2), 161–171. https://doi.org/10.2190/EC.42.2.b
Strauss, A., & Corbin, J. (1998). Basics of qualitative research techniques. Sage.
Spielberger, C. D. (1966). Theory and research on anxiety. Anxiety and Behavior, 1(3). https://doi.org/10.1016/b978-1-4832-3131-0.50006-8
Spielberger, C. D., Gorsuch, R. L., Lushene, R., Vagg, P. R., & Jacobs, G. A. (1983). Manual for the state-trait anxiety inventory. Consulting Psychologists Press.
Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1–10. https://doi.org/10.1007/BF02291170
Unger, S., & Meiran, W. (2020). Student attitudes towards online education during the COVID-19 viral outbreak of 2020: Distance learning in a time of social distance. International Journal of Technology in Education and Science, 4(4), 256–266.
van Buuren S, Groothuis-Oudshoorn K (2011). mice: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45(3), 1–67. https://www.jstatsoft.org/v45/i03/
Wang, C., Zhao, H., & Zhang, H. (2020). Chinese college students have higher anxiety in new semester of online learning during COVID-19: A machine learning approach. Frontiers in Psychology, 11, 3465. https://doi.org/10.3389/fpsyg.2020.587413
Wombacher, K. A., Harris, C. J., Buckner, M. M., Frisby, B., & Limperos, A. M. (2017). The effects of computer-mediated communication anxiety on student perceptions of instructor behaviors, perceived learning, and quiz performance. Communication Education, 66(3), 299–312. https://doi.org/10.1080/03634523.2016.1221511
Yang, Z., Asbury, K., & Griffiths, M. D. (2019). An exploration of problematic smartphone use among Chinese university students: Associations with academic anxiety, academic procrastination, self-regulation and subjective wellbeing. International Journal of Mental Health and Addiction, 17(3), 596–614. https://doi.org/10.1007/s11469-018-9961-1
Young, D. J. (1991). Creating a low‐anxiety classroom environment: What does language anxiety research suggest? The Modern Language Journal, 75(4), 426–437. https://doi.org/10.1111/j.1540-4781.1991.tb05378.x
Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A. R. (2015). Design and implementation content validity study: Development of an instrument for measuring patient-centered communication. Journal of Caring Sciences, 4(2), 165–178.
Downloads
Published
Issue
Section
License
As a condition of publication, the author agrees to apply the Creative Commons – Attribution International 4.0 (CC-BY) License to OLJ articles. See: https://creativecommons.org/licenses/by/4.0/.
This licence allows anyone to reproduce OLJ articles at no cost and without further permission as long as they attribute the author and the journal. This permission includes printing, sharing and other forms of distribution.
Author(s) hold copyright in their work, and retain publishing rights without restrictions
