Are They Literate on ChatGPT? University Language Students’ Perceptions, Benefits and Challenges in Higher Education Learning

Authors

DOI:

https://doi.org/10.24059/olj.v28i3.4599

Keywords:

ChatGPT, university students, learning, benefits and challenges, higher education

Abstract

Despite the promising potential of artificial intelligence (AI) tools like ChatGPT for enhancing the learning experience, its integration as an educational tool in higher education poses disruptions that could affect students. This study explored university language students’ usage, awareness, readiness, concerns, and perceived benefits and challenges of using ChatGPT in higher education learning. The study used an explanatory sequential mixed- method design, combining online surveys and semi-structured interviews. A total of 355 language students from five private higher education institutions in Indonesia were recruited using purposive sampling. These participants were asked to complete the closed-ended questionnaire, and nine participants were selected for interview sessions. The data was analyzed using descriptive analysis and thematic analysis. The findings reveal that a majority of students had been using ChatGPT for their learning purposes, especially for writing assignments. The findings also highlight that university language students had a high awareness, readiness, and concerns about using ChatGPT for their academic activities. Additionally, university language students acknowledged the potential benefits of ChatGPT in terms of writing support, personalized learning, increased productivity, brainstorming for generating ideas, and additional resources. However, they also identified the challenges of using ChatGPT, including inaccuracy, lack of critical thinking, plagiarism and AI detection, and technical problems. These findings provide a nuanced understanding of how university language students use and perceive ChatGPT for learning purposes, highlighting the need for support and guidance from higher education providers in the responsible use of AI in academic settings.

Author Biographies

Sri Sarwanti, Universitas Tidar

Dr. Sri Sarwanti, M.Hum. is a Senior Lecturer and also the the Head of Language and Microteaching Laboratory in Tidar University.  She obtained her doctorate from State University of Yogyakarta, Indonesia.  She has published her research many journals, Cakrawala Pendidikan, Journal of Language and Language Teaching, Transformatika, Metathesis, and Journal of Academic Research and language Teaching. His research interests lay in the area of policy and planning, literacy education, applied linguistics, curriculum and instruction, and language teaching-learning. He is on the editorial boards of Metathesis and Journal of language and language Teaching Online. She may be contacted at srisarwanti@untidar.ac.id.

Laily Rahmatika, Universitas Muhammadiyah Surakarta

Laily Rahmatika is a teacher of Indonesian language as foreign speakers. She graduated from Universitas Muhammadiyah Surakarta. Her research interest includes critical discourse analysis, sociolinguistics, pragmatics, language teaching and learning, technology integration in education, and BIPA (Bahasa Indonesia bagi Penutur Asing or Indonesian Language for Foreign Speakers). Orcid: https://orcid.org/0000-0002-4294-5315. E-mail: lailyrahmatika20@gmail.com

M. Monjurul Islam, Universiti Pendidikan Sultan Idris

M Monjurul Islam, PhD is a senior lecturer at Universiti Pendidikan Sultan Idris.  He obtained his PhD from the University of Malaya, Malaysia.  He has published his research many journals Current Issues in Language Planning, Discourse: Studies in the Cultural Politics of Education, The Journal of Asia TEFL, Smart Learning Environment and The Qualitative Report. His research interests lay in the area of policy and planning, literacy education, applied linguistics, curriculum and instruction, and language teaching-learning. He is on the editorial boards of Journal of Educators Online, Education and Information Technologies, Humanities and Social Sciences Communications and Heliyon. He may be contacted at monj0603@gmail.com. ORCID ID https://orcid.org/0000-0002-0036-7174

References

Abbas, M., Jam, F. A., & Khan, T. I. (2024). Is it harmful or helpful? Examining the causes and consequences of generative AI usage among university students. International Journal of Educational Technology in Higher Education, 21(1), 10–32. https://doi.org/10.1186/s41239-024-00444-7

Acosta-Enriquez, B. G., Arbulú Ballesteros, M. A., Huamaní Jordan, O., López Roca, C., & Saavedra Tirado, K. (2024). Analysis of college students' attitudes toward the use of ChatGPT in their academic activities: effect of intent to use, verification of information and responsible use. BMC psychology, 12(1), 255–273. https://doi.org/10.1186/s40359-024-01764-z

Anderson, N., Belavy, D. L., Perle, S. M., Hendricks, S., Hespanhol, L., Verhagen, E., & Memon, A. R. (2023). AI did not write this manuscript, or did it? Can we trick the AI text detector into generated texts? The potential future of ChatGPT and AI in sports & exercise medicine manuscript generation. BMJ Open Sport & Exercise Medicine, 9(1), e001568. https://doi.org/10.1136/bmjsem-2023-001568

Aruleba, K., Sanusi, I. T., Obaido, G., & Ogbuokiri, B. (2023). Integrating ChatGPT in a computer science course: Students perceptions and suggestions. arXiv preprint arXiv:2402.01640, 1–13. https://doi.org/10.48550/arXiv.2402.01640

Assad, A. (2024). Exploring the use of ChatGPT among media students in Egypt: Opportunities and challenges. Online Journal of Communication and Media Technologies, 14(2), e202424. https://doi.org/10.30935/ojcmt/14416

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa

Chan, C. K. Y. (2023). A comprehensive AI policy education framework for university teaching and learning. International Journal of Educational Technology in Higher Education, 20(1), 38–62. https://doi.org/10.1186/s41239-023-00408-3

Chan, C. K. Y., & Hu, W. (2023). Students’ voices on generative AI: Perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education, 20(1), 43–60. https://doi.org/10.1186/s41239-023-00411-8

Chan, C. K. Y., & Lee, K. K. (2023). The AI generation gap: Are Gen Z students more interested in adopting generative AI such as ChatGPT in teaching and learning than their Gen X and millennial generation teachers? Smart Learning Environments, 10(1), 60–83. https://doi.org/10.1186/s40561-023-00269-3

Creswell, J. W. (2014). Research design: Qualitative, quantitative and mixed method approaches (4th ed.). Sage Publications.

Creswell, J. W., & Clark, V. L. P. (2017). Designing and conducting mixed methods research (3rd ed.). Sage Publications.

Das, S. R., & Madhusudan, J. V. (2024). Perceptions of higher education students towards ChatGPT usage. International Journal of Technology in Education, 7(1), 86–106.

Elbanna, S., & Armstrong, L. (2024). Exploring the integration of ChatGPT in education: Adapting for the future. Management & Sustainability: An Arab Review, 3(1), 16–29. https://doi.org/10.1108/MSAR-03-2023-0016

Fuchs, K. (2023). Exploring the opportunities and challenges of NLP models in higher education: Is ChatGPT a blessing or a curse? Frontiers in Education, 8, 1166682. https://doi.org/10.3389/feduc.2023.1166682

Fuchs, K., & Aguilos, V. (2023). Integrating artificial intelligence in higher education: Empirical insights from students about using ChatGPT. International Journal of Information and Education Technology, 13(9), 1365–1371. http://dx.doi.org/10.18178/ijiet

Graf, A., & Bernardi, R. E. (2023). ChatGPT in research: balancing ethics, transparency and advancement. Neuroscience, 515, 71–73. https://doi.org/10.1016/j.neuroscience.2023.02.008

Güven, G. Ö., Yilmaz, Ş., & Inceoğlu, F. (2024). Determining medical students' anxiety and readiness levels about artificial intelligence. Heliyon, 10(4), e25894 https://doi.org/10.1016/j.heliyon.2024.e25894

Hartanto, A. Y., & Rohmah, F. N. (2024). Makin marak siswa pakai AI untuk mengerjakan tugas [The rise of students using AI to do assignments]. tirto.id. https://tirto.id/penggunaan-ai-di-dunia-pendidikan-makin-marak-dan-merata-gZax

Huallpa, J. J. (2023). Exploring the ethical considerations of using Chat GPT in university education. Periodicals of Engineering and Natural Sciences, 11(4), 105–115. http://dx.doi.org/10.21533/pen.v11i4.3770

Iku-Silan, A., Hwang, G. J., & Chen, C. H. (2023). Decision-guided chatbots and cognitive styles in interdisciplinary learning. Computers & Education, 201, 104812. https://doi.org/10.1016/j.compedu.2023.104812

Johnston, H., Wells, R. F., Shanks, E. M., Boey, T., & Parsons, B. N. (2024). Student perspectives on the use of generative artificial intelligence technologies in higher education. International Journal for Educational Integrity, 20(1), 2–21. https://doi.org/10.1007/s40979-024-00149-4

Kayali, B., Yavuz, M., Balat, Ş., & Çalişan, M. (2023). Investigation of student experiences with ChatGPT-supported online learning applications in higher education. Australasian Journal of Educational Technology, 39(5), 20–39. https://doi.org/10.14742/ajet.8915

Kelly, A., Sullivan, M., & Strampel, K. (2023). Generative artificial intelligence: University student awareness, experience, and confidence in use across disciplines. Journal of University Teaching & Learning Practice, 20(6). https://doi.org/10.53761/1.20.6.12

Lin, X., Luterbach, K., Gregory, K. H., & Sconyers, S. E. (2024). A case study investigating the utilization of ChatGPT in online discussions. Online Learning, 28(2), 1–23. https://doi.org/10.24059/olj.v28i2.4407

Lowe, A., Norris, A. C., Farris, J. A., & Babbage, D. R. (2018). Quantifying thematic saturation in qualitative data analysis. Field Methods, 30(3), 191–207. https://doi.org/10.1177/1525822X17749386

Maulana, M. J., & Darmawan, C. (2023). Penggunaan ChatGPT dalam pendidikan berdasarkan perspektif etika akademik [The use of ChatGPT in education based on the perspective of academic ethics]. Bhineka Tunggal Ika; Kajian Teori dan Praktik Pendidikan PKN, 10(1), 58–66.

Merriam, S. B., & Tisdell, E. J. (2015). Qualitative research: A guide to design and implementation (4th ed.). Jossey-Bass.

Michel-Villarreal, R., Vilalta-Perdomo, E., Salinas-Navarro, D. E., Thierry-Aguilera, R., & Gerardou, F. S. (2023). Challenges and opportunities of generative AI for higher education as explained by ChatGPT. Education Sciences, 13(9), 856. https://doi.org/10.3390/educsci13090856

Nikolopoulou, K. (2024). Generative artificial intelligence in higher education: Exploring ways of harnessing pedagogical practices with the assistance of ChatGPT. International Journal of Changes in Education, 1(2), 103–111. https://doi.org/10.47852/bonviewIJCE42022489

Obenza, B., Salvahan, A., Rios, A. N., Solo, A., Alburo, R. A., & Gabila, R. J. (2024). University students' perception and use of ChatGPT: Generative artificial intelligence (AI) in higher education. International Journal of Human Computing Studies, 5(12), 5–18.

Pallant, J. (2016). SPSS survival manual: A step-by-step guide to data analysis using IBM SPSS. Allen & Unwin.

Rasul, T., Nair, S., Kalendra, D., Robin, M., de Oliveira Santini, F., Ladeira, W. J., ... & Heathcote, L. (2023). The role of ChatGPT in higher education: Benefits, challenges, and future research directions. Journal of Applied Learning and Teaching, 6(1), 41–56 https://doi.org/10.37074/jalt.2023.6.1.29

Rogers, M. P., Hillberg, H. M., & Groves, C. L. (2024). Attitudes towards the use (and misuse) of ChatGPT: A preliminary study. In Proceedings of the 55th ACM Technical Symposium on Computer Science Education, 1147–1153. https://doi.org/10.1145/3626252.3630784

Saldaña, J. (2015). The coding manual for qualitative researchers (3rd ed). Sage Publications.

Sallam, M. (2023). ChatGPT utility in healthcare education, research, and practice: Systematic review on the promising perspectives and valid concerns. Healthcare, 11(6), 887. https://doi.org/10.3390/healthcare11060887

Singh, H., Tayarani-Najaran, M. H., & Yaqoob, M. (2023). Exploring computer science students’ perception of ChatGPT in higher education: A descriptive and correlation study. Education Sciences, 13(9), 924. https://doi.org/10.3390/educsci13090924

Suryono, M. N. R. N., Bhagaskara, R. E., Pratama, M. A., & Pratama, A. (2023). Analisis pengaruh ChatGPT terhadap produktivitas mahasiswa [Analyze the effect of ChatGPT on student productivity]. In Prosiding Seminar Nasional Teknologi Dan Sistem Informasi, 3(1), 364–373.

Swindell, A., Greeley, L., Farag, A., & Verdone, B. (2024). Against artificial education: Towards an ethical framework for generative artificial intelligence (AI) use in education. Online Learning, 28(2), 7–27. https://doi.org/10.24059/olj.v28i2.4438

van Dis, E. A. M., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023). ChatGPT: Five priorities for research. Nature, 614, 224–226. https://doi.org/10.1038/d41586-023-00288-7

Vargas-Murillo, A. R., de la Asuncion, I. N. M., & de Jesús Guevara-Soto, F. (2023). Challenges and opportunities of AI-assisted learning: A systematic literature review on the impact of ChatGPT usage in higher education. International Journal of Learning, Teaching and Educational Research, 22(7), 122–135.

Xu, X., Su, Y., Zhang, Y., Wu, Y., & Xu, X. (2024). Understanding learners’ perceptions of ChatGPT: A thematic analysis of peer interviews among undergraduates and postgraduates in China. Heliyon, 10(4): e26239. https://doi.org/10.1016%2Fj.heliyon.2024.e26239

Younis, B. K. (2024). Examining students' self-regulation skills, confidence to learn online, and perception of satisfaction and usefulness of online classes in three suggested online learning environments that integrates ChatGPT. Online Learning, 28(2), 1–23. https://doi.org/10.24059/olj.v28i2.4397

Zhai, C., Wibowo, S., & Li, L. D. (2024). The effects of over-reliance on AI dialogue systems on students' cognitive abilities: a systematic review. Smart Learning Environments, 11(1), 28–64. https://doi.org/10.1186/s40561-024-00316-7

Zhang, C., Zhang, C., Li, C., Qiao, Y., Zheng, S., Dam, S. K., ... & Hong, C. S. (2023). One small step for generative ai, one giant leap for agi: A complete survey on chatgpt in aigc era. arXiv preprint arXiv:2304.06488, 1–29. https://doi.org/10.48550/arXiv.2304.06488

Zhang, S., Zhao, X., Zhou, T., & Kim, J. H. (2024). Do you have AI dependency? The roles of academic self-efficacy, academic stress, and performance expectations on problematic AI usage behavior. International Journal of Educational Technology in Higher Education, 21(1), 34–47. https://doi.org/10.1186/s41239-024-00467-0

Zhou, X., Zhang, J., & Chan, C. (2024). Unveiling students’ experiences and perceptions of Artificial Intelligence usage in higher education. Journal of University Teaching and Learning Practice, 21(6). https://doi.org/10.53761/xzjprb23

Downloads

Published

2024-09-01

How to Cite

Sarwanti, S., Sariasih, Y., Rahmatika, L., Islam, M. M., & Riantina, E. M. (2024). Are They Literate on ChatGPT? University Language Students’ Perceptions, Benefits and Challenges in Higher Education Learning. Online Learning, 28(3). https://doi.org/10.24059/olj.v28i3.4599

Issue

Vol. 28 No. 3 (2024): Online Learning

Section

Online and Blended Learning in the Age of Generative AI

License

Copyright (c) 2024 Isthifa Kemal , Yanti Sariasih, Sri Sarwanti, Laily Rahmatika, M. Monjurul Islam

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

As a condition of publication, the author agrees to apply the Creative Commons – Attribution International 4.0 (CC-BY) License to OLJ articles. See: https://creativecommons.org/licenses/by/4.0/.

This licence allows anyone to reproduce OLJ articles at no cost and without further permission as long as they attribute the author and the journal. This permission includes printing, sharing and other forms of distribution.

Author(s) hold copyright in their work, and retain publishing rights without restrictions

Most read articles by the same author(s)