Graduate Teacher Education Students Use and Evaluate ChatGPT as an Essay-Writing Tool

Authors

  • Anthony G Picciano City University of New York, Hunter College

DOI:

https://doi.org/10.24059/olj.v28i2.4373

Keywords:

artificial intelligence, generative AI, ChatGPT, graduate teacher education, qualitative research

Abstract

Artificial intelligence (AI) has been evolving since the mid-20th Century when luminaries such as Alan Turing, Herbert Simon and Marvin Minsky began developing rudimentary AI applications. For decades, AI programs remained pretty much in the realm of computer science and experimental game playing.  This changed radically in the 2020s when commercial vendors such as OpenAI  and Google developed generative AI programs (ChatGPT) and (Bard) using large, language modelling (LLM).  As a result, generative AI  is now being considered for use in all walks of life including education.

     In Spring 2023, when ChatGPT burst into the public psyche, twenty-five education students in the author’s graduate seminar were invited to participate in a qualitative study using ChatGPT as a tool for completing an essay assignment.  Fifteen (N=15) accepted the offer. The purpose in doing this was to give students in this seminar the opportunity to use ChatGPT in a supportive environment and to collect qualitative data from them on their experiences using ChatGPT.

     All of these students have master’s degrees in education and experience as teachers in New York City schools. Their training and experience give them keen insights into pedagogical practice making them ideally suited to evaluate ChatGPT as an instructional tool. This article reports on the results of this study.

Keywords:  Artificial Intelligence, AI, ChatGPT,  Graduate Teacher Education, Qualitative Research

Author Biography

Anthony G Picciano, City University of New York, Hunter College

see anthonypicciano.com

References

Ahmad, N., Murugesan, S., & Kshetri, N. (2023). Generative artificial intelligence and the education sector. Computer, 56(6). https://ieeexplore.ieee.org/document/10132034

Bahroun, Z., Anane, C., Ahmed, V., & Zacca, A. (2023). Transforming education: A comprehensive review of generative artificial intelligence in educational settings through bibliometric and content analysis. Sustainability, 15, 12983. https://www.mdpi.com/2071-1050/15/17/12983

Barrot, J. S. (2023). Using ChatGPT for second language writing: Pitfalls and potentials. Assessing Writing, 57, 100745. https://doi.org/10.1016/j.asw.2023.100745

Bašić, Ž., Banovac, A., Kružić, I., & Jerković, I. (2023). Better by you, better than me? Chat GPT-3 as writing assistance in students’ essays. https://www.semanticscholar.org/reader/5c125a2d0ed00185a08c67ee64b9d29250fd5274

Creswell. J. W. (2009). Research design: Qualitative, Quantitative, and mixed methods design (3rd ed.). Sage.

Cohen, Z. (2023, January 17). Can ChatGPT be the key to achieving educational equity? The Core Collaborative. https://thecorecollaborative.com/can-chat-gpt-be-the-key-to-achieving-educational-equity/

de Haas, A. A. (2023, March 3). ChatGPT: A game-changer for dyslexics. News & Views from Davis Dyslexia Association International. https://blog.dyslexia.com/chat-gpt-for-dyslexics/

Deng, X., & Yu, Z. (2023) A meta-analysis and systematic review of the effect of

chatbot technology use in sustainable education. Sustainability, 15, 2940. https://doi.org/10.3390/su15042940

Global Services in Education (2023). AI in education: Embracing a human-centered approach to learning. https://www.gsineducation.com/blog/ai-in-education-embracing-a-human-centered-approach-to-learning

Henane, S. (2023). Teachers: The indispensable human element in the age of AI. Math Bridge Builders Newsletter. https://www.linkedin.com/pulse/teachers-indispensable-human-element-age-ai-samia-henaine/

Hall, M. (2023, February 3). ChatGPT “levels playing field” for people with disabilities. News Nation. https://www.newsnationnow.com/business/tech/chatgpt-levels-playing-field-for-people-with-disabilities/

Huang, W. J., Hew, K. F., & Fryer, L. K. (2022). Chatbots for language learning—Are they really useful? A systematic review of chatbot-supported language learning. Journal of Computer Assisted Learning, 38, 237–257. https://onlinelibrary.wiley.com/doi/epdf/10.1111/jcal.12610

Kimbrough, K., Carpanelli, M., Raghavan, S., Kaura, A., & Erer, M. (2023). Future of work report: AI at work. Linkedin. future-of-work-report-ai-august-2023.pdf (linkedin.com)

Lo, L. (2023). Human meets AI: Helping educators navigate their emotions about technological change. EdSurge. https://www.edsurge.com/news/2023-08-04-human-meets-ai-helping-educators-navigate-their-emotions-about-technological-change

Mao, J., Chen, B., & Liu, J. C. (2023). Generative artificial intelligence in education and its implications for assessment. TechTrends. https://doi.org/10.1007/s11528-023-00911-4

Parra, J. (2024). Social media and artificial intelligence: Critical conversations and where do we go from here. Education Sciences, 13, 845. https://www.mdpi.com/journal/education/special_issues/T3XIO39D6Z

Schiel, J., Bobek, B. L., & Schnieders, J. C. (2023). High school Students’ use and

impressions of AI tools. ACT. https://www.act.org/content/dam/act/secured/documents/High-School-Students-Use-and-Impressions-of-AI-Tools-Accessible.pdf

Sidoti, O., & Gottfried, J. (2023, November 16). About 1 in 5 U.S. teens who’ve heard of ChatGPT have used it for schoolwork. Pew Research Center. https://www.pewresearch.org/short-reads/2023/11/16/about-1-in-5-us-teens-whove-heard-of-chatgpt-have-used-it-for-schoolwork/

Song, C., & Song, Y. (2023). Enhancing academic writing skills and motivation: Assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1260843

Suleyman, M. (2023). The coming wave: Technology, power and the 21st century’s greatest dilemma. Crown Publishing Co.

Tanjga, M. (2023). E-learning and the use of AI: A review of current practices and future directions. Qeios. https://doi.org/10.32388/ap0208

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. https://arxiv.org/pdf/1706.03762.pdf

Walton Family Foundation (2023, March 1). ChatGPT used by teachers more than students, new survey from Walton Family Foundation finds. https://www.waltonfamilyfoundation.org/chatgpt-used-by-teachers-more-than-students-new-survey-from-walton-family-foundation-finds

Yan, D. (2023). Impact of ChatGPT on learners in a L2 writing practicum: An exploratory investigation. Education and Information Technologies. https://doi.org/10.1007/s10639-023-11742-4

Yifan, W., Mengmeng, Y., & Omar, M. K. (2023). “A friend or a foe" Determining factors contributed to the use of ChatGPT among university students. International Journal of Academic Research in Progressive Education and Development 12(2): 2184–2201. https://www.researchgate.net/publication/372829470_A_Friend_or_A_Foe_Determining_Factors_Contributed_to_the_Use_of_ChatGPT_among_University_Students

Zou, M., & Huang, L. (2023). The impact of ChatGPT on L2 writing and expected responses: Voice from doctoral students. Education and Information Technology. https://doi.org/10.1007/s10639-023-12397-x

Downloads

Published

2024-06-01

How to Cite

Picciano, A. G. (2024). Graduate Teacher Education Students Use and Evaluate ChatGPT as an Essay-Writing Tool. Online Learning, 28(2). https://doi.org/10.24059/olj.v28i2.4373

Issue

Section

Online and Blended Learning in the Age of Generative AI