Generative AI Generating Buzz: Volume, Engagement, and Content of Initial Reactions to ChatGPT in Discussions Across Education-Related Subreddits
DOI:
https://doi.org/10.24059/olj.v28i2.4434Keywords:
ChatGPT, GenAI, Reddit, affinity spaces, technology reaction, learning analyticsAbstract
The emergence of generative artificial intelligence (GenAI) has ignited intense debates regarding its potential benefits and detriments for education. Despite such widespread discussions, insights into GenAI's impact have often been limited to anecdotal evidence and a narrow scope of educational stakeholders. To understand the broader response to GenAI tools in education, we collected and analyzed public online discussions of ChatGPT, a leading GenAI tool, in the first four months following the tool’s release. We collected 345 posts and 6,463 comments about ChatGPT from 25 education-focused subreddits. We analyzed the volume, engagement, and content of ChatGPT discussions through descriptive statistics and natural language processing techniques. Findings show relatively low volume of ChatGPT discussions, unevenly spread across education-related subreddits—with the majority of the discussions occurring in two subreddits while six subreddits did not have any discussions. Despite this, the level of engagement within ChatGPT posts was substantial; for instance, a ChatGPT post hosted a median of 15 comments, and these comments were lengthy, indicating rich engagement rather than superficial. The content of ChatGPT discussions across the six largest education-related subreddits differed in the degree of analytical thinking and emotional tone even while sharing a predominant focus on students and AI. Diverse reactions to and perspectives on GenAI—observed from varied levels of volume, engagement, and content of ChatGPT across educational-related subreddits—highlights how diverse educational stakeholders reacted to GenAI differently, offering insights into how to explore, analyze, comprehend the spread and adoption of technological innovation in education.
References
Bahroun, Z., Anane, C., Ahmed, V., & Zacca, A. (2023). Transforming education: A comprehensive review of generative artificial intelligence in educational settings through bibliometric and content analysis. Sustainability, 15(17), 12983. https://doi.org/10.3390/su151712983
Bennett, E. (2014). Learning from the early adopters: Developing the digital practitioner. Research in Learning Technology, 22, 21453. http://doi.org/10.3402/rlt.v22.21453
Boehm, P. J., Justice, M., & Weeks, S. (2009). Promoting academic integrity in higher education. The Community College Enterprise, 15(1), 45–61. https://home.schoolcraft.edu/cce/search-archives/289
Bozkurt, A., & Sharma, R. C. (2023). Generative AI and prompt engineering: The art of whispering to let the genie out of the algorithmic world. Asian Journal of Distance Education, 18(2). https://doi.org/10.5281/zenodo.817494
Bozkurt, A. (2023). Generative artificial intelligence (AI) powered conversational educational agents: The inevitable paradigm shift. Asian Journal of Distance Education, 18(1), 198–204. https://doi.org/10.5281/zenodo.7716416
Carpenter, J., McDade, C., & Childers, S. (2018, March). Advice seeking and giving in the Reddit r/Teachers online space. In Proceedings of the society for information technology & teacher education international conference (pp. 2207–2215). Association for the Advancement of Computing in Education (AACE). https://www.learntechlib.org/p/182831/
Carpenter, J. P., & Staudt Willet, K. B. (2021). The teachers’ lounge and the debate hall: Anonymous self-directed learning in two teaching-related subreddits. Teaching and Teacher Education, 104, 103371. https://doi.org/10.1016/j.tate.2021.103371
Carpenter, J., Tani, T., Morrison, S., & Keane, J. (2022). Exploring the landscape of educator professional activity on Twitter: An analysis of 16 education-related Twitter hashtags. Professional Development in Education, 48(5), 784–805. https://doi.org/10.1080/19415257.2020.1752287
Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A review. IEEE Access, 8, 75264–75278. https://doi.org/10.1109/ACCESS.2020.2988510
Chen, X., Xie, H., Zou, D., & Hwang, G. J. (2020). Application and theory gaps during the rise of artificial intelligence in education. Computers and Education: Artificial Intelligence, 1, 100002. https://doi.org/10.1016/j.caeai.2020.100002
Chiu, T. K. (2023). The impact of Generative AI (GenAI) on practices, policies and research direction in education: A case of ChatGPT and Midjourney. Interactive Learning Environments, 1–17. https://doi.org/10.1080/10494820.2023.2253861
Clark, R. (2023a, July 20). Juniors. Can we chat(GPT)? Georgia Tech Admission Blog. https://sites.gatech.edu/admission-blog/2023/07/20/juniors-can-we-chatgpt/
Clark, R. (2023b, July 27). Seniors, can we ChatGPT? Georgia Tech Admission Blog. https://sites.gatech.edu/admission-blog/2023/07/27/seniors-can-we-chatgpt/
Cotton, D. R., Cotton, P. A., & Shipway, J. R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 1–12. https://doi.org/10.1080/14703297.2023.2190148
Cuban, L. (1986). Teachers and machines: The classroom of technology since 1920. Teachers College Press.
Cuban, L. (2003). Oversold and underused: Computers in the classroom. Harvard University Press.
Dai, W., Lin, J., Jin, H., Li, T., Tsai, Y. S., Gašević, D., & Chen, G. (2023, July). Can large language models provide feedback to students? A case study on ChatGPT. In 2023 IEEE International Conference on Advanced Learning Technologies (ICALT) (pp. 323–325). IEEE. https://doi.org/10.1109/ICALT58122.2023.00100
Davies, R. S., West, R. E. (2014). Technology integration in schools. In J. Spector, M. Merrill, J. Elen, & M. Bishop (Eds.), Handbook of research on educational communications and technology (pp. 841–853). Springer. https://doi.org/10.1007/978-1-4614-3185-5_68
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–340. https://doi.org/10.2307/249008
ElSayary, A. (2023). An investigation of teachers' perceptions of using ChatGPT as a supporting tool for teaching and learning in the digital era. Journal of Computer Assisted Learning. https://doi.org/10.1111/jcal.12926
Frei-Landau, R., Muchnik-Rozanov, Y., & Avidov-Ungar, O. (2022). Using Rogers' diffusion of innovation theory to conceptualize the mobile-learning adoption process in teacher education in the COVID-19 era. Education and Information Technologies, 27(9), 12811–12838. https://doi.org/10.1007/s10639-022-11148-8
Gee, J. P. (2004). Situated language and learning: A critique of traditional schooling. Routledge.
Greenhalgh, S. P., & Koehler, M. J. (2017). 28 days later: Twitter hashtags as “just in time” teacher professional development. TechTrends, 61, 273–281. https://doi.org/10.1007/s11528-016-0142-4
Greenhalgh, S. P., Rosenberg, J. M., Staudt Willet, K. B., Koehler, M. J., & Akcaoglu, M. (2020). Identifying multiple learning spaces within a single teacher-focused Twitter hashtag. Computers & Education, 148, 103809. https://doi.org/10.1016/j.compedu.2020.103809
Habibi, A., Muhaimin, M., Danibao, B. K., Wibowo, Y. G., Wahyuni, S., & Octavia, A. (2023). ChatGPT in higher education learning: Acceptance and use. Computers and Education: Artificial Intelligence, 5, 100190. https://doi.org/10.1016/j.caeai.2023.100190
Hagendorff, T. (2020). The ethics of AI ethics: An evaluation of guidelines. Minds and Machines, 30(1), 99–120. https://doi.org/10.1007/s11023-020-09517-8
Haythornthwaite, C., Kumar, P., Gruzd, A., Gilbert, S., Esteve del Valle, M., & Paulin, D. (2018). Learning in the wild: Coding for learning and practice on Reddit. Learning, Media and Technology, 43(3), 219–235. https://doi.org/10.1080/17439884.2018.1498356
Henninger, N. M. (2020). “I gave someone a good death”: Anonymity in a community of Reddit’s medical professionals. Convergence: The International Journal of Research into New Media Technologies, 26(5–6), 1391–1410. https://doi.org/10.1177/1354856519847329
Huang, A. Y., Lu, O. H., & Yang, S. J. (2023). Effects of artificial intelligence-enabled personalized recommendations on learners’ learning engagement, motivation, and outcomes in a flipped classroom. Computers & Education, 194, 104684. https://doi.org/10.1016/j.compedu.2022.104684
Hung, J., & Chen, J. (2023). The benefits, risks and regulation of using ChatGPT in Chinese academia: A content analysis. Social Sciences, 12(7), 380. https://doi.org/10.3390/socsci12070380
Hwang, G. J., Xie, H., Wah, B. W., & Gašević, D. (2020). Vision, challenges, roles and research issues of Artificial Intelligence in Education. Computers and Education: Artificial Intelligence, 1, 100001. https://doi.org/10.1016/j.caeai.2020.100001
Iqbal, N., Ahmed, H., & Azhar , K. A. (2022). Exploring teachers’ attitudes towards using Chatgpt. Global Journal for Management and Administrative Sciences, 3(4), 97–111. https://doi.org/10.46568/gjmas.v3i4.163
Kalolo, J. F. (2019). Digital revolution and its impact on education systems in developing countries. Education and Information Technologies, 24, 345–358. https://doi.org/10.1007/s10639-018-9778-3
Kelly, S. M. (2023, January 26). ChatGPT passes exams from law and business schools. CNN. https://www.cnn.com/2023/01/26/tech/chatgpt-passes-exams/index.html
Lee, R. M., Fielding, N. G., & Blank, G. (2017). Online research methods in the social sciences: An editorial introduction. In N. G. Fielding, R. M. Lee, & G. Blank (Eds.), The SAGE handbook of online research methods (2nd ed.). SAGE.
Lee, Y. H., Hsieh, Y. C., & Hsu, C. N. (2011). Adding innovation diffusion theory to the technology acceptance model: Supporting employees’ intentions to use E-learning systems. Journal of Educational Technology & Society, 14(4), 124–137.
Lincoln, Y. S., & Guba, E. G. 1985. Naturalistic inquiry. SAGE.
Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410
Mailizar, M., Almanthari, A., & Maulina, S. (2021). Examining teachers’ behavioral intention to use E-learning in teaching of mathematics: An extended TAM model. Contemporary Educational Technology, 13(2), ep298. https://doi.org/10.30935/cedtech/9709
Mandal, R., & Mete, J. (2023). Teachers’ and students’ perception towards integration of artificial intelligence in school curriculum: A survey. International Journal of Multidisciplinary Educational Research, 12(7), 5.
Martin, D. (2023, June 12). The ChatGPT-fueled AI gold rush: How solution providers are cashing in. CRN. https://www.crn.com/news/software/the-chatgpt-fueled-ai-gold-rush-how-solution-providers-are-cashing-in
Massanari, A. (2017). #Gamergate and the Fappening: How Reddit's algorithm, governance, and culture support toxic technocultures. New Media & Society, 19(3), 329–346. https://doi.org/10.1177/1461444815608807
Moore, S., Hedayati-Mehdiabadi, A., Law, V., & Kang, S. P. (2024). The change we work: Professional agency and ethics for emerging AI technologies. TechTrends, 68, 27–36. https://doi.org/10.1007/s11528-023-00895-1
Moura, A., & Carvalho, A. A. A. (2024, February). Teachers’ perceptions of the use of artificial intelligence in the classroom. In International Conference on Lifelong Education and Leadership for All (ICLEL 2023) (pp. 140–150). Atlantis Press.
Muljana, P. S., Staudt Willet, K. B., & Luo, T. (2022). Adjusting sails for changing winds: Exploring Reddit use for professional purposes in higher education. Journal of Computing in Higher Education, 34(3), 679–707. https://doi.org/10.1007/s12528-022-09317-2
Na, H., & Staudt Willet, K. B. (2022). Affinity and anonymity benefitting early career teachers in the r/Teachers subreddit. Journal of Research on Technology in Education. https://doi.org/10.1080/15391523.2022.2150727
Na, H., Staudt Willet, K. B., Shi, H., Hur, J., He, D., & Kim, C. (2024). Initial discussions of ChatGPT in education-related subreddits. Journal of Research on Technology in Education. https://doi.org/10.1080/15391523.2024.2338091
OpenAI. (2022, November 30). Introducing ChatGPT. https://openai.com/blog/chatgpt/
OpenAI. (2023, March 14). GPT-4. https://openai.com/research/gpt-4
Oravec, J. A. (2023). Artificial intelligence implications for academic cheating: Expanding the dimensions of responsible human-AI collaboration with ChatGPT. Journal of Interactive Learning Research, 34(2), 213–237. https://www.learntechlib.org/primary/p/222340/
Pennebaker, J. W., Booth, R. J., Boyd, R. L., & Francis, M. E. (2015a). Linguistic inquiry and word count (Version LIWC2015) [Computer software]. Pennebaker Conglomerates. https://www.liwc.app/
Pennebaker, J. W., Booth, R. J., Boyd, R. L., & Francis, M. E. (2015b). Linguistic inquiry and word count: LIWC2015 operator’s manual. Pennebaker Conglomerates. https://www.liwc.app/static/documents/LIWC2015%20Manual%20-%20Operation.pdf
Perault, M. (2023). Section 230 won't protect ChatGPT. Journal of Free Speech Law, 3, 363–374. https://heinonline.org/HOL/P?h=hein.journals/jfspl3&i=363
Picciano, A. G. (2019). Artificial intelligence and the academy’s loss of purpose. Online Learning, 23(3), 270–284. https://doi.org/10.24059/olj.v23i3.2023
Pichai, S., & Hassabis, D. (2023, December 6). Introducing Gemini: Our largest and most capable AI model. https://blog.google/technology/ai/google-gemini-ai/
Pokrivcakova, S. (2019). Preparing teachers for the application of AI-powered technologies in foreign language education. Journal of Language and Cultural Education, 7(3), 135–153. https://doi.org/10.2478/jolace-2019-0025
Python Software Foundation. (2024). Python [Computer software]. https://python.org/
RedditInc. (2024). Homepage - Reddit. https://www.redditinc.com/
R Core Team. (2024). R: A language and environment for statistical computing (Version 4.3.3) [Computer software]. https://www.R-project.org/
Richard, B., Sivo, S. A., Ford, R. C., Murphy, J., Boote, D. N., Witta, E., & Orlowski, M. (2021). A guide to conducting online focus groups via Reddit. International Journal of Qualitative Methods, 20. https://doi.org/10.1177/16094069211012217
Robinson, B., Czauderna, A., & von Gillern, S. (2023). “I think I get why y’all do this now”: Reckoning with Elden Ring’s difficulty in an online affinity space. Games and Culture, 15554120231203134. https://doi.org/10.1177/15554120231203134
Rogers, M.E. (2003) Diffusion of Innovations (5th ed.). Free Pass.
Similarweb. (2024, May 17). Reddit.com competitive analysis, marketing mix and traffic. Similarweb. https://www.similarweb.com/website/reddit.com
Simmonds, R. (2023, September 1). Reddit statistics for 2023: Demographic, usage & traffic data. Foundation Marketing. https://foundationinc.co/lab/reddit-statistics/
Staudt Willet, K. B., & Carpenter, J. P. (2020). Teachers on Reddit? Exploring contributions and interactions in four teaching-related subreddits. Journal of Research on Technology in Education, 52(2), 216–233. https://doi.org/10.1080/15391523.2020.1722978
Staudt Willet, K. B., & Carpenter, J. P. (2021). A tale of two subreddits: Change and continuity in teaching-related online spaces. British Journal of Educational Technology, 52(2), 714–733. https://doi.org/10.1111/bjet.13051
Stokel-Walker, C., & Van Noorden, R. (2023). What ChatGPT and generative AI mean for science. Nature (London), 614(7947), 214–216. https://doi.org/10.1038/d41586-023-00340-6
Tamim, R. M., Bernard, R. M., Borokhovski, E., Abrami, P. C., & Schmid, R. F. (2011). What forty years of research says about the impact of technology on learning: A second-order meta-analysis and validation study. Review of Educational Research, 81(1), 4–28. https://doi.org/10.3102/0034654310393361
Topsakal, O., & Topsakal, E. (2022). Framework for a foreign language teaching software for children utilizing AR, voicebots and ChatGPT (large language models). The Journal of Cognitive Systems, 7(2), 33–38. https://doi.org/10.52876/jcs.1227392
Tov, W., Ng, K. L., Lin, H., & Qiu, L. (2013). Detecting well-being via computerized content analysis of brief diary entries. Psychological Assessment, 25(4), 1069–1078. https://doi.org/10.1037/a0033007
Weller, M. (2020). 25 years of ed tech. Athabasca University Press.
Wingo, N. P., Ivankova, N. V., & Moss, J. A. (2017). Faculty perceptions about teaching online: Exploring the literature using the technology acceptance model as an organizing framework. Online Learning, 21(1), 15–35. https://doi.org/10.24059/olj.v21i1.761
Wolf, R. R., & Wolf, A. B. (2023). Using AI to evaluate a competency-based online writing course in nursing. Online Learning, 27(3), 41–69. https://doi.org/10.24059/olj.v27i3.3974
Woodruff, K., Hutson, J., & Arnone, K. (2023). Perceptions and barriers to adopting artificial intelligence in K–12 education: A survey of educators in fifty states. In S. Mistretta (Ed.), Reimagining education—The role of e-learning, creativity, and technology in the post-pandemic era. IntechOpen. https://doi.org/10.5772/intechopen.1002741
Zhang, K., & Aslan, A. B. (2021). AI technologies for education: Recent research & future directions. Computers and Education: Artificial Intelligence, 2, 100025. https://doi.org/10.1016/j.caeai.2021.100025
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 K. Bret Staudt Willet, Hunhui Na
This work is licensed under a Creative Commons Attribution 4.0 International License.
As a condition of publication, the author agrees to apply the Creative Commons – Attribution International 4.0 (CC-BY) License to OLJ articles. See: https://creativecommons.org/licenses/by/4.0/.
This licence allows anyone to reproduce OLJ articles at no cost and without further permission as long as they attribute the author and the journal. This permission includes printing, sharing and other forms of distribution.
Author(s) hold copyright in their work, and retain publishing rights without restrictions
