Enhancing Oral Language Skills with Pi AI: A Study on Speaking and Pronunciation Gains

Behnam Behforouz; Afrooz Poorghorban; Ali Al Ghaithi

doi:10.24059/olj.v30i1.4928

Authors

Behnam Behforouz University of Technology and Applied Sciences, Shinas, Oman
Afrooz Poorghorban Islamic Azad University, Rasht
Ali Al Ghaithi Sohar University, Oman

DOI:

https://doi.org/10.24059/olj.v30i1.4928

Keywords:

AI-driven learning tool, Pi AI, speaking skills, pronunciation

Abstract

Learners often struggle with speaking and pronunciation due to insufficient practice and feedback opportunities in real situations, which classroom instruction cannot provide adequately. This paper examined the effectiveness of Pi AI, an AI-powered chatbot, in improving speaking and pronunciation among Omani EFL learners. In this investigation, 60 students were randomly divided into experimental (n = 30) and control groups (n = 30). Speaking pretests were conducted to ensure all participants had similar speaking skills. While both groups received regular classroom instruction, the experimental group received additional practice through Pi AI for a month of treatment period. Speaking posttests were conducted to compare the results with the pretests. Findings showed that the experimental group performed better than their peers in the control group on both speaking and pronunciation posttests. The findings are helpful for students, teachers, and educational institutions.

References

Abimanto, D., & Sumarsono, W. (2024). Improving English pronunciation with AI speech-recognition technology. Acitya: Journal of Teaching and Education, 6(1), 146–156. https://doi.org/10.30650/ajte.v6i1.3810

Adamopoulou, E., & Moussiades, L. (2020). Chatbots: History, technology, and applications. Machine Learning with Applications, 2, 100006. https://doi.org/10.1016/j.mlwa.2020.100006

Afendi, A., Sholihah, N., Mutmainah, F., Ishak, K., & Lubis, A. (2022). Penggunaan Microsoft Office untuk meningkatkan motivasi dan hasil belajar siswa sekolah dasar [The use of Microsoft Office to improve motivation and learning outcomes of elementary school students]. Jurnal PGSD, 8(1), 28–32. https://doi.org/10.32534/jps.v8i1.2949

Ahmad, N. A., Che, M. H., & Zainal, A. (2018). Review of chatbots design techniques. International Journal of Computer Applications, 18(8), 7–10. https://doi.org/10.5120/ijca2018917606

Akhter, S., Haidov, R., Rana, A. M., & Qureshi, A. H. (2020). Exploring the significance of speaking skill for EFL learners. PalArch’s Journal of Archaeology of Egypt/Egyptology, 17(9), 6019–6030.

Al Balushi, M., & Al Siyabi, F. (2016). Spelling strategies of Omani EFL students. English Linguistics Research, 5(3), 1–14. https://doi.org/10.5430/elr.v5n3p1

Aldosari, M. S. (2024). Another world with artificial intelligence in speaking classes: To delve into the influences on willingness to communicate, personal best goals, and academic enjoyment. Computer Assisted Language Learning Electronic Journal (CALL-EJ), 25(4), 439–463.

Al Mahrooqi, R. (2012). A student perspective on low English proficiency in Oman. International Education Studies, 5(6), 263–271. https://doi.org/10.5539/ies.v5n6p263

Alsalihi, H. D. (2020). Main difficulties faced by EFL students in language learning. Journal of College of Education for Women, 31(2), 19–34. https://doi.org/10.36231/coedw.v31i2.1359

Al-Shallakh, M. A. I. (2024). Embedding artificial intelligent applications in higher educational institutions to improve students’ pronunciation performance. Theory and Practice in Language Studies, 14(6), 1897–1906. https://doi.org/10.17507/tpls.1406.31

Al Yaqoobi, Z., Ali, F., & Sulan, N. (2016). An analysis of errors caused by Omani EFL learners in pronouncing certain consonant sounds. International Journal of Languages, Education and Applied Linguistics, 5, 59–71.

Arbi, A. P. (2024). Optimizing the use of artificial intelligence in English language learning: A literature review. Global Journal of Management and Innovation, 2(2), 25–30. https://doi.org/10.59435/gjmi.v2i2.278

Baek, J., & Lee, C. H. (2018). University students’ perceptions and engagement in mobile-assisted blended learning in English speaking classes. Multimedia-Assisted Language Learning, 21(4). https://doi.org/10.15702/mall.2018.21.4.11

Bower, J., & Kawaguchi, S. (2011). Negotiation of meaning and corrective feedback in Japanese/English eTandem. Language, Learning and Technology, 15(1), 41–71. http://dx.doi.org/10125/44237

Brown, H. D., & Lee, H. (2015). Teaching by principles: An interactive approach to language pedagogy (4th ed.). Pearson Education.

Bueno, A., Madrid, D., & McLaren, N. (2006). TEFL in secondary education. Editorial Universidad de Granada.

Burston, J. (2015). Twenty years of MALL project implementation: A meta-analysis of learning outcomes. ReCALL, 27(1), 4–20. https://doi.org/10.1017/S0958344014000159

Çakmak, F. (2022). Chatbot-human interaction and its effects on EFL students’ L2 speaking performance and anxiety. Novitas-ROYAL (Research on Youth and Language), 16(2), 113–131.

Chen, M. R. A., & Hwang, G. J. (2019). Effects of a concept mapping–based flipped learning approach on EFL students’ English-speaking performance, critical thinking awareness, and speaking anxiety. British Journal of Educational Technology, 51(3), 817–834. https://doi.org/10.1111/bjet.12887

Colace, F., Santo, M. D., Lombardi, M., Pascale, F., Pietrosanto, A., & Lemma, S. (2018). Chatbot for e-learning: A case of study. International Journal of Mechanical Engineering and Robotics Research, 7(5), 528–533. https://doi.org/10.18178/ijmerr.7.5.528-533

Dao, H. (2017). Identify factors that negatively influence non-English major students’ speaking skills. Higher Education Research, 2(2), 35–43. https://doi.org/10.11648/j.her.20170202.12

Davis, F. D. (1986). A technology acceptance model for empirically testing new end-user information systems: Theory and results [Doctoral dissertation, MIT Sloan School of Management].

Dennis, N. K. (2024). Using AI-powered speech recognition technology to improve English pronunciation and speaking skills. IAFOR Journal of Education, 12(2), 107–126.

Duong, T., & Suppasetseree, S. (2024). The effects of an artificial intelligence voice chatbot on improving Vietnamese undergraduate students’ English-speaking skills. International Journal of Learning, Teaching and Educational Research, 23(3), 293–321. https://doi.org/10.26803/ijlter.23.3.15

El Shazly, R. (2021). Effects of artificial intelligence on English speaking anxiety and speaking performance: A case study. Expert Systems, 38(e12667). https://doi.org/10.1111/exsy.12667

El Shorbagi, A., Al Kharusi, H., Al Kindi, F., Al Siyabi, A., & Al Abri, A. (2017). The effectiveness of phonemic and phonological awareness program to improve reading performance of first grade basic education students in Oman. Journal of Educational and Psychological Studies, 11(3), 666–676. https://doi.org/10.24200/jeps.vol11iss3pp666-676

Fathi, J., Rahimi, M., & Derakhshan, A. (2024). Improving EFL learners’ speaking skills and willingness to communicate via artificial intelligence-mediated interactions. System, 121, 103254. https://doi.org/10.1016/j.system.2024.103254

Fryer, L., & Carpenter, R. (2006). Bots as language learning tools. Language Learning & Technology, 10(3), 8–14. http://dx.doi.org/10.125/44068

Hamuddin, B. (2018). Blogs as powerful learning tools: The perception from EFL students in Riau main island, Indonesia. IOP Conference Series: Earth and Environmental Science, 156, 012060. https://doi.org/10.1088/1755-1315/156/1/012060

Jabber, K. W., & Mahmood, A. A. (2020). Non-verbal communication between two non-native English speakers: Iraqi and Chinese. Theory and Practice in Language Studies, 10(2), 189–196. https://doi.org/10.17507/tpls.1002.06

Heil, C. R., Wu, J. S., Lee, J. J., & Schmidt, T. (2016). A review of mobile language learning applications: Trends, challenges, and opportunities. The EuroCALL Review, 24(2), 32–50. https://doi.org/10.4995/eurocall.2016.6402

Hill, J., Ford, W. R., & Farreras, I. G. (2015). Real conversations with artificial intelligence: A comparison between human–human online conversations and human–chatbot conversations. Computers in Human Behavior, 49, 245–250. https://doi.org/10.1016/j.chb.2015.02.026

Huy, V., Nam, T., & Bon, N. (2024). The importance of speaking in English as a foreign language between skillful and thoughtful competencies: Studying sociolinguistics perspectives. International Journal of English Language Studies, 6(2), 153–159. https://doi.org/10.32996/ijels.2024.6.2.22

Junaidi, J. (2020). Artificial intelligence in EFL context: Rising students’ speaking performance with Lyra virtual assistance. International Journal of Advanced Science and Technology Rehabilitations, 29, 6735–6741.

Kang, H. (2022). Effects of artificial intelligence and native speaker interlocutors on ESL learners’ speaking ability and affective aspects. Multimedia-Assisted Language Learning, 25, 9–43. https://doi.org/10.15702/mall.2022.25.2.09

Kaplan, J. (2016). Artificial intelligence: What everyone needs to know. Oxford University Press. https://doi.org/10.1093/wentk/9780190602383.001.0001

Kim, N.-Y. (2017). Effects of types of voice-based chat on EFL students’ negotiation of meaning according to proficiency levels. English Teaching, 72(1), 159–181. https://doi.org/10.15858/engtea.72.1.201703.159

Kim, N.-Y. (2018). A study on chatbots for developing Korean college students’ English listening and reading skills. Journal of Digital Convergence, 16(8), 19–26. https://doi.org/10.14400/JDC.2018.16.8.019

Kim, H.-S., Cha, Y., & Kim, N. Y. (2021). Effects of AI voice chatbots on EFL students’ communication skills. Korean Journal of English Language and Linguistics, 21, 712–734. https://doi.org/10.15738/kjell.21..202108.712

Kohn, K., & Hoffstaedter, P. (2017). Learner agency and non-native speaker identity in pedagogical lingua franca conversations: Insights from intercultural telecollaboration in foreign language education. Computer Assisted Language Learning, 30(5), 351–367. https://doi.org/10.1080/09588221.2017.1304966

Li, Q., & Chan, K. K. (2024). Test takers’ attitudes of using exam-oriented mobile application as a tool to adapt in a high-stakes speaking test. Education and Information Technologies, 29(1), 219–237. https://doi.org/10.1007/s10639-023-12297-0

Loewen, S., Crowther, D., Isbell, D. R., Kim, K. M., Maloney, J., Miller, Z. F., & Rawal, H. (2019). Mobile-assisted language learning: A Duolingo case study. ReCALL, 31(3), 293–311. https://doi.org/10.1017/S0958344019000065

Loewen, S., Isbell, D. R., & Sporn, Z. (2020). The effectiveness of app-based language instruction for developing receptive linguistic knowledge and oral communicative ability. Foreign Language Annals, 53(2), 209–233. https://doi.org/10.1111/flan.12454

Makhlouf, M. K. I. (2021). Effect of artificial intelligence-based application on Saudi preparatory-year students’ EFL speaking skills at Albaha University. International Journal of English Language Education, 9(2), 36. https://doi.org/10.5296/ijele.v9i2.18782

Maknun, L. L. (2020). The implementation of Orai as artificial intelligence for digital native students in English speaking learning. Indonesian Technology Enhanced Language Learning, 1, 131–138.

Manurung, K. (2015). Improving the speaking skill using reading contextual internet-based instructional materials in an EFL class in Indonesia. Procedia - Social and Behavioral Sciences, 176, 44–51. https://doi.org/10.1016/j.sbspro.2015.01.442

Mitchell, R., & Myles, F. (2004). Second language learning theories (2nd ed.). Hodder Arnold.

Mohammadkarimi, E. (2024). Exploring the use of artificial intelligence in promoting English language pronunciation skills. LLT Journal: A Journal on Language and Language Teaching, 27(1), 98–115. https://doi.org/10.24071/llt.v27i1.8151

Muslimah, M., Usman, B., & Iskandar, A. S. (2021). Teaching speaking report text through documentary video. Research in English and Education, 6(1), 42–48.

Nazara, S. (2011). Students’ perception on EFL speaking skill development. JET (Journal of English Teaching), 1(1), 28–43.

Paudel, P. (2024). Navigating linguistic diversity: Implementing English medium instruction in Nepal’s community schools. Issues in Educational Research, 34(4), 1526–1547.

Qiao, H., & Zhao, A. (2023). Artificial intelligence-based language learning: Illuminating the impact on speaking skills and self-regulation in Chinese EFL context. Frontiers in Psychology, 14, 1255594. https://doi.org/10.3389/fpsyg.2023.1255594

Qiao, H., & Zhao, A. (2023). Artificial intelligence-based language learning: illuminating the impact on speaking skills and self-regulation in Chinese EFL context. Frontiers in Psychology, 14, 1255594. https://doi.org/10.3389/fpsyg.2023.1255594

Rahimi, M., & Fathi, J. (2022). Employing e-tandem language learning method to enhance speaking skills and willingness to communicate: The case of EFL learners. Computer Assisted Language Learning, 1–37. https://doi.org/10.1080/09588221.2022.2064512

Reiss, M. J. (2021). The use of AI in education: Practicalities and ethical considerations. London Review of Education, 19(1), 1–14. https://doi.org/10.14324/LRE.19.1.05

Ronsumbre, S., Rukmawati, T., Sumarsono, A., & Waremra, R. S. (2023). Pembelajaran digital dengan kecerdasan buatan (AI): Korelasi AI terhadap motivasi belajar [Digital learning with artificial intelligence (AI): The correlation of AI with learning motivation]. Educatio: Jurnal Pendidikan, 9(3), 1464–1474. https://doi.org/10.31949/educatio.v9i3.5761

Safadi, H. A., Shgair, M. S. A., & Qatawnih, K. S. (2022). The effectiveness of designing an e-learning environment based on mastery learning and artificial intelligence on developing English speaking skills among tenth graders in Palestine. Journal of Educational and Psychological Sciences, 31, 475–507. https://doi.org/10.33976/IUGJEPS.31.1/2023/22

Shumin, K. (1997). Factors to consider: Developing adult EFL pupils’ speaking abilities. English Teaching Forum, 35(3), 8–13. Retrieved January 5, 2025, from http://dosfan.lib.uic.edu/usia/E-USIA/forum/vols/vol35/no3/p8.htm

Shumin, K. (2002). Factors to consider: Developing adult EFL student speaking abilities. In J. C. Richards & W. A. Renandya (Eds.), Methodology in language teaching: An anthology of current practice (pp. 204–211). Cambridge University Press. https://doi.org/10.1017/CBO9780511667190.028

Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153–189. https://doi.org/10.3102/0034654307313795

Soleimani, H., Mohammaddokht, F., & Fathi, J. (2022). Exploring the effect of assisted repeated reading on incidental vocabulary learning and vocabulary learning self-efficacy in an EFL context. Frontiers in Psychology, 13, 851812. https://doi.org/10.3389/fpsyg.2022.851812

Tarisayi, K. S. (2024). A theoretical framework for interrogating the integration of artificial intelligence in education. Research on Education and Media, 16(1), 37–44. https://doi.org/10.2478/rem-2024-0006

Thornbury, S., & Slade, D. (2006). Conversation: From description to pedagogy. Cambridge University Press.

Toolify.ai. (2023, December 26). Meet Pi, your personal AI companion. https://www.toolify.ai/ai-news/meet-pi-your-personal-ai-companion-25320

Wan, Y., & Moorhouse, B. L. (2024). Using Call Annie as a generative artificial intelligence speaking partner for language learners. RELC Journal. Advance Online Publication. https://doi.org/10.1177/00336882231224813

Wekke, I. S., Yandra, A., & Hamuddin, B. (2017). Learning strategy in class management: A reflection from Manado case. IOP Conference Series: Earth and Environmental Science, 97(1), 012053. https://doi.org/10.1088/1755-1315/97/1/012053

Yahya, M., Hidayat, & Wahyudi. (2023). Implementasi artificial intelligence (AI) di bidang pendidikan kejuruan pada era revolusi industri 4.0 [Implementation of artificial intelligence (AI) in vocational education in the era of the industrial revolution 4.0]. Prosiding Seminar Nasional Dies Natalis ke-62, 190–199. Retrieved from https://journal.unm.ac.id/index.php/Semnasdies62/index

Zhang, R., & Zou, D. (2020). Types, purposes, and effectiveness of state-of-the-art technologies for second and foreign language learning. Computer Assisted Language Learning, 35(2), 1–47. https://doi.org/10.1080/09588221.2020.1744666

Zhou, W. (2021). Sociocultural theory and its implications in college English teaching and learning in the age of artificial intelligence. Journal of Physics: Conference Series, 1646(1), 012142. https://doi.org/10.1088/1742-6596/1646/1/012142

Zou, B., Du, Y., Wang, Z., Chen, J., & Zhang, W. (2023). An investigation into artificial intelligence speech evaluation programs with automatic feedback for developing EFL learners’ speaking skills. SAGE Open, 13. https://doi.org/10.1177/21582440231193818

Zou, B., Liviero, S., Hao, M., & Wei, C. (2020). Artificial intelligence technology for EAP speaking skills: Student perceptions of opportunities and challenges. In M. R. Freiermuth & N. Zarrinabadi (Eds.), Technology and the psychology of second language learners and users (pp. 433–463). https://doi.org/10.1007/978-3-030-34212-8_17