Investigating the Impacts of Voice-based Student-Chatbot Interactions in the Classroom on EFL Learners' Oral Fluency and Foreign Language Speaking Anxiety

Document Type : Original Article

Author

TEFL, Razi University, Kermanshah, Iran

Abstract

This study reports the findings of a quasi-experimental investigation into the impact of chatbot-supported speaking activities in the classroom on English as a Foreign Language (EFL) learners’ speaking fluency and Foreign Language Speaking Anxiety (FLSA). Sixty Iranian upper-intermediate EFL learners were divided into experimental and control groups practicing speaking skills with and without a voice-based chatterbot throughout an 8-week general English course. Data was collected through participants’ speaking fluency pre-and post-test scores (measured based on speech rate and the number of pauses in their spoken words) and the FLSA scale. A one-way ANCOVA was used to investigate whether EFL learners’ participation in chatterbot-supported in-class speaking activities using Replica makes any significant difference in their oral fluency compared to conventional class. The pre-test fluency scores were considered as the covariate. Similarly, two One-way ANCOVAs were run to investigate measures of FLSA. Results revealed that the experimental group significantly outperformed the control group regarding oral fluency; this group was also less anxious when speaking in the target language at the end of the experiment.

Keywords


Alrayah, H. (2018). The effectiveness of cooperative learning activities in enhancing EFL learners’ fluency. English Language Teaching, 11(4), 21–31. doi:10.5539/elt.v11n4p21
Azlan, N., Zakaria, S., & Melor , M. (2019). Integrative task-based learning: Developing speaking skill and increase motivation via Instagram. International Journal of Academic Research in Business and Social Sciences, 9(1), 620-636. doi:10.6007/IJARBSS/v9-i1/5463
Brand, C., & Götz, S. (2011). Fluency versus accuracy in advanced spoken learner language: A multi-method approach. International Journal of Corpus Linguistics, 16, 255-275. doi:10.1075/ijcl.16.2.05bra
ÇAKMAK, F. (2022). Chatbot-Human Interaction and Its Effects on EFL Students' L2 Speaking Performance and Anxiety. Novitas-ROYAL, 113–131. Retrieved from https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Chatbot-Human+Interaction+and+Its+Effects+on+EFL+Students%E2%80%99+L2+Speaking+Performance+and+Anxiety&btnG=
Chang, C., Lee, J., Chao, P., Wang, C., & Chen, G. (2010). Exploring the possibility of using humanoid robots as instructional tools for teaching a second language in primary school. Journal of Educational Technology & Society, 13(2), 13-24. http://www.jstor.org/stable/jeductechsoci.13.2.13
Chen, M.-R., & Hwang, G.-J. (2020). Effects of a concept mapping-based flipped learning approach on EFL students’ English speaking performance, critical thinking awareness and speaking anxiety. British Journal of Educational Technology, 51(3), 817–834. doi:10.1111/bjet.12887
Chiu, T., Liou, H., & Yeh, Y. (2007). A study of web-based oral activities enhanced by automatic speech recognition for EFL college learning. Computer Assisted Language Learning, 20(3), 209-234. doi:10.1080/09588220701489374
Coniam, D. (2008). Evaluating the language resources of chatbots for their potential in English as a second language. ReCALL, 20(1), 98-116. doi:10.1017/S0958344008000815
Cohen, J.W. (1988). Statistical power analysis for the behavioral sciences (2nd ed). Lawrence Erlbaum Associates.
Creswell , J. (2014). Education Research. Planning, Conducting and Evaluating Quantitative and Qualitative Research (4th ed ed.). Boston: Pearson.
El Shazly, R. (2021). Effects of artificial intelligence on English speaking anxiety and speaking performance: A case study. Expert Systems, 38(3), 1-15. doi:10.1111/exsy.12667
Fryer, L., Ainley, M., Thompson, A., Gibson, A., & Sherlock, Z. (2017). Stimulating and sustaining interest in a language course: An experimental comparison of Chatbot and Human task partners. Computers in Human Behavior, 75, 461–468. doi:10.1016/j.chb.2017.05.045
Fryer, L., Nakao, K., & Thompson, A. (2019). Chatbot learning partners: Connecting learning experiences, interest and competence. Computers in Human Behavior, 93, 279-289. doi:10.1016/j.chb.2018.12.023
Goda, Y., Yamada, M., Matsukawa, H., Hata, K., & Yasunami, S. (2014). Conversation with a chatbot before an online EFL group discussion and the effects on critical thinking. The Journal of Information and Systems in Education, 13(1), 1-7. https://doi.org/10.12937/ejsise.13.1
Hanafiah, W., Aswad, M., Sahib, H., Yassi, A., & Mousavi, M. (2022). The Impact of CALL on vocabulary learning, speaking skill, and foreign language speaking anxiety: the case study of Indonesian EFL learners. Education Research International , 2022, 13. doi:10.1155/2022/5500077
Hanzawa, K. (2021). Development of second language speech fluency in foreign language classrooms: A longitudinal study. Language Teaching Research (SAGE), 27. doi:10.1177/13621688211008693
Haristiani, N. (2019). Artificial Intelligence (AI) chatbot as language learning medium: An inquiry. In Journal of Physics: Conference Series, 1387(1), 2020.
Holland, M., Kaplan, J., & Sabol, M. (1999). Preliminary tests of language learning in a speech-interactive graphics microworld. CALICO Journal, 16(3), 339-359. Retrieved from https://www.jstor.org/stable/24147847
Horwitz, E., Horwitz, M., & Cope, J. (1986). Foreign language classroom anxiety. The Modern Language Journal, 70(2), 125-132. doi:10.2307/327317
House, B., Malkin, J., & Bilmes, J. (2009). The VoiceBot: A voice controlled robot arm. roceedings of the SIGCHI Conference on Human Factors (pp. 183-192). Boston, MA: ACM: Computing Systems. doi:10.1145/1518701.1518731
Housen, A., & Kuiken, F. (2009). Complexity, accuracy, and fluency in second language acquisition. Applied Linguistics, 30, 461-473. doi:10.1093/applin/amp048
Huang, W., Hew, K., & Fryer, L. (2021). Chatbots for language learning—Are they really useful? A systematic review of chatbot-supported language learning. Journal of Computer Assisted Learning, 38(1), 237-257. doi:10.1111/jcal.12610
Jeon, J. (2022). Exploring AI chatbot affordances in the EFL classroom: young learners’ experiences and perspectives. Computer Assisted Language Learning, 1-26. doi:10.1080/09588221.2021.2021241
Karatas, H., Alci, B., Bademcioglu, M., & Ergin, A. (2016). An Investigation into University Students's Foreign Language Speaking Anxiety. Procedia-Social and Behavioral Sciences, 232, 382-388. doi:10.1016/j.sbspro.2016.10.053
Kim, N. (2017). Effects of types of voice-based chat on EFL students’ negotiation of meaning according to proficiency levels. English Teaching, 72(1), 159-181. doi:10.15858/engtea.72.1.201703.159
Kim, N.-Y., Cha, Y., & Kim, H.-S. (2019). Future English learning: Chatbots and artificial intelligence. Multimedia-Assisted Language Learning, 22(3), 32-53.
Lee, S., Noh, H., Lee, J., Lee, K., Lee, G., Sagong, S., & Kim, M. (2011). On the effectiveness of robot-assisted language learning. ReCALL, 23(1), 25-58. doi:10.1017/S0958344010000273
Lu, C., Chiou, G., Day, M., Ong, C., & Hsu, W. (2006). Using instant messaging to provide an intelligent learning environment. ntelligent Tutoring Systems: 8th International Conference, ITS 2006 (pp. 575-583). Berlin Heidelberg: Springer.
MacIntyre, P. (1999). Language Anxiety: A Review of Literature for Language Teachers. In D. Young, Affect in foreign language and second language teaching: A practical guide to creating a low-anxiety classroom atmosphere (pp. 24-45). Boston: McGraw-Hill: McGraw-Hill Companies.
Pallant, J. S. (2010). SPSS survival manual: A step by step guide to data analysis using SPSS for windows. Allen & Unwin, Crows Nest.
Richards, J., & Trew, G. (2019). Tactics for Listening: expanding (3rd ed ed.). Oxford: Oxford university press.
Richards, J., Hull, J., & Proctor, S. (2019). nterchange: Student's book (5th ed ed.). Cambridge: Cambridge University Press.
Tabachnick, B.G. & Fidell, L.S. (2007). Using multivariate statistics. Pearson Education.
Tai, T.-Y., & Chen, H.-J. (2022). The impact of intelligent personal assistants on adolescent EFL learners’ speaking proficiency. Computer Assisted Language Learning, 1-28. doi:10.1080/09588221.2022.2070219
Tian, J., & Wang, Y. (2010). Taking language learning outside the classroom: learners perspectives of eTandem learning via Skype. Innovation in Language Learning and Teaching, 4(3), 181-197. doi:10.1080/17501229.2010.513443
Tzu-Yu, T., & Chen, H. (2022). The impact of intelligent personal assistants on adolescent EFL learners’ speaking proficiency. Computer Assisted Language Learning, 1-28. doi:10.1080/09588221.2022.2070219
Wang, Y., Petrina, S., & Feng, F. (2017). VILLAGE—Virtual immersive language and presence. British Journal of Educational Technology, 48(2), 431–450. doi:10.1111/bjet.12388
Weizenbaum, J. (1996). ELIZA-A computer program for the study of natural language communication between man and machine. Communications of the ACM, 9(1), 36-45. doi:10.1145/365153.365168
Winkler, R., & Soellner, M. (2018). Unleashing the potential of chatbots in education: A state-of-the-art analysis. In Academy of Management Annual Meeting Proceedings. Academy of Management.
Xu, Y., Wang, D., Collins, P., Lee, H., & Warschauer, M. (2021). Same benefits, different communication patterns: Comparing children's reading with a conversational agent vs. a human partner. Computers & Education, 161, 40-59. doi:10.1016/j.compedu.2020.104059
Yang, H., Kim, H., Lee, J., & Shin, D. (2022). Implementation of an AI chatbot as an English conversation partner in EFL speaking classes. ReCALL FirstView, 34(3), 1-17. doi:10.1017/S0958344022000039
Yen-Chen, Y., Huei-Tse, H., & Chang, K. (2015). Applying role-playing strategy to enhance learners’ writing and speaking skills in EFL courses using Facebook and Skype as learning tools: a case study in Taiwan. Computer Assisted Language Learning, 28(15), 383-406. doi:10.1080/09588221.2013.839568
Hafner, C. (2015). Remix culture and English language teaching: The expression of learner voice in digital multimodal compositions. TESOL Quarterly, 49(3), 486–509. https://doi:10.1002/tesq.238
Hafner, C. (2015). Remix culture and English language teaching: The expression of learner voice in digital multimodal compositions. TESOL Quarterly, 49(3), 486–509. https://doi:10.1002/tesq.238
Hafner, C. (2015). Remix culture and English language teaching: The expression of learner voice in digital multimodal compositions. TESOL Quarterly, 49(3), 486–509. https://doi:10.1002/tesq.238