Evidence on AI Tools in Second Language Writing: A Systematic Review of SLA Outcomes, Learner Experiences, and Pedagogical Dynamics

Rifyal Kalam Mahardhika, Margana Margana Margana, Rozanah Kartina Herda, Bazilah Raihan Mat Shawal, Shahzadi Hina Sain

Abstract


Artificial intelligence (AI) tools have transformed second language (L2) writing instruction, yet empirical evidence spanning traditional Automated Writing Evaluation (AWE) and modern Generative AI (GenAI) remains fragmented. This systematic literature review synthesized 22 primary empirical studies published between 2018 and 2025 to evaluate the effects of AI tools on L2 writing performance and map associated pedagogical benefits, operational challenges, and ethical concerns within Second Language Acquisition (SLA) frameworks. Guided by PRISMA 2020 protocols, literature was gathered across five academic databases and analyzed using SLA performance constructs and thematic synthesis. Findings reveal that most included studies focusing on accuracy (11 out of 14) reported improvements in surface-level linguistic error reduction, whereas effects on syntactic complexity were variable across 8 studies depending on tool type (AWE vs. GenAI). GenAI also showed promising effects on coherence and structural organization when accompanied by explicit instructional scaffolding. While AI tools provide immediate scaffolding and reduce writing anxiety, operational challenges, such as declining engagement, feedback overload, and cognitive passivity, and ethical risks concerning academic integrity and loss of learner voice persist. The review concludes that AI tools are most productive when used as supportive writing companions within explicitly scaffolded and collaborative learning environments. Future research should employ longitudinal designs, include more diverse learner populations, and empirically examine critical AI literacy interventions and the transfer of AI-assisted gains to unassisted L2 writing. Educators should integrate AI critically while fostering learner agency, ethical awareness, and independent writing development.

Keywords


Artificial intelligence; Automated writing evaluation; Generative AI; L2 writing; Second language acquisition

Full Text:

PDF

References


Ajabshir, Z. F., & Ebadi, S. (2023). The effects of automatic writing evaluation and teacher-focused feedback on CALF measures and overall quality of L2 writing across different genres. Asian-Pacific Journal of Second and Foreign Language Education, 8(1). https://doi.org/10.1186/s40862-023-00201-9

Chen, Y. (2025). Evaluating the potential of ChatGPT-reformulated essays as written feedback in L2 writing. Computers and Education: Artificial Intelligence, 9. https://doi.org/10.1016/j.caeai.2025.100500

Darvin, R. (2025). The need for critical digital literacies in generative AI-mediated L2 writing. Journal of Second Language Writing, 67. https://doi.org/10.1016/j.jslw.2025.101186

Hwang, H., Chang, X., & Sun, J. (2025). Generative AI is useful for second language writing, but when, why, and for how long do learners use it? Journal of Second Language Writing, 69. https://doi.org/10.1016/j.jslw.2025.101230

Karatay, Y., & Karatay, L. (2024). Automated writing evaluation use in second language classrooms: A research synthesis. In System (Vol. 123). Elsevier Ltd. https://doi.org/10.1016/j.system.2024.103332

Lin, S., & Crosthwaite, P. (2024). The grass is not always greener: Teacher vs. GPT-assisted written corrective feedback. System, 127. https://doi.org/10.1016/j.system.2024.103529

Mahapatra, S. (2024). Impact of ChatGPT on ESL students’ academic writing skills: a mixed methods intervention study. Smart Learning Environments, 11(1). https://doi.org/10.1186/s40561-024-00295-9

Meniado, J. C., Huyen, D. T. T., Panyadilokpong, N., & Lertkomolwit, P. (2024). Using ChatGPT for second language writing: Experiences and perceptions of EFL learners in Thailand and Vietnam. Computers and Education: Artificial Intelligence, 7. https://doi.org/10.1016/j.caeai.2024.100313

Michel, M., Bazhutkina, I., Abel, N., & Strobl, C. (2025). Collaborative writing based on generative AI models: Revision and deliberation processes in German as a foreign language. Journal of Second Language Writing, 67. https://doi.org/10.1016/j.jslw.2025.101185

Mizumoto, A., Shintani, N., Sasaki, M., & Teng, M. F. (2024). Testing the viability of ChatGPT as a companion in L2 writing accuracy assessment. Research Methods in Applied Linguistics, 3(2). https://doi.org/10.1016/j.rmal.2024.100116

Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Journal of Clinical Epidemiology, 134, 178–189. https://doi.org/10.1016/j.jclinepi.2021.03.001

Ranalli, J. (2021). L2 student engagement with automated feedback on writing: Potential for learning and issues of trust. Journal of Second Language Writing, 52. https://doi.org/10.1016/j.jslw.2021.100816

Schimdt, R. W. (1990). The Role of Consciousness in Second Language Learning1. Applied Linguistics, 11(2), 129–158. https://doi.org/10.1093/applin/11.2.129

Shen, C., Shi, P., Guo, J., Xu, S., & Tian, J. (2023). From process to product: writing engagement and performance of EFL learners under computer-generated feedback instruction. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1258286

Shi, H., & Aryadoust, V. (2024). A systematic review of AI-based automated written feedback research. ReCALL, 36(2), 187–209. https://doi.org/10.1017/S0958344023000265

Sweller, J. (1988). Cognitive Load During Problem Solving: Effects on Learning. Cognitive Science, 12(2), 257–285. https://doi.org/10.1207/s15516709cog1202_4

Teng, M. F. (2024). “ChatGPT is the companion, not enemies”: EFL learners’ perceptions and experiences in using ChatGPT for feedback in writing. Computers and Education: Artificial Intelligence, 7. https://doi.org/10.1016/j.caeai.2024.100270

Vygotsky, L. S. (1980). Mind in Society (M. Cole, V. Jolm-Steiner, S. Scribner, & E. Souberman, Eds.). Harvard University Press. https://doi.org/10.2307/j.ctvjf9vz4

Wang, C., & Wang, Z. (2025). Investigating L2 writers’ critical AI literacy in AI-assisted writing: An APSE model. Journal of Second Language Writing, 67. https://doi.org/10.1016/j.jslw.2025.101187

Wang, Y. (2024). Cognitive and sociocultural dynamics of self-regulated use of machine translation and generative AI tools in academic EFL writing. System, 126. https://doi.org/10.1016/j.system.2024.103505

Wei, P., Wang, X., & Dong, H. (2023). The impact of automated writing evaluation on second language writing skills of Chinese EFL learners: a randomized controlled trial. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1249991

Wiboolyasarin, W., Wiboolyasarin, K., Suwanwihok, K., Jinowat, N., & Muenjanchoey, R. (2024). Synergizing collaborative writing and AI feedback: An investigation into enhancing L2 writing proficiency in wiki-based environments. Computers and Education: Artificial Intelligence, 6. https://doi.org/10.1016/j.caeai.2024.100228

Xiaosa, L., & Ping, K. (2025). How L2 student writers engage with automated feedback: A longitudinal perspective. Assessing Writing, 64. https://doi.org/10.1016/j.asw.2025.100919

Yan D. (2024). Comparing individual vs. collaborative processing of ChatGPT-generated feedback: Effects on L2 writing task improvement and learning. Language Learning & Technology, 2024(1), 1–19. https://hdl.handle.net/10125/73597

Yan, D., & Zhang, S. (2024). L2 writer engagement with automated written corrective feedback provided by ChatGPT: A mixed-method multiple case study. Humanities and Social Sciences Communications, 11(1). https://doi.org/10.1057/s41599-024-03543-y

Zhang, Z. (Victor). (2020). Engaging with automated writing evaluation (AWE) feedback on L2 writing: Student perceptions and revisions. Assessing Writing, 43. https://doi.org/10.1016/j.asw.2019.100439

Zimmerman, B. J. (2000). Attaining Self-Regulation. In Handbook of Self-Regulation (pp. 13–39). Elsevier. https://doi.org/10.1016/B978-012109890-2/50031-7




DOI: http://dx.doi.org/10.25157/jwp.v13i2.26521

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Jurnal Wahana Pendidikan

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License

 

Indexing: