Exploring the Effectiveness of Pedagogical Orientation of Generative AI Models on Enhancing University Students' Translation Skills: An Experimental Study
DOI:
https://doi.org/10.63939/ajts.yx0k0267Keywords:
Translation Training, Generative AI, AI-driven Pedagogy, Translation Skills, Intervention, Arab ContextAbstract
This study attempted to bridge the research gap in AI-driven pedagogy for translation training in the Arab context, focusing on the potential of generative AI models to improve the translation proficiency of university translation majors. The research explored the effectiveness of pedagogically oriented generative AI tools in enhancing students’ skills across linguistic, cultural, and text-level dimensions in English ⇄ Arabic translation, using a true experimental pre-test-post-test control group design. While both groups used identical training materials, the experimental group received AI-guided training, and the control group was taught through traditional instruction. Through a random sampling (n = 37 per group), participants were recruited from four universities in Yemen and Oman, ensuring a comparable educational background. The findings revealed that the experimental group outperformed the control group in translation achievement in all targeted translation skills due to the impact of guided integration of AI. The study underscored the multi-faceted pedagogical applications of AI in translation education when grounded in a systematic pedagogical framework under instructor guidance. Through highlighting practical pedagogical implications and offering an evidence-based framework for integrating AI into translation programs, the research opens new avenues for innovative practices in AI-assisted translation pedagogy for instructors and curriculum designers.
Downloads
References
Abu-Rayyash, E. A. (2017). Errors and non-errors in English-Arabic machine translation of gender-bound constructs in technical texts. Procedia Computer Science, 117, 73-80. https://doi.org/10.1016/j.procs.2017.10.095 DOI: https://doi.org/10.1016/j.procs.2017.10.095
Al-Ali, L. R. (2025). The influence of AI on improving translation skills: A survey study. Wasit Journal for Human Sciences, 21(1 Pt1), 919-950. https://doi.org/10.31185/wjfh.Vol21.Iss1/Pt1.841 DOI: https://doi.org/10.31185/wjfh.Vol21.Iss1/Pt1.841
Aleedy, M., Atwell, E., & Meshoul, S. (2022). Towards deep learning-powered chatbot for translation learning. School of Computing, University of Leeds; College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University. https://eprints.whiterose.ac.uk/183815/ DOI: https://doi.org/10.1007/978-3-031-05675-8_11
Alghamdi, F. A., & Alotaibi, H. (2025). Using AI in translation quality assessment: A case study of ChatGPT and legal translation texts. Electronics, 14(19), 3893. https://doi.org/10.3390/electronics14193893 DOI: https://doi.org/10.3390/electronics14193893
Alharbi, W. (2024). Future translators’ linguistic and non-linguistic competencies and skills in the age of neural machine translation and artificial intelligence: A content analysis. International Journal of Linguistics, Literature and Translation, 7(4), 124-143 DOI: https://doi.org/10.32996/ijllt.2024.7.4.16
Alqohfa, K. a. S., & Sanad, S. N. T. (2025). Linguistic and Cultural Challenges in Translating Idioms with Artificial Intelligence. Journal of English Studies in Arabia Felix, 4(1), 34-49. https://doi.org/10.56540/jesaf.v4i1.116 DOI: https://doi.org/10.56540/jesaf.v4i1.116
Amaro, V., & Pires, M. (2024). Found in translation, lost in education: Artificial intelligence's impacts on translation tertiary education in Macao. Asian Education and Development Studies. https://doi.org/10.1108/AEDS-01-2024-0012 DOI: https://doi.org/10.1108/AEDS-01-2024-0012
Atlas, S. (2023). ChatGPT for Higher Education and Professional Development: A guide to Conversational AI. DigitalCommons@URI. https://digitalcommons.uri.edu/cba_facpubs/548
Bakhov, I., Bilous, N., Saiko, M., Isaienko, S., Hurinchuk, S., & Nozhovnik, O. (2024). Beyond the dictionary: Redefining translation education with artificial intelligence-assisted app design and training. International Journal of Learning Teaching and Educational Research, 23(4), 119-140. https://doi.org/10.26803/ijlter.23.4.7 DOI: https://doi.org/10.26803/ijlter.23.4.7
Bhattacherjee, A. (2019). Social science Research: principles, methods and practices. In University of Southern Queensland ePrints (University of Southern Queensland). https://doi.org/10.26192/q7w89
Brown, K. (2019). Personalized learning and artificial intelligence in the language classroom. Journal of Educational Technology Research, 28(3), 232-245
Campbell, D. T., & Stanley, J. C. (2015). Experimental and Quasi-Experimental designs for research. Ravenio Books
Cheng, M. (2022). Practical exploration of English translation activity courses in colleges and universities under the background of artificial intelligence. Advances in Education and Teaching International, Special Issue. https://doi.org/10.1155/2022/4547342 DOI: https://doi.org/10.1155/2022/4547342
Conover, W. J. (1999). Practical Nonparametric Statistics (3rd Ed.). Wiley
Creswell, J. W., & Creswell, J. D. (2017). Research design: Qualitative, Quantitative, and Mixed Methods Approaches. SAGE Publications
Ed-Dali, R. (2025). Assessing DeepSeek R1 and ChatGPT 4.5 in Arabic-English literary translation: performance, challenges, and implications. Cogent Arts & Humanities, 12(1). https://doi.org/10.1080/23311983.2025.2531183 DOI: https://doi.org/10.1080/23311983.2025.2531183
Elen, J., Clarebout, G., Léonard, R., & Lowyck, J. (2007). Student-centred and teacher-centred learning environments: what students think. Teaching in Higher Education, 12(1), 105-117. https://doi.org/10.1080/13562510601102339 DOI: https://doi.org/10.1080/13562510601102339
Emara, E. a. E. M. (2024). Using AI Tools to Enhance Translation Skills among Basic Education English Major Students. CDELT Occasional Papers in the Development of English Education, 86(1), 339-380. https://doi.org/10.21608/opde.2024.362829 DOI: https://doi.org/10.21608/opde.2024.362829
Field, A. (2018). Discovering statistics using IBM SPSS statistics (5th Ed.). Sage
Grassini, S. (2023). Shaping the Future of Education: Exploring the Potential and Consequences of AI and ChatGPT in Educational Settings. Education Sciences, 13(7), 692. https://doi.org/10.3390/educsci13070692 DOI: https://doi.org/10.3390/educsci13070692
Hajdu, Z., & Farkas, J. (2025). AI technology in technical translation courses. Humán Innovációs Szemle, 16(1). https://doi.org/10.61177/hisz.2025.16.1.2 DOI: https://doi.org/10.61177/HISZ.2025.16.1.2
He, S. (2024). Prompting ChatGPT for translation: A Comparative analysis of translation brief and persona prompts. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2403.00127
Hellmich, E., & Vinall, K. (2021). FL instructor beliefs about machine translation: Ecological insights to guide research and practice. International Journal of Computer-Assisted Language Learning and Teaching (IJCALLT), 11(4), 1-18. https://doi.org/10.4018/IJCALLT.2021100101 DOI: https://doi.org/10.4018/IJCALLT.2021100101
Kalpana, T. (2014). A constructivist perspective on teaching and learning: A conceptual framework. International Research Journal of Social Sciences, 3(1), 27-29. http://www.isca.me/IJSS/Archive/v3/i1/6.ISCA-IRJSS-2013-186.pdf
Kanglang, R. (2021). Student satisfaction with online learning during the pandemic: A review of empirical studies. Journal of Education and Practice, 12(2), 24-37
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., ... & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and individual differences, 103, 102274 DOI: https://doi.org/10.1016/j.lindif.2023.102274
Khasawneh, M. a. S., & Shawaqfeh, A. T. (2024). Breaking traditional boundaries in translation pedagogy; Evaluating how senior lecturers have incorporated digital tools to enhance translation teaching. World Journal of English Language, 14(4), 154. https://doi.org/10.5430/wjel.v14n4p154 DOI: https://doi.org/10.5430/wjel.v14n4p154
Khoshafah, F. (2023). ChatGPT for Arabic-English translation: Evaluating the accuracy. https://doi.org/10.21203/rs.3.rs-2814154/v1 DOI: https://doi.org/10.21203/rs.3.rs-2814154/v2
Kiraly, D. (2014). A social Constructivist approach to translator education: Empowerment from Theory to Practice. Routledge DOI: https://doi.org/10.4324/9781315760186
Koka, N. A. (2024). The integration and utilization of artificial intelligence (AI) in supporting older/senior lecturers to adapt to the changing landscape in translation pedagogy. Migration Letters, 21(S1), 59-71. https://www.migrationletters.com DOI: https://doi.org/10.59670/ml.v21iS1.5939
Kornacki, M., & Pietrzak, P. (2024). Hybrid workflows in translation: Integrating GenAI into translator training [Print]. Routledge
Kynigos, C. (2015). Constructionism: Theory of Learning or Theory of Design? In Selected Regular Lectures from the 12th International Congress on Mathematical Mathematical Education (pp. 417-438). Springer. https://doi.org/10.1007/978-3-319-17187-6_24 DOI: https://doi.org/10.1007/978-3-319-17187-6_24
Levin, I., Semenov, A. L., & Gorsky, M. (2025). Smart Learning in the 21st Century: Advancing constructionism across three digital epochs. Education Sciences, 15(1), 45. https://doi.org/10.3390/educsci15010045 DOI: https://doi.org/10.3390/educsci15010045
Li, J. (2014). A Tentative Approach of Translation Education under the Constructivism Theory. Advances in Social Science, Education and Humanities Research/Advances in Social Science, Education and Humanities Research. https://doi.org/10.2991/icssr-14.2014.196 DOI: https://doi.org/10.2991/icssr-14.2014.196
Liang, Y., Wang, J., Zhu, H., Wang, L., Qian, W., & Lan, Y. (2023). Prompting Large Language Models with Chain-of-Thought for Few-Shot Knowledge Base Question Generation. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2310.08395 DOI: https://doi.org/10.18653/v1/2023.emnlp-main.263
Mohammed, S. Y. (2025). Stylistic accuracy in AI translation. Translation and Interpreting Studies, 20(2), 156-179
Mohammed, S. Y., & Aljanabi, M. (2024). Advancing Translation Quality Assessment: Integrating AI models for real-time feedback. EDRAAK, 2024, 1-7. https://doi.org/10.70470/edraak/2024/001 DOI: https://doi.org/10.70470/EDRAAK/2024/001
Mohsen, M. A. (2024). Artificial intelligence in academic translation: A comparative study of large language models and Google Translate. Psycholinguistics, 35(2), 134-156. https://doi.org/10.31470/2309-1797-2024-35-2-134-156 DOI: https://doi.org/10.31470/2309-1797-2024-35-2-134-156
Newmark, P. (1988). A textbook of translation. Prentice-Hall International
Omar, L. I., & Salih, A. A. (2024). Systematic Review of English/Arabic Machine Translation Postediting: Implications for AI Application in Translation Research and Pedagogy. Informatics, 11(2), 23. https://doi.org/10.3390/informatics11020023 DOI: https://doi.org/10.3390/informatics11020023
Pallant, J. (2020). SPSS survival manual: A step-by-step guide to data analysis using IBM SPSS (7th Ed.). McGraw-Hill DOI: https://doi.org/10.4324/9781003117452
Polit, D. F., & Beck, C. T. (2006). Essentials of Nursing Research: Methods, Appraisal, and Utilization (6th Ed.). Lippincott Williams & Wilkins
Richards, J. C., & Schmidt, R. (2002). Longman Dictionary of Language Teaching and Applied Linguistics (3rd Ed.)
Sadiq, S. (2025). Evaluating English-Arabic translation: Human translators vs. Google Translate and ChatGPT. Journal of Languages and Translation, 12(1), 67-95. https://doi.org/10.21608/jltmin.2025.423147 DOI: https://doi.org/10.21608/jltmin.2025.423147
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Cengage Learning
Somers, H. (2021). Neural machine translation in language learning and teaching: potentials and pitfalls. Lang. LearnJ, 12(2), 188-208
Thowaini, B., & Qassem, M. (2024). The impact of an industry-driven translation training program on the performance of trainee translators. Cogent Arts & Humanities, 11(1), 2339618. https://doi.org/10.1080/23311983.2024.2339618 DOI: https://doi.org/10.1080/23311983.2024.2339618
Tian, X. (2024). Personalized translator training in the era of digital intelligence: Opportunities, challenges, and prospects. Heliyon, (10), e39354. https://doi.org/10.1016/j.heliyon.2024.e39354 DOI: https://doi.org/10.1016/j.heliyon.2024.e39354
Vygotsky, L. S. (2018). Mind in society: Development of Higher Psychological Processes. Harvard University Press
Wang, Y. (2023). Artificial intelligence technologies in college English translation teaching. Journal of Psycholinguistic Research, 52(5), 1525-1544. https://doi.org/10.1007/s10936-023-09960-5 DOI: https://doi.org/10.1007/s10936-023-09960-5
Wang, Y. (2024). Preparing translators for the age of generative AI: Revising educational curricula to prioritize essential skills in an AI-dominated landscape. Advances in Humanities Research, 9. EWA Publishing. Published online: October 21, 2024. DOI:10.54254/2753-7080/9/2024109 DOI: https://doi.org/10.54254/2753-7080/9/2024109
Xu, S., Sun, Y., Su, Y., & Liu, K. (2025). Translation Pedagogy in the AI Era. In Translation Studies in the Age of Artificial Intelligence (pp. 100-124). Routledge. https://doi.org/10.4324/9781003482369-6 DOI: https://doi.org/10.4324/9781003482369-6
Xu, Y. (2024). AI empowered undergraduate translation teaching and professional improvement of translation teachers. International Journal of Education and Humanities, 17(2), 253-256. https://doi.org/10.54097/cytrjn11 DOI: https://doi.org/10.54097/cytrjn11
Yang, C., Chen, J., Hou, S., Wider, W., & Yi, W. L. (2025). How AI benefits student translators: An exploratory study on the impact of ChatGPT feedback on translation proficiency. Forum for Linguistic Studies, 7(10). https://doi.org/10.30564/fls.v7i10.11080 DOI: https://doi.org/10.30564/fls.v7i10.11080
Zhang, J., & Doherty, S. (2025). Investigating novice translation students’ AI literacy in translation education. The Interpreter and Translator Trainer, 19(3-4), 234-253. https://doi.org/10.1080/1750399x.2025.2541478 DOI: https://doi.org/10.1080/1750399X.2025.2541478
Downloads
Published
Issue
Section
License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
As an open-access the journal follows the CC BY-NC 4.0 Attribution-NonCommercial 4.0 International which states that:
- you are free to:
- Share— copy and redistribute the material in any medium or format.
- Adapt— remix, transform, and build upon the material.
- Under the following terms:
- Attribution— You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- NonCommercial — You may not use the material for commercial purposes.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
