Exploring the Effectiveness of Pedagogical Orientation of Generative AI Models on Enhancing University Students' Translation Skills: An Experimental Study

Authors

DOI:

https://doi.org/10.63939/ajts.yx0k0267

Keywords:

Translation Training, Generative AI, AI-driven Pedagogy, Translation Skills, Intervention, Arab Context

Abstract

This study attempted to bridge the research gap in AI-driven pedagogy for translation training in the Arab context, focusing on the potential of generative AI models to improve the translation proficiency of university translation majors. The research explored the effectiveness of pedagogically oriented generative AI tools in enhancing students’ skills across linguistic, cultural, and text-level dimensions in English ⇄ Arabic translation, using a true experimental pre-test-post-test control group design. While both groups used identical training materials, the experimental group received AI-guided training, and the control group was taught through traditional instruction. Through a random sampling (n = 37 per group), participants were recruited from four universities in Yemen and Oman, ensuring a comparable educational background. The findings revealed that the experimental group outperformed the control group in translation achievement in all targeted translation skills due to the impact of guided integration of AI. The study underscored the multi-faceted pedagogical applications of AI in translation education when grounded in a systematic pedagogical framework under instructor guidance. Through highlighting practical pedagogical implications and offering an evidence-based framework for integrating AI into translation programs, the research opens new avenues for innovative practices in AI-assisted translation pedagogy for instructors and curriculum designers.

Downloads

Download data is not yet available.

Author Biographies

  • Redhwan Qasem Alsharef, Hajjah University, Hajjah, Yemen

    Redhwan Qasem Alsharef is an Assistant Professor of English Language and Comparative Literature in the Department of English at Hajjah University, Republic of Yemen. He is a certified translator, translation trainer, and an expert in the development of translation programs and pedagogy. He has extensive experience in teaching translation courses as well as evaluating and developing translation programs across several universities. His research interests include the development of pedagogically oriented translation applications and programs supported by modern technologies, most notably the Translation Companion App, available on Google Play. The application can be accessed via the following link: https://play.google.com/store/apps/details?id=com.englishapp.englishapp

         
  • Faisal Ali Aldawli, Sana’a University, Sanaa, Yemen

    Faisal Ali Aldawli is an Assistant Professor of Translation and Head of the Translation Unit at the Language and Translation Center, Sana’a University. He has over a decade of academic and teaching experience in delivering translation courses within undergraduate programs at Sana’a University and several private universities.

     
  • Khaled Abdulrahman Alahdal , University of Nizwa, Nizwa, Oman

    Khaled Abdulrahman Alahdal  is an Associate Professor of English Language and Literature in the Department of Foreign Languages at the University of Nizwa, Sultanate of Oman. He has over fifteen years of academic experience teaching courses in English literature and translation.

  • Nuha Ali Shamsan, Hajjah University, Hajjah, Yemen

    Nuha Ali Shamsan holds a Master’s degree in Translation. She is a researcher, university lecturer, and translator with extensive professional experience in translating specialized documents across various fields.

         

References

Abu-Rayyash, E. A. (2017). Errors and non-errors in English-Arabic machine translation of gender-bound constructs in technical texts. Procedia Computer Science, 117, 73-80. https://doi.org/10.1016/j.procs.2017.10.095 DOI: https://doi.org/10.1016/j.procs.2017.10.095

Al-Ali, L. R. (2025). The influence of AI on improving translation skills: A survey study. Wasit Journal for Human Sciences, 21(1 Pt1), 919-950. https://doi.org/10.31185/wjfh.Vol21.Iss1/Pt1.841 DOI: https://doi.org/10.31185/wjfh.Vol21.Iss1/Pt1.841

Aleedy, M., Atwell, E., & Meshoul, S. (2022). Towards deep learning-powered chatbot for translation learning. School of Computing, University of Leeds; College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University. https://eprints.whiterose.ac.uk/183815/ DOI: https://doi.org/10.1007/978-3-031-05675-8_11

Alghamdi, F. A., & Alotaibi, H. (2025). Using AI in translation quality assessment: A case study of ChatGPT and legal translation texts. Electronics, 14(19), 3893. https://doi.org/10.3390/electronics14193893 DOI: https://doi.org/10.3390/electronics14193893

Alharbi, W. (2024). Future translators’ linguistic and non-linguistic competencies and skills in the age of neural machine translation and artificial intelligence: A content analysis. International Journal of Linguistics, Literature and Translation, 7(4), 124-143 DOI: https://doi.org/10.32996/ijllt.2024.7.4.16

Alqohfa, K. a. S., & Sanad, S. N. T. (2025). Linguistic and Cultural Challenges in Translating Idioms with Artificial Intelligence. Journal of English Studies in Arabia Felix, 4(1), 34-49. https://doi.org/10.56540/jesaf.v4i1.116 DOI: https://doi.org/10.56540/jesaf.v4i1.116

Amaro, V., & Pires, M. (2024). Found in translation, lost in education: Artificial intelligence's impacts on translation tertiary education in Macao. Asian Education and Development Studies. https://doi.org/10.1108/AEDS-01-2024-0012 DOI: https://doi.org/10.1108/AEDS-01-2024-0012

Atlas, S. (2023). ChatGPT for Higher Education and Professional Development: A guide to Conversational AI. DigitalCommons@URI. https://digitalcommons.uri.edu/cba_facpubs/548

Bakhov, I., Bilous, N., Saiko, M., Isaienko, S., Hurinchuk, S., & Nozhovnik, O. (2024). Beyond the dictionary: Redefining translation education with artificial intelligence-assisted app design and training. International Journal of Learning Teaching and Educational Research, 23(4), 119-140. https://doi.org/10.26803/ijlter.23.4.7 DOI: https://doi.org/10.26803/ijlter.23.4.7

Bhattacherjee, A. (2019). Social science Research: principles, methods and practices. In University of Southern Queensland ePrints (University of Southern Queensland). https://doi.org/10.26192/q7w89

Brown, K. (2019). Personalized learning and artificial intelligence in the language classroom. Journal of Educational Technology Research, 28(3), 232-245

Campbell, D. T., & Stanley, J. C. (2015). Experimental and Quasi-Experimental designs for research. Ravenio Books

Cheng, M. (2022). Practical exploration of English translation activity courses in colleges and universities under the background of artificial intelligence. Advances in Education and Teaching International, Special Issue. https://doi.org/10.1155/2022/4547342 DOI: https://doi.org/10.1155/2022/4547342

Conover, W. J. (1999). Practical Nonparametric Statistics (3rd Ed.). Wiley

Creswell, J. W., & Creswell, J. D. (2017). Research design: Qualitative, Quantitative, and Mixed Methods Approaches. SAGE Publications

Ed-Dali, R. (2025). Assessing DeepSeek R1 and ChatGPT 4.5 in Arabic-English literary translation: performance, challenges, and implications. Cogent Arts & Humanities, 12(1). https://doi.org/10.1080/23311983.2025.2531183 DOI: https://doi.org/10.1080/23311983.2025.2531183

Elen, J., Clarebout, G., Léonard, R., & Lowyck, J. (2007). Student-centred and teacher-centred learning environments: what students think. Teaching in Higher Education, 12(1), 105-117. https://doi.org/10.1080/13562510601102339 DOI: https://doi.org/10.1080/13562510601102339

Emara, E. a. E. M. (2024). Using AI Tools to Enhance Translation Skills among Basic Education English Major Students. CDELT Occasional Papers in the Development of English Education, 86(1), 339-380. https://doi.org/10.21608/opde.2024.362829 DOI: https://doi.org/10.21608/opde.2024.362829

Field, A. (2018). Discovering statistics using IBM SPSS statistics (5th Ed.). Sage

Grassini, S. (2023). Shaping the Future of Education: Exploring the Potential and Consequences of AI and ChatGPT in Educational Settings. Education Sciences, 13(7), 692. https://doi.org/10.3390/educsci13070692 DOI: https://doi.org/10.3390/educsci13070692

Hajdu, Z., & Farkas, J. (2025). AI technology in technical translation courses. Humán Innovációs Szemle, 16(1). https://doi.org/10.61177/hisz.2025.16.1.2 DOI: https://doi.org/10.61177/HISZ.2025.16.1.2

He, S. (2024). Prompting ChatGPT for translation: A Comparative analysis of translation brief and persona prompts. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2403.00127

Hellmich, E., & Vinall, K. (2021). FL instructor beliefs about machine translation: Ecological insights to guide research and practice. International Journal of Computer-Assisted Language Learning and Teaching (IJCALLT), 11(4), 1-18. https://doi.org/10.4018/IJCALLT.2021100101 DOI: https://doi.org/10.4018/IJCALLT.2021100101

Kalpana, T. (2014). A constructivist perspective on teaching and learning: A conceptual framework. International Research Journal of Social Sciences, 3(1), 27-29. http://www.isca.me/IJSS/Archive/v3/i1/6.ISCA-IRJSS-2013-186.pdf

Kanglang, R. (2021). Student satisfaction with online learning during the pandemic: A review of empirical studies. Journal of Education and Practice, 12(2), 24-37

Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., ... & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and individual differences, 103, 102274 DOI: https://doi.org/10.1016/j.lindif.2023.102274

Khasawneh, M. a. S., & Shawaqfeh, A. T. (2024). Breaking traditional boundaries in translation pedagogy; Evaluating how senior lecturers have incorporated digital tools to enhance translation teaching. World Journal of English Language, 14(4), 154. https://doi.org/10.5430/wjel.v14n4p154 DOI: https://doi.org/10.5430/wjel.v14n4p154

Khoshafah, F. (2023). ChatGPT for Arabic-English translation: Evaluating the accuracy. https://doi.org/10.21203/rs.3.rs-2814154/v1 DOI: https://doi.org/10.21203/rs.3.rs-2814154/v2

Kiraly, D. (2014). A social Constructivist approach to translator education: Empowerment from Theory to Practice. Routledge DOI: https://doi.org/10.4324/9781315760186

Koka, N. A. (2024). The integration and utilization of artificial intelligence (AI) in supporting older/senior lecturers to adapt to the changing landscape in translation pedagogy. Migration Letters, 21(S1), 59-71. https://www.migrationletters.com DOI: https://doi.org/10.59670/ml.v21iS1.5939

Kornacki, M., & Pietrzak, P. (2024). Hybrid workflows in translation: Integrating GenAI into translator training [Print]. Routledge

Kynigos, C. (2015). Constructionism: Theory of Learning or Theory of Design? In Selected Regular Lectures from the 12th International Congress on Mathematical ‎Mathematical Education ‎ (pp. 417-438). Springer. https://doi.org/10.1007/978-3-319-17187-6_24 DOI: https://doi.org/10.1007/978-3-319-17187-6_24

Levin, I., Semenov, A. L., & Gorsky, M. (2025). Smart Learning in the 21st Century: Advancing constructionism across three digital epochs. Education Sciences, 15(1), 45. https://doi.org/10.3390/educsci15010045 DOI: https://doi.org/10.3390/educsci15010045

Li, J. (2014). A Tentative Approach of Translation Education under the Constructivism Theory. Advances in Social Science, Education and Humanities Research/Advances in Social Science, Education and Humanities Research. https://doi.org/10.2991/icssr-14.2014.196 DOI: https://doi.org/10.2991/icssr-14.2014.196

Liang, Y., Wang, J., Zhu, H., Wang, L., Qian, W., & Lan, Y. (2023). Prompting Large Language Models with Chain-of-Thought for Few-Shot Knowledge Base Question Generation. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2310.08395 DOI: https://doi.org/10.18653/v1/2023.emnlp-main.263

Mohammed, S. Y. (2025). Stylistic accuracy in AI translation. Translation and Interpreting Studies, 20(2), 156-179

Mohammed, S. Y., & Aljanabi, M. (2024). Advancing Translation Quality Assessment: Integrating AI models for real-time feedback. EDRAAK, 2024, 1-7. https://doi.org/10.70470/edraak/2024/001 DOI: https://doi.org/10.70470/EDRAAK/2024/001

Mohsen, M. A. (2024). Artificial intelligence in academic translation: A comparative study of large language models and Google Translate. Psycholinguistics, 35(2), 134-156. https://doi.org/10.31470/2309-1797-2024-35-2-134-156 DOI: https://doi.org/10.31470/2309-1797-2024-35-2-134-156

Newmark, P. (1988). A textbook of translation. Prentice-Hall International

Omar, L. I., & Salih, A. A. (2024). Systematic Review of English/Arabic Machine Translation Postediting: Implications for AI Application in Translation Research and Pedagogy. Informatics, 11(2), 23. https://doi.org/10.3390/informatics11020023 DOI: https://doi.org/10.3390/informatics11020023

Pallant, J. (2020). SPSS survival manual: A step-by-step guide to data analysis using IBM SPSS (7th Ed.). McGraw-Hill DOI: https://doi.org/10.4324/9781003117452

Polit, D. F., & Beck, C. T. (2006). Essentials of Nursing Research: Methods, Appraisal, and Utilization (6th Ed.). Lippincott Williams & Wilkins

Richards, J. C., & Schmidt, R. (2002). Longman Dictionary of Language Teaching and Applied Linguistics (3rd Ed.)

Sadiq, S. (2025). Evaluating English-Arabic translation: Human translators vs. Google Translate and ChatGPT. Journal of Languages and Translation, 12(1), 67-95. https://doi.org/10.21608/jltmin.2025.423147 DOI: https://doi.org/10.21608/jltmin.2025.423147

Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Cengage Learning

Somers, H. (2021). Neural machine translation in language learning and teaching: potentials and pitfalls‎. Lang. LearnJ, 12(2), 188-208

Thowaini, B., & Qassem, M. (2024). The impact of an industry-driven translation training program on the performance of trainee translators. Cogent Arts & Humanities, 11(1), 2339618. https://doi.org/10.1080/23311983.2024.2339618 DOI: https://doi.org/10.1080/23311983.2024.2339618

Tian, X. (2024). Personalized translator training in the era of digital intelligence: Opportunities, challenges, and prospects. Heliyon, (10), e39354. https://doi.org/10.1016/j.heliyon.2024.e39354 DOI: https://doi.org/10.1016/j.heliyon.2024.e39354

Vygotsky, L. S. (2018). Mind in society: Development of Higher Psychological Processes. Harvard University Press

Wang, Y. (2023). Artificial intelligence technologies in college English translation teaching. Journal of Psycholinguistic Research, 52(5), 1525-1544. https://doi.org/10.1007/s10936-023-09960-5 DOI: https://doi.org/10.1007/s10936-023-09960-5

Wang, Y. (2024). Preparing translators for the age of generative AI: Revising educational curricula to prioritize essential skills in an AI-dominated landscape. Advances in Humanities Research, 9. EWA Publishing. Published online: October 21, 2024. DOI:10.54254/2753-7080/9/2024109 DOI: https://doi.org/10.54254/2753-7080/9/2024109

Xu, S., Sun, Y., Su, Y., & Liu, K. (2025). Translation Pedagogy in the AI Era. In Translation Studies in the Age of Artificial Intelligence (pp. 100-124). Routledge. https://doi.org/10.4324/9781003482369-6 DOI: https://doi.org/10.4324/9781003482369-6

Xu, Y. (2024). AI empowered undergraduate translation teaching and professional improvement of translation teachers. International Journal of Education and Humanities, 17(2), 253-256. https://doi.org/10.54097/cytrjn11 DOI: https://doi.org/10.54097/cytrjn11

Yang, C., Chen, J., Hou, S., Wider, W., & Yi, W. L. (2025). How AI benefits student translators: An exploratory study on the impact of ChatGPT feedback on translation proficiency. Forum for Linguistic Studies, 7(10). https://doi.org/10.30564/fls.v7i10.11080 DOI: https://doi.org/10.30564/fls.v7i10.11080

Zhang, J., & Doherty, S. (2025). Investigating novice translation students’ AI literacy in translation education. The Interpreter and Translator Trainer, 19(3-4), 234-253. https://doi.org/10.1080/1750399x.2025.2541478 DOI: https://doi.org/10.1080/1750399X.2025.2541478

Published

2026-05-03

How to Cite

Exploring the Effectiveness of Pedagogical Orientation of Generative AI Models on Enhancing University Students’ Translation Skills: An Experimental Study. (2026). Arabic Journal for Translation Studies, 5(15), 11-47. https://doi.org/10.63939/ajts.yx0k0267