Beyond Words: Towards a Multimodal Model of Subtitle Analysis
DOI:
https://doi.org/10.63939/ajts.eh2vnp27Keywords:
Multimodal Analysis, Subtitle Analysis, Taylor’s Multimodal Transcription Model, Audiovisual Translation (AVT)Abstract
The present article highlights the importance of adopting a multimodal approach to subtitle analysis in audiovisual translation (AVT) research. While existing studies have predominantly focused on verbal and textual dimensions, they have often underestimated the relevance of the interaction between linguistic, visual, and acoustic modes in audiovisual texts. To address this gap, the study adopts a multimodal perspective that conceptualizes subtitling as the outcome of meaning-making processes unfolding across multiple semiotic channels. In this regard, a subtitled excerpt from Hicham Ayouch’s 2021 comedy film Abdelinho was analyzed by using a modified version of Taylor’s (2016) multimodal transcription model (MT). The findings reveal that subtitling decisions are not shaped by language alone but are also influenced by multimodal and cinematic cues, resulting in shifts, omissions, or compensations across semiotic modes.
Downloads
References
Adami, E. (2023). A social semiotic multimodal approach to translation. In The Routledge handbook of translation theory and concepts (pp. 369–388). Routledge DOI: https://doi.org/10.4324/9781003161448-23
Baldry, A., & Thibault, P. (2006). Film texts and genres. In Multimodal transcription and text analysis: A multimodal toolkit and coursebook (pp. 165-249). Equinox
Díaz-Cintas, J. (2020). The name and nature of subtitling. In Ł. Bogucki & M. Deckert (Eds.), The Palgrave handbook of audiovisual translation and media accessibility (pp. 149-172). Palgrave Macmillan. https://doi.org/10.1007/978-3-030-42105-2_8 DOI: https://doi.org/10.1007/978-3-030-42105-2_8
Díaz-Cintas, J., & Remael, A. (2021). Subtitling: Concepts and practices. Routledge DOI: https://doi.org/10.4324/9781315674278
Gambier, Y. (2023). Audiovisual translation and multimodality: What future? Media and Intercultural Communication: A Multidisciplinary Journal, 1(1), 1-16. https://doi.org/10.22034/mic.2023.167451
Halliday, M. A. K. (1978). A sociosemiotic interpretation of language. In Language as social semiotic: The social interpretation of language and meaning (pp. 1-25). Edward Arnold
Kress, G., & van Leeuwen, T. (2020). Reading images: The grammar of visual design (3rd ed.). Routledge DOI: https://doi.org/10.4324/9781003099857
Lotman, J., & Clark, W. (2005). On the semiosphere. Sign Systems Studies, 33(1), 205-229. https://doi.org/10.12697/SSS.2005.33.1.09 DOI: https://doi.org/10.12697/SSS.2005.33.1.09
Lu, S. (2023). How existing literary translation fits into film adaptations: The subtitling of neologisms in Harry Potter from a multimodal perspective. Visual Communication. https://doi.org/10.1177/14703572221141959 DOI: https://doi.org/10.1177/14703572221141959
Newmark, P. (1988). A textbook of translation. Prentice Hall
Peirce, C. S. (1992). What is a sign? In N. Houser & C. Kloesel (Eds.), The essential Peirce: Selected philosophical writings (Vol. 2, pp. 5-10). Indiana University Press
Petrilli, S. (2014). Sign studies and semioethics: Communication, translation and values. De Gruyter Mouton DOI: https://doi.org/10.1515/9781614515227
Petrilli, S., & Zanoletti, M. (2023). Intersemiotic approaches. In The Routledge handbook of translation theory and concepts (pp. 340-368). Routledge DOI: https://doi.org/10.4324/9781003161448-22
Sulubacak, U., Caglayan, O., Grönroos, S.-A., Rouhe, A., Elliott, D., Specia, L., & Tiedemann, J. (2020). Multimodal machine translation through visuals and speech. Machine Translation, 34(2-3), 97-147. https://doi.org/10.1007/s10590-020-09250-0 DOI: https://doi.org/10.1007/s10590-020-09250-0
Taylor, C. (2013). Multimodality and audiovisual translation. In Y. Gambier & L. van Doorslaer (Eds.), Handbook of translation studies (Vol. 4, pp. 98-104). John Benjamins DOI: https://doi.org/10.1075/hts.4.mul2
Taylor, C. (2016). The multimodal approach in audiovisual translation. Target: International Journal of Translation Studies, 28(2), 222-236.
https://doi.org/10.1075/target.28.2.04tay DOI: https://doi.org/10.1075/target.28.2.04tay
Taylor, C. (2020). Multimodality and intersemiotic translation. In Ł. Bogucki & M. Deckert (Eds.), The Palgrave handbook of audiovisual translation and media accessibility (pp. 83-100). Palgrave Macmillan. https://doi.org/10.1007/978-3-030-42105-2_5 DOI: https://doi.org/10.1007/978-3-030-42105-2_5
مخرج “عبدلينو”: الفيلم لا يمس الدين وينتقد استغلاله؛ وباي: كوميديا مختلفة عن المعتاد. (2023، 10 يناير). مدار21. https://madar21.com/132210.html
---
Romanization of Arabic Bibliography
Director of "Abdelino": Al-Film la Yams Al-Din wa Yantaqid Istighlaluh; wa Bay: Komidya Mukhtalifa ‘an Al-Mu‘tad [The film does not offend religion but criticizes its exploitation; and Bay: A comedy different from the usual]. (2023, January 10). Madar21. https://madar21.com/132210.html
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
As an open-access the journal follows the CC BY-NC 4.0 Attribution-NonCommercial 4.0 International which states that:
- you are free to:
- Share— copy and redistribute the material in any medium or format.
- Adapt— remix, transform, and build upon the material.
- Under the following terms:
- Attribution— You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- NonCommercial — You may not use the material for commercial purposes.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
How to Cite
