Teachers’ orchestration of semiotic resources in EFL classrooms: a multimodal analysis

M. Ibnu Mustofa; Riswanto Riswanto; Pebri Prandika Putra

doi:10.23971/jefl.v13i2.6912

Teachers’ orchestration of semiotic resources in EFL classrooms: a multimodal analysis

M. Ibnu Mustofa, Riswanto Riswanto, Pebri Prandika Putra

Abstract

Teaching is an activity involving semiotic resources beyond verbal language. Therefore, more studies investigating what semiotic resources are employed and how they are utilized within EFL classroom settings are needed. This study sought to explore the types of semiotic resources employed by two EFL teachers in Indonesia and the roles of these semiotic resources in teaching activities. Through a qualitative case study, two EFL teachers in Bandung and Medan, Indonesia, were purposively selected. Data collection was through a semi-structured interview and document analysis. A six-phase of thematic analysis was employed to analyze the interview results, while a three-step of skimming, reading, and interpretation was used to analyze the documents. This study found that spoken language, pictures, videos, proxemics, gestures, head movements, gaze, and music were the semiotic resources used by both teachers in their teaching. The findings also demonstrated that these semiotic resources were used in the opening, delivering, and closing of the class, explaining learning content, performing interactions with students, checking the students' progress, managing classroom order, showing appreciation, and conducting evaluations. This study implies the crucial roles of all stakeholders in education to help EFL teachers in multimodal knowledge and practical strategy to create better teaching outcomes.

Keywords

classroom activities; English as a foreign language; multimodal pedagogy; semiotic resources; teaching and learning

Full Text:

PDF

Article Metrics

Abstract view : 25 times | PDF view : 13 times

References

Ajayi, L. (2010). Preservice teachers’ knowledge, attitudes, and perception of their preparation to teach multiliteracies/multimodality. The Teacher Educator, 46(1), 6–31. https://doi.org/10.1080/08878730.2010.488279

Alamri, W. A. (2019). Effectiveness of qualitative research methods: interviews and diaries. International Journal of English and Cultural Studies, 2(1), 65–70. https://doi.org/10.11114/ijecs.v2i1.4302

Almusharraf, N., & Engemann, J. (2020). Postsecondary instructors’ perspectives on teaching English as a foreign language by means of a multimodal digital literacy approach. International Journal of Emerging Technologies in Learning (IJET), 15(18), 86-107. https://doi.org/10.3991/ijet.v15i18.15451

Apriani, E., Azizah, U. A., Morgana, R., & Syafryadin, S. (2021). Multimodal resources to enrich meaning construction by EFL teacher. Journal of English Education and Teaching, 5(1), 123–137. https://ejournal.unib.ac.id/index.php/JEET/article/view/13573

Bernad-Mechó, E. (2021). Combining multimodal techniques to approach the study of academic lectures: a methodological reflection. Atlantis. Journal of the Spanish Association for Anglo-American Studies, 43(1), 178–198. https://doi.org/10.28914/Atlantis-2021-43.1.10

Bezemer, J., & Kress, G. (2008). Writing in multimodal texts: a social semiotic account of designs for learning. Written Communication, 25(2), 166–195. https://doi.org/10.1177/0741088307313177

Bowen, G. A. (2009). Document analysis as a qualitative research method. Qualitative Research Journal, 9(2), 27–40. https://doi.org/10.3316/QRJ0902027

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa

Braun, V., & Clarke, V. (2012). Thematic analysis. In H. Cooper, P. M. Camic, D. L. Long, A. T. Panter, D. Rindskopf, & K. J. Sher (Eds.), APA handbook of research methods in psychology, Vol 2: Research designs: quantitative, qualitative, neuropsychological, and biological. (pp. 57–71). American Psychological Association. https://doi.org/10.1037/13620-004

Bull, G., & Anstey, M. (2010). Evolving pedagogies: reading and writing in a multimodal world. Curriculum Press.

Choi, J., & Yi, Y. (2016). Teachers’ integration of multimodality into classroom practices for English language learners. TESOL Journal, 7(2), 304–327. https://doi.org/10.1002/tesj.204

Creswell, J. W., & Creswell, J. D. (2018). Research design: qualitative, quantitative, and mixed methods approaches (5th ed.). SAGE.

Danielsson, K., & Selander, S. (2021). Semiotic modes and representations of knowledge. In K. Danielsson, & S. Selander, Multimodal texts in disciplinary education (pp. 17–23). Springer International Publishing. https://doi.org/10.1007/978-3-030-63960-0_3

Djamdjuri, D. S., Suseno, M., Tajuddin, S., Lustyantie, N., & Chaeruman, U. A. (2021). Multimodal approach in online EFL class using Islamic learning materials: students’ perspective. International Journal of Language Education, 5(4), 337-355. https://doi.org/10.26858/ijole.v5i4.22495

Fitriana, W., & Wirza, Y. (2021). An analysis of multimodal text in EFL textbook of secondary school in Indonesia in assisting students’ text understanding. Proceedings of the Thirteenth Conference on Applied Linguistics (CONAPLIN 2020) (pp. 627-632). Atlantis Press. https://doi.org/10.2991/assehr.k.210427.095

Gargallo-Camarillas, N., & Girón-García, C. (2016). Learning styles’ influence in SL/FL reading. International Journal of Humanities and Social Science Invention. 7(5), 59-76. https://core.ac.uk/download/pdf/61490973.pdf.

Gilakjani, A. P., Ismail, H. N., & Ahmadi, S. M. (2011). The effect of multimodal learning models on language teaching and learning. Theory and Practice in Language Studies, 10(1), 1321–1327. https://doi.org/10.4304/tpls.1.10.1321-1327

Guichon, N., & McLornan, S. (2008). The effects of multimodality on L2 learners: implications for CALL resource design. System, 36(1), 85–93. https://doi.org/10.1016/j.system.2007.11.005

Hennink, M., Hutter, I., & Bailey, A. (2019). Qualitative research methods (2nd ed.). SAGE Publications Ltd.

Ho, W. Y. J., & Feng, D. (William). (2022). Orchestrating multimodal resources in English language teaching: a critical study of an online English teaching video. Pedagogies: An International Journal, 17(4), 368–388. https://doi.org/10.1080/1554480X.2022.2139257

Ilmi, K. A., & Dewi, D. N. (2022). The Integration of multimodality in EFL classes: students’ perception. Jo-ELT (Journal of English Language Teaching), 9(2), 150-159. https://doi.org/10.33394/jo-elt.v9i2.6343

Jauhara, D., Emilia, E., & Lukmana, I. (2021). Re-contextualising ‘greeting’: a multimodal analysis in an EFL textbook. Indonesian Journal of Functional Linguistics, 1(1), 15–24. https://doi.org/10.17509/ijsfl.v1i1.32621

Jewitt, C. (2009). Technology, literacy and learning: a multimodal approach. Routledge.

Jewitt, C., & Kress, G. R. (Eds.). (2003). Multimodal literacy. P. Lang.

Khoiriyah, K., & Ilmi, Ach. F. (2023). Multimodal digital extensive reading program: a reflection on literacy movement in madrasah and pesantren. Journal on English as a Foreign Language, 13(1), 265–288. https://doi.org/10.23971/jefl.v13i1.6059

Kress, G. R. (2010). Multimodality: a social semiotic approach to contemporary communication. Routledge.

Kress, G. R., & Van Leeuwen, T. (2020). Reading images: the grammar of visual design (3rd ed.). Routledge.

Lim, F. V. (2021). Investigating intersemiosis: a systemic functional multimodal discourse analysis of the relationship between language and gesture in classroom discourse. Visual Communication, 20(1), 34–58. https://doi.org/10.1177/1470357218820695

Lim, F. V., Chia, A., & Nguyen, T. T. H. (2022). “From the beginning, I think it was a stretch” – teachers’ perceptions and practices in teaching multiliteracies. English Teaching: Practice & Critique, 21(4), 379–396. https://doi.org/10.1108/ETPC-04-2021-0025

Lim, F. V., Towndrow, P. A., & Min Tan, J. (2021). Unpacking the teachers’ multimodal pedagogies in the primary English language classroom in Singapore. RELC Journal, 52(1), 1-15. https://doi.org/10.1177/00336882211011783

Lim, V. F. (2019). Analysing the teachers’ use of gestures in the classroom: a systemic functional multimodal discourse analysis approach. Social Semiotics, 29(1), 83–111. https://doi.org/10.1080/10350330.2017.1412168

Lincoln, Y. S., Guba, E. G., & Pilotta, J. J. (1985). Naturalistic inquiry. International Journal of Intercultural Relations, 9(4), 438–439. https://doi.org/10.1016/0147-1767(85)90062-8

Merriam, S. B., & Merriam, S. B. (2009). Qualitative research: a guide to design and implementation. Jossey-Bass.

Mildenhall, P., & Sherriff, B. (2018). Using multiple metaphors and multimodalities as a semiotic resource when teaching year 2 students computational strategies. Mathematics Education Research Journal, 30(4), 383–406. https://doi.org/10.1007/s13394-017-0212-8

Mills, J., & Birks, M. (2014). Qualitative methodology: a practical guide. SAGE Publications, Inc. https://doi.org/10.4135/9781473920163

Ministry of Education and Culture of the Republic of Indonesia. (2022). Keputusan kepala badan standar, kurikulum, dan asesmen pendidikan, kementerian pendidikan, kebudayaan, riset, dan teknologi nomor 008/H/Kr/2022 tentang capaian pembelajaran pada pendidikan anak usia dini, jenjang pendidikan dasar, dan jenjang pendidikan menengah pada kurikulum merdeka [The policy of head of the agency for education standards, curriculum, and assessment, ministry of education, culture, research, and technology number 008/H/Kr/2022 about learning outcomes in early childhood education, basic education, and secondary education in kurikulum merdeka]. https://kurikulum.kemdikbud.go.id/wp-content/unduhan/CP_2022.pdf

Moghtadi, L. (2013). Visual elements used in Iran EFL high school textbooks. International Journal of Foreign Language Teaching and Research, 1(1), 45–56. https://jfl.iaun.iau.ir/article_550497.html

Morell, T. (2018). Multimodal competence and effective interactive lecturing. System, 77(6), 70–79. https://doi.org/10.1016/j.system.2017.12.006

Mustofa, M. I., & Kurniawan, E. (2023). Theme and thematic progression in a recount text by an advanced student. Indonesian Journal of English Language Teaching and Applied Linguistics, 7(2), 481-494. http://dx.doi.org/10.21093/ijeltal.v7i2.1382

Mustofa, M. I., & Martina, F. (2019). The analysis of cultural content in two EFL textbooks used at SMA IT Iqra’ and SMKN 1 Bengkulu city. Journal of English Education and Teaching, 3(4), 481–493. https://doi.org/10.33369/jeet.3.4.481-493

Mustofa, M. I., & Wirza, Y. (2023). Promoting learner autonomy through EFL textbook: the textbook facilitation and the students’ and teacher’s perceptions. Journal on English as a Foreign Language, 13(1), 289–313. https://doi.org/10.23971/jefl.v13i1.6056

Nabifar, N., & Baghermousavi, M. S. (2015). Social semiotics evaluation of English one by gender. Studies in English Language and Education, 2(2), 74-86. https://doi.org/10.24815/siele.v2i2.2692

Norris, S. (2004). Analyzing multimodal interaction: a methodological framework. Routledge.

Norris, S. (2020). Multimodal theory and methodology: for the analysis of (inter)action and identity (1st ed.). Routledge. https://doi.org/10.4324/9780429351600

Pantidos, P. (2017). Narrating science in the classroom: the role of semiotic resources in evoking imaginative thinking. Journal of Science Teacher Education, 28(4), 388–401. https://doi.org/10.1080/1046560X.2017.1345557

Pham, Q. N., & Li, M. (2022). Digital multimodal composing using Visme: EFL students’ perspectives. The Asia-Pacific Education Researcher, 31(5), 1-12. https://doi.org/10.1007/s40299-022-00687-w

Pramono, P. (2019). The teachers’ use of semiotic resources in EFL classrooms: a multimodal analysis [Master’s thesis, Universitas Pendidikan Indonesia]. http://repository.upi.edu/44663/

Purba, R., Herman, Fatmawati, E., Saputra, N., & Yusniati N. S. (2023). Multimodal-based learning improves students’ reading ability in perspective of systemic functional linguistics. Journal of Education Technology, 7(1), 61–70. https://doi.org/10.23887/jet.v7i1.54336

Qin, Y., & Wang, P. (2021). How EFL teachers engage students: a multimodal analysis of pedagogic discourse during classroom lead-ins. Frontiers in Psychology, 12(1), 1-16. https://doi.org/10.3389/fpsyg.2021.793495

Robinson, R. S. (2014). Purposive sampling. In A. C. Michalos (Ed.), Encyclopedia of quality of life and well-being research (pp. 5243–5245). Springer Netherlands. https://doi.org/10.1007/978-94-007-0753-5_2337

Rowsell, J., & Collier, D. R. (2017). Researching multimodality in language and education. In K. A. King, Y.-J. Lai, & S. May (Eds.), Research methods in language and education (pp. 311–324). Springer International Publishing. https://doi.org/10.1007/978-3-319-02249-9_23

Sakulprasertsri, K. (2020). Teacher’s integration of multimodality into 21st century EFL classrooms in Thailand: practice and perception. LEARN Journal: Language Education and Acquisition Research Network Journal, 13(2), 225-242. https://eric.ed.gov/?id=EJ1258740

Shanahan, L. E., & Flury-Kashmanian, C. (2014). Orchestrating semiotic resources in explicit strategy instruction. Pedagogies: An International Journal, 9(2), 99–115. https://doi.org/10.1080/1554480X.2014.899484

Sukyadi, D., Hermawan, B., & Dallyono, R. (2016). Transduction and transformation of semiotic resources in an English classroom. Malaysian Journal of ELT Research, 12(1), 60-72. https://meltajournals.com/index.php/majer/article/view/580/563

Tan, X., & Matsuda, P. K. (2020). Teacher beliefs and pedagogical practices of integrating multimodality into first-year composition. Computers and Composition, 58(4), 1-16. https://doi.org/10.1016/j.compcom.2020.102614

The New London Group (1996). A pedagogy of multiliteracies: designing social futures. Harvard Educational Review, 66(1), 60–93. http://newarcproject.pbworks.com/f/Pedagogy+of+Multiliteracies_New+London+Group.pdf

Trisanti, N., Suherdi, D., & Sukyadi, D. (2022). Multimodality reflected in EFL teaching materials: Indonesian EFL in-service teacher’s multimodality literacy perception. LANGUAGE CIRCLE: Journal of Language and Literature, 17(1), 12–22. https://doi.org/10.15294/lc.v17i1.38776

Wardini, O., Megawati, F., & Astutik, Y. (2021). Picture book: its effect on EFL reading comprehension. Advances in Social Science, Education and Humanities Research: Proceedings of the 1st Paris Van Java International Seminar on Health, Economics, Social Science and Humanities (PVJ-ISHESSH 2020) (pp. 165-169). Atlantis Press. https://doi.org/10.2991/assehr.k.210304.036

Wigham, C. R., & Satar, M. (2021). Multimodal (inter)action analysis of task instructions in language teaching via videoconferencing: a case study. ReCALL, 33(3), 195–213. https://doi.org/10.1017/S0958344021000070

Wilmes, S. E. D., & Siry, C. (2021). Multimodal interaction analysis: a Powerful tool for examining plurilingual students’ engagement in science practices. Research in Science Education, 51(1), 71–91. https://doi.org/10.1007/s11165-020-09977-z

Wulan, D. R., Drajati, N. A., & Supriadi, S. (2022). Exploring EFL students’ digital multimodal composing (DMC) affordance: Stories from a vocational school. L-Ishlah: Jurnal Pendidikan, 14(2), 2007–2018. https://doi.org/10.35445/alishlah.v14i1.1970

Yi, Y. (2014). Possibilities and challenges of multimodal literacy practices in teaching and learning English as an additional language. Language and Linguistics Compass, 8(4), 158–169. https://doi.org/10.1111/lnc3.12076

Yi, Y., & Angay-Crowder, T. (2016). Multimodal pedagogies for teacher education in TESOL. TESOL Quarterly, 50(4), 988–998. https://doi.org/10.1002/tesq.326

Yin, R. K. (2014). Case study research: Design and methods (5th ed.). SAGE.

Yunus, M. M., Suciati, S., Ritonga, M., & Kumar, T. (2022). Multimodal teaching practices for EFL teacher education: an action-based research study. Journal for Educators, Teachers, and Trainers, 13(1), 141-148. https://doi.org/10.47750/jett.2022.13.01.016

DOI: https://doi.org/10.23971/jefl.v13i2.6912