Mitigating Cognitive Overload in Deaf Education: The Pedagogical Impact of a Multimodal Instructional Design on Digital Media Literacy Retention
Keywords:
cognitive load theory; deaf education; digital media literacy; multimodal instruction; universal design for learningAbstract
In evolving digital landscapes, the acquisition of digital media literacy (DML) remains a systemic challenge for deaf and hard-of-hearing (DHH) students. This disparity is largely driven by the extraneous cognitive overload and the split-attention effect caused by conventional, auditory-centric multimedia designs relegating sign language and captions to peripheral windows. This study investigates the educational efficacy of a newly developed multimodal instructional framework engineered to address these barriers by integrating a prominent visual-spatial sign language interface (Big Sign) with Universal Design for Learning (UDL) principles. Employing a one-group quasi-experimental approach, the research evaluated the proposed framework by comparing baseline pre-test scores against immediate knowledge acquisition and short-term retention among 30 DHH learners in higher education over a two-week period. Statistical analyses revealed that the intervention significantly improved initial DML competency (pre-test to post-test) and sustained high retention rates over two weeks. Furthermore, qualitative assessments conducted via semi-structured interviews highlighted a transition from fragmented, visually taxing attention patterns to a more integrated and naturalistic visual learning experience, thereby maximizing pedagogical engagement. While limited by the absence of a control group, these findings offer a scalable, evidence-based model for educators and instructional designers to transcend mere technical accessibility compliance and move toward the creation of cognitively equitable digital learning environments that optimize knowledge encoding for DHH populations.
https://doi.org/10.26803/ijlter.25.7.21
References
Abdullina, K., & Zolotovitskaya, A. (2023). Social integration and activities of children with hearing loss with digital literacy strategies. Education and Information Technologies, 29(6), 1–22. https://doi.org/10.1007/s10639-023-12099-4
Alit, N. A., Ellias, M. S., & Ahmad, A. D. (2025). Technology application in teaching and learning for hearing impaired students: A recent systematic review. International Journal of Education, Psychology and Counseling, 10(58), 541–561. https://doi.org/10.35631/IJEPC.1058036
AlRawi, J. M., & AlKahtani, M. A. (2021). Universal design for learning for educating students with intellectual disabilities: A systematic review. International Journal of Developmental Disabilities, 68(6), 800–808. https://doi.org/10.1080/20473869.2021.1900505
Alsalamah, A. (2020). Using captioning services with deaf and hard of hearing students in higher education: A systematic review. American Annals of the Deaf, 165(1), 114–127. https://doi.org/10.1353/aad.2020.0012
Blom, H., Segers, E., Knoors, H., Hermans, D., & Verhoeven, L. (2019). Comprehension of networked hypertexts in students with hearing or language problems. Learning and Individual Differences, 73, 124–137. https://doi.org/10.1016/j.lindif.2019.05.006
Boyle, J. R., Watson, L., & Robinson, H. E. (2024). Smartpens for students with disabilities in inclusive content-area classes. Journal of Special Education Technology, 39(1), 151–159. https://doi.org/10.1177/01626434231184877
Bulger, M., & Davison, P. (2018). The promises, challenges, and futures of media literacy. Journal of Media Literacy Education, 10(1), 1–21. https://doi.org/10.23860/JMLE-2018-10-1-1
Burke, D. D., Clapper, D., & McRae, D. (2016). Accessible online instruction for students with disabilities: Federal imperatives and the challenge of compliance. Journal of Law & Education, 45(2), 135–158.
Cabero-Almenara, J., Gutiérrez-Castillo, J. J., Palacios-Rodríguez, A., & Guillén-Gámez, F. D. (2023). Digital competence of university students with disabilities and factors that determine it: A descriptive, inferential and multivariate study. Education and Information Technologies, 28(8), 9417–9436. https://doi.org/10.1007/s10639-022-11297-w
Campoverde-Molina, M., Luján-Mora, S., & Valverde, L. (2023). Accessibility of university websites worldwide: A systematic literature review. Universal Access in the Information Society, 22(1), 133–168. https://doi.org/10.1007/s10209-021-00825-z
Cho, M., & Kim, K. M. (2022). Effect of digital divide on people with disabilities during the COVID-19 pandemic. Disability and Health Journal, 15(1), Article 101214. https://doi.org/10.1016/j.dhjo.2021.101214
Davis, J. S. (2020). Game framework analysis and cognitive learning theory providing a theoretical foundation for efficacy in learning in educational gaming. International Journal of Learning, Teaching and Educational Research, 19(7), 159-175. https://doi.org/10.26803/ijlter.19.7.9
DeForte, S., Sezgin, E., Huefner, J., Lucius, S., Luna, J., Satyapriya, A. A., & Malhotra, P. (2020). Usability of a mobile app for improving literacy in children with hearing impairment: Focus group study. JMIR Human Factors, 7(2), Article e16310. https://doi.org/10.2196/16310
Evmenova, A., Vermeer, A., Cooney, L., Washburn, J., Jackson, T., & Sulaimon, T. (2024). Evidence-based technology tools to support diverse learners, educators, and service providers across instructional settings. Focus on Exceptional Children, 48(2), 1–25. https://doi.org/10.17161/foec.v48i2.22951
Fernández Batanero, J. M., Rueda Montenegro, M., Cerero Fernández, J., & García Alonso, S. (2022). Challenges and trends in the use of technology by hearing impaired students in higher education. Technology and Disability, 34(2), 101–111. https://doi.org/10.3233/TAD-220360
Gareyev, A. A., Ponomarenko, E. P., Shishkina, A. A., & Krasavina, Yu. V. (2023). Structure and contents of hearing impaired university students’ epistemic competence within digital learning environment: Criteria and evaluation methods. Science for Education Today, 13(4), 148–169. http://dx.doi.org/10.15293/2658-6762.2304.07
Graham, P., Neild, R., & Kenyon, K. (2023). Deaf education teachers and online instruction: Ensuring equity in instructional activities and collaboration. American Annals of the Deaf, 168(3), 55–70. https://doi.org/10.1353/aad.2023.a908902
Ibraimkulov, A., Khalikova, K., Yerimbetova, A., & Gromaszek, K. (2022). Enhancement of digital literacy of students with disabilities. European Journal of Contemporary Education, 11(2), 388–407. https://doi.org/10.13187/ejced.2022.2.388
King, C., & Piotrowski, C. (2021). Navigating the ADA accessibility requirements and legal pitfalls in online education. College Student Journal, 55(2), 127–134.
Krasavina, Y., Ponomarenko, E., Shishkina, A., & Gareyev, A. (2025). Digital divide and operational digital literacy in deaf and hard-of-hearing students. Specijalna Edukacija I Rehabilitacija, 24(1), 1–19. https://doi.org/10.5937/specedreh24-51366
Krasavina, Yu. V., Ponomarenko, ?. P., Gareyev, ?. ?., & Shishkina, ?. ?. (2023). Learning experiences of deaf and hard-of-hearing students in digital media: Challenges and the use of cognitive and metacognitive strategies. Science for Education Today, 13(6), 60–81. http://dx.doi.org/10.15293/2658-6762.2306.03
Kritzer, K. L., & Smith, C. E. (2020). Changing perspectives for the 21st century: Digital literacy and computational thinking for deaf/hard-of-hearing learners. In M. Marschark & H. Knoors (Eds.), The Oxford Handbook of Deaf Studies in Learning and Cognition (pp. 332–346). Oxford University Press.
Kuntze, M., Branum-Martin, L., & Scott, J. (2023). Pandemic effects on the reading trajectories of deaf and hard of hearing students: A pilot analysis. Reading and Writing, 36(2), 429–448. https://doi.org/10.1007/s11145-022-10365-4
Livingstone, S. (2022). Media literacy policy: An umbrella concept for multiple realities. In R. Hobbs & P. Mihailidis (Eds.), The Routledge Handbook of Media Education Futures Post-pandemic. Routledge.
Marschark, M., Pelz, J. B., Convertino, C., Sapere, P., Arndt, M. E., & Seewagen, R. (2008). Classroom interpreting and visual information processing in mainstream education for deaf students: Live or Memorex? American Educational Research Journal, 45(3), 727–761. https://doi.org/10.3102/00028312042004727
Mayer, R. E. (2014). Cognitive theory of multimedia learning. In R. E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (2nd ed., pp. 43–71). Cambridge University Press. https://doi.org/10.1017/CBO9781139547369.005
Muchuweni, T., & Jojo Z. (2026). Learning design architecture of visual feedback and gamified design in secondary mathematics: Effects on student learning and performance. International Journal of Learning, Teaching and Educational Research, 25(2), 330-347. https://doi.org/10.26803/ijlter.25.2.16
Paivio, A. (1986). Mental representations: A dual-coding approach. Oxford University Press.
Paivio, A. (1991). Dual coding theory: Retrospect and current status. Canadian Journal of Psychology/Revue Canadienne de Psychologie, 45(3), 255–287. https://doi.org/10.1037/h0084295
Qing, X., & Jing, G. (2024). Digital literacy in a global context: Constructing models for international Chinese teachers across regions and countries. International Journal of Learning, Teaching and Educational Research, 23(7), 539-561. https://doi.org/10.26803/ijlter.23.7.27
Rutledge, F. (2025). Enhancing digital accessibility for deaf or hard of hearing learners: Innovative strategies for inclusive education. Developmental Disabilities Network Journal, 5(1), Article 8. https://doi.org/10.59620/2694-1104.1122
Sachdeva, N., Tuikka, A. M., Kimppa, K. K., & Suomi, R. (2015). Digital disability divide in information society: A framework based on a structured literature review. Journal of Information, Communication and Ethics in Society, 13(3/4), 283–298. https://doi.org/10.1108/JICES-10-2014-0050
Skyer, M. E. (2023). Multimodal transduction and translanguaging in deaf pedagogy. Languages, 8(2), Article 127. https://doi.org/10.3390/languages8020127
Spires, H. A., Medlock Paul, C., & Kerkhoff, S. N. (2019). Digital literacy for the 21st century. In M. Khosrow-Pour (Ed.), Advanced Methodologies and Technologies in Library Science, Information Management, and Scholarly Inquiry (pp. 12–21). IGI Global. https://doi.org/10.4018/978-1-5225-7659-4.ch002
Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive Science, 12(2), 257–285. https://doi.org/10.1207/s15516709cog1202_4
Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learning and Instruction, 4(4), 295–312. https://doi.org/10.1016/0959-4752(94)90003-5
Tabieh, A. A. S., Hamzeh, M., Abu-Foudeh, B. K. S., Jarrar, N., Al-Manaseer, S., Al-Shawabkeh, A., & Seikaly, R. (2021). Digital literacy and its acquisition by teachers and principals at educational workplaces. International Journal of Learning, Teaching and Educational Research, 20(5), 38-55. https://doi.org/10.26803/ijlter.20.5.3
UNESCO Institute for Statistics. (2018). A global framework of reference on digital literacy skills for indicator 4.4.2 (UIS Information Paper No. 51). UNESCO. https://unesdoc.unesco.org/ark:/48223/pf0000265403
Valle, N., Zhao, P., Freed, D., Gorton, K., Chapman, A. B., Shea, A. L., & Bazarova, N. N. (2025). Towards a critical framework of social media literacy: A systematic literature review. Review of Educational Research, 95(4), 701–746. https://doi.org/10.3102/00346543241235678
Venkatesan, S. (2025). Digital literacy in people with disabilities: An overview and narrative review. Global Journal of Arts Humanity and Social Sciences, 3(12), 1475–1494.
Weber, J., Hayward, D., Skyer, M., & Snively, S. (2025). Applied deaf aesthetics toward transforming deaf higher education. Journal of Deaf Studies and Deaf Education, 30(1), 108–125. https://doi.org/10.1093/jdsade/enae050
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Sirodom Maneehaet, Pongpipat Saithong, Khachakrit Liamthaisong
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
All articles published by IJLTER are licensed under a Creative Commons Attribution Non-Commercial No-Derivatives 4.0 International License (CCBY-NC-ND4.0).
