Exploring University Students’ AI Literacy through Reflective Journals

Authors

  • Yong-Jik Lee
  • Seung-Hoon Jeong

Keywords:

AI literacy; university students; generative AI; qualitative thematic analysis; higher education

Abstract

University students increasingly use generative artificial intelligence (GenAI) for academic work, yet frequent access can coexist with uncritical reliance, inaccurate output, and uncertainty about authorship and responsible use. Although AI-literacy scales identify broad dimensions of competence, fewer qualitative studies have examined how non-Science, Technology, Engineering and Mathematics students describe AI literacy after a credit-bearing course. This qualitative study explored how university students conceptualized AI literacy and AI-supported learning through end-of-course reflective journals. Using voluntary response sampling, 20 students enrolled in a regular three?credit general education course at a Korean national university consented to the study of their journals. Two findings encompassing five subthemes were identified: (1) AI literacy as critical and ethical academic competence, including competence beyond technical skill, verification and epistemic responsibility, and ethical authorship; and (2) learner?controlled AI-supported learning, including personalized learning support and human-AI collaboration. Participants described AI literacy as involving inquiry, evaluation, transparency, responsibility, and retention of human judgment. Because the study used retrospective self-reports from one course and did not triangulate journals with interviews, observations, or performance measures, the findings represent participants’ perceptions rather than measured competence or causal course effects.

https://doi.org/10.26803/ijlter.25.9.4

References

Alamäki, A., Nyberg, C., Kimberley, A., & Salonen, A. O. (2024). Artificial intelligence literacy in sustainable development: A learning experiment in higher education. Frontiers in Education, 9, Article 1343406.

https://doi.org/10.3389/feduc.2024.1343406

Cardon, P., Fleischmann, C., Aritz, J., Logemann, M., & Heidewald, J. (2023). The challenges and opportunities of AI-assisted writing: Developing AI literacy for the AI age. Business and Professional Communication Quarterly, 86(3), 257–295. https://doi.org/10.1177/23294906231176517

Cetindamar, D., Kitto, K., Wu, M., Zhang, Y., Abedin, B., & Knight, S. (2024). Explicating AI literacy of employees at digital workplaces. IEEE Transactions on Engineering Management, 71, 810–823. https://doi.org/10.1109/tem.2021.3138503

Chan, C. K. Y., & Hu, W. (2023). Students' voices on generative AI: Perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education, 20, Article 43. https://doi.org/10.1186/s41239-023-00411-8

Christ-Brendemühl, S. (2025). Leveraging generative AI in higher education: An analysis of opportunities and challenges addressed in university guidelines. European Journal of Education, 60(1), Article e12891. https://doi.org/10.1111/ejed.12891

Gümü?, M. M., & Kara, M. (2025). Development and validation of the Generative AI Literacy for Learning Scale (GenAI-LLs). Australasian Journal of Educational Technology, 41(4), 1–16. https://doi.org/10.14742/ajet.10236

Hou, C., Zhu, G., Sudarshan, V., Lim, F. S., & Ong, Y. S. (2025). Measuring undergraduate students' reliance on generative AI during problem-solving: Scale development and validation. Computers & Education, 234, Article 105329. https://doi.org/10.1016/j.compedu.2025.105329

Hwang, H. S., Zhu, L. C., & Cui, Q. (2023). Development and validation of a digital literacy scale for college students in the era of artificial intelligence. KSII Transactions on Internet and Information Systems, 17(8), 2241–2258.

https://doi.org/10.3837/tiis.2023.08.016

Jeong, H. (2025). From curriculum to strategy: Tracing shifts in AI education policy in South Korea through keyword and topic analysis. Asia Pacific Journal of Education, 1–30. https://doi.org/10.1080/02188791.2025.2580988

Johnston, H., Wells, R. F., Shanks, E. M., Boey, T., & Parsons, B. N. (2024). Student perspectives on the use of generative artificial intelligence technologies in higher education. International Journal for Educational Integrity, 20, Article 2. https://doi.org/10.1007/s40979-024-00149-4

Kong, S. C., Cheung, W. M. Y., & Zhang, G. (2023). Evaluating an artificial intelligence literacy programme for developing university students' conceptual understanding, literacy, empowerment, and ethical awareness. Educational Technology & Society, 26(1), 16–30. https://www.jstor.org/stable/48707964

Kong, S.-C., Korte, S. M., Burton, S., Keskitalo, P., Turunen, T., Smith, D., Wang, L., Lee, J. C.-K., & Beaton, M. C. (2025). Artificial intelligence (AI) literacy – An argument for AI literacy in education. Innovations in Education and Teaching International, 62(2), 477–483. https://doi.org/10.1080/14703297.2024.2332744

Laupichler, M. C., Aster, A., Haverkamp, N., & Raupach, T. (2023). Development of the "Scale for the assessment of non-experts' AI literacy" – An exploratory factor analysis. Computers in Human Behavior Reports, 12, Article 100338. https://doi.org/10.1016/j.chbr.2023.100338

Lee, J., & Jeong, H. (2023). Keyword analysis of artificial intelligence education policy in South Korea. IEEE Access, 11, 102408–102417. https://doi.org/10.1109/ACCESS.2023.3317261

Lee, Y.-J., Oh, J., & Hong, C. (2024). Exploratory research on understanding university students' artificial intelligence literacy in a Korean university. Online Journal of Communication and Media Technologies, 14(3), e202440. https://doi.org/10.30935/ojcmt/14711

Lee, Y. J., & Davis, R. O. (2025). Assessing the impact of prior coding and artificial intelligence learning on non-computing majors' perception of AI in a university context. Information, 16(4), 277. https://doi.org/10.3390/info16040277

Ma, S., & Chen, Z. (2024). The development and validation of the Artificial Intelligence Literacy Scale for Chinese college students (AILS-CCS). IEEE Access, 12, 146419–146429. https://doi.org/10.1109/access.2024.3468378

Ng, D. T. K., Wu, W., Leung, J. K. L., Chiu, T. K. F., & Chu, S. K. W. (2024). Design and validation of the AI literacy questionnaire: The affective, behavioural, cognitive and ethical approach. British Journal of Educational Technology, 55(3), 1082–1104. https://doi.org/10.1111/bjet.13411

Ning, Y., Zhang, W., Yao, D., Fang, B., Xu, B., & Wijaya, T. T. (2025). Development and validation of the Artificial Intelligence Literacy Scale for Teachers (AILST). Education and Information Technologies. https://doi.org/10.1007/s10639-025-13347-5

Nong, Y., Cui, J., He, Y., Zhang, P., & Zhang, T. (2024). Development and validation of an AI lite racy scale. Journal of Artificial Intelligence Research, 1(1), 17–26. https://doi.org/10.70891/JAIR.2024.100029

Yilmaz, F. G., Yilmaz, R., & Ceylan, M. (2024). Generative artificial intelligence acceptance scale: A validity and reliability study. International Journal of Human–Computer Interaction, 40(24), 8703–8715. https://doi.org/10.1080/10447318.2023.2288730

Vaismoradi, M., Turunen, H., & Bondas, T. (2013). Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nursing & health sciences, 15(3), 398-405. https://doi.org/10.1111/nhs.12048

Downloads

Published

2026-09-30

How to Cite

Lee, Y.-J. ., & Jeong, S.-H. (2026). Exploring University Students’ AI Literacy through Reflective Journals. International Journal of Learning, Teaching and Educational Research, 25(9), 77–89. Retrieved from https://ijlter.myres.net/index.php/ijlter/article/view/3040