Exploring University Students’ AI Literacy through Reflective Journals
Keywords:
AI literacy; university students; generative AI; qualitative thematic analysis; higher educationAbstract
University students increasingly use generative artificial intelligence (GenAI) for academic work, yet frequent access can coexist with uncritical reliance, inaccurate output, and uncertainty about authorship and responsible use. Although AI-literacy scales identify broad dimensions of competence, fewer qualitative studies have examined how non-Science, Technology, Engineering and Mathematics students describe AI literacy after a credit-bearing course. This qualitative study explored how university students conceptualized AI literacy and AI-supported learning through end-of-course reflective journals. Using voluntary response sampling, 20 students enrolled in a regular three?credit general education course at a Korean national university consented to the study of their journals. Two findings encompassing five subthemes were identified: (1) AI literacy as critical and ethical academic competence, including competence beyond technical skill, verification and epistemic responsibility, and ethical authorship; and (2) learner?controlled AI-supported learning, including personalized learning support and human-AI collaboration. Participants described AI literacy as involving inquiry, evaluation, transparency, responsibility, and retention of human judgment. Because the study used retrospective self-reports from one course and did not triangulate journals with interviews, observations, or performance measures, the findings represent participants’ perceptions rather than measured competence or causal course effects.
https://doi.org/10.26803/ijlter.25.9.4
References
Alamäki, A., Nyberg, C., Kimberley, A., & Salonen, A. O. (2024). Artificial intelligence literacy in sustainable development: A learning experiment in higher education. Frontiers in Education, 9, Article 1343406.
https://doi.org/10.3389/feduc.2024.1343406
Cardon, P., Fleischmann, C., Aritz, J., Logemann, M., & Heidewald, J. (2023). The challenges and opportunities of AI-assisted writing: Developing AI literacy for the AI age. Business and Professional Communication Quarterly, 86(3), 257–295. https://doi.org/10.1177/23294906231176517
Cetindamar, D., Kitto, K., Wu, M., Zhang, Y., Abedin, B., & Knight, S. (2024). Explicating AI literacy of employees at digital workplaces. IEEE Transactions on Engineering Management, 71, 810–823. https://doi.org/10.1109/tem.2021.3138503
Chan, C. K. Y., & Hu, W. (2023). Students' voices on generative AI: Perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education, 20, Article 43. https://doi.org/10.1186/s41239-023-00411-8
Christ-Brendemühl, S. (2025). Leveraging generative AI in higher education: An analysis of opportunities and challenges addressed in university guidelines. European Journal of Education, 60(1), Article e12891. https://doi.org/10.1111/ejed.12891
Gümü?, M. M., & Kara, M. (2025). Development and validation of the Generative AI Literacy for Learning Scale (GenAI-LLs). Australasian Journal of Educational Technology, 41(4), 1–16. https://doi.org/10.14742/ajet.10236
Hou, C., Zhu, G., Sudarshan, V., Lim, F. S., & Ong, Y. S. (2025). Measuring undergraduate students' reliance on generative AI during problem-solving: Scale development and validation. Computers & Education, 234, Article 105329. https://doi.org/10.1016/j.compedu.2025.105329
Hwang, H. S., Zhu, L. C., & Cui, Q. (2023). Development and validation of a digital literacy scale for college students in the era of artificial intelligence. KSII Transactions on Internet and Information Systems, 17(8), 2241–2258.
https://doi.org/10.3837/tiis.2023.08.016
Jeong, H. (2025). From curriculum to strategy: Tracing shifts in AI education policy in South Korea through keyword and topic analysis. Asia Pacific Journal of Education, 1–30. https://doi.org/10.1080/02188791.2025.2580988
Johnston, H., Wells, R. F., Shanks, E. M., Boey, T., & Parsons, B. N. (2024). Student perspectives on the use of generative artificial intelligence technologies in higher education. International Journal for Educational Integrity, 20, Article 2. https://doi.org/10.1007/s40979-024-00149-4
Kong, S. C., Cheung, W. M. Y., & Zhang, G. (2023). Evaluating an artificial intelligence literacy programme for developing university students' conceptual understanding, literacy, empowerment, and ethical awareness. Educational Technology & Society, 26(1), 16–30. https://www.jstor.org/stable/48707964
Kong, S.-C., Korte, S. M., Burton, S., Keskitalo, P., Turunen, T., Smith, D., Wang, L., Lee, J. C.-K., & Beaton, M. C. (2025). Artificial intelligence (AI) literacy – An argument for AI literacy in education. Innovations in Education and Teaching International, 62(2), 477–483. https://doi.org/10.1080/14703297.2024.2332744
Laupichler, M. C., Aster, A., Haverkamp, N., & Raupach, T. (2023). Development of the "Scale for the assessment of non-experts' AI literacy" – An exploratory factor analysis. Computers in Human Behavior Reports, 12, Article 100338. https://doi.org/10.1016/j.chbr.2023.100338
Lee, J., & Jeong, H. (2023). Keyword analysis of artificial intelligence education policy in South Korea. IEEE Access, 11, 102408–102417. https://doi.org/10.1109/ACCESS.2023.3317261
Lee, Y.-J., Oh, J., & Hong, C. (2024). Exploratory research on understanding university students' artificial intelligence literacy in a Korean university. Online Journal of Communication and Media Technologies, 14(3), e202440. https://doi.org/10.30935/ojcmt/14711
Lee, Y. J., & Davis, R. O. (2025). Assessing the impact of prior coding and artificial intelligence learning on non-computing majors' perception of AI in a university context. Information, 16(4), 277. https://doi.org/10.3390/info16040277
Ma, S., & Chen, Z. (2024). The development and validation of the Artificial Intelligence Literacy Scale for Chinese college students (AILS-CCS). IEEE Access, 12, 146419–146429. https://doi.org/10.1109/access.2024.3468378
Ng, D. T. K., Wu, W., Leung, J. K. L., Chiu, T. K. F., & Chu, S. K. W. (2024). Design and validation of the AI literacy questionnaire: The affective, behavioural, cognitive and ethical approach. British Journal of Educational Technology, 55(3), 1082–1104. https://doi.org/10.1111/bjet.13411
Ning, Y., Zhang, W., Yao, D., Fang, B., Xu, B., & Wijaya, T. T. (2025). Development and validation of the Artificial Intelligence Literacy Scale for Teachers (AILST). Education and Information Technologies. https://doi.org/10.1007/s10639-025-13347-5
Nong, Y., Cui, J., He, Y., Zhang, P., & Zhang, T. (2024). Development and validation of an AI lite racy scale. Journal of Artificial Intelligence Research, 1(1), 17–26. https://doi.org/10.70891/JAIR.2024.100029
Yilmaz, F. G., Yilmaz, R., & Ceylan, M. (2024). Generative artificial intelligence acceptance scale: A validity and reliability study. International Journal of Human–Computer Interaction, 40(24), 8703–8715. https://doi.org/10.1080/10447318.2023.2288730
Vaismoradi, M., Turunen, H., & Bondas, T. (2013). Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nursing & health sciences, 15(3), 398-405. https://doi.org/10.1111/nhs.12048
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Yong-Jik Lee, Seung-Hoon Jeong

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
All articles published by IJLTER are licensed under a Creative Commons Attribution Non-Commercial No-Derivatives 4.0 International License (CCBY-NC-ND4.0).