Developing Students’ HOTS Digital Literacy Profile by Using IRT
Vol 7 No 2 (2025), Articles
Vol 7 No 2 (2025)

Developing Students’ HOTS Digital Literacy Profile by Using IRT

Articles
https://doi.org/10.46303/jcsr.2025.16
Published August 10, 2025
Guldana A. Begimbetova
Graduate School, Yogyakarta State University, Yogyakarta, 55281, Indonesia. Faculty of Pedagogy and Psychology, Abai Kazakh National Pedagogical University, Almaty, Dostyk Ave 13, 050010, Kazakhstan.
https://orcid.org/0000-0002-0435-1014
Heri Retnawati
Graduate School, Yogyakarta State University, Yogyakarta, 55281, Indonesia.
https://orcid.org/0000-0002-1792-5873
Gulzhaina K. Kassymova
Faculty of Pedagogy and Psychology, Abai Kazakh National Pedagogical University, Almaty, Kazakhstan; Institute of Metallurgy and Ore Beneficiation JSC, Satbayev University Almaty, Kazakhstan
https://orcid.org/0000-0001-7004-3864
Mochamad Bruri Triyono
Graduate School, Yogyakarta State University, Yogyakarta, 55281, Indonesia.
https://orcid.org/0000-0001-5720-9604
Mochamad Nor Azhari Azman
Department Engineering Technology, Faculty of Technical and Vocational, Sultan Idris Education University, 35900 Tanjung Malim, Perak, Malaysia.
https://orcid.org/0000-0003-1756-1990
Reisa Aulia Sodikin
Education of System and Information Technology, Campus of Purwakarta, Indonesia University of Education, Purwakarta, 41115, Indonesia.
https://orcid.org/0009-0006-5256-3384
Download Full-Text (PDF)

Keywords

Digital literacy
Education
HOTS cognitive test
Item characteristics

How to Cite

Begimbetova, G., Retnawati, H., Kassymova, G., Triyono, M., Azman, M., & Sodikin, R. (2025). Developing Students’ HOTS Digital Literacy Profile by Using IRT. Journal Of Curriculum Studies Research, 7(2), 155-176. https://doi.org/10.46303/jcsr.2025.16
ACM ACS APA ABNT Chicago Harvard IEEE MLA Turabian Vancouver

Download Citation

Endnote/Zotero/Mendeley (RIS) BibTeX

Abstract

This study aimed to develop and validate a digital literacy higher-order thinking skills (HOTS) cognitive test for engineering students at Universitas Negeri Yogyakarta in Indonesia. Utilising a quantitative research design, the study involved 95 participants and employed expert judgement to assess content validity through the Aiken V Index, which yielded a high average validity score of 1.783. Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) confirmed a single factor structure with strong fit indices (CFI = 0.98, TLI = 0.97, RMSEA = 0.08), indicating robust construct validity. Reliability analysis revealed a high internal consistency (α = 0.92). Item Response Theory (IRT) calibration demonstrated satisfactory model fit, with moderate discrimination and average difficulty indices for the test items. The findings affirm that the developed test is both reliable and valid, effectively capturing students' digital literacy HOTS profiles, thereby providing valuable insights for educational interventions aimed at enhancing digital literacy skills in engineering education.

https://doi.org/10.46303/jcsr.2025.16
Download Full-Text (PDF)
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.