Pemanfaatan Artificial Intelligence (AI) dalam Penyusunan dan Validasi Asesmen Pembelajaran di MA Muhammadiyah 1 Malang
Abstract
This community service program assisted teachers in using generative artificial intelligence (AI) to develop and review learning assessments at MA Muhammadiyah 1 Malang. Twenty-two teachers from different subjects participated in a face-to-face workshop and online mentoring from 24 April to 1 May 2026. Participants practised developing assessment items with ChatGPT, designing visual presentations using Canva AI, checking AI-generated outputs for alignment with learning objectives and cognitive demands, and revising their assessment products. Evaluation included 20-item pre- and post-tests, a product assessment rubric, and a 20-item participant response questionnaire. The mean test score increased descriptively from 15.95 to 18.41 out of 20. The mean product score was 86.08, with 11 products rated Good and 11 rated Very Good, while the questionnaire score reached 79.27% of the maximum possible score. Based on these evaluations, the mentoring program achieved its intended objectives during the training period. However, some assessment products still require greater cognitive depth in higher-order thinking tasks. These findings reflect outcomes observed during the program and do not establish the empirical validity of the assessments in classroom use or the long-term sustainability of teachers' skills.
References
Celik, I., Dindar, M., Muukkonen, H., & Järvelä, S. (2022). The promises and challenges of artificial intelligence for teachers: A systematic review of research. TechTrends, 66, 616–630. https://doi.org/10.1007/s11528-022-00715-y
Gardner, J., O’Leary, M., & Yuan, L. (2021). Artificial intelligence in educational assessment: ‘Breakthrough? Or buncombe and ballyhoo?’. Journal of Computer Assisted Learning, 37(5), 1207–1216. https://doi.org/10.1111/jcal.12577
González-Calatayud, V., Prendes-Espinosa, P., & Roig-Vila, R. (2021). Artificial intelligence for student assessment: A systematic review. Applied Sciences, 11(12), Article 5467. https://doi.org/10.3390/app11125467
Kaldaras, L., Akaeze, H., & Reckase, M. (2024). Developing valid assessments in the era of generative artificial intelligence. Frontiers in Education, 9, Article 1399377. https://doi.org/10.3389/feduc.2024.1399377
Kamalov, F., Santandreu Calonge, D., & Gurrib, I. (2023). New era of artificial intelligence in education: Towards a sustainable multifaceted revolution. Sustainability, 15(16), Article 12451. https://doi.org/10.3390/su151612451
Martin Kowal, J., Hurley Bryant, K., Segall, D., & Kantrowitz, T. (2025). Harnessing generative AI for assessment item development: Comparing AI-generated and human-authored items. International Journal of Selection and Assessment, 33(3), Article e70021. https://doi.org/10.1111/ijsa.70021
Owan, V. J., Abang, K. B., Idika, D. O., Etta, E. O., & Bassey, B. A. (2023). Exploring the potential of artificial intelligence tools in educational measurement and assessment. Eurasia Journal of Mathematics, Science and Technology Education, 19(8), Article em2307. https://doi.org/10.29333/ejmste/13428
Perkins, M., Furze, L., Roe, J., & MacVaugh, J. (2024). The artificial intelligence assessment scale (AIAS): A framework for ethical integration of generative AI in educational assessment. Journal of University Teaching and Learning Practice, 21(6). https://doi.org/10.53761/q3azde36
Salinas-Navarro, D. E., Vilalta-Perdomo, E., Michel-Villarreal, R., & Montesinos, L. (2024). Using generative artificial intelligence tools to explain and enhance experiential learning for authentic assessment. Education Sciences, 14(1), Article 83. https://doi.org/10.3390/educsci14010083
Shi, L. (2025). Assessing teachers’ generative artificial intelligence competencies: Instrument development and validation. Education and Information Technologies, 30, 23365–23384. https://doi.org/10.1007/s10639-025-13684-5
Yan, L., Greiff, S., Teuber, Z., & Gašević, D. (2024). Promises and challenges of generative artificial intelligence for human learning. Nature Human Behaviour, 8, 1839–1850. https://doi.org/10.1038/s41562-024-02004-5
Copyright (c) 2026 Mochammad Hafiizh, Vita Kusumasari, Ety Tejo Dwi Cahyowati, Sudirman Sudirman, Fazrina Saumi, Nourma Pramestie Wulandari, Rosmariyadi Rosmariyadi

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
