Analysis of the Quality of Islamic Religious Education Test Items Based on the SOLO Taxonomy for Developing Summative Assessment in Schools

Nur Fadilah Ramadhany; Suwadi Suwadi; Amri  Saputra

doi:10.61227/b5333626

Authors

Nur Fadilah Ramadhany Universitas Islam Negeri Sunan Kalijaga Yogyakarta https://orcid.org/0009-0009-0025-5867
Suwadi Suwadi Universitas Islam Negeri Sunan Kalijaga Yogyakarta
Amri Saputra Universitas Islam Negeri Sunan Kalijaga Yogyakarta

DOI:

https://doi.org/10.61227/b5333626

Keywords:

Islamic Religious Education, question quality, SOLO Taxonomy, summative assesment

Abstract

Islamic Religious Education (IRE) assessment is still frequently oriented toward the ability to recall information, recognize terms, understand definitions, and determine legal rulings textually. Consequently, IRE test items may measure only basic knowledge rather than depth of understanding, interconceptual relationships, legal reasoning, reflection, and the application of Islamic values in everyday life. This study examines the extent to which IRE test items represent the complexity of students’ understanding based on the SOLO Taxonomy framework. Employing a descriptive qualitative approach and content analysis, the study treats IRE test items as assessment texts that represent the cognitive demands placed on students. The data comprised 50 senior high school IRE test items obtained from a school in Batam City. The data were analyzed using Krippendorff’s content analysis framework through a critical reading of each item, identification of the structure of its cognitive demands, classification according to SOLO Taxonomy levels, tabulation of frequencies and percentages, and interpretation of assessment-quality patterns. The results show that, of the 50 items analyzed, 35 items (70%) were unistructural, 5 items (10%) were multistructural, 9 items (18%) were relational, and 1 item (2%) was extended abstract, while no prestructural items were identified. These findings indicate that IRE test items remain dominated by basic cognitive demands and therefore do not yet fully represent assessment that promotes interconceptual connections, legal reasoning, reflection, and the application of Islamic values in real-life contexts. This study recommends restructuring the weighting and composition of IRE test items in assessment blueprints by increasing the proportion of relational and extended abstract items. This improvement can be achieved through case-based stimuli, reasoned questions, analyses of interconceptual relationships, attitudinal reflection, and the application of Islamic values to authentic situations, thereby aligning assessment more closely with learning outcomes and principles of meaningful assessment.

Downloads

Download data is not yet available.

References

Adeniji, S. M., Baker, P., & Schmude, M. (2022). Structure of the Observed Learning Outcomes (SOLO) model: A Mixed- Method Systematic Review of Research in Mathematics Education. Eurasia Journal of Mathematics, Science and Technology Education, 18(6), 1–17. https://doi.org/10.29333/ejmste/12087

Agustinsa, R., Muchlis, E. E., & Maizora, S. (2021). Level of Student Understanding in Solving Geometry Problems based on Taxonomy of SOLO (Structure of Observed Learning Outcomes). Journal of Physics: Conference Series, 1731(1), 012055. https://doi.org/10.1088/1742-6596/1731/1/012055

Amalina, N., Rahman, A., Djollong, A. F., Kharis, M., Rondhiyah, S., Wahyuni, M., Parepare, U. M., Info, S., Strategies, C. L., & Education, I. R. (2026). Pengembangan Strategi Pembelajaran Kognitif Berbasis Hots (Higher Order Thinking Skills) pada Mata Pelajaran Pendidikan Agama Islam. 11(1), 1174–1182.

Amaly, A. M., Herdiana, Y., Ruswandi, U., & Arifin, B. S. (2023). The Necessity and Reality of Islamic Religious Education in Schools. Jurnal Ilmiah Islam Futura, 23(1), 1. https://doi.org/10.22373/jiif.v23i1.13190

Ariani, F., Suyanto, S., Yuliana, L., Asriyah, A., & Rahmah, L. (2026). From Taxonomies to Rubrics: SOLO-based Formative Assessment to Improve Understanding of Population Dynamics. International Journal of Learning, Teaching and Educational Research, 25(1), 518–535. https://doi.org/10.26803/ijlter.25.1.25

Aripin, S., Nurdiansyah, N. M., Arief, A., & Yusof, N. binti. (2025). Effectiveness and Reformulation of Islamic Religious Education in Schools in the Modern Era. Jurnal Pendidikan Agama Islam, 22(1), 215–234. https://doi.org/10.14421/jpai.v22i1.7432

Batubara, A. U., & Matsum, H. (2025). Assessment Patterns in Islamic Education Learning on Fiqh Material. Halaqa: Islamic Education Journal, 9(1), 165–184. https://doi.org/10.21070/halaqa.v9i1.1733

Biggs, Jo. B., & Collis, K. F. (1982). Evaluating The Quality of Learning The SOLO Taxonomy (Structure of The Observed Learning Outcome) (Vol. 2). A Subsidiary of Harcourt Brace JovanovichLondon.

Cao, J., Fang, Z., & Yu, S. (2023). Automatic Evaluation of Chinese Short-Answer Questions Based on Structure of Observed Learning Outcomes Taxonomy. 2023 IEEE International Conference on Advanced Learning Technologies (ICALT), 315–317. https://doi.org/10.1109/ICALT58122.2023.00098

Chae, S. E., & Alexander, P. A. (2021). The Development of Relational Reasoning in South Korean Elementary and Middle-School Students: A Cross-Sectional Investigation. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.630609

Dhesita, S. J., & Pinilih, F. W. (2025). Asesmen Bermakna Humanis untuk Mendorong Otonomi Belajar Siswa Madrasah Aliyah. 1(2), 91–105.

Fauzi, A., & Inayati, N. L. (2023). Implementasi Evaluasi Pembelajaran Pendidikan Al Islam di Sekolah Menengah Atas Muhammadiyah. Munaddhomah: Jurnal Manajemen Pendidikan Islam, 4(2), 272–283. https://doi.org/10.31538/munaddhomah.v4i2.438

Fernandez, P. J. M., & Guzon, A. F. H. (2025). A SOLO Taxonomy-based Rubric for Assessing Conceptual Understanding in Applied Calculus. Journal on Mathematics Education, 16(2), 559–580. https://doi.org/10.22342/jme.v16i2.pp559-580

Hidayat, R., & Rohmawati, B. (2025). Pengembangan Butir Soal HOTS: Tantangan dan Solusi untuk Meningkatkan Kemampuan Analisis Siswa Pada Pembelajaran PAI. JUMPER: Journal of Educational Multidisciplinary Research, 4(1), 1–20. https://doi.org/10.56921/jumper.v4i1.255

Hidayati, Z., & Nurdi, N. (2023). Persepsi Guru Terhadap Implementasi Kurikulum Merdeka dalam Pembelajaran PAI dan Budi Pekerti di Sekolah Dasar. Jurnal Cendekia Media Komunikasi Penelitian Dan Pengembangan Pendidikan Islam, 15(01), 30–41. https://doi.org/10.37850/cendekia.v15i01.442

Krathwohl, D. R., Bloom, B. S., & Masia, B. B. (1964). Taxonomy of Educational Objectives Affective Domain. In Educational Objectives (Vol. 93, Number 1979). Longman.

Krippendorff, K. (2019). Content Analysis an Introductionto Its Methodology. SAGE Publications Ltd.

Laela, N., & Sa’adah, K. (2026). Eksplorasi Pengembangan Dimensi Konseptual untuk Meningkatkan Efektivitas Pembelajaran SKI Kelas VIII di MTs Syi’ar Islam Maibit. Jurnal Manajemen Dan Pendidikan Agama Islam, 4(1), 181–193. https://doi.org/10.61132/jmpai.v4i1.1758

Malasari, P. N., Sari, A., Haqiqi, A. K., Masrukhin, & Qomariyah, S. (2023). Using the SOLO Taxonomy to Investigate Students’ Mathematical Creative Thinking Proficiency. 060009. https://doi.org/10.1063/5.0123686

Maryani, I., Prasetyo, Z. K., Wilujeng, I., Purwanti, S., & Fitrianawati, M. (2021). HOTs Multiple Choice and Essay Questions: A Validated Instrument to Measure Higher-order Thinking Skills of Prospective Teachers. Journal of Turkish Science Education, 18(4), 674–690. https://doi.org/10.36681/tused.2021.97

Mohanna, K., Wall, D., Cottrell, E., & Chambers, R. (2023). The Theory behind the Practical Aspects of Teaching and Learning. In Teaching Made Easy (pp. 87–102). CRC Press. https://doi.org/10.1201/9781003352532-9

Mujiburrahman, M., Kartiani, B. S., & Parhanuddin, L. (2023). Asesmen Pembelajaran Sekolah Dasar dalam Kurikulum Merdeka. Pena Anda: Jurnal Pendidikan Sekolah Dasar, 1(1), 39–48. https://doi.org/10.33830/penaanda.v1i1.5019

Nashir, M. J., Wardani, A., Intan Apriliani, E., & Zahiri, M. (2025). HOTS-Based Learning Methodology Innovation in Islamic Religious Education: A Case Study at State Senior High School 1 Karanganyar. Jurnal Tarbiyatuna, 16(2), 235–256. https://doi.org/10.31603/tarbiyatuna.v16i2.14987

Nurhaliza, A. S., & Fiqri Mustopa, M. (2023). Analysis of the Cognitive Level of School Exam Questions in Islamic Religious Education Based on the 2001 Revised Bloom’S Taxonomy. Journal of Research and Thought on Islamic Education (JRTIE), 6(1), 71–84.

Pastore, S. (2023). Teacher Assessment Literacy: a Systematic Review. Frontiers in Education, 8. https://doi.org/10.3389/feduc.2023.1217167

Rahmah, S., Ramlan, Wardhani, N., Alwiyah, S., & Syarboini. (2026). Implementing Higher-Order Thinking Skills Oriented Assessment in Islamic Religious Education. Al-Hayat: Journal of Islamic Education, 10(1), 237–253. https://doi.org/10.35723/ajie.v10i1.152

Rahmat, A., & Jamil, M. W. (2024). Retention-Based Learning: an Approach to Maximizing Student Learning Outcomes in High School Plant Anatomy Lesson. Malaysian Journal of Learning and Instruction, 21(2), 49–78. https://doi.org/10.32890/mjli2024.21.2.3

Savika, H. I., & Zuhriyah, I. A. (2024). Peran Analisis Butir Soal Terhadap Kualitas Soal, Kompetensi Guru, dan Prestasi Belajar Peserta Didik di Sekolah Dasar. PANDU : Jurnal Pendidikan Anak Dan Pendidikan Umum, 2(2), 43–51. https://doi.org/10.59966/pandu.v2i2.856

Savin, M., Bordelon, C., Moss, C., & Baker, L. (2023). Using Active Learning to Evaluate Student Competency Beyond Clinical Skills. The Journal for Nurse Practitioners, 19(5), 104596. https://doi.org/10.1016/j.nurpra.2023.104596

Supriadi, Sahri, & Hasmy, A. (2025). Pengembangan Instrumen Penilaian Pembelajaran Pai Dengan Pendekatan Higher Order Thinking Skills (Hots) Pada Siswa Tingkat Dasar. Jurnal Pendidikan Dan Pengajaran, 6(3), 119–135. https://ijurnal.com/1/index.php/jpp

Syawal, M. K.-K., Maulana, I., Nasution, S. K., & Nurmawati. (2025). Analisis Butir Soal Sumatif Akhir Semester Genap PAI Berdasarkan Taksonomi Bloom di Kelas VI SD Islam Al-Abid. BADA’A: Jurnal Ilmiah Pendidikan Dasar, 7(1), 153–163. https://doi.org/10.37216/badaa.v7i1.2161

Vlachopoulos, D., & Makri, A. (2024). A Systematic Literature Review on Authentic Assessment in Higher Education: Best Practices for the Development of 21st Century Skills, and Policy Considerations. Studies in Educational Evaluation, 83, 101425. https://doi.org/10.1016/j.stueduc.2024.101425

Wahyuni, A. S. (2023). Implementasi Autentik Assessment pada Pembelajaran Fikih di Madrasah Tsanawiyah. Tarqiyatuna: Jurnal Pendidikan Agama Islam Dan Madrasah Ibtidaiyah, 2(1), 48–58. https://doi.org/10.36769/tarqiyatuna.v2i1.323

Warsah, I., & Habibullah, H. (2022). Implementasi Evaluasi Hasil Belajar Pendidikan Agama Islam di Madrasah. Journal of Education and Instruction (JOEAI), 5(1), 213–225. https://doi.org/10.31539/joeai.v5i1.3595

Widada, W., Herawaty, D., Jumri, R., Wulandari, H., Aliza, F., & Anggoro, A. F. D. (2020). Students of the Extended Abstract in Proving Lobachevsky’s Parallel Lines Theorem. Journal of Physics: Conference Series, 1470(1), 012098. https://doi.org/10.1088/1742-6596/1470/1/012098

Winget, M., & Persky, A. M. (2022). A Practical Review of Mastery Learning. American Journal of Pharmaceutical Education, 86(10), ajpe8906. https://doi.org/10.5688/ajpe8906

Yuanita, P., Maimunah, M., Kartini, K., & Arif, N. (2023). Analysis of SOLO taxonomy-based Test Instruments in Approaching the Merdeka Curriculum. JRAMathEdu (Journal of Research and Advances in Mathematics Education), 12–29. https://doi.org/10.23917/jramathedu.v8i1.1270

Zahra, A. A., & At-Taqiyyah, A. K. (2024). Mengukur Kemampuan Kognitif Tingkat Tinggi dengan Pertanyaan Pilihan Ganda. Jurnal Pelita Nusantara, 1(4), 462–470. https://doi.org/10.59996/jurnalpelitanusantara.v1i4.336