Evaluation of the Basic Arabic Competency Strengthening Program for Arabic Language Study Program Students
DOI:
https://doi.org/10.60040/jak.v5i2.257Keywords:
Arabic competency strengthening, Kirkpatrick evaluation, Learning Outcomes, questionnaire reliability, institutional sustainabilityAbstract
This study examined the Basic Arabic Competency Strengthening Program delivered to 27 first-semester students at IAIN Sultan Amai Gorontalo during March–May 2026. The mixed-methods evaluation assessed Kirkpatrick Level 1 (Reaction), Level 2 (Learning), and descriptive institutional discrepancies. Student responses were collected using 25 Likert-scale statements grouped into eight aspects, with complete item-level records. The equally weighted Reaction mean was 4.21/5, while exploratory Cronbach's alpha for all 25 items was 0.745. Paired assessments documented an increase in the composite Arabic competency mean from 53.30 to 73.56, corresponding to a gain of 20.26 points. Skill-specific gains were 21.30 in qirā’ah, 20.00 in kitābah, 21.33 in istimā‘, and 18.41 in kalām. Wilcoxon signed-rank tests indicated differences between pre-test and post-test scores (all p < .001). These findings describe changes within one cohort, as no comparison group was included. Based on descriptive gain thresholds, 24 students (88.89%) were classified as showing moderate or high improvement. Tutor and administrator accounts pointed to continuing needs in productive skills, formal competency standards, organized academic support, and institutional policy. A program-specific standard operating procedure had not yet been issued. The evaluation provides context-specific evidence to guide refinement, sustained implementation, and further assessment of a regular academic bridging program.
References
Achuthan, K., Kolil, V. K., & Jyothy, S. N. (2023). Effectiveness of virtual laboratory teacher training workshops: A Kirkpatrick model analysis. International Journal of Emerging Technologies in Learning, 18(15), 225–239. https://doi.org/10.3991/ijet.v18i15.40037
Anggraeni, A., Alfan, M., & Rani, N. (2023). The impact of utilizing Uno Stacko on Arabic learning vocabulary acquisition. Ta’lim al-’Arabiyyah: Jurnal Pendidikan Bahasa Arab & Kebahasaaraban, 7(2), 261–277. https://doi.org/10.15575/jpba.v7i2.29740
Ardini, N., & Lukas, S. (2024). Evaluation of Officer Development Program Training. Jurnal Syntax Admiration, 5(3), 782–794. https://doi.org/10.46799/jsa.v5i3.1044
Bambang, B., Tanjung, I., Ritonga, D. H., Hasibuan, L. P., & Pohan, A. H. (2023). Planning and strategies for mahārah al-kalām learning Arabic language in madrasah. Waraqat: Jurnal Ilmu-Ilmu Keislaman, 8(1), 91–100. https://doi.org/10.51590/waraqat.v8i1.457
Banuwa, A. K., & Susanti, A. N. (2021). Evaluasi Skor Pre-Test Dan Post-Test Peserta Pelatihan Teknis New SIGA Di Perwakilan BKKBN Provinsi Lampung. Jurnal Ilmiah Widyaiswara, 1(2), 77–85. https://doi.org/10.35912/jiw.v1i2.1266
Bhakti, Y. B., Ridwan, A., & Riyadi, R. (2022). Urgensi sistem penjaminan mutu internal & eksternal dalam meningkatkan mutu perguruan tinggi. Jurnal Penjaminan Mutu, 8(2), 251–260. https://doi.org/10.25078/jpm.v8i02.1394
Cordon, C., Dlugosz, D., Lopez, L. K., Gelacio, R., Smith-Eivemark, K., Maier, S. R. O., Ginzburg, A., Hua, K., Williams, D., & Irwin, T. (2025). Supporting Novice Nurses’ Transition to Independent Practice: Evaluation of the TIPS Program Using the Kirkpatrick Model. Nursing Reports, 15(2), 50. https://doi.org/10.3390/nursrep15020050
Council of Europe. (2020). Common European Framework of Reference for Languages: Learning, teaching, assessment—Companion volume. Council of Europe Publishing. https://www.coe.int/en/web/common-european-framework-reference-languages
Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). SAGE Publications.
Creswell, J. W., & Plano Clark, V. L. (2018). Designing and conducting mixed methods research (3rd ed.). SAGE Publications. https://collegepublishing.sagepub.com/products/designing-and-conducting-mixed-methods-research-3-241842
Fajri, M., Zurqoni, Z., & Sugeng, S. (2023). Analisis data kualitatif dalam evaluasi kurikulum Program Studi Sarjana Pendidikan Agama Islam di Kalimantan Timur. Afeksi: Jurnal Penelitian Dan Evaluasi Pendidikan, 4(1), 27–42. https://doi.org/10.35672/afeksi.v4i1.58
Farhani, C., Hania, I., Maksudin, M., & Suteja, S. (2023). Comparative Study of Arabic Learning Materials in Traditional and Modern Pondok Pesantren in North Sumatera, Indonesia. Insania Jurnal Pemikiran Alternatif Kependidikan, 28(1), 1–14. https://doi.org/10.24090/insania.v28i1.6929
Flowriza, E., & Rahmiati, R. (2021). Evaluasi Implementasi Pembelajaran Praktik Selama Pandemi Covid-19 Program Studi Pendidikan Tata Rias Dan Kecantikan. Jurnal Imiah Pendidikan Dan Pembelajaran, 5(2), 179. https://doi.org/10.23887/jipp.v5i2.35067
Gupta, S., Sathe, S., Arya, K., & Mangeshkar, A. (2025). Evaluation of an Integrated Teaching Approach in Physiology, Anatomy, and Biochemistry for Phase I MBBS Students Using the Kirkpatrick Model. Cureus. https://doi.org/10.7759/cureus.88879
Haryati, H., Rasyid, M. N. A., Mania, S., & Widodo, S. (2023). Evaluasi Pembelajaran Statistik Pendidikan Di STAI Al Khairaat Labuha Dengan Model Evaluasi Discrepancy Dan Kirkpatrick. Palapa, 11(1), 426–445. https://doi.org/10.36088/palapa.v11i1.3251
Hidayah, K. (2023). CEFR-based mahārah al-kitābah competencies in Class V textbooks at madrasah tsanawiyah level in Indonesia. Edumaspul: Jurnal Pendidikan, 7(2), 2922–2931. https://doi.org/10.33487/edumaspul.v7i2.6809
Hoppmann, N. A., Manassa, E. H., Kleining, L., & Ehlers, J. P. (2025). The Effectiveness of Further Education and Training Programs for Plastic and Aesthetic Surgeons: An Evaluation According to Kirkpatrick Levels 1–3. BMC Medical Education, 25(1). https://doi.org/10.1186/s12909-025-07213-8
Hula, I. R. N., Paputungan, M. Z., & Mariana, A. (2021). Pengembangan hybrid learning berbasis aplikasi Computer Assisted Test (CAT) pada program Arabic Proficiency Test. Tadbir: Jurnal Manajemen Pendidikan Islam, 9(1), 103–125. https://doi.org/10.30603/tjmpi.v9i1.2063
Irvani, A. I., Sriyati, S., Nahadi, N., Sinaga, P., & Henukh, A. (2024). Evaluasi Program Perkuliahan Fisika Kuantum Dengan Virtual Lab Menggunakan Model CIPP. Jurnal Pendidikan Mipa, 14(2), 511–520. https://doi.org/10.37630/jpm.v14i2.1603
Ismaili, J., & Moutaouakil, K. E. (2023). D-learning and COVID-19 crisis: Appraisal of reactions and means of perpetuity. SN Computer Science, 4(3). https://doi.org/10.1007/s42979-023-01726-z
Kamalia, K., Nasution, W. N., & Nasution, S. (2022). Implementation of active learning strategies in improving Arabic language skills for students of STAI As-Sunnah Tanjung, North Sumatra. Al-Ishlah: Jurnal Pendidikan, 14(2), 1793–1802. https://doi.org/10.35445/alishlah.v14i2.1902
Keumala, C. M., Zainuddin, Z., & Fauzan, F. (2021). Implementasi sistem evaluasi formatif berbasis game “Kahoot dan Quizizz” untuk meningkatkan motivasi belajar mahasiswa di masa pandemi. Jurnal Inovasi Pendidikan Ekonomi, 11(2), 125. https://doi.org/10.24036/011123600
Khambali, K. (2023). Analysis of teaching materials for Arabic textbooks for Islamic junior high school based on CEFR standards. Arabiyat: Jurnal Pendidikan Bahasa Arab Dan Kebahasaaraban, 10(1), 88–105. https://doi.org/10.15408/a.v10i1.30439
Kirkpatrick, J. D., & Kirkpatrick, W. K. (2016). Kirkpatrick’s four levels of training evaluation. ATD Press. https://www.td.org/product/book--kirkpatricks-four-levels-of-training-evaluation/111614
Laili, N., Suyudi, M., Rahmatullah, A. S., & Aziz, A. N. (2023). Application of Tamyiz Method in Improving Maharah Kitabah. International Journal of Multidisciplinary Research and Analysis, 06(08). https://doi.org/10.47191/ijmra/v6-i8-33
LoVerde, J., Kerber, C., Kisch, T., Miller, B., Jenkins, S., & Shropshire, M. (2021). Comparison of Lecture and Manipulative Teaching Methods on Learning and Application to Practice. Nursing Forum, 56(3), 520–528. https://doi.org/10.1111/nuf.12575
Lubis, L., Siregar, I., Rohman, N., & Damanik, M. H. (2022). Optimalisasi Pembelajaran Bahasa Arab Sebagai Penunjang Persiapan Calon Mahasiswa Baru Al-Azhar Mesir: Studi Kasus Pada Markaz Syaikh Zayed Cabang Indonesia. Edumaspul - Jurnal Pendidikan, 6(1), 1006–1015. https://doi.org/10.33487/edumaspul.v6i1.3417
Miolo, M. I., & Langkau, M. J. (2023). Problems of mahārah al-qirā’ah learning at MTs Al-Khairaat Gorontalo City. Al-Kalim: Jurnal Pendidikan Bahasa Arab Dan Kebahasaaraban, 2(1), 1–13. https://doi.org/10.60040/jak.v2i1.14
Mohamed, W. (2024). Impact of Educating Faculty on Student Assessment: Beyond Satisfaction Level. Journal of Applied Research in Higher Education, 16(5), 2108–2125. https://doi.org/10.1108/jarhe-12-2022-0383
Mufid, M., & Anwar, M. (2024). Pengaruh Penggunaan Game Edukasi Baamboozle Terhadap Peningkatan Keterampilan Memahami Kosa Kata Bahasa Arab Di Program Studi Bahasa Dan Sastra Arab Di UNUGIRI / the Impact of the Educational Game Bamboozle on Arabic Vocabulary Comprehension Skills Among Students in the Arabic Language and Literature Program Study at UNUGIRI. Loghat Arabi: Jurnal Bahasa Arab Dan Pendidikan Bahasa Arab, 5(2), 335. https://doi.org/10.36915/la.v5i2.307
Mufidah, A., Puspitasari, N., Khusna, K., & Suroso, I. (2024). Pendampingan Pembelajaran Metode Penelitian Gabungan (Mixed Method) Di IAIS Lumajang. Jurnal Pengabdian Masyarakat Akademisi, 3(1), 53–69. https://doi.org/10.54099/jpma.v3i1.871
Mufti, A., & Mudrofin, M. (2021). Analisis Kesesuaian Kompetensi Dasar Dengan Bahan Ajar Bahasa Arab MTs Kelas IX Karya Yushi M. Mahmudah. Alsina Journal of Arabic Studies, 3(1), 81–102. https://doi.org/10.21580/alsina.3.1.10432
Musiman, M., & Kristiawan, M. (2021). Evaluasi Sistem Penjaminan Mutu Program Studi S1 Pendidikan Sekolah Dasar STKIP Muhammadiyah Oku Timur. Jurnal Basicedu, 5(6), 5070–5077. https://doi.org/10.31004/basicedu.v5i6.1591
Mustafawi, E., Shaaban, K., Khwaileh, T., & Ata, K. (2021). Perceptions and Attitudes of Qatar University Students Regarding the Utility of Arabic and English in Communication and Education in Qatar. Language Policy, 21(1), 75–119. https://doi.org/10.1007/s10993-021-09590-4
Musyafa’ah, N., Widayanti, R., Rezi, M., Rosyad, M. S., & Nuha, M. A. U. (2023). Implementation of the Al-Miftah Method in Mastering Arabic Mufradat at Al-Ikhlas Islamic Boarding School Tambakberas Jombang. Alsuna Journal of Arabic and English Language, 6(1), 1–20. https://doi.org/10.31538/alsuna.v6i1.3110
Mutmainah, M. (2024). Strategi Pengembangan Desain Model Social Learning Untuk Peningkatan Kualitas Penguasaan Bahasa Arab. Qismul Arab Journal of Arabic Education, 2(01), 31–39. https://doi.org/10.62730/qismularab.v2i01.23
Nahdla, N. C., Nadilla, A., & Roji, F. (2023). Strategi pembelajaran Qira’ah di Pondok Pesantren Nahdlatul ‘Ulum Kota Metro. Al Maghazi: Arabic Language in Higher Education, 1(2), 38. https://doi.org/10.51278/al.v1i2.716
Nashoih, A. K. (2022). Penguatan kompetensi guru melalui pelatihan dan pendampingan pembuatan media pembelajaran kartu BiZi bagi guru Bahasa Arab di Jombang. Jumat Pendidikan: Jurnal Pengabdian Masyarakat, 3(1), 18–25. https://doi.org/10.32764/abdimaspen.v3i1.2285
Nation, I. S. P. (2022). Learning vocabulary in another language (3rd ed.). Cambridge University Press. https://catdir.loc.gov/catdir/samples/cam031/2001269892.pdf
Nira, R. D., & Fauziyah, Y. (2021). Development of Arabic Curriculum in Improving Pedagogic Competence of Lecturer Ma’had Umar Bin Al-Khattab. Nazhruna Jurnal Pendidikan Islam, 4(2), 294–309. https://doi.org/10.31538/nzh.v4i2.1480
Nur, T., Arsyad, A., Nawas, K. A., Kasim, A., Suriyati, S., & Nur, M. J. (2024). Implementation of Arabic Language Learning With School-Based Management. Nidhomul Haq Jurnal Manajemen Pendidikan Islam, 9(1), 1–15. https://doi.org/10.31538/ndh.v9i1.4344
Nur’aini, R., & Farisi, M. Z. A. (2023). The Observation of Arabic Language Differentiation in the 2013 Curriculum and the “Merdeka” Curriculum. Abjadia International Journal of Education, 8(1), 62–78. https://doi.org/10.18860/abj.v8i1.22359
Olaifa, A. S. (2024). Provosts’ quality assurance strategies and lecturers’ job performance in colleges of education in Kwara State, Nigeria. Journal of Education Research and Evaluation, 8(1), 21–27. https://doi.org/10.23887/jere.v8i1.69973
Prihantoro, A., Santoso, F. S., & Haroen, H. (2024). Penerapan assessment of, for dan as learning dalam perkuliahan di Perguruan Tinggi Keagamaan Islam Indonesia. Ulumuddin: Jurnal Ilmu-Ilmu Keislaman, 14(1), 59–78. https://doi.org/10.47200/ulumuddin.v14i1.2371
Provus, M. M. (1971). Discrepancy evaluation: For educational program improvement and assessment. McCutchan Publishing Corporation.
Puspa, E. M., Sutanto, A., & Aminin, S. (2021). Evaluasi Sistem Penjaminan Mutu Internal (SPMI) pada sekolah model Lampung Timur. POACE: Jurnal Program Studi Administrasi Pendidikan, 1(1), 20–32. https://doi.org/10.24127/poace.v1i1.610
Rahmadani, R. (2022). Study Related to the CIPP Model as a Form of Evaluation in Training Programs. 12 Waiheru, 8(2), 114–123. https://doi.org/10.47655/12waiheru.v8i2.28
Ramadani, C., & Sutriyani, S. (2023). Concept of Arabic Language Learning Management Strategy in Madrasah. Tanwir Arabiyyah Arabic as Foreign Language Journal, 3(1), 15–26. https://doi.org/10.31869/aflj.v3i1.3958
Richards, J. C. (2022). Key issues in language teaching (2nd ed.). Cambridge University Press.
Rosadi, N. N., & Syarif, E. (2024). Efektivitas Program Onboarding Sales Assistant Untuk Meningkatkan Pengetahuan Produk Di PT Kurnia Ciptamoda Gemilang. The Journal of Learning and Technology, 3(1), 38–47. https://doi.org/10.33830/jlt.v3i1.9853
Sammara, R., & Hasbi, H. (2023). Implementasi Sistem Penjaminan Mutu Pendidikan Dalam Meningkatkan Mutu Pendidikan. Kelola Journal of Islamic Education Management, 8(1), 45–58. https://doi.org/10.24256/kelola.v8i1.3569
Sampe, N., & Arifin, Z. (2024). Internal Quality Assurance System in Indonesia Higher Education: Literature Review. Indonesian Journal of Educational Research and Review, 7(1), 73–84. https://doi.org/10.23887/ijerr.v7i1.67925
Setiadi, F. M., & Zulpina, Z. (2022). Pelatihan Penguatan Maharah Kalam Bagi Santri Pondok Pesantren Darut Tarbiyah Mandailing Natal. Jubaedah Jurnal Pengabdian Dan Edukasi Sekolah (Indonesian Journal of Community Services and School Education), 2(3), 319–326. https://doi.org/10.46306/jub.v2i3.98
Setiawan, D. (2021). Educational Quality Assurance Management in Improving and Developing the Middle School Professionalism Teachers. Akademika Jurnal Manajemen Pendidikan Islam, 3(1), 19–36. https://doi.org/10.51339/akademika.v3i1.281
Siregar, H. H., Hadi, N., & Hilmi, D. (2021). Analisis pembelajaran berbasis SAVI dalam Maharah Kalam. Shaut Al Arabiyyah, 9(1), 32. https://doi.org/10.24252/saa.v9i1.20588
Sujefri, A., & Habibah, I. F. (2023). Analysis of Needs to Learn Arabic Through Instagram. International Journal of Arabic Language Teaching, 5(02), 245. https://doi.org/10.32332/ijalt.v5i02.7180
Syam, R., Muchtar, M. I., & Juhanis, H. B. (2022). Manajemen evaluasi pembelajaran dalam meningkatkan mutu lulusan di Lembaga Studi Bahasa Arab Ma’had Al-Birr Makassar. Jurnal Ilmiah Iqra, 16(2), 151. https://doi.org/10.30984/jii.v16i2.2020
Syamsudar, S. (2019). The EFFORTS TO OVERCOME THE DIFFICULTIES OF LEARNING ARABIC IN MTs. YASRIB LAPAJUNG BOARDING SCHOOL. Jicsa (Journal of Islamic Civilization in Southeast Asia), 8(1), 157. https://doi.org/10.24252/jicsa.v8i1.9845
Tolinggi, S. O. R., & Wahyuningsih, E. (2022). Teknik Dan Instrumen Penilaian Mah?rah Al-Qir?’ah Di Tinjau Dari Tingkat Dan Tujuan Pembelajarannya. El-Tsaqafah Jurnal Jurusan Pba, 20(2), 187–208. https://doi.org/10.20414/tsaqafah.v20i2.4024
Umam, M. K., Nawangsari, A. L. F., & Firdausah, I. (2023). Non-test portfolio assessment techniques: Innovation to improve Maharah Al-Kitabah. Nusantara: Jurnal Pendidikan Indonesia, 3(3), 351–370. https://doi.org/10.14421/njpi.2023.v3i3-1
Wahidaeni, M., S., & Firdaus, F. (2023). Pengaruh penerapan metode Mim-Mem dan metode Muhādaṡah terhadap keterampilan berbicara Bahasa Arab. Shaut Al Arabiyyah, 11(1), 238–247. https://doi.org/10.24252/saa.v11i1.38605
Wahyuni, S., Ritonga, M., & Afrianti, W. (2023). Systematic review of learning method for teaching Arabic listening and speaking skills. Al-Hayat: Journal of Islamic Education, 7(1), 30. https://doi.org/10.35723/ajie.v7i1.321
Yusuf, M., & Nawas, K. A. (2023). Implementation of Principles and Steps for Selecting Teaching Materials for Mahārah Al-Istimā’s Subject. Ta Lim Al- Arabiyyah Jurnal Pendidikan Bahasa Arab & Kebahasaaraban, 7(1), 47–71. https://doi.org/10.15575/jpba.v7i1.19963
Zhao, W., Liu, Z., Wang, T., Yin, X., Sun, Y., Zhang, X., & Yang, H. (2023). Assessment of a Training Project of English as a Media of Instruction(EMI) Using Kirkpatrick Model. BMC Medical Education, 23(1). https://doi.org/10.1186/s12909-023-04204-5
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Ahmad M. Latief, Sitti Mania, Muhammad Nur Akbar Rasyid

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.





