Leveraging AI-Generated Images for Visual Stimulus-Based Arabic Speaking Assessment

Rovi Udin, Riska Hangkiho, Muhammad Jundi, Renni Hasibuan

Abstract


In recent years, the integration of artificial intelligence (AI) technology has revolutionized various aspects of education, including language learning and assessment. This study aims to explore the utilization of AI-generated images in language learning and its application in the assessment of Arabic speaking skills. The research examines the process of creating images for the purpose of assessing Arabic speaking skills using AI platforms. By analyzing various related literature sources, a qualitative approach is employed to understand how AI-generated images can be used in the assessment of Arabic speaking skills using visual stimuli. The results indicate that there are two types of speaking skill assessments using visual stimuli: describing images and responding to questions orally based on images. The development process of the assessment instruments involves competence analysis, determination of achievement indicators, formulation of assessment grids, and the creation of items and rating scales. The image preparation process with AI assistance is carried out during the item creation phase. The AI platform used is the Bing AI Image Generator due to its easy accessibility and free availability. It is essential to understand that the success of producing images suitable for assessment purposes heavily depends on the formulation and completeness of the written prompt. These findings underscore the importance of well-designed prompts by the assessment instrument developers. A well-crafted prompt can maximize the effectiveness of AI-generated images in visual stimulus-based speaking skill assessments. This, in turn, provides valuable insights for instructional design and assessment development in the context of language learning.


Full Text:

PDF

References


Adam, M. Z., Jundi, M., Ali, I., Laubaha, S. A., & Kadir, S. D. (2023). Studi Komparatif Kompetensi Dasar KMA 183 dan KMA 164 pada Mata Pelajaran Bahasa Arab Kelas VII MTs pada Kompetensi Ranah Kognitif. Assuthur: Jurnal Pendidikan Bahasa Arab, 2(1). https://doi.org/10.58194/as.v2i1.262

Agarwal, M., Sharma, P., Goswami, A., Agarwal, M., Sharma, P., & Goswami, A. (2023). Analysing the Applicability of ChatGPT, Bard, and Bing to Generate Reasoning-Based Multiple-Choice Questions in Medical Physiology. Cureus, 15(6). https://doi.org/10.7759/cureus.40977

Ainin, M. (2016). KESAHIHAN DALAM PENYUSUNAN TES BAHASA ARAB DI MADRASAH/SEKOLAH. Prosiding Konferensi Nasional Bahasa Arab II, 1, Article 2. http://prosiding.arab-um.com/index.php/konasbara/article/view/75

Aiumtrakul, N., Thongprayoon, C., Suppadungsuk, S., Krisanapan, P., Miao, J., Qureshi, F., & Cheungpasitporn, W. (2023). Navigating the Landscape of Personalized Medicine: The Relevance of ChatGPT, BingChat, and Bard AI in Nephrology Literature Searches. Journal of Personalized Medicine, 13(10), Article 10. https://doi.org/10.3390/jpm13101457

Al-Ashwal, F. Y., Zawiah, M., Gharaibeh, L., Abu-Farha, R., & Bitar, A. N. (2023). Evaluating the Sensitivity, Specificity, and Accuracy of ChatGPT-3.5, ChatGPT-4, Bing AI, and Bard Against Conventional Drug-Drug Interactions Clinical Tools. Drug, Healthcare and Patient Safety, 15, 137–147. https://doi.org/10.2147/DHPS.S425858

Ali, I., & Jundi, M. (2023). كتاب اللغة العربية للصف العاشر مدرسة عالية: التحليل بنظرية إعداد الكتاب التعليمي لناصر عبد الله الغالي‬. JURNAL AL-IHDA: Media Ilmiah Bahasa Arab, 11(2). https://doi.org/10.58645/alihda.v11i2.418

Arikunto, S. (2009). Dasar-Dasar Evaluasi Pendidikan. Bumi Aksara.

Asrori, I., Thohir, M., & Ainin, M. (2019). EVALUASI PEMBELAJARAN BAHASA ARAB (A. F. Effendy, Ed.). MISYKAT.

Baker, L. (2006). Observation: A Complex Research Method. Library Trends, 55(1), 171–189.

Bernstein, J. (2006). Theory and method in automatic evaluation of spoken language proficiency. The Journal of the Acoustical Society of America, 120(5_Supplement), 3138. https://doi.org/10.1121/1.4787747

Buaton, R., Fauzi, A., & Yel, M. (2022). New Paradigm E-Learning Model Based on Artificial Intelligence: New Paradigm E-Learning Model Based on Artificial Intelligence. Journal of Artificial Intelligence and Engineering Applications (JAIEA), 2(1), Article 1. https://doi.org/10.59934/jaiea.v2i1.116

Cowie, N. (2009). Observation. In J. Heigham & R. A. Croker (Eds.), Qualitative Research in Applied Linguistics: A Practical Introduction (pp. 165–181). Palgrave Macmillan UK. https://doi.org/10.1057/9780230239517_8

Dalle, M. (2019). تحليل الأخطاء النحوية والصرفية في تركيب الكلام: دراسة مقارنة بين برنامج الجدال العربي الكندي وبرنامج الجدال العربي منابر‬ [Master, UIN Maulana Malik Ibrahim]. https://scholar.google.com/citations?view_op=view_citation&hl=en&user=p--bHocAAAAJ&authuser=5&citation_for_view=p--bHocAAAAJ:9yKSN-GCB0IC

Dinata, R. S., Musalwa, M., & Budiarti, M. (2021). Students’ Perceptions about Evaluation of Speaking Skills (Mahârah Kalâm) Through Youtube Channel. Lisaanuna Ta`lim Al-Lughah Al-Arabiyah: Jurnal Pendidikan Bahasa Arab, 4(2), 221–232. https://doi.org/10.15548/lisaanuna.v4i2.3274

Fuentealba, C. (2011). The Role of Assessment in the Student Learning Process. Journal of Veterinary Medical Education, 38(2), 157–162. https://doi.org/10.3138/jvme.38.2.157

Gipps, C. (1998). Student assessment and learning for a changing society. Prospects, 28(1), 31–44. https://doi.org/10.1007/BF02737778

Haenlein, M., & Kaplan, A. (2019). A Brief History of Artificial Intelligence: On the Past, Present, and Future of Artificial Intelligence. California Management Review, 61(4), 5–14. https://doi.org/10.1177/0008125619864925

Handayani, F., Nurhayati, N., & Kamila, A. (2022). Artificial intelligence as an educational media to improve adolescent reproductive health: Research and development studies. Jurnal Keperawatan Padjadjaran, 10(3), Article 3. https://doi.org/10.24198/jkp.v10i3.2104

Haniefa, R. (2022). Implementasi Model Penilaian Hots (Higher Order Thinking Skills) Pada Penilaian Empat Keterampilan Berbahasa Arab. Ta’limi | Journal of Arabic Education and Arabic Studies, 1(1), Article 1. https://doi.org/10.53038/tlmi.v1i1.11

Hasibuan, R., & Jundi, M. (2023). استراتيجيات إدارية مبتكرة لتحقيق نجاح برنامج تعليم اللغة العربية في معهد دار العلوم الإسلامية في سيباهو. Kitaba, 1(3), Article 3. https://doi.org/10.18860/kitaba.v1i3.24218

Hill, J. E., Harris, C., & Clegg, A. (2024). Methods for using Bing’s AI-powered search engine for data extraction for a systematic review. Research Synthesis Methods, 15(2), 347–353. https://doi.org/10.1002/jrsm.1689

Hosna, H., Firdaus, A. N. H., Mutmainnah, W., & Maulana, A. (2023). THE IMPLEMENTATION OF AUTHENTIC ASSESMENT IN RAISING THE STUDENT’S SPEAKING SKILL AT RELIGIUS PROGRAMS (MANPK) SENIOR HIGH SCHOOL 01 JEMBER: Ethical Lingua: Journal of Language Teaching and Literature, 10(2). https://doi.org/10.30605/25409190.637

Ji, H., Han, I., & Ko, Y. (2022). A systematic review of conversational AI in language education: Focusing on the collaboration with human teachers. Journal of Research on Technology in Education, 55, 48–63. https://doi.org/10.1080/15391523.2022.2142873

Jundi, M. (2023a). Classical Test Theory in Analyzing Arabic Test Questions: A Descriptive Study on Item Analysis Research in Indonesia. ATHLA: Journal of Arabic Teaching, Linguistic and Literature, 4(2). https://doi.org/10.22515/athla.v4i2.7747

Jundi, M. (2023b). تصميم برنامج أندرويد لتعزيز إتقان المفردات لدى طلاب المدرسة العالية. Lahjah Arabiyah: Jurnal Bahasa Arab Dan Pendidikan Bahasa Arab, 4(2), Article 2. https://doi.org/10.35316/lahjah.v4i2.140-158

Jundi, M. (2023c). مقارنة تحليل بنود الأسئلة باستخدام نظرية الاختبار التقليدية ونظرية استجابة البنود لدرس اللغة العربية في المدرسة المتوسطة الإسلامية الحكومية باتو [Masters, Universitas Islam Negeri Maulana Malik Ibrahim]. http://etheses.uin-malang.ac.id/60055/

Jundi, M., & Ali, M. (2023). Assessing The Classroom Learning in Arabic Matriculation Program: Tutor and Student Perspective. Jurnal Al-Maqayis, 10(2), 21–36.

Jundi, M., & Hasibuan, R. (2023). Enhancing Arabic Language Proficiency among Students: A Case Study of Language Matriculation Strategies at Al-Hasyimiyah Darul Ulum Sipaho Islamic Boarding School. Kilmatuna: Journal Of Arabic Education, 3(2), Article 2. https://doi.org/10.55352/pba.v3i2.619

Kementrian Pendidikan dan Kebudayaan. (n.d.). Permendiknas No.16, Tahun 2007, tentang Standar Kualifikasi Akademik dan Kompetensi Guru.

Kholisoh, L. N. (2018). SUDAHKAH EVALUASI KEMAHIRAN BERBICARA BAHASA ARAB PADA TINGKAT DASAR DILAKUKAN? ALSUNIYAT: Jurnal Penelitian Bahasa, Sastra, Dan Budaya Arab, 1(1), Article 1. https://doi.org/10.17509/alsuniyat.v1i1.24200

Kshirsagar, P. R., Jagannadham, D. B. V., Alqahtani, H., Noorulhasan Naveed, Q., Islam, S., Thangamani, M., & Dejene, M. (2022). Human Intelligence Analysis through Perception of AI in Teaching and Learning. Computational Intelligence and Neuroscience, 2022, e9160727. https://doi.org/10.1155/2022/9160727

Latief, M. A. (2016). Reliability of Language Skills Assessment Results. Jurnal Ilmu Pendidikan. https://www.semanticscholar.org/paper/Reliability-of-Language-Skills-Assessment-Results-Latief/2b725100441a2500b3320498320bfc6cd27c34a0

Mahmudi, I., & Nurbaha, A. (2023). Anwā’u al-Ikhtibārāt wa al-Mustawiyāt al-Mi’yāriyyah li Mahārah al-Kalām fī al-Lugah al-‘Arabiyyah. Aphorisme: Journal of Arabic Language, Literature, and Education, 4(2), 112–127. https://doi.org/10.37680/aphorisme.v4i2.3997

Mardapi, D. (2016). Pengukuran Penilaian dan Evaluasi Pendidikan (2nd ed.). Nuha Litera.

Matrokhim, M. (2021). Students’ Self-Assessment of Arabic Speaking Skill. International Journal of Arabic Language Teaching, 3(02), Article 02. https://doi.org/10.32332/ijalt.v3i02.4208

Maulidia, L. N., Suparno, S., & Rosyidah, U. J. (2023). A Systematic Literature Review on Technology-Based Learning Media in ECE to Face Society 5.0 Era. Jurnal Obsesi : Jurnal Pendidikan Anak Usia Dini, 7(5), Article 5. https://doi.org/10.31004/obsesi.v7i5.4997

Melati, S. E., Aini, N., & Wahyuni, A. F. (2023). The Uses of AI And Technology in Media and Material Development of Merdeka Belajar. International Conference on Education, 239–246.

Miladya, J. (2015). EVALUASI DALAM PEMBELAJARAN BAHASA ARAB. Prosiding Konferensi Nasional Bahasa Arab, 1(1), Article 1. http://prosiding.arab-um.com/index.php/konasbara/article/view/21

Miles, B. M., Huberman, A. M. and Saladana. (2014). Qualitative Data Analysis A Methods Sourcebook. Edition 3 (p. 22). SAGE Publications.

Mukti, F. D. (2023). TRANSFORMATION OF EDUCATION IN ELEMENTARY SCHOOLS: UTILIZATION OF ARTIFICIAL INTELLIGENCE-BASED LEARNING MEDIA IN THE DIGITAL ERA. DIRASATUL IBTIDAIYAH, 3(2), Article 2. https://doi.org/10.24952/ibtidaiyah.v3i2.10200

Nuryadin, R., & Marliana, M. (2023). The Use of AI (Artificial Intelligence) in Education—Literature Review. Indonesian Journal of Primary Education, 7(2), Article 2. https://doi.org/10.17509/ijpe.v7i2.64290

Park, G., Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Kosinski, M., Stillwell, D. J., Ungar, L. H., & Seligman, M. E. P. (2015). Automatic personality assessment through social media language. Journal of Personality and Social Psychology, 108(6), 934–952. https://doi.org/10.1037/pspp0000020

Plough, I. (2018). Revisiting the speaking construct: The question of interactional competence. Language Testing, 35(3), 325–329. https://doi.org/10.1177/0265532218772322

Prananta, A. W., Susanto, N., Purwantoro, A., & Fuadah, N. (2023). ChatGPT Artificial Intelligence Integration in Science Learning Media: Systematic Literature Review. Jurnal Penelitian Pendidikan IPA, 9(7), Article 7. https://doi.org/10.29303/jppipa.v9i7.4386

Pratama, M. P., Sampelolo, R., & Lura, H. (2023). REVOLUTIONIZING EDUCATION: HARNESSING THE POWER OF ARTIFICIAL INTELLIGENCE FOR PERSONALIZED LEARNING. KLASIKAL : JOURNAL OF EDUCATION, LANGUAGE TEACHING AND SCIENCE, 5(2), Article 2. https://doi.org/10.52208/klasikal.v5i2.877

Rahman, A., Santosa, T. A., Ilwandri, I., Suharyat, Y., Aprilisia, S., & Suhaimi, S. (2023). The Effectiveness of AI Based Blended Learning on Student Scientific Literacy: Meta-analysis. LITERACY : International Scientific Journals of Social, Education, Humanities, 2(1), Article 1. https://doi.org/10.56910/literacy.v2i1.542

Rakuasa, H. (2023). Integration of Artificial Intelligence in Geography Learning: Challenges and Opportunities. Sinergi International Journal of Education, 1(2), Article 2. https://doi.org/10.61194/education.v1i2.71

Rina, N. (2023). Artificial Intelligence Use as Communication Media in Learning Activity for Senior High School. Jurnal Ilmiah LISKI (Lingkar Studi Komunikasi), 9(2), 135–142. https://doi.org/10.25124/liski.v9i2.6675

Rosser, H. L. (1979). Testing Oral Communicative Skills. Foreign Language Annals, 12(5), 371–373. https://doi.org/10.1111/j.1944-9720.1979.tb00198.x

Rosyadi, M. I., Kustiawan, I., Tetehfio, E. O., & Joshua, Q. (2023). The Role of AI In Vocational Education: A Systematic Literature Review. Journal of Vocational Education Studies, 6(2), Article 2. https://doi.org/10.12928/joves.v6i2.9032

Roviin, R. (2018). Evaluasi Pembelajaran Bahasa Arab (Kajian Tentang Instrumen Tes). Arabia, 10(1), Article 1. https://doi.org/10.21043/arabia.v10i1.3085

Rukajat, A. (2018). Pendekatan Penelitian Kualitatif (Qualitative Research Approach). Deepublish.

Seo, K., Tang, J., Roll, I., Fels, S., & Yoon, D. (2021). The impact of artificial intelligence on learner–instructor interaction in online learning. International Journal of Educational Technology in Higher Education, 18(1), 54. https://doi.org/10.1186/s41239-021-00292-9

Triantafillou, E., Georgiadou, E., & Economides, A. A. (2008). The design and evaluation of a computerized adaptive test on mobile devices. Computers & Education, 50(4), 1319–1330. https://doi.org/10.1016/j.compedu.2006.12.005

Wang, W., & Liu, Z. (2021). Using Artificial Intelligence-Based Collaborative Teaching in Media Learning. Frontiers in Psychology, 12. https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2021.713943

Wang, X., Gulenman, T., Pinkwart, N., De Witt, C., Gloerfeld, C., & Wrede, S. (2020). Automatic Assessment of Student Homework and Personalized Recommendation. 2020 IEEE 20th International Conference on Advanced Learning Technologies (ICALT), 150–154. https://doi.org/10.1109/ICALT49669.2020.00051

Wibisono, F., & Pramudita, D. A. (2023). Smart geometry object detection: Flat shape recognition learning media based on artificial intelligence. 020035. https://doi.org/10.1063/5.0151690

Widodo, J., & Qosim, M. N. (2021). Penilaian Kinerja Pada Pembelajaran Maharah Al-Kalam Level 1 Di Kursus Bahasa Arab Al-Arobiya Surakarta. Uktub: Journal of Arabic Studies, 1(2), Article 2. https://doi.org/10.32678/uktub.v1i2.5814

Williamson, B., Macgilchrist, F., & Potter, J. (2023). Re-examining AI, automation and datafication in education. Learning, Media and Technology, 48(1), 1–5. https://doi.org/10.1080/17439884.2023.2167830

Yanhua, Z. (2020). The Application of Artificial Intelligence in Foreign Language Teaching. 2020 International Conference on Artificial Intelligence and Education (ICAIE), 40–42. https://doi.org/10.1109/ICAIE50891.2020.00017

Yasin, A., & Tarauni, H. (2023). Tashmim al-Ikhtibar li Maharah al-Kalam al-‘Arabi Wafqhan li al-Ithar al-Marja’i al-Urubi al-Musytarak li al-Lughat li al-Thullab al-Jami’ah fi Indunisiya. Arabiyatuna: Jurnal Bahasa Arab, 7(1 May), Article 1 May. https://doi.org/10.29240/jba.v7i1.6390

Yin, N. (2021). Research on the Impacts of Artificial Intelligence Technology on Language Teaching Innovation. Frontiers in Educational Research, 4(7). https://doi.org/10.25236/FER.2021.040706

Zaharo, Hangkiho, R., Jundi, M., Udin, R., & Hasibuan, R. (2024). Al-Ibtikār al-Hadīṡ fi al-Taqyīm al-Takwīni: Istifādatu min al- Ṣuwari al-Muwalladah bi al- Żakā` al-I ṣṭinā’i fi Taqyīm Maḥārah al-Kalām li al-Lugah al-Arabiyyah: الابتكار الحديث في التقييم التكويني: استفادة من الصور المولدة بالذكاء الاصطناعي في تقييم مهارة الكلام للّغة العربية. Al-Madrasah: Jurnal Pendidikan, Pembelajaran dan Kebudayaan, 1(1), Article 1.

Zaharo, Z., Chamidah, D., & Jundi, M. (2024). Can Word Puzzle-Based Formative Assessments Track Student Progress in Arabic Language Learning? Kilmatuna: Journal Of Arabic Education, 4(1), Article 1. https://doi.org/10.55352/pba.v4i1.871

Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education – where are the educators? International Journal of Educational Technology in Higher Education, 16, 1–27. https://doi.org/10.1186/s41239-019-0171-0

Zhai, X., Chu, X., Chai, C. S., Jong, M. S. Y., Istenic, A., Spector, M., Liu, J.-B., Yuan, J., & Li, Y. (2021). A Review of Artificial Intelligence (AI) in Education from 2010 to 2020. Complexity, 2021, e8812542. https://doi.org/10.1155/2021/8812542

علام, ر. م. أ. (2005). تقويم التعلم. دار المسيرة للطباعة والنشر.

عليمات, م. م. (2022). بناء اختبار محكي المرجع في الرياضيات وفق النموذج اللوجستي ثلاثي المعلمة. مجلة جامعة القدس المفتوحة للأبحاث والدراسات التربوية والنفسية, 13(38), Article 38. https://doi.org/10.33977/1182-013-038-004

عواضة, ه. (2010). تقويم التعلم. دار العلم للملايين.

عودة, أ. (2005). القياس والتقويم في العملية التدريسية. شركة الأمل للطباعة والنشر والتوزيع.




DOI: https://doi.org/10.15548/imlah.v6i1.9680

Refbacks

  • There are currently no refbacks.


UPT Pengembangan Bahasa, Universitas Islam Negeri Imam Bonjol Padang Jl. M. Yunus No. 1, Lubuk Lintah, Kuranji. Kota Padang, Sumatera Barat 25153