Developing an Instrument to Assess Writing Skills in Arabic as a Second Language: A Confirmatory Factor Analysis Approach

Lalu Agus Pujiartha; Apri Wardana Ritonga; Ayu Desrani; Agus Supriatna

doi:10.15548/jt.v32i2.937

Developing an Instrument to Assess Writing Skills in Arabic as a Second Language: A Confirmatory Factor Analysis Approach

Lalu Agus Pujiartha, Apri Wardana Ritonga, Ayu Desrani, Agus Supriatna

Abstract

This study aims to develop an assessment instrument for Arabic writing skills as a second language using Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA). The instrument was developed based on the Oriondo and Antonio model, with a sample of 248 students who completed a writing test. Data were analyzed using R-Studio software for EFA, CFA, and descriptive statistics. The EFA results revealed one main factor, with eigenvalues and factor loadings above 0.6, indicating a consistent factor structure. In CFA, the four dimensions of writing skills Ideas and Content, Structure and Organization, Style and Rhetoric, and Language and Grammar demonstrated strong factor loadings and good model fit, confirming the robustness of the instrument. The instrument also showed high internal consistency and strong construct validity. This instrument can be practically used by educators and language program administrators to evaluate and enhance students’ writing proficiency in Arabic as a second language. This study produces a valid and reliable instrument for assessing Arabic writing skills as a second language in higher education.

Keywords

Arabic learning; EFA, CFA; instrument validation; second language; writing skills.

10.15548/jt.v32i2.937

Abstract view : 451 times

PDF : 206 times

Full Text:

PDF

References

Akar, S. G. M. (2025). Students’ Disengagement in Online Courses: Validity and Reliability of an Instrument. Journal of Education and Learning, 19(1), 506–514. https://doi.org/10.11591/edulearn.v19i1.21733

Akomah, B. B., & Ramani, P. V. (2024). Confirmatory Factor Analysis of the Positive Factors Influencing the Performance of Ghanaian Construction Projects. Construction Innovation. https://doi.org/10.1108/CI-08-2022-0190

Al-Janabi, A., Al-Zubaidi, E. A., & Abdulzhraa Al-Sagheer, R. H. (2020). Encapsulation of Semantic Description with Syntactic Components for the Arabic Language. Indonesian Journal of Electrical Engineering and Computer Science, 22(2), 961–967.

Baharum, H., Ismail, A., Awang, Z., Mckenna, L., Ibrahim, R., Mohamed, Z., & Hassan, N. H. (2023). The Study Adapted Instruments Based on Confirmatory Factor Analysis (CFA) to Validate Measurement Models of Latent Constructs. International Journal of Environmental Research and Public Health, 20(2860).

Bean, G. J., & Bowen, N. K. (2021). Item Response Theory and Confirmatory Factor Analysis: Complementary Approaches for Scale Development. Journal of Evidence-Based Social Work (United States), 18(6), 597–618. https://doi.org/10.1080/26408066.2021.1906813

Bereiter, C., & Scardamalia, M. (1987). The Psychology of Written Composition. In The psychology of written composition. Lawrence Erlbaum Associates, Inc.

Black, P., & Wiliam, D. (1998). Assessment and Classroom Learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7–74. https://doi.org/10.1080/0969595980050102

Brown, H. D. (2007). Principles of Language Learning And Teaching (5th Ed). Longman.

Brown, T. A. (2015). Confirmatory Factor Analysis for Applied Research (Second Edi). Guilford Publications.

Costello, A. B., & Osborne, J. W. (2005). Best Practices in Exploratory Factor Analysis: Four Recommendations for Getting the Most From Your Analysis. Practical Assessment, Research & Evaluation, 10(7), 135–138. https://doi.org/10.7275/jyj1-4868

D’Souza, R. (2021). What Characterises Creativity in Narrative Writing, and How do we Assess it? Research Findings from a Systematic Literature Search. Thinking Skills and Creativity, 42, 100949. https://doi.org/10.1016/j.tsc.2021.100949

Erguvan, I. D. (2021). Gathering Evidence on E-rubrics: Perspectives and Many Facet Rasch Analysis of Rating Behavior. International Journal of Assessment Tools in Education, 8(2), 454–474. https://doi.org/https://doi.org/10.21449/ijate.818151

Hair, J. F. (2011). Multivariate Data Analysis: An Overview. In International Encyclopedia of Statistical Science (pp. 904–907). Springer Berlin Heidelberg.

Mellinger, C. D., & Hanson, T. A. (2020). Methodological Considerations for Survey Research : Validity , Reliability , and Quantitative Analysis. Linguistica Antverpiensia, New Series: Themes in Translation Studies, 19, 172–190. https://doi.org/10.52034/lanstts.v19i0.549.

Oriondo, L. L., & Dallo-Antonio, E. M. (1984). Evaluating Educational Outcome: Test, Measurement, Evaluation. Rex Book Store, Inc.

Rakhlin, N. V, Aljughaiman, A., & Grigorenko, E. L. (2021). Assessing language development in Arabic: The Arabic language: Evaluation of function (ALEF). Applied Neuropsychology: Child, 10(1), 37–52. https://doi.org/10.1080/21622965.2019.1596113

Rufaiqoh, E., Sutaman, S., Arifa, Z., Ibrahim ElJack Ibrahim, N., & Asy’ari, H. (2023). Jacob’s Analytical Assessment in the Evaluation of Arabic Writing Skills at Madrasah Aliyah Negeri Program Keagamaan. Alsinatuna, 9(1), 29–40.

Sureshchandar, G. S. (2023a). Quality 4.0 – A Measurement Model using the Confirmatory Factor Analysis (CFA) Approach. International Journal of Quality & Reliability Management, 40(1), 280–303. https://doi.org/10.1108/IJQRM-06-2021-0172

---. (2023b). Quality 4.0 – A Measurement Model Using the Confirmatory Factor Analysis (CFA) Approach. International Journal of Quality & Reliability Management, 40(1), 280–303. https://doi.org/10.1108/IJQRM-06-2021-0172

Yilmaz, E., & Jafarova, G. (2022). Development of Data Driven Decision Making Scale: A Validity and Reliability Study. Research on Education and Psychology, 6(Special Issue), 69–91. https://doi.org/10.54535/rep.1104114

Zakaria, M. K., Saputra, R. H., Embong, A. M., Khadim, K. A., Ab Wahab, N. A., Hailan, S., Abdul Kadir, F. K., Munawarah, J., Abdul-

Kadir, N. A., Nasir, N. Y. M., & Kadir, K. A. (2024). Similar but Not Same: Language Barriers and the Facet of Life Faced by the Indonesians as International Students in Malaysia. International Journal of Sustainable Development and Planning, 19(4), 1347–1359. https://doi.org/10.18280/ijsdp.190412

Zaki, M. (2021). Self‐correction through Corpus‐based Tasks: Improving Writing Skills of Arabic Learners. International Journal of Applied Linguistics, 31(2), 193–210. https://doi.org/10.1111/ijal.12312

DOI: https://doi.org/10.15548/jt.v32i2.937