Citation

Singh, Parmjit and Anthonysamy, Lilian (2025) Development and validation of an instrument to assess instructors’ usage, acceptance, and confidence towards ChatGPT: a reliability and discriminant validity analysis. Education and Information Technologies. ISSN 1360-2357

Text s10639-025-13773-5.pdf - Published Version Restricted to Repository staff only Download (1MB)

Abstract

ChatGPT is the way of future education and with the quick evolution of this AI instrument in the classroom, there must be a way to test the teacher’s ability to use this technology in the most productive way. But first a measurable instrument needs to be developed for the attitudes and willingness of instructors toward ChatGPT. That makes it hard to fully assess how much professors welcome and use ChatGPT, and thus exactly what makes it work in the classroom. Therefore, this study aimed to develop and validate an instrument to effectively measure instructors’ readiness and acceptance of ChatGPT in the context of teaching and learning. The study’s structure was divided into two main parts: developing the questionnaire and its validation. During the first stage, the questionnaire was designed by an expert team of three members and that took a long time. The analysis of the different survey questions and items, including the possible validity of the contents, was carried out and the forms modified appropriately for the instructors. Then followed the validation stage, during which the questionnaire was subjected to the evaluation of its psychometric properties: validity, and reliability. Different methods were applied in evaluating the performance of the questionnaire, including internal consistency (Cronbach’s Alpha and Composite Reliability), convergent validation (Factor Loadings and Average Variance Extracted (AVE)), and discriminant validation (Fornell-Larcker criterion, cross-loading, HTMT criterion). The findings of the analyses confirmed the discriminant validity of the questionnaire. In the cross-loading analysis, the indicators displayed high loadings on the respective constructs, while the Fornell-Larcker criterion indicated that intra-construct correlations were higher than inter-construct correlations. In addition, the HTMT ratios demonstrated the discriminant validity of the instrument. Thus, the questionnaire is proved to be effective in measuring instructors’ usage, acceptance and confidence of ChatGPT. To conclude, the tool demonstrated high internal consistency reliability, construct and discriminant validity. This equips both researchers and practitioners with a sound instrument to assess the scale of effects ChatGPT may have on the pointers of teaching and learning process, thus ease the implementation of such technology within the education system.

Item Type:	Article
Uncontrolled Keywords:	ChatGPT, Instructors, Readiness, Psychometric validation, Discriminant analysis, Teaching and learning
Subjects:	H Social Sciences > HD Industries. Land use. Labor > HD28-70 Management. Industrial Management > HD30.2 Electronic data processing. Information technology. Including artificial intelligence and knowledge management
Divisions:	Faculty of Management (FOM)
Depositing User:	Ms Suzilawati Abu Samah
Date Deposited:	30 Sep 2025 02:44
Last Modified:	05 Oct 2025 02:44
URII:	http://shdl.mmu.edu.my/id/eprint/14544

Downloads

Edit (login required)