Development of the generative artificial intelligence awareness scale for secondary school students in Türkiye

Abstract

The widespread adoption of generative artificial intelligence (AI) in education and daily life necessitates a deeper understanding of students' awareness and attitudes. However, there is a lack of appropriate and psychometrically validated tools to assess these constructs reliably. This study aimed to examine the validity and reliability of a newly developed scale measuring secondary school students' awareness of generative artificial intelligence in the Turkish context. This methodological study employed a cross-sectional, descriptive, and correlational design. The research was conducted with 444 secondary school students aged 14-18. Data were collected using a Demographic Information Form and the Generative Artificial Intelligence Awareness Scale. The study followed a three-stage process in line with the STROBE checklist: (1) item development, (2) expert evaluation for content validity, and (3) construct validity and reliability testing. Construct validity was assessed using Exploratory and Confirmatory Factor Analyses. Reliability was examined through Cronbach's alpha, corrected item-total correlations, and split-half reliability analysis. EFA revealed a three-factor structure: Basic Knowledge of Generative Artificial Intelligence, Positive Attitudes Toward Generative Artificial Intelligence, and Concerns About the Impacts of Generative Artificial Intelligence, explaining 54.29% of the total variance. CFA supported the model, yielding acceptable fit indices (chi 2/df = 3.792, RMSEA = 0.056, GFI = 0.905, CFI = 0.927, TLI = 0.919), indicating good model fit. The Cronbach's alpha for the total scale was 0.946, with subscale coefficients ranging from 0.822 to 0.925. Corrected item-total correlations ranged from 0.512 to 0.733. Split-half reliability for the first factor showed strong consistency (Spearman-Brown = 0.891, Guttman = 0.887, correlation between halves = 0.804). The findings demonstrate that the Turkish version of the generative artificial intelligenceawareness scale is a valid and reliable instrument for assessing students' knowledge, attitudes, and concerns about generative AI. What is Known:center dot Generative artificial intelligence (GAI) technologies are increasingly used by adolescents in educational settings, yet their awareness, ethical understanding, and usage patterns remain underexplored.center dot Existing measurement tools for AI literacy often target higher education students and lack specificity in assessing secondary school students' awareness of generative AI.What is New:center dot This study developed and psychometrically validated the first comprehensive scale to assess secondary school students' awareness of generative AI, including knowledge, attitudes, and ethical concerns.center dot The Generative Artificial Intelligence Awareness Scale (GAIAS) provides educators and policymakers with a reliable tool to evaluate and support adolescents' digital and ethical preparedness in the age of generative AI.