Moving beyond academic achievement goal measures: A study of social achievement goals

The current research explored the theory of social goal orientation. More specifically, we conducted three studies utilizing six-independent university student samples to evaluate the construct validity of the Social Achievement Goal Orientation Scale (SAGOS; Ryan & Hopkins, 2003), a measure representing the construct of social goal orientation. The purpose of Study 1 was to: (1) compare the three-dimensional (mastery, performance-approach, and performance-avoidance) model of social goal orientation to three theoretically based competing models, (2) examine item functioning, and (3) assess generalizability of the factor structure. The fit of the proposed three-factor model was promising; however, areas of misfit and problematic items were identified. Stronger support for the three-factor structure of goal orientation was found using scores from an abbreviated 13-item SAGOS. In Study 2, item wording was altered slightly to evaluate a revised Social Achievement Goal Scale (SAGS), yet resulted in similar findings. Study 3 examined external validity evidence for the SAGS, garnering some support for the meaning of the scores. Although continued refinement of the SAGOS and SAGS is recommended, the findings help contribute to our general understanding and conceptualization of social goal theory and the role that social goals may play in academic contexts.     

Spanish validation of the Basic Psychological Needs at Work Scale: A measure to predict teachers’ well-being in the workplace

The present study aimed to validate a Spanish-version of the Basic Psychological Needs at Work Scale (BPNWS-Sp) and to examine the associations between needs satisfaction and engagement and burnout in secondary education teachers. Using a sample of 584 secondary education teachers, the results supported the three-factor model, composite reliability, measurement invariance, and nomological validity of the BPNWS-Sp. This study contributes to validating the first instrument in Spanish to measure the satisfaction of the three BPNs separately in secondary education teachers. The measurement of teachers’ BPNs could effectively provide guidance for school policies to improve teaching and learning.     

Measuring Quality of Classroom Interactions in Italian Primary School: Structural Validity of the CLASS K–3

Abstract

Through two studies, this work examined the applicability, interpretability, and construct validity of the Classroom Assessment Scoring System K-3 (CLASS) to measure quality of classroom interactions. In the first study, the CLASS was used in 332 classrooms to test three alternative models (in time order, the one-, three-factor, and two-factor models) to examine its factorial structure. The one-factor model showed worse fit than the other two models. The latent factors of the three-factor model were highly correlated. The bifactor model showed adequate fit. The aim of the second study was to investigate the construct validity of the CLASS. We used data collected from 31 classrooms to examine associations between factors extracted from the bifactor model with outcome variables in the domains of the student-teacher relationship, behavioral problems, and academic achievement. General- and domain-specific factors revealed different patterns of associations with child outcomes. The results are discussed relative to the Italian context.     

A comprehensive reanalysis of the metacognitive self-regulation scale from the MSLQ

The metacognitive self-regulation (MSR) scale is among the most widely used measures of metacognition in educational research. However, the psychometric properties and validity of the scale have not been well established. A series of analyses on a college sample were performed to address this issue. In Study 1, a split-sample exploratory (EFA) and confirmatory factor analysis (CFA) was performed to test the one-factor specification of the MSR scale. Time and study environment (TSE), total study time, and cumulative grade performance average (cGPA) were introduced as outcome variables in a structural equation model (SEM) to examine the factors suggested by the EFA. The results of Study 1 indicated poor one-factor model fit and suggested two and three-factor models provided improved fits of the sample data. Results from the SEM indicated the novel factors from the two and three-factor models had different relationships with the outcome variables than the originally specified one-factor model. In Study 2, a modified one-factor model was introduced that consisted of nine items and was named metacognitive self-regulation revised (MSR-R). Five additional samples were included to replicate the model fit for the revised model specification. Finally, a path analysis was performed to examine the relationship of the MSR-R to variables from Study 1. The results of Study 2 revealed improved psychometric properties and reliability for the MSR-R. An indirect relationship emerged between MSR-R and cGPA through TSE. In conclusion, convincing evidence for replacing the MSR was found and implications of the revised scale for future studies was discussed.     

Validating the early childhood classroom observation measure in first and third grade classrooms

The present study reports on the psychometric properties of the Early Childhood Classroom Observation Measure (ECCOM) in Finnish and Estonian first and third grade classrooms. The observation data were collected from 91 first grade teachers and 70 third grade teachers. Teachers' curriculum goals, teaching experience and the classroom size were measured also. The results of confirmatory factor analysis provided evidence of the three-factor model (management, climate, and instruction) for each dimension—child-centred, teacher-directed, and child-dominated—in both grades. The reliability of the dimensions and sub-scales was good, and some evidence was also found for criterion validity. The findings imply that ECCOM is a reliable and valid instrument for measuring teaching practices in primary school.     

Measuring Teachers’ enjoyment,anger, and anxiety: The Teacher Emotions Scales (TES)

The emotions of teachers are considered relevant not only for their own well-being but also for the functioning of classrooms. Nevertheless, research on teacher emotions has been slow to emerge, and scales for their assessment via self-report are generally lacking. In the present research we developed four-item scales for three emotions considered most relevant in the context of teaching: enjoyment, anger, and anxiety (Teacher Emotions Scales, TES). Based on data of 944 teachers, we tested German and English language versions of the TES for reliability, internal and external validity, and cross-language equivalence, while exploring the utility of both a general and a student-group specific variant. All scales proved to be highly reliable, and confirmatory factor analysis supported internal validity by showing that three-factor models (enjoyment, anger, and anxiety) were superior to single-factor or two-factor (positive vs. negative affect) models. The external validation analyses provided consistent evidence for theoretically meaningful relations with teachers’ general affect, burnout, job satisfaction, and teacher self-efficacy. These findings were robust across multiple studies. In addition, consistent relationships with student ratings of teaching behaviors were found. Analyses of measurement invariance revealed that the English and the German language versions were fully structurally equivalent und displayed metric invariance.     

Validation of a Norwegian Version of the Approaches and Study Skills Inventory for Students (ASSIST): Application of structural equation modelling

The Approaches and Study Skills Inventory for Students (ASSIST) were administered to 573 under-graduate students in order to analyse a Norwegian version of this inventory. To cross-validate the factor structure, the subjects were divided into two equal samples. Principal axis factor analysis of sample 1 reproduced the three main factors of deep, surface and strategic approaches to learning. However, two of the subscales failed to load appropriately on the 'strategic approach'. When omitting these subscales, the principle of simple structure was better supported by the results. A subsequent CFA with comparison of samples 1 and 2 supported the existence of the expected three-factor model. It is concluded that this Norwegian version of ASSIST is valuable as a research tool for the assessment of approaches to learning among Norwegian students, but that caution should be taken with respect to the interpretation of particular subscales and possible sample effects.     

Examining factorial validity and measurement invariance of the Student-Teacher Relationship Scale

The purposes of this study were to (a) test the hypothesized factor structure of the Student-Teacher Relationship Scale (STRS; Pianta, 2001) for 308 African American (AA) and European American (EA) children using confirmatory factor analysis (CFA) and (b) examine the measurement invariance of the factor structure across AA and EA children. CFA of the hypothesized three-factor model with correlated latent factors did not yield an optimal model fit. Parameter estimates obtained from CFA identified items with low factor loadings and R² values, suggesting that content revision is required for those items on the STRS. Deletion of two items from the scale yielded a good model fit, suggesting that the remaining 26 items reliably and validly measure the constructs for the whole sample. Tests for configural invariance, however, revealed that the underlying constructs may differ for AA and EA groups. Subsequent exploratory factor analyses (EFAs) for AA and EA children were carried out to investigate the comparability of the measurement model of the STRS across the groups. The results of EFAs provided evidence suggesting differential factor models of the STRS across AA and EA groups. This study provides implications for construct validity research and substantive research using the STRS given that the STRS is extensively used in intervention and research in early childhood education.     

Investigations of Temperament at Three to Seven Years: The Children''s Behavior Questionnaire

This article reviews evidence on the reliability and validity of the Children's Behavior Questionnaire (CBQ), and presents CBQ data on the structure of temperament in childhood. The CBQ is a caregiver report measure designed to provide a detailed assessment of temperament in children 3 to 7 years of age. Individual differences are assessed on 15 primary temperament characteristics: Positive Anticipation, Smiling/Laughter, High Intensity Pleasure, Activity Level, Impulsivity, Shyness, Discomfort, Fear, Anger/Frustration, Sadness, Soothability, Inhibitory Control, Attentional Focusing, Low Intensity Pleasure, and Perceptual Sensitivity. Factor analyses of CBQ scales reliably recover a three-factor solution indicating three broad dimensions of temperament: Extraversion/Surgency, Negative Affectivity, and Effortful Control. This three-factor solution also appears to be reliably recovered in ratings of children in other cultures (e.g., China and Japan). Evidence for convergent validity derives from confirmation of hypothesized relations between temperament and socialization-relevant traits. In addition, parental agreement on CBQ ratings is substantial. The CBQ scales demonstrate adequate internal consistency, and may be used in studies requiring a highly differentiated yet integrated measure of temperament for children in this age range.     

Cultural validation of the Maslach Burnout Inventory for Korean students

The purpose of this study was to examine the factorial validity of the MBI-SS in Korean students. Specifically, we investigated whether the original three-factor structure of the MBI-SS was appropriate for use with Korean students. In addition, by running multi-group structural equation model analyses with factorial invariance tests simultaneously for both genders (i.e., males and females) and academic settings (i.e., middle school and high school), we tested whether the factor loading and correlations between factors can be similarly interpreted across the different groups. Results indicated that the MBI-SS is a valid instrument to measure academic burnout of Korean students. Furthermore, results presented the possibility that the MBI-SS could be used regardless of cultural background. Implications for future research and practice and limitations are discussed.     

Development and validation of the E-learning Acceptance Measure (ElAM)

This research involves the development and validation of a survey that measures users' acceptance of e-learning. A total sample of 386 university students from a teacher training institute in an Asian country participated in this study. Comprising two studies, the first study (n = 197) initiated a generic questionnaire, and examined factorial validity and reliability. The second study (n = 189) used confirmatory factor analysis to establish factorial validity and measurement invariance by gender using a different sample. A correlated three-factor model (Tutor Quality, Perceived Usefulness, and Facilitating Conditions) was fit using maximum likelihood estimation (MLE) and found to be adequate. For the two samples, the E-learning Acceptance Measure (ElAM) was found to be a precise and internally consistent measure. Applications of the ElAM were discussed.     

Teacher change beliefs: validating a scale with structural equation modelling

The objectives of the study were to validate a substantiated Teacher Change Beliefs Model (TCBM) and an instrument to identify critical components of teacher change beliefs (TCB) in Malaysian secondary schools. Five different pilot test approaches were applied to ensure the validity and reliability of the instrument. A total of 936 teachers from 47 high-performing secondary schools completed the survey. Structural equation modelling was applied to test the models. Exploratory factor analysis was employed to identify the underlying factors, whereas confirmatory factor analysis was applied to test the measurement models. The analysis yielded a three-factor TCBM: (1) discrepancy, (2) efficacy and (3) principal support. The results demonstrated a good fit of the model: normed χ² = 3.156, Tucker-Lewis Fix Index = .987, Comparative Fix Index = .991 and Root Mean Square Error of Approximation = .048. The results also provided evidence for convergent validity, discriminant validity and construct reliability. The TCBM is an empirically tested model derived in a local Malaysian cultural education setting. It provides direction for practitioners in planning and designing training programmes of change management for school principals in the enhancement of TCB among teachers in schools. Besides, Teacher Change Beliefs Scale is a promising and welcome tool for both practitioners and researchers. With only nine items, it is easy to administer and not time-consuming.     

A three-factor model of educational practice considerations for teaching neurodiverse learners from a strengths-based perspective

The purpose of this practice paper is to promote the teaching of learners with neurodevelopmental conditions from a neurodiverse perspective. The challenge teachers face in having to draw on up-to-date research evidence and theoretical perspectives, and align these with practical considerations to generate contextualised teaching strategies, are addressed with the introduction of a three-factor model. The utility of considering pupil assessment data gathered from a strengths-based perspective is positioned as a central component to bridging the gap between the incipient neurodiversity literature and the realities of applied teaching practice. Two case examples have presented that draw on the proposed three-factor model to demonstrate how teachers can assess and teach learners from a neurodevelopmental perspective. These case studies focus on supporting learners with Autism and Attention Deficit Hyperactivity Disorder in a secondary setting.     

An Assessment of the Quantitative Literacy of Undergraduate Students

Quantitative literacy (QLT) represents an underlying higher-order construct that accounts for a person's willingness to engage in quantitative situations in everyday life. The purpose of this study is to retest the construct validity of a model of quantitative literacy (Wilkins, 2010). In this model, QLT represents a second-order factor that accounts for the interrelationship among three first-order factors: mathematical beliefs, mathematical disposition, and mathematical cognition. Using data from two samples of undergraduate students (n = 186 and n = 184), a series of confirmatory factor analyses were conducted. Results supported the hierarchical three-factor structure and confirmed its factorial invariance across multiple groups of students. Latent QLT scores from the model were used to compare and rank student QLT by gender and class standing.     

Maintaining motivation and regulating emotion: measuring individual differences in academic volitional strategies

This study examined self-regulatory strategies used by students to maintain motivation on academic goal tasks. Of particular interest were strategies for managing potentially disruptive emotional states. The Academic Volitional Strategy Inventory (AVSI) was developed to investigate this aspect of student self-regulatory behavior. Three separate student samples (n = 378; n = 463; n = 246) from a large southwestern university contributed to the refinement of the AVSI, and supported theoretical arguments for the existence of volitional self-regulatory action by students in maintaining academic task motivation. Factor analyses performed on items for each administration of the AVSI revealed a three-factor structure as providing a conceptually clear division of items. Item groupings consisted of strategies reflecting (1) self-efficacy enhancement, (2) stress reduction, and (3) negative-based incentives. Reliability estimates revealed strong internal consistency and stability. Further analyses currently in progress to support the validity of the scale are also discussed. However, the preliminary results presented in this paper suggest that the AVSI is a promising research instrument, and one that captures an aspect of self-regulatory action not adequately examined by existing instruments.     

The Student–Teacher Relationship Scale revisited: Testing factorial structure,measurement invariance and validity criteria in German-speaking samples

The Student–Teacher Relationship Scale (STRS) is widely used for research in kindergarten and school. The increasing number of applications inside and outside of the U.S. stresses the need to investigate STRS properties, accordingly. The present study used the STRS in German-speaking countries, examining whether (a) the original factor structure is appropriate for a German version, (b) whether applications of a German STRS are invariant across contexts (kindergarten, first and second grade) as well as gender, and (c) whether construct and criterion validity are met. The original STRS was translated into German and filled out by 368 kindergarten and 503 elementary school teachers in Germany and Austria. Observations in kindergartens, student reports in schools, and teacher reports of students’ characteristics served as validity criteria. Results of confirmatory factor analyses (CFAs) did not confirm the original STRS factor structure. Subsequent exploratory factor analyses on training samples resulted in significant item reductions, followed by further CFAs on validation samples. The bootstrapped results yielded an adjusted three-factor model with subscales indicating satisfying alphas and invariance across context and gender. Construct and criterion validity were met for all subscales of the German STRS based on various criteria from both, observations and reports.     

Psychodiagnostic Properties of the Piotr Oleś “Internal Dialogical Activity Scale”

The article discusses the concept of internal dialogue and how it is understood in various schools of psychological research, including both Russia and abroad. The authors briefly investigate how the concept was understood by Mikhail Bakhtin, Lev Vygotsky, G.M. Kuchinskii, and Hubert Hermans. The “Internal Dialogical Activity Scale” (IDAS) methodology, pioneered by Piotr Ole?, is introduced. A sample of 256 people was tested using a Russian-language version of the IDAS. A subset of 123 people from the original sample was retested two weeks later. After analysis of the empirical data, the general test score (tendency to engage in internal dialogue) was successfully validated. However, according to our data the three-factor structure of the IDAS (consisting of internal dialogue, internal world, and internal conflict) turned out to be more suitable than the original model, which included seven subscales. The former returned the highest reliability and validity indicators. Construct validity is grounded in its high correlation with various forms of reflexive processes and aspects of self-attitude. Unlike the differential reflection test proposed by Dmitry Leontiev and E.N. Osin, the IDAS represents a negative pole of reflection, confirmed by an analysis of how the IDAS correlates with other personality variables. The approach proposed in the article is suitable for both research and applied contexts.     

Validity and reliability of questionnaire on perceived professional identity among teachers (QIPPE) scores

The purpose of this study was to develop and examine the psychometric properties of a Questionnaire on Perceived Professional Identity among Teachers (QIPPE), including three individual components (i.e., subject matter, didactical and pedagogical expertise) in the definition of teachers’ professional identity. This study involved three steps: the development of a preliminary version; a first study to establish the factorial validity of the QIPPE scores and its reliability; and a second study to test the convergent validity of the QIPPE. Through three samples and based on multiple criteria for assessing model adequacy, the results provided evidence for a 2-factor, 11-item solution of the QIPPE, including one factor related to pedagogical expertise and another related to subject matter – didactical expertise, labelled ‘subject matter expertise’. This questionnaire will be helpful for conducting longitudinal and quantitative research to estimate the reciprocal effects of perceived teachers’ professional identity (TPI) and other related factors.     

Psychometry of the Teacher's Sense of Efficacy Scale in Spanish Teachers' Education

Our objective was to test the factorial validity of the different versions (TSES-24, TSES-12, and TSES-11) of the Teacher's Sense of Efficacy Scale in Spanish preservice teachers'. The participants were 358 preservice teachers. The confirmatory factor analysis showed inadequate fit indexes for both TSES-24 and TSES-12 but adequate fit indexes for TSES-11, which was invariant across gender. The reliability analysis showed appropriate values. The global factor for teachers' sense of efficacy and the three factors that constitute it positively predicted intrinsic motivation and life satisfaction. The global factor for sense of efficacy and the classroom management and student engagement factor negatively predicted amotivation. The results support the use of the TSES-11 three-factor model, rather than TSES-24 or TSES-12, for Spanish preservice teachers.     

Effects of Missing Data Methods in SEM Under Conditions of Incomplete and Nonnormal Data

Using Monte Carlo simulations, this research examined the performance of four missing data methods in SEM under different multivariate distributional conditions. The effects of four independent variables (sample size, missing proportion, distribution shape, and factor loading magnitude) were investigated on six outcome variables: convergence rate, parameter estimate bias, MSE of parameter estimates, standard error coverage, model rejection rate, and model goodness of fit—RMSEA. A three-factor CFA model was used. Findings indicated that FIML outperformed the other methods in MCAR, and MI should be used to increase the plausibility of MAR. SRPI was not comparable to the other three methods in either MCAR or MAR.