Survey of attitudes toward statistics: Factor structure and factorial invariance for women and men

White undergraduate students enrolled in introductory statistics courses completed the Survey of Attitudes Toward Statistics (SATS). Student responses were analyzed using confirmatory factor analysis to determine the validity of several alternative models of the structure of attitudes toward statistics. A four‐factor structure composed of Affect, Cognitive Competence, Value, and Difficulty provided the best model fit. Responses of women and men to the SATS were then examined to explore scale invariance across gender. Invariance tests of factor structure, factor‐variable correlations, factor correlations, and variable uniquenesses showed that the four‐factor model fit well for both female and male responses. Only two significant differences in model fit were found: the Value variance was greater for women and the correlation between Affect and Value was greater for men. Generally, the study provided evidence for the appropriateness of a four‐factor structure of the SATS.     

Cross-validation of the Norwegian Teacher's Self-Efficacy Scale (NTSES)

The study assesses the psychometric properties of the Italian version of the Norwegian Teacher Self-Efficacy Scale – NTSES. Multiple group confirmatory factor analysis was used to explore the measurement invariance of the scale across two countries. Analyses performed on Italian and Norwegian samples confirmed a six-factor structure of the scale with a strong factorial invariance. The analyses conducted on the Italian sample supported good internal consistency and test-retest reliability. The Italian version of the NTSES showed expected correlations with measures of job-related well-being. These results confirm the good psychometric properties of the Italian version of the NTSES.     

Evaluating the perception of disability and the inclusive education of teachers: the Italian validation of the Sacie-R (Sentiments,Attitudes, and Concerns about Inclusive Education – Revised Scale)

This study aimed to verify the factorial structure, internal validity, reliability, and criterion validity of The Sentiments, Attitudes and Concerns about Inclusive Education Revised Scale (SACIE-R) in an Italian sample. The SACIE-R is a useful tool to measure three aspects of teachers’ perceptions about inclusion, which are Sentiments, Attitudes and Concerns, providing valuable information to address the needs of teachers working with special students. A measure of this construct is currently not available in Italian, and a validation process is required. In order to provide an initial psychometric evaluation of the Italian adaptation, the SACIE-R was translated for use in Italian-speaking populations. Four hundred Italian teachers enrolled in educational teaching courses completed the SACIE-R. Confirmatory factor analyses demonstrated a good fit to the hypothesised 3-factor model, and adequate internal consistency for the scale was evidenced. A confirmatory factor analysis showed the same factor structural validity as the original instrument (although some items in the original version were deleted). Furthermore, taken together, the results showed a good level of reliability, and convergent and discriminant validity. Finally, the Italian version of the SACIE-R has good psychometric characteristics that can make it a useful measure of teacher attitude toward inclusion in the Italian educational context.     

A Perceptual Measure of the Degree of Development of Proprietary Equipment

In this article we evaluate the psychometric properties of a scale for a perceptual measure of the extent to which manufacturing organizations develop proprietary equipment. We use a confirmatory factor analysis (CFA) approach to assess unidimensionality and reliability as well as convergent, discriminant and concurrent validity. Convergent and discriminant validity is assessed using CFA of the multitrait-multimethod (MTMM) matrix. In addition, we assess the scale's factorial invariance across industries. Results suggest that although method effects are present, the scale demonstrates internal consistency and validity. Implications of this study in the field of operations strategy and general strategy are discussed.     

Assessing math attitude through the Attitude Toward Mathematics Inventory – Short form in introductory statistics course students

Math attitude refers to emotional responses, beliefs, and behaviors towards mathematics. Several studies measured the relation with math learning and related variables, but very few with statistics learning. To better investigate this relation has become increasingly relevant to have a measure that ensuring multidimensionality and shortness. The aim of the present paper was to confirm the factor structure of the Lin and Huang (2014)'s ATMI - Short Form (ATMI - SF) when administered to Italian college students attending introductory statistics course, and to test its measurement invariance applying a multigroup confirmatory analysis. We also assessed the reliability and the incremental validity of the ATMI - SF by verifying whether it predicted statistics achievement over and above the effect of math knowledge. The overall findings provide that ATMI - SF is a reliable and valid measure to assess math attitude among college students who attend introductory statistics courses in non-mathematical courses.     

Assessing Social Competence and Behavior Problems in a Sample of Italian Preschoolers Using the Social Competence and Behavior Evaluation Scale

Research Findings: The main goals of this study were to examine the factor validity of the Social Competence and Behavior Evaluation (SCBE-30) scale using exploratory factor analysis and confirmatory factor analysis and to test factor invariance across gender in a sample of Italian preschool-age children (241 boys, 252 girls). The concurrent validity of the SCBE scale was examined with measures of children's popularity and rejection. Our findings replicated a 3-factor model of the SCBE scale found in other studies with 3 correlated factors of social competence, anger–aggression, and anxiety–withdrawal. Multigroup confirmatory factor analyses provided evidence of configural, metric, and partial scalar invariance of the scale across gender. Popularity was positively related to children's social competence and negatively related to anxiety–withdrawal. Rejection was positively related to children's anger–aggression and anxiety–withdrawal and negatively related to social competence. Practice or Policy: The use of the SCBE scale in the Italian educational setting may help teachers understand children's emotional and social competencies and thereby improve social adjustment in the classroom.     

Development and validation of Mobile Learning Acceptance Measure

The growth of Smartphone usage, increased acceptance of electronic learning (E-learning), the availability of high reliability mobile networks and need for flexibility in learning have resulted in the growth of mobile learning (M-learning). This has led to a tremendous interest in the acceptance behaviors related to M-learning users among the information systems researchers. Despite a large amount of significant research in the field of M-learning, the measurement of user acceptance of M-learning has not received attention. This research study intends to develop and validate a survey that measures users’ acceptance of M-learning. A total sample of 806 university and higher college students from different institutes in Oman participated in this study. This research study was conducted in two stages. The first stage using a sample size of 388 students initiated a generic questionnaire, and examined factorial validity and reliability. The second stage that was conducted using different sample of 418 students employed confirmatory factor analysis to establish factorial validity and measurement invariance. A correlated six-factor model (Flexibility, Suitability, Enjoyment, Efficiency, Economic and Social) was fit using maximum likelihood estimation. The internal consistency and item reliability of Mobile Learning Acceptance Measure was found to be at acceptable level for both samples.     

Examining Undergraduate Students’ Attitudes toward Business Statistics in the United States and China

The rapid growth of analytics is bringing more attention to quantitative core curriculum requirements in undergraduate business programs. Statistical knowledge and skills are unequivocally recognized as essential cornerstone of business analytics. Furthermore, educational research has shown that academic performance in statistics classes is related to the attitudes that students bring to the course. This article assesses the reliability and validity of the Survey of Attitudes toward Statistics (SATS) in measuring noncognitive dimensions of attitudes among undergraduate business students. Sample data from U.S. and Chinese introductory business statistics classes were collected and analyzed to learn more about this aspect of student engagement across business schools located in countries with substantially different levels of success in international mathematics achievement testing, as well as differing cultural and educational practices. Results show that the six‐factor model structure of the SATS provides a good fit in both populations, with students entering business statistics holding only slightly positive attitudes toward the subject. Significant distinctions between four of the six attitude components were identified. Implications of measuring and improving these attitudes are discussed. Business statistics instructors are encouraged to use the survey as a standardized instrument to measure effects of interventions and make evidence‐based pedagogical decisions.     

Development and validation of the E-learning Acceptance Measure (ElAM)

This research involves the development and validation of a survey that measures users' acceptance of e-learning. A total sample of 386 university students from a teacher training institute in an Asian country participated in this study. Comprising two studies, the first study (n = 197) initiated a generic questionnaire, and examined factorial validity and reliability. The second study (n = 189) used confirmatory factor analysis to establish factorial validity and measurement invariance by gender using a different sample. A correlated three-factor model (Tutor Quality, Perceived Usefulness, and Facilitating Conditions) was fit using maximum likelihood estimation (MLE) and found to be adequate. For the two samples, the E-learning Acceptance Measure (ElAM) was found to be a precise and internally consistent measure. Applications of the ElAM were discussed.     

Exploring the validity of a teachers’ self-efficacy scale in five countries

The purpose of this article was twofold. The first purpose was to test the validity of the Teachers’ Sense of Self-Efficacy Scale (TSES) in five settings—Canada, Cyprus, Korea, Singapore, and the United States. The second purpose was, by extension, to establish the importance of the teacher self-efficacy construct across diverse teaching conditions. Multi-group confirmatory factor analysis was used to better understand the measurement invariance of the scale across countries, after which the relationship between the TSES, its three factors, and job satisfaction was explored. The TSES showed convincing evidence of reliability and measurement invariance across the five countries, and the relationship between the TSES and job satisfaction was similar across settings. The study provides general evidence that teachers’ self-efficacy is a valid construct across culturally diverse settings and specific evidence that teachers’ self-efficacy showed a similar relationship with teachers’ job satisfaction in five contrasting settings.     

The potential of anchoring vignettes to increase intercultural comparability of non-cognitive factors

ABSTRACT

We investigate whether Anchoring Vignettes (AV) improve intercultural comparability of non-cognitive student-directed factors (e.g., procrastination). So far, correlation analyses for anchored and non-anchored scores with a criterion have been used to demonstrate the effectiveness of AV in improving data quality. However, correlation analyses are often used to investigate external validity of a scale. Nonetheless, before testing for validity, the reliability of the measurement of a construct should be examined. In the present study, we tested for measurement invariance across countries and languages and compared anchored and non-anchored student-directed self-reports that are highly relevant for the students’ self and their behaviour and performance. In addition, we apply further criteria for testing reliability. The results indicate that the data quality for some of the constructs can – in fact – be improved slightly by anchoring; whereas, for other self-reports, anchoring is less successful than was hoped. We discuss with regard to possible consequences for research methodology.     

Measuring Teachers’ enjoyment,anger, and anxiety: The Teacher Emotions Scales (TES)

The emotions of teachers are considered relevant not only for their own well-being but also for the functioning of classrooms. Nevertheless, research on teacher emotions has been slow to emerge, and scales for their assessment via self-report are generally lacking. In the present research we developed four-item scales for three emotions considered most relevant in the context of teaching: enjoyment, anger, and anxiety (Teacher Emotions Scales, TES). Based on data of 944 teachers, we tested German and English language versions of the TES for reliability, internal and external validity, and cross-language equivalence, while exploring the utility of both a general and a student-group specific variant. All scales proved to be highly reliable, and confirmatory factor analysis supported internal validity by showing that three-factor models (enjoyment, anger, and anxiety) were superior to single-factor or two-factor (positive vs. negative affect) models. The external validation analyses provided consistent evidence for theoretically meaningful relations with teachers’ general affect, burnout, job satisfaction, and teacher self-efficacy. These findings were robust across multiple studies. In addition, consistent relationships with student ratings of teaching behaviors were found. Analyses of measurement invariance revealed that the English and the German language versions were fully structurally equivalent und displayed metric invariance.     

The Basic Psychological Needs in Exercise Scale: Measurement Invariance Over Gender

This study examined the extent of measurement invariance of the Basic Psychological Needs in Exercise Scale responses (BPNES; Vlachopoulos & Michailidou, 2006) across male (n = 716) and female (n = 1,147) exercise participants. BPNES responses from exercise participants attending private fitness centers (n = 1,012) and community exercise programs (n = 851) were used. The 3-factor BPNES confirmatory factor analysis model, discriminant validity, and scale reliability were supported for both male and female participants separately. The multisample models supported the configural invariance, partial metric invariance, partial measurement error invariance, and partial scalar invariance of the BPNES responses across gender. Both male and female participants attached the same meaning to the constructs assessed by the BPNES items. The BPNES score invariance properties support tests of the needs universality hypothesis offered by self-determination theory across gender in exercise and meaningful comparison of the autonomy, competence, and relatedness construct latent means across gender.     

Spanish validation of the Basic Psychological Needs at Work Scale: A measure to predict teachers’ well-being in the workplace

The present study aimed to validate a Spanish-version of the Basic Psychological Needs at Work Scale (BPNWS-Sp) and to examine the associations between needs satisfaction and engagement and burnout in secondary education teachers. Using a sample of 584 secondary education teachers, the results supported the three-factor model, composite reliability, measurement invariance, and nomological validity of the BPNWS-Sp. This study contributes to validating the first instrument in Spanish to measure the satisfaction of the three BPNs separately in secondary education teachers. The measurement of teachers’ BPNs could effectively provide guidance for school policies to improve teaching and learning.     

Validating the Implementation Climate Scale (ICS) in child welfare organizations

There is increasing emphasis on the use of evidence-based practices (EBPs) in child welfare settings and growing recognition of the importance of the organizational environment, and the organization's climate in particular, for how employees perceive and support EBP implementation. Recently, Ehrhart, Aarons, and Farahnak (2014) reported on the development and validation of a measure of EBP implementation climate, the Implementation Climate Scale (ICS), in a sample of mental health clinicians. The ICS consists of 18 items and measures six critical dimensions of implementation climate: focus on EBP, educational support for EBP, recognition for EBP, rewards for EBP, selection or EBP, and selection for openness. The goal of the current study is to extend this work by providing evidence for the factor structure, reliability, and validity of the ICS in a sample of child welfare service providers. Survey data were collected from 215 child welfare providers across three states, 12 organizations, and 43 teams. Confirmatory factor analysis demonstrated good fit to the six-factor model and the alpha reliabilities for the overall measure and its subscales was acceptable. In addition, there was general support for the invariance of the factor structure across the child welfare and mental health sectors. In conclusion, this study provides evidence for the factor structure, reliability, and validity of the ICS measure for use in child welfare service organizations.     

Psychometric properties of the Chinese version of the Childhood Trauma Questionnaire-Short Form (CTQ-SF) among undergraduates and depressive patients

ObjectiveThe Childhood Trauma Questionnaire-Short Form (CTQ-SF) is a self-report questionnaire that retrospectively provides screening for a history of childhood abuse and neglect, and which is widely used throughout the world. The current study aimed to examine the psychometric properties of the Chinese version of the CTQ-SF.MethodsParticipants included 3431 undergraduates from Hunan provinces and 234 depressive patients from psychological clinics. Confirmatory factor analysis was performed to examine how well the original five-factor model fit the data and the measurement equivalence of CTQ-SF across gender. Internal consistency was also evaluated.ResultsThe five-factor model achieved satisfactory fit (Undergraduate sample TLI = 0.925, CFI = 0.936, RMSEA = 0.034, SRMR = 0.046; depressive sample TLI = 0.912, CFI = 0.923, RMSEA = 0.044, SRMR = 0.062). Measurement invariance of the five-factor model across gender was supported fully assuming different degrees of invariance. The CTQ-SF also showed acceptable internal consistency and good stability.ConclusionThe current study provides that the Chinese version of the Childhood Trauma questionnaire-short form has good reliability and validity among Chinese undergraduates and depressive samples, which also indicates that the CTQ-SF is a good tool for child trauma assessment.     

Assessing perceptions of resources and inclusive teaching practices: A cross-country study between German and Saudi students in inclusive schools

The present paper examines the measurement invariance of the adjusted version of the Perception of Resources Questionnaire (PRQ) by Goldan & Schwab (2018; 2019). A cross-country comparison between students from Germany (N = 885) and Saudi Arabia (N = 888) is conducted that examines invariance not only across countries but also across gender. Results confirm the two-factorial structure of the scale (“personnel resources” and “material and spatial resources”). Configural and partial metric invariance was also established across both groups. Furthermore, an ANCOVA was used to show that perceptions of resources and perceptions of inclusive teaching practices are positively interrelated. This finding can be interpreted as an indicator for criterion validity of the PRQ. As expected, German students perceive a significantly higher level of resources than their peers in Saudi Arabia. Finally, the importance of adequate provision for the successful implementation of inclusive education and its assessment is discussed.     

Psychometric properties of Science Motivation Questionnaire II-Chinese version in two waves of longitudinal data

Science motivation is an important factor that directly influences students’ science learning. Numerous studies have been undertaken to develop and validate questionnaire items for measuring students’ motivation in science learning. This study is the first longitudinal examination of the Chinese version of Science Motivation Questionnaire II (SMQ II-C) in a Chinese cultural context. Using two waves of surveys, we evaluated its internal structure validity and criterion-related validity. Results showed that at each time point, scores were internally consistent and the hypothesized five-factor model was confirmed as the best model fit for the data. Results of multigroup invariance revealed the structure of the SMQ II-C was equivalent within gender subgroups. Furthermore, the present study added longitudinal invariance evidence of the SMQ II-C by sampling two-time points. Overall, this study suggests the SMQ II-C is a robust instrument for evaluating Chinese high school students’ motivation to learn science. Furthermore, boys yielded higher scores than girls among all five subscales of science motivation and significant gender differences were observed in both waves. Implications and limitations of these results are discussed.     

Validation of the Chinese version of the Sense of Self (SOS) Scale

This study explored the cross-cultural applicability of the Sense of Self (SOS) Scale in the Hong Kong Chinese cultural context. The SOS Scale is a 26-item questionnaire designed to measure students?? sense of purpose, self-reliance, and self-concept in school. Six hundred ninety-seven Hong Kong Chinese high school students participated in the study. Both within-network and between-network approaches to construct validation were adopted. Responses to this questionnaire are shown to have good internal consistency reliability, and support is provided for its construct validity in terms of its factorial structure and correlations with other educational outcomes such as learning strategies. In addition, multigroup confirmatory factor analysis also indicated invariance of the instrument across males and females, across students of different year levels, and across students from different types of school. Implications for cross-cultural research are discussed.