Psychometric reevaluation of the scientific attitude inventory‐revised (SAI‐II)

The central purposes of this study were to review the development and evolution of the Scientific Attitude Inventory (SAI) and then reevaluate the psychometric properties of the revised form of the SAI, the Scientific Attitude Inventory II (SAI‐II). The SAI‐II was administered to a convenience sample of 543 middle and high school students from five teachers in four schools in four school districts in San Antonio, Texas, at the beginning of the 2004–2005 school year. Confirmatory factor analysis on the full data set failed to support the existence of a 12‐factor structure (as proposed by the scale developers) or a one‐factor structure. The data were then randomly divided into exploratory [exploratory factor analysis (EFA)] validation and confirmatory [confirmatory factor analysis (CFA)] cross‐validation sets. Exploratory and confirmatory models yielded a three‐factor solution that did not fit the data well [χ² (321) = 646, p < .001; RMSEA = .061 (.90 CI = .054–.068); and CFI = .81]. The three factors were labeled “Science is About Understanding and Explaining” (13 items), “Science is Rigid” (6 items), and “I Want to Be a Scientist” (8 items). The α‐coefficients for these three factors ranged from 0.59 to 0.85. Whether these identified subscales are valid will require independent investigation. In this sample, and consistent with prior publications, the SAI‐II in its current form did not have satisfactory psychometric properties and cannot be recommended for further use. © 2008 Wiley Periodicals, Inc. J Res Sci Teach 45: 600–616, 2008     

INITIAL DEVELOPMENT AND VALIDATION OF THE BULLYHARM: THE BULLYING,HARASSMENT, AND AGGRESSION RECEIPT MEASURE

This article describes the development and preliminary validation of the Bullying, Harassment, and Aggression Receipt Measure (BullyHARM). The development of the BullyHARM involved a number of steps and methods, including a literature review, expert review, cognitive testing, readability testing, data collection from a large sample, reliability testing, and confirmatory factor analysis. A sample of 275 middle school students was used to examine the psychometric properties and factor structure of the BullyHARM, which consists of 22 items and six subscales: physical bullying, verbal bullying, social/relational bullying, cyber‐bullying, property bullying, and sexual bullying. First‐order and second‐order factor models were evaluated. Results demonstrate that the first‐order factor model had superior fit. Results of reliability testing indicate that the BullyHARM scale and subscales have very good internal consistency reliability. Findings indicate that the BullyHARM has good properties regarding content validation and respondent‐related validation, and is a promising instrument for measuring bullying victimization in school.     

Using the Attribute Hierarchy Method to Make Diagnostic Inferences about Examinees’ Cognitive Skills in Critical Reading

The purpose of this study is to apply the attribute hierarchy method (AHM) to a subset of SAT critical reading items and illustrate how the method can be used to promote cognitive diagnostic inferences. The AHM is a psychometric procedure for classifying examinees’ test item responses into a set of attribute mastery patterns associated with different components from a cognitive model. The study was conducted in two steps. In step 1, three cognitive models were developed by reviewing selected literature in reading comprehension as well as research related to SAT Critical Reading. Then, the cognitive models were validated by having a sample of students think aloud as they solved each item. In step 2, psychometric analyses were conducted on the SAT critical reading cognitive models by evaluating the model‐data fit between the expected and observed response patterns produced from two random samples of 2,000 examinees who wrote the items. The model that provided best data‐model fit was then used to calculate attribute probabilities for 15 examinees to illustrate our diagnostic testing procedure.     

An empirical analysis of an alternative configuration of the Academic Motivation Scale

The purpose of this study was to examine an alternative configuration of the Academic Motivation Scale (AMS), a psychometric instrument used as a measure of academic motivation in various academic environments. The analyses utilised data from a convenience sample of 2354 business students, broken into two random subsamples of 1177 cases. Exploratory factor analysis of the 28 AMS scale items was conducted on the estimation sample. The results indicated good model fit for a four-factor configuration consisting of amotivation, external regulation, identified regulation, and intrinsic motivation as indicated by factor loadings, as well as internal consistency and reliability statistics.

Confirmatory factor analysis was conducted on the holdout sample to independently assess the construct validity and internal consistency of the item loadings on the reconfigured scale. Results indicated good model fit for the four-factor configuration and a significant loss of fit for competing three- and one-factor models. The uncovered factor structure advances our understanding of how the items on this scale cluster into theoretically meaningful constructs. This knowledge may be utilised in research designed to further assess the impact of motivational states on educational outcomes such as academic performance, absenteeism, dropout rates, etc.     

Psychometric characteristics of the Persian version of the Multidimensional School Anger Inventory–Revised

The Multidimensional School Anger Inventory–Revised (MSAI-R) is a measurement tool to evaluate high school students' anger. Its psychometric features have been tested in the USA, Australia, Japan, Guatemala, and Italy. This study investigates the factor structure and psychometric quality of the Persian version of the MSAI-R using data from an administration of the inventory to 585 Iranian high school students. The study adopted the four-factor underlying structure of high school student anger derived through factor analysis in previous validation studies, which consists of: School Hostility, Anger Experience, Positive Coping, and Destructive Expressions. Confirmatory factor analysis of this four-factor model indicated that it fit the data better than a one-factor baseline model, although the fit was not perfect. The Rasch model showed a very high internal consistency among items, with no item misfitting; however, our results suggest that to represent the construct sufficiently some items should be added to Positive Coping and Destructive Expression. This finding is in agreement with Boman, Curtis, Furlong, and Smith's Rasch analysis of the MSAI-R with an Australian sample. Overall, the results from this study support the psychometric features of the Persian MSAI-R. However, results from some test items also point to the dangers inherent in adapting the same test stimuli to widely divergent cultures.     

Investigating the theoretical structure of the DAS‐II core battery at school age using Bayesian structural equation modeling

Bayesian structural equation modeling (BSEM) was used to investigate the latent structure of the Differential Ability Scales—Second Edition core battery using the standardization sample normative data for ages 7–17. Results revealed plausibility of a three‐factor model, consistent with publisher theory, expressed as either a higher‐order (HO) or a bifactor (BF) model. The results also revealed an alternative structure with the best model fit, a two‐factor BF model with Matrices (MA) and Sequential and Quantitative Reasoning (SQ) loading on g only with no respective group factor loading. This was only the second study to use BSEM to investigate the structure of a commercial ability test and the first to use a large normative sample and the specification of both approximate zero cross‐loadings and correlated residual terms. It is believed that the results produced from the current study will advance the field's understanding of not only the factor structure of the DAS‐II core battery but also the potential utility of BSEM in psychometric investigations of intelligence test structures.     

Beliefs about Schooled Knowledge: Domain Specific or Domain General?

This study explored the domain specificity of students' beliefs about academic knowledge in three related studies. Using a four-factor model as an initial framework, a series of domain-specific items about mathematics and history was developed. In Study I, these items were administered to 182 undergraduates, and the psychometric properties and underlying factor structure were examined via exploratory factor analysis. In Study II, the modified instrument, the Domain-Specific Beliefs Questionnaire (DSBQ), was administered to 633 students and a confirmatory factor analysis was conducted. A subsample of participants' responses on the DSBQ was also compared to responses on Schommer's epistemological questionnaire. Study III involved a second confirmatory factor analysis using data from a new sample (n = 523). Those data were examined for potential gender differences. Overall, the results of this investigation suggested that students possess certain domain-specific beliefs about knowledge in mathematics and history. Further, a significant moderate relationship between the DSBQ and Schommer's questionnaire provided some evidence of domain-generality in undergraduates' epistemological beliefs.     

Factorial validity of the Reynolds Intellectual Assessment Scales for referred students

The Reynolds Intellectual Assessment Scales (RIAS) is a recently developed, individually administered psychometric instrument designed to measure general cognitive ability, as well as verbal (crystallized) intelligence, nonverbal (fluid) intelligence, and memory. Test reviewers have recommended the use of the RIAS despite the fact that, although the RIAS has been in circulation for more than four years, there is a paucity of independent research published about its psychometric properties. The purpose of the current study was to examine the factor structure of the RIAS across three samples of school‐age children: the RIAS norming sample; the data reported by Nelson, Canivez, Lindstrom, and Hatt; and a new, independent sample of students referred for special education services. Using confirmatory factor analytic techniques, this study found that a two‐factor model, positing verbal and nonverbal factors, fit all three data sets better than a one‐factor model. Furthermore, the two‐factor model demonstrated partial measurement invariance across the three samples, although the verbal factor showed much stronger invariance, construct reliability, and overall interpretability than did the nonverbal factor. Implications of this study for practitioners are discussed. © 2009 Wiley Periodicals, Inc.     

Construction and Initial Validation of the Chinese Reading Motivation Questionnaire

This paper describes the development and initial validation of a Chinese reading motivation questionnaire (CRMQ) which was designed to assess Chinese students' reading motivation in Hong Kong. The development of the CRMQ consisted of two steps. In the first study, groups of items were constructed based on achievement motivation theories and existing instruments. The initial version of the CRMQ was administered to a small group of Grade 7 students in Hong Kong and exploratory factor analysis, item‐total correlation, and reliability analyses were carried out to assess its psychometric quality. The CRMQ was then revised and administered to a larger sample of Grade 7 students in the second study. Findings of confirmatory factor analysis provided further validation for the proposed factor structure of the revised questionnaire. In addition, findings indicated that students' reading motivation was positively related to their strategy use, reading comprehension, and academic achievement. The findings of this study could enrich our understanding of Chinese reading motivation among Hong Kong students. Implications of these findings for implementing effective reading instruction in Chinese language teaching are also discussed.     

Psychometric Characteristics of the California Preschool Social Competence Scale in a Spanish Population Sample

Research Findings: Few rating scales measure social competence in very young Spanish or Catalan children. We aimed to analyze the psychometric characteristics of the California Preschool Social Competence Scale (CPSCS) when applied to a Spanish- and Catalan-speaking population. Children were rated by their respective teachers within 6 months following their 4th birthday in two population-based birth cohorts in Spain (N = 378). A confirmatory factor analysis (CFA) was used to compare the underlying structure of the Spanish–Catalan version with that of the original version. Cronbach's alpha coefficient was used to determine the internal consistency of each of the confirmed factors. Cohen's kappa formula was used to calculate the test–retest reliability in a small subset of children who were rated again one month later. Five correlated factors (Considerateness, Task Orientation, Extraversion, Verbal Facility, and Response to Unfamiliar) were optimally confirmed as a result of CFA. The first three factors had robust internal consistency. The kappa coefficient was satisfactory in 29 items out of 30. Children's cognitive abilities as assessed by the McCarthy Scales, children's gender, maternal social class and level of education were related to the social competence scores as indicators of criterion-related factors. Practice or Policy: The bilingual version of the CPSCS has good psychometric properties allowing it to be used in further studies in either Spanish or Catalan populations.     

Finding two dimensions in MMPI‐2 depression

This study examined the underlying structure of the Depression scale of the revised Minnesota Multiphasic Personality Inventory using dichotomous Rasch model and factor analysis. Rasch methodology was used to identify and restructure the Depression scale, and factor analysis was used to confirm the structure established by the Rasch model. The item calibration and factor analysis were carried out on the full sample of 2,600 normative subjects. The results revealed that the Depression scale did not consist of one homogeneous set of items, even though the scale was developed to measure one dimension of depression. Rasch analysis, as well as factor analysis, recognized two distinct content‐homogeneous subscales, here labeled mental depression and physical depression. The Rasch methodology provided a basis for a better understanding of the underlying structure and furnished a useful solution to the scale refinement.     

Factor Structure and Reliability of the Parent-Informant Strengths and Difficulties Questionnaire in a Scottish Preschool Sample

Research Findings: Despite it being a widely accepted measure of social, emotional, and behavioral problems among children and young people, the factor structure underlying the Strengths and Difficulties Questionnaire (SDQ) is contested. Recent research has suggested a need to consider methodological bias in the SDQ, associated with the positive wording of some of the items, as a separate latent construct. Using data from the 2006–2007 Growing Up in Scotland study, we performed confirmatory factor analyses with 1,789 parents’ SDQ reports of their 4-year-old children, estimating and comparing 3 competing factor models: a 5-factor model, 3-factor model, and a 6-factor model incorporating a method factor. Results indicated that the 6-factor solution was the best fitting model. Several items from the original Pro-Social Behaviour and Peer Relationship Problems subscales loaded higher on the method factor than the original, suggesting bias influences across the SDQ domains. Reliability analysis demonstrated poor internal consistency for the individual difficulties subscales but good internal consistency for a Total Difficulties score and moderate internal consistency for the strengths subscale. Practice or Policy: As the SDQ is widely used internationally, further research is required to facilitate interpretation across populations and purposes (i.e., screening, diagnosis, or outcome assessment).     

Assessing the Psychometric Properties of the Attitudes Toward Seeking Professional Psychological Help Scale-Short Form in Mainland China

This investigation tested the psychometric properties of the Attitudes Toward Seeking Professional Psychological Help Scale-Short Form (ATSPPH-SF; Fisher and Farina [Journal of College Student Development, 36, 368–373, 1995]) in a sample of 338 Mainland Chinese college students. Using back-translation, the ATSPPH-SF was translated into simplified Chinese. Confirmatory factor analysis did not support the original one-factor model. Subsequently, exploratory factor analysis suggested a 7-item, two-factor model; however, the new factor structure yielded poor reliability coefficients, below .60. Results suggest that the help-seeking construct as operationalized by the ATSPPH-SF may not be valid for the Chinese population. The importance of designing indigenous instruments for help-seeking attitudes is discussed.     

New evidence on the validity of the Arnett Caregiver Interaction Scale: Results from the Early Childhood Longitudinal Study-Birth Cohort

The Arnett Caregiver Interaction Scale (CIS) has been widely used in research studies to measure the quality of caregiver–child interactions. The scale was modeled on a well-established theory of parenting, but there are few psychometric studies of its validity. We applied factor analyses and item response theory methods to assess the psychometric properties of the Arnett CIS in a national sample of toddlers in home-based care and preschoolers in center-based care from the Early Childhood Longitudinal Study-Birth Cohort. We found that a bifactor structure (one common factor and a second set of specific factors) best fits the data. In the Arnett CIS, the bifactor model distinguishes a common substantive dimension from two methodological dimensions (for positively and negatively oriented items). Despite the good fit of this model, the items are skewed (most teachers/caregivers display positive interactions with children) and, as a result, the Arnett CIS is not well suited to distinguish between caregivers who are “highly” versus “moderately” positive in their interactions with children, according to the items on the scale. Regression-adjusted associations between the Arnett CIS and child outcomes are small, especially for preschoolers in centers. We encourage future scale development work on measures of child care quality by early childhood scholars.     

L'Éducation à la Carrière: Une Étude Brésilienne de la Validité Transculturelle du Questionnaire sur l'Éducation à la Carrière

Abstract: Career education: A Brazilian study on transcultural validity of the Career Education Questionnaire. The purpose of this study is to validate a Brazilian version of the Career Education Questionnaire (Questionnaire sur l'éducation à lacarrière) of Dupont and Gingras (1990) and to compare the results with those for the original Quebec and Spanish versions. A Brazilian sample of 390 male and 499 female high school students is used to establish the psychometric properties of the instrument. Results of item analysis, correlations between scales, and factor analysis obtained with this sample strongly corroborate those obtained for the Quebec and Spanish samples. Future studies are needed to further investigate the cross-cultural validity of the instrument. This revised version was published online in July 2006 with corrections to the Cover Date.     

Development of the California school climate and safety survey‐short form

Planning is essential to creating safe schools and it is required by the Federal No Child Left Behind legislation (U.S. Department of Education, 2004) and implemented via district local education action plans. The implementation of these plans involves continuous monitoring and reevaluation of information pertinent to each campus. As such, this process is facilitated by the availability of measures that are simple to administer, inexpensive, and whose psychometric properties have been evaluated. The California School Climate and Safety Survey (CSCSS), originally developed by M.J. Furlong, R. Morrison, and S. Boles (1991), was specifically developed for these purposes. The CSCSS is a student self‐report questionnaire created to measure general school climate and personal safety‐related experiences. In this article, we present the results of an evaluation of the CSCSS including exploratory and confirmatory factor analyses. These analyses reduced the original CSCSS research version from 102 items to 54 items. The psychometric properties of this CSCSS‐SF (Short Form) are presented. © 2005 Wiley Periodicals, Inc. Psychol Schs 42: 137–149, 2005.     

Development and validation of a short form of the Teacher Efficacy for Inclusive Practices Scale (TEIP-SF)

High self-efficacy is a marker of successful teaching and is, therefore, a subject of great interest to research on inclusive education. One of the most frequently used instruments to assess such beliefs is the Teacher Efficacy for Inclusive Practice (TEIP) scale. Although used widely, some studies did not precisely replicate the original factor structure, and no short form of the TEIP scale currently exists, although this could enhance measurement efficiency. This study (1) systematically assessed the TEIP scale's factor structure and psychometric properties, (2) identified potentially problematic items and developed a more concise short form of the scale, and (3) evaluated its dimensionality and criterion and convergent validities using three validation samples of teachers in three different countries (486 in Switzerland, 189 in Australia and 276 in Canada). Compared to the full-length TEIP scale, the TEIP-SF uses half the items, demonstrates better model fit and reveals a clearer distinction of domain-specific factors. In conclusion, the TEIP-SF represents a concise, efficient means of assessing teachers' self-efficacy about teaching in inclusive classrooms.     

VALIDATION OF THE SOCIAL AND EMOTIONAL HEALTH SURVEY FOR FIVE SOCIOCULTURAL GROUPS: MULTIGROUP INVARIANCE AND LATENT MEAN ANALYSES

Social‐emotional health influences youth developmental trajectories and there is growing interest among educators to measure the social‐emotional health of the students they serve. This study replicated the psychometric characteristics of the Social Emotional Health Survey (SEHS) with a diverse sample of high school students (Grades 9–12; N = 14,171), and determined whether the factor structure was invariant across sociocultural and gender groups. A confirmatory factor analysis (CFA) tested the fit of the previously known factor structure, and then structural equation modeling was used to test invariance across sociocultural and gender groups through multigroup CFAs. Results supported the SEHS measurement model, with full invariance of the SEHS higher‐order structure for all five sociocultural groups. There were no moderate effect size or higher group differences on the overall index for sociocultural or gender groups, which lends support to the eventual development of common norms and universal interpretation guidelines.     

Development and validation of Children’s Responsible Environmental Behavior Scale

Though environmentally responsible behavior (ERB) has been a focus of many studies in the field of environmental education, very few scales have been developed to assess children’s ERB. In this regard, this article focuses on the development and validation of Children’s Responsible Environmental Behavior Scale (CREBS) and also reports the psychometric properties of this scale. The items in the CREBS were developed initially from the responses to four open-ended items by 229 fourth and fifth grade students. This initial form was pilot tested with 673 fourth and fifth graders and then subjected to exploratory factor analysis. Later, the revised version of the scale was administrated to 2412 fifth graders, and those results were subjected to confirmatory factor analysis and reliability analysis. CREBS consists of 23 items measured using a seven-point Likert-type scale, which have been organized into four sub-scales: political action (six items, α?=?.92); eco-management (six items, α?=?.70); consumer and economic action (five items, α?=?.70); and Individual and Public Persuasion (six items, α?=?.80). Study results indicate that CREBS can be used for exploring the extent to which elementary school students in Turkey demonstrate four types of behavior to help prevent and resolve environmental problems and issues.     

Psychometric Properties of the ECERS-R Among an Epidemiological Sample of Preschools

Research Findings: The Early Childhood Environment Rating Scale–Revised (ECERS-R) is widely used to evaluate the quality of early childhood education and its association with child development. However, the psychometric properties of the ECERS-R are not well established. Consequently, in this study we tested 3 different factor solutions of the ECERS-R using models sourced from the existing literature (featuring 1-, 2-, and 3-correlated-factor solutions) and applying confirmatory factor analysis to data from the epidemiological sample of the Embu Pre-school Mental Health Study (n = 1,292 children). Alternative measures of child education quality (such as teacher-to-child ratio) were also analyzed. The confirmatory factor analysis returned good fit indices for both the unidimensional and 3-correlated-factor solution models. Practice or Policy: This study showcases different applications of the ECERS-R, both the full and shortened versions. These findings are particularly important for improving ECERS-R guidelines for researchers, professionals, and policymakers.