The suitability of the EPQ‐R Short Scale for counselling Brunei student teachers when administered in English and Malay languages

The study investigated the psychometric properties of the Eysenck Personality Questionnaire – Revised (EPQ‐R) Short Scale administered to two groups of Brunei trainee teachers of both genders taking psychology courses in English (117 students) and Malay (106 students). The extraversion scale had the most problematic items. Both administrations produced means and standard deviations comparable to the norms in the technical manual. All the scales, except P (psychoticism), had satisfactory levels of alpha reliability and validity (discriminant and construct) on both versions. In addition factor analysis correctly assigned some of the items to their respective scales on both versions. No statistically significant gender difference in performance on both scales was obtained. Findings suggest that the instrument was suitable for use with Brunei student teachers with tertiary‐level education when technical terms were clarified and reasonable administration time was given.     

The psychometric properties of the Trauma Symptom Checklist For Children (TSCC) in a sample of Swedish children

OBJECTIVE: To evaluate the psychometric properties of the Swedish version of the Trauma Symptom Checklist for Children (TSCC) and to study traumatic symptoms in a normative group of Swedish children and adolescents. METHOD: A normative group of 728 children and adolescents age 10-17 and a clinical group of 91 children and adolescents known to have experienced sexual abuse participated in the study. A test-retest procedure was conducted with 79 participants from the normative group. RESULTS: Good reliability such as internal consistency (Cronbach's alpha) for the total scale .94 (ranging in the clinical scales .78-.83) and test-retest for the total scale r=.81 (ranging in the clinical scales .67-.81) were found. The confirmatory 6-factor analysis explained 50.7% of the variance. Other validity measures such as concurrent validity and criterion related validity were also shown to be satisfactory. The normative sample of Swedish children and adolescents showed lower means on the subscales than has been reported in previous studies from a number of other countries. CONCLUSION: The Swedish version of TSCC has been shown to be a screening instrument with satisfactory psychometric qualities that is capable to identify trauma symptoms among children and adolescents who have themselves self-reported experiencing trauma or for whom clinicians have identified traumatic experiences.     

Development and validation of Children’s Responsible Environmental Behavior Scale

Though environmentally responsible behavior (ERB) has been a focus of many studies in the field of environmental education, very few scales have been developed to assess children’s ERB. In this regard, this article focuses on the development and validation of Children’s Responsible Environmental Behavior Scale (CREBS) and also reports the psychometric properties of this scale. The items in the CREBS were developed initially from the responses to four open-ended items by 229 fourth and fifth grade students. This initial form was pilot tested with 673 fourth and fifth graders and then subjected to exploratory factor analysis. Later, the revised version of the scale was administrated to 2412 fifth graders, and those results were subjected to confirmatory factor analysis and reliability analysis. CREBS consists of 23 items measured using a seven-point Likert-type scale, which have been organized into four sub-scales: political action (six items, α?=?.92); eco-management (six items, α?=?.70); consumer and economic action (five items, α?=?.70); and Individual and Public Persuasion (six items, α?=?.80). Study results indicate that CREBS can be used for exploring the extent to which elementary school students in Turkey demonstrate four types of behavior to help prevent and resolve environmental problems and issues.     

Development of the Transferable Learning Orientations tool: providing metacognitive opportunities and meaningful feedback for students and instructors

This study encapsulates the development and testing of the Transferable Learning Orientations (TLO) tool. It is a triangulated measure built on select scales from the Motivated Strategies for Learning Questionnaire (MSLQ), together with multiple-choice items adapted from the lifelong learning VALUE rubric, and an open-ended response for each dimension. Select scales from the MSLQ were tested in a range of undergraduate courses, and the TLO (version one) was developed and piloted in a first-year engineering course. Minor refinements were made, and the TLO (version two) was retested with second-year undergraduates. The TLO is designed to engage students in meta-cognitive processes and provide meaningful feedback to students. The dimensions are outcome motivation, learning belief, self-efficacy, transfer and organisation. Results from the second-year group were more consistent and reliable than the first-year group, suggesting that context is an important factor. The scales demonstrate acceptable reliability, and the moderate correlations between scale scores and rubric ratings provide support for concurrent validity. We recommend the TLO be tested with broader populations to confirm psychometric properties and that it be implemented longitudinally to investigate the development of learning skills and changes in orientations over time.     

L'Éducation à la Carrière: Une Étude Brésilienne de la Validité Transculturelle du Questionnaire sur l'Éducation à la Carrière

Abstract: Career education: A Brazilian study on transcultural validity of the Career Education Questionnaire. The purpose of this study is to validate a Brazilian version of the Career Education Questionnaire (Questionnaire sur l'éducation à lacarrière) of Dupont and Gingras (1990) and to compare the results with those for the original Quebec and Spanish versions. A Brazilian sample of 390 male and 499 female high school students is used to establish the psychometric properties of the instrument. Results of item analysis, correlations between scales, and factor analysis obtained with this sample strongly corroborate those obtained for the Quebec and Spanish samples. Future studies are needed to further investigate the cross-cultural validity of the instrument. This revised version was published online in July 2006 with corrections to the Cover Date.     

Piecing together the puzzle: development of the Societal Attitudes towards Autism (SATA) scale

The rise in the prevalence of autism creates a need for a reliable and valid measure of attitudes towards autism. The current study describes the development of a brief 16‐ item measure of Societal Attitudes towards Autism (SATA) that exhibits sound psychometric properties and has a demonstrated ability to discriminate between expert and general college student samples. The final SATA was the result of pilot work on 75 items and exploratory and confirmatory factor analyses on a 45‐item version with 475 undergraduates. Knowledge and personal distance subscales yielded inconsistent reliability and validity outcomes. The SATA showed strong content and construct validity as evidenced by known groups discrimination, and predicted associations with an attitude towards disability measure, an autism preference item, and a measure of implicit attitudes towards disabilities.     

Measuring Parental Meta-Emotion: Psychometric Properties of the Emotion-Related Parenting Styles Self-Test

Parental meta-emotion, assessed through interviews, involves parents' philosophy about emotions and has been found to be related to parenting behaviors and children's emotional and social competence (e.g., Gottman, Katz, & Hooven, 1996; Katz & Windecker-Nelson, 2004). The Emotion-Related Parenting Styles Self-Test is a true-false (ERPSST-T/F) self-report version of the meta-emotion interview introduced in a parenting guidebook (Gottman, 1997). Although this test is user-friendly, its psychometric properties have not been evaluated. In the first study, 100 parents (89 mothers, 11 fathers) completed the ERPSST-T/F and evidence was found for the internal consistency and test-retest reliability of the measure (Lee, Hakim-Larson, & Voelker, 2000). In the second study, 31 parents (21 mothers, 10 fathers) completed a Likert-type scale version of the ERPSST (ERPSST-Likert) and the internal consistency of the scales was improved. In addition, the scales were found to correlate in expected directions with other measures of parenting attitudes regarding children's emotional expressions, even after controlling for parent gender and social desirability. These findings provide some preliminary evidence for the reliability and validity of the ERPSST-Likert and provide support for further development of the instrument.     

Construction and validation of a classroom climate scale: a mixed methods approach

Students’ perceptions of their classroom climate have been found to relate significantly to students’ learning outcomes. The purpose of the present study was to construct an instrument for assessing elementary-school students’ perceptions of classroom climate, based on a previous instrument that was being used in Chile by a public national school mental health program as a tool for aiding teachers in improving classroom management, but which showed poor psychometric properties. We used a six-staged mixed-methods approach to construct relevant items and dimensions based on this measure and by adapting previously-existing scales. Item development included participatory construction of items involving program officials, focus groups with students, and a pilot study. The final version was administered to a sample of 6813 elementary-school students. Results showed adequate reliability and construct validity, convergent validity with school climate, and divergent validity with peer victimisation. When consequential validity was explored through semi-structured interviews with program officials and school administrators, we found that the instrument was being used as a tool for helping teachers to improve their school climate and management skills. We discuss the importance of constructing instruments using a mixed-methods approach.     

Measuring Parental Meta-Emotion: Psychometric Properties of the Emotion-Related Parenting Styles Self-Test

Parental meta-emotion, assessed through interviews, involves parents' philosophy about emotions and has been found to be related to parenting behaviors and children's emotional and social competence (e.g., Gottman, Katz, & Hooven, 1996; Katz & Windecker-Nelson, 2004). The Emotion-Related Parenting Styles Self-Test is a true–false (ERPSST–T/F) self-report version of the meta-emotion interview introduced in a parenting guidebook (Gottman, 1997). Although this test is user-friendly, its psychometric properties have not been evaluated. In the first study, 100 parents (89 mothers, 11 fathers) completed the ERPSST–T/F and evidence was found for the internal consistency and test–retest reliability of the measure (Lee, Hakim-Larson, & Voelker, 2000). In the second study, 31 parents (21 mothers, 10 fathers) completed a Likert-type scale version of the ERPSST (ERPSST–Likert) and the internal consistency of the scales was improved. In addition, the scales were found to correlate in expected directions with other measures of parenting attitudes regarding children's emotional expressions, even after controlling for parent gender and social desirability. These findings provide some preliminary evidence for the reliability and validity of the ERPSST–Likert and provide support for further development of the instrument.     

The Psychometric Properties of Classroom Response System Data: A Case Study

Classroom response systems (often referred to as “clickers”) have slowly gained adoption over the recent decade; however, critics frequently doubt their pedagogical value starting with the validity of the gathered responses: There is concern that students simply “click” random answers. This case study looks at different measures of response reliability, starting from a global look at correlations between formative clicker responses and summative examination performance to how clicker questions are used in context. It was found that clicker performance is a moderate indicator of course performance as a whole, and that while the psychometric properties of clicker items are more erratic than those of examination data, they still have acceptable internal consistency and include items with high discrimination. It was also found that clicker responses and item properties do provide highly meaningful feedback within a lecture context, i.e., when their position and function within lecture sessions are taken into consideration. Within this framework, conceptual questions provide measurably more meaningful feedback than items that require calculations.     

用项目反应理论修订教学效能感量表

采用随机整群抽样抽取505名中小学教师作为被试,其中,男教师189名,女教师271名,年龄均在25至55岁之间。采用教学效能感问卷进行施测,基于项目反应理论,对测试结果进行分析,得出所有项目的区分度、难度和项目信息峰值,参考项目区分度、难度及项目信息函数峰值对教学效能感量表做了修订,再运用结构方程模型、层面理论技术和最小空间分析对修订后的量表进行质量检验,结果表明修订后的量表测量拥有更为清晰的结构效度和更高的信度,测量更为精确。运用SPSS15.0管理数据,运用Hudap6.0和MULTILOG 7.03分析数据,研究得出如下五个结论:1)教学效能感量表为单一维度,可以使用项目反应理论进行分析;2)修订后的量表项目的区分度、难度更为合理;3)修订后的量表的测验信息峰值较原量表稍低;4)修订前后量表对应层面元素之间存在高相关;5)量表的三个方面内容结构得以证实,即学生品德行为教育、课堂组织管理和知识传授。     

Development of an instrument for measuring attitudes of early childhood educators towards science

The attitude towards science of first year early childhood education students was explored using an instrument developed for the purpose. The instrument comprises four Likert-type scales, biographical items and two open-ended attitude items. The four scales, characterised as ‘confidence’, ‘enjoyment’, ‘usefulness’ and ‘appropriateness of science for young children’, were supported by varimax factor analysis and had reliabilities from 0.83 to 0.88. Use of the combined scales as a general ‘attitude towards science’ scale was supported by principal components analysis; reliability for the combined scale was 0.94. Comments made in response to the open-ended items supported the validity of the scales. For the student group as a whole, mean scores on all scales were slightly to moderately positive, with the highest mean being for the ‘science for young children’ scale. Students who had studied at least one science subject at Year 12 level had significantly higher scores on all scales than students who had not studied science at senior level. Australia.Specializations: early childhood science education, biological aspects of child development, conservation biology of gulls.     

Psychometric Characteristics of the California Preschool Social Competence Scale in a Spanish Population Sample

Research Findings: Few rating scales measure social competence in very young Spanish or Catalan children. We aimed to analyze the psychometric characteristics of the California Preschool Social Competence Scale (CPSCS) when applied to a Spanish- and Catalan-speaking population. Children were rated by their respective teachers within 6 months following their 4th birthday in two population-based birth cohorts in Spain (N = 378). A confirmatory factor analysis (CFA) was used to compare the underlying structure of the Spanish–Catalan version with that of the original version. Cronbach's alpha coefficient was used to determine the internal consistency of each of the confirmed factors. Cohen's kappa formula was used to calculate the test–retest reliability in a small subset of children who were rated again one month later. Five correlated factors (Considerateness, Task Orientation, Extraversion, Verbal Facility, and Response to Unfamiliar) were optimally confirmed as a result of CFA. The first three factors had robust internal consistency. The kappa coefficient was satisfactory in 29 items out of 30. Children's cognitive abilities as assessed by the McCarthy Scales, children's gender, maternal social class and level of education were related to the social competence scores as indicators of criterion-related factors. Practice or Policy: The bilingual version of the CPSCS has good psychometric properties allowing it to be used in further studies in either Spanish or Catalan populations.     

Do images influence assessment in anatomy? Exploring the effect of images on item difficulty and item discrimination

Anatomists often use images in assessments and examinations. This study aims to investigate the influence of different types of images on item difficulty and item discrimination in written assessments. A total of 210 of 460 students volunteered for an extra assessment in a gross anatomy course. This assessment contained 39 test items grouped in seven themes. The answer format alternated per theme and was either a labeled image or an answer list, resulting in two versions containing both images and answer lists. Subjects were randomly assigned to one version. Answer formats were compared through item scores. Both examinations had similar overall difficulty and reliability. Two cross‐sectional images resulted in greater item difficulty and item discrimination, compared to an answer list. A schematic image of fetal circulation led to decreased item difficulty and item discrimination. Three images showed variable effects. These results show that effects on assessment scores are dependent on the type of image used. Results from the two cross‐sectional images suggest an extra ability is being tested. Data from a scheme of fetal circulation suggest a cueing effect. Variable effects from other images indicate that a context‐dependent interaction takes place with the content of questions. The conclusion is that item difficulty and item discrimination can be affected when images are used instead of answer lists; thus, the use of images as a response format has potential implications for the validity of test items. Anat Sci Educ © 2012 American Association of Anatomists.     

The child sexual behavior inventory: Reliability and validity in a Dutch normative and clinical sample

BackgroundThe Child Sexual Behavior Inventory (CSBI) is one of the few instruments available to assess sexual behavior in children. Because of cross-cultural differences in the definition of normal and atypical sexual behaviors, the CSBI is not generalizable to other countries.ObjectiveThe current study examined psychometric properties of the Dutch version of the CSBI.Participants and settingThe study represents 3206 children from a normative sample, and 932 children from clinical samples.MethodsParents ratings on the CSBI, and questionnaires for psychosocial problems were obtained to assess psychometric properties.ResultsResults showed that Dutch parents interpret more CSBI items as developmentally appropriate than USA parents. Reliability coefficients indicated internal consistency (α = .39–.82), test-retest (r = .86, p < .000) and interrater reliability (Cohen's d =0.47, p >.05). Positive correlations between the CSBI total scale and the subscales demonstrated content validity (r = .32–.96, p < .01). Differences between normative and clinical samples on the CSBI total (ηp² = .01–.65, p < .000), DRSB (ηp² = .00–.03, p = .00–.38) and SASI scales (ηp² =.00–.18, p < .01) indicated construct validity. Within the clinical samples, highest associations were found between the CSBI score and convergent measures (r = .64, p < .000). Lowest associations were found between the CSBI scores and divergent measures r = .14–.54, p = n.s.−<.000.ConclusionsCross-cultural differences in the perception of developmental appropriate sexual behavior underscore the importance of country-specific normative data. Good psychometric properties of the Dutch version of the CSBI were supported by this study.     

Adaptation and psychometric properties of the ISPCAN Child Abuse Screening Tool for use in trials (ICAST-Trial) among South African adolescents and their primary caregivers

Child abuse prevention research has been hampered by a lack of validated multi-dimensional non-proprietary instruments, sensitive enough to measure change in abuse victimization or behavior. This study aimed to adapt the ICAST child abuse self-report measure (parent and child) for use in intervention studies and to investigate the psychometric properties of this substantially modified tool in a South African sample. First, cross-cultural and sensitivity adaptation of the original ICAST tools resulted in two preliminary measures (ICAST-Trial adolescents: 27 items, ICAST-Trial caregivers: 19 items). Second, ICAST-Trial data from a cluster randomized trial of a parenting intervention for families with adolescents (N = 1104, 552 caregiver-adolescent dyads) was analyzed. Confirmatory factor analysis established the hypothesized 6-factor (adolescents) and 4-factor (caregivers) structure. Removal of two items for adolescents and five for caregivers resulted in adequate model fit. Concurrent criterion validity analysis confirmed hypothesized relationships between child abuse and adolescent and caregiver mental health, adolescent behavior, discipline techniques and caregiver childhood abuse history. The resulting ICAST-Trial measures have 25 (adolescent) and 14 (caregiver) items respectively and measure physical, emotional and contact sexual abuse, neglect (both versions), and witnessing intimate partner violence and sexual harassment (adolescent version). The study established that both tools are sensitive to measuring change over time in response to a parenting intervention. The ICAST-Trial should have utility for evaluating the effectiveness of child abuse prevention efforts in similar socioeconomic contexts. Further research is needed to replicate these findings and examine cultural appropriateness, barriers for disclosure, and willingness to engage in child abuse research.     

THE IMPACT OF ITEM PHRASING ON THE VALIDITY OF ATTITUDE SCALES FOR ELEMENTARY SCHOOL CHILDREN

The purpose of the study was to examine the effect of item phrasing on the validity of a Likert-type attitude scale. Three content similar scales were composed of 15 items, either all positive, all negative, or a mixture of positive and negative items. Five hundred twenty-two students in grades 4–6 responded to one of the three forms. Results from the all positive and negative forms indicated that item means, variances, and factor structures differed significantly. Inspection of item means suggested that it was difficult for the students to indicate agreement by disagreeing with a negative statement. Analyses of the mixed phrasing form indicated factors based upon item phrasing, not item content. Taken together, the results suggest that the technique of balancing item phrasing when used with elementary students appears to affect adversely the validity of attitude measurement.     

Development and validation of two scales to measure elaboration and behaviors associated with stewardship in children

This investigation examines the development of two scales that measure elaboration and behaviors associated with stewardship in children. The scales were developed using confirmatory factor analysis to investigate their construct validity, reliability, and psychometric properties. Results suggest that a second-order factor model structure provides the best fit. This model produced: (1) a stewardship elaboration scale measuring interest and cognitive engagement in stewardship issues, and (2) a stewardship behavior scale measuring in-park, community, and home behaviors. These scales will be useful for evaluating environmental educational programs focused on environmental and park stewardship. The scales may also help researchers assess whether environmental education results in participants elaborating on persuasive messaging, thereby increasing the likelihood that behavioral intentions leading to behavior change will occur.     

The Nowicki Locus of Control Scales: An Australian Study of Normal and Cerebral Palsied School Children

Mildly handicapped cerebral palsied (CP) children integrated into regular schools were measured on locus of control scales to test the hypothesis that physically disabled children with possible academic difficulties display a more external locus of control than their unimpaired peers. The contribution of this construct to their academic and social performance was also examined. As local norms for these scales were not available, mean grade values were obtained for all children in classes in which a handicapped child had been integrated in order to study the psychometric properties of the scales and the construct's cross‐cultural implications. Results indicated that the instrument did not differentiate between mildly handicapped CP children integrated into regular schools and their non‐disabled peers nor was it a significant correlate of academic or social performance for the target group. Although the possibility exists of real cross‐cultural difference between American and Australian school children, the doubtful reliability and validity of the measure for the population sampled do not support its widespread use as a research instrument with Australian school children.     

New evidence on the validity of the Arnett Caregiver Interaction Scale: Results from the Early Childhood Longitudinal Study-Birth Cohort

The Arnett Caregiver Interaction Scale (CIS) has been widely used in research studies to measure the quality of caregiver–child interactions. The scale was modeled on a well-established theory of parenting, but there are few psychometric studies of its validity. We applied factor analyses and item response theory methods to assess the psychometric properties of the Arnett CIS in a national sample of toddlers in home-based care and preschoolers in center-based care from the Early Childhood Longitudinal Study-Birth Cohort. We found that a bifactor structure (one common factor and a second set of specific factors) best fits the data. In the Arnett CIS, the bifactor model distinguishes a common substantive dimension from two methodological dimensions (for positively and negatively oriented items). Despite the good fit of this model, the items are skewed (most teachers/caregivers display positive interactions with children) and, as a result, the Arnett CIS is not well suited to distinguish between caregivers who are “highly” versus “moderately” positive in their interactions with children, according to the items on the scale. Regression-adjusted associations between the Arnett CIS and child outcomes are small, especially for preschoolers in centers. We encourage future scale development work on measures of child care quality by early childhood scholars.