The social conflict inventory (SCI): A measure of beliefs about classroom peer conflicts

Abstract

This study describes the development of the Social Conflict Inventory (SCI), a self‐report teacher belief scale for assessing beliefs about young children's classroom peer conflicts. Three phases were involved in the construction of the SCI: item development, initial testing with one sample (n = 218), and follow‐up field test with a second sample (n = 395) that also addressed the convergent and concurrent validity of the instrument. Reliability and factor analyses conducted during the initial field test resulted in a reduction to 20 items (Cronbach’ s α = .87) with three subscales: General Orientation to Peer Conflict (α = .81), Cessation (α = .84), and Facilitation (α = .65). Similar patterns of factor loadings and reliabilities resulted from analyses of the follow‐up field test data. Overall, the SCI proved to be a reliable instrument for assessing the beliefs concerning the role of classroom conflicts in children's development and for differentiating among groups of teachers. Further use of the SCI in conjunction with other measures of teacher beliefs will contribute to a better understanding of its concurrent validity. Finally, the potential for its use in future studies to clarify the relationship between beliefs and actual classroom practices and as an instrument for assessing the effectiveness of specific classroom management training programs is discussed.     

The Development of a Happiness Measure for Schoolchildren

Happiness, or subjective well‐being, the self‐evaluation of how happy or unhappy a person is, has been studied amongst adults using a variety of self‐report methods. However, there has been relatively little related work with children. A psychometrically valid and reliable SWB measure for schoolchildren aged 8‐ to 15‐years‐old, the School Children’s Happiness Inventory (SCHI), was piloted and developed against existing measures of self‐esteem, affect and depression (n = 71). Predictive validity (n = 771) was assessed using a measure of being bullied, sharing the same context (school) and time scale (the previous week). The School Children’s Happiness Inventory (SCHI) may be especially useful in assessing the effect of school‐based interventions and influences on schoolchildren’s well‐being.     

Measuring self-efficacy,aptitude to participate and functioning in students with and without impairments

Including vulnerable groups of students such as students with learning disabilities in mainstream school research, require ethical considerations and questionnaire adaptation. These students are often excluded, due to low understanding or methodologies generating inadequate data. Students with disability need be studied as a separate group and provided accessible questionnaires. This pilot study aims at developing and evaluating student self-reported measures, rating aspects of student experiences of school-based Physical Education (PE). Instrument design, reliability and validity were examined in Swedish secondary school students (n = 47) including students, aged 13, with intellectual disability (n = 5) and without impairment and test–retested on 28 of these students. Psychometric results from the small pilot-study sample were confirmed in analyses based on replies from the first wave of data collection in the main study (n = 450). Results show adequate internal consistency, factor structure and relations between measures. In conclusion, reliability and validity were satisfactory in scales to measure self-efficacy in general, in PE, and aptitude to participate. Adapting proxy ratings for functioning into self-reports indicated problems. Adequacy of adjustments made were confirmed and a dichotomous scale for typical/atypical function is suggested for further analyses.     

Digital ITEMS Module 2: Scale Reliability in Structural Equation Modeling

In this ITEMS module, we frame the topic of scale reliability within a confirmatory factor analysis and structural equation modeling (SEM) context and address some of the limitations of Cronbach's α. This modeling approach has two major advantages: (1) it allows researchers to make explicit the relation between their items and the latent variables representing the constructs those items intend to measure, and (2) it facilitates a more principled and formal practice of scale reliability evaluation. Specifically, we begin the module by discussing key conceptual and statistical foundations of the classical test theory model and then framing it within an SEM context; we do so first with a single item and then expand this approach to a multi‐item scale. This allows us to set the stage for presenting different measurement structures that might underlie a scale and, more importantly, for assessing and comparing those structures formally within the SEM context. We then make explicit the connection between measurement model parameters and different measures of reliability, emphasizing the challenges and benefits of key measures while ultimately endorsing the flexible McDonald's ω over Cronbach's α. We then demonstrate how to estimate key measures in both a commercial software program (Mplus) and three packages within an open‐source environment (R). In closing, we make recommendations for practitioners about best practices in reliability estimation based on the ideas presented in the module.     

Evaluating the reliability of a detailed analytic scoring rubric for foreign language writing

The demand for valid and reliable methods of assessing second and foreign language writing has grown in significance in recent years. One such method is the timed writing test which has a central place in many testing contexts internationally. The reliability of this test method is heavily influenced by the scoring procedures, including the rating scale to be used and the success with which raters can apply the scale. Reliability is crucial because important decisions and inferences about test takers are often made on the basis of test scores. Determining the reliability of the scoring procedure frequently involves examining the consistency with which raters assign scores. This article presents an analysis of the rating of two sets of timed tests written by intermediate level learners of German as a foreign language (n = 47) by two independent raters who used a newly developed detailed scoring rubric containing several categories. The article discusses how the rubric was developed to reflect a particular construct of writing proficiency. Implications for the reliability of the scoring procedure are explored, and considerations for more extensive cross-language research are discussed.     

Developing a Scale of Adaptive Behavior for Young Chinese Children With Autism Spectrum Disorder

The purpose of the present study was to develop and evaluate a scale to measure adaptive behavior skills in Chinese children with autism spectrum disorder (ASD). Participants were 121 young children (M = 55.18 months, SD = 0.18 months) with a formal diagnosis of ASD (73% male). Psychometric evaluation indicated that the reliability and validity of this scale were good. Furthermore, independent t‐tests revealed that boys demonstrated better adaptive behavior skills than girls. The present findings suggest that the scale is a valid measure of adaptive behavior skills in Chinese children with ASD.     

The attitudes of Israeli Arab and Jewish high school students towards extrinsic and intrinsic values

The aim of this research was to investigate the attitudes of Israeli Arab (n = 259) and Jewish (n = 259) high school students toward extrinsic and intrinsic values. A questionnaire, which consisted of eight value scales in two groups—extrinsic and intrinsic values—was administered. Participants were asked to state whether they agreed or disagreed with 31 statements on a five-point Likert scale. Jewish students who experience school-based values education endorsed more intrinsic values (e.g. autonomy: Jews M = 4.27, SD = .53; Arabs M = 3.92, SD = .83), whereas Arab students, whose education as a minority group focuses on education towards achievement, endorsed more extrinsic values (e.g. attractiveness: Jews M = 3.56, SD = .82; Arabs M = 3.96, SD = .84). The findings suggest that the use of a more refined and complex analysis of extrinsic–intrinsic scales yields multiple interpretations of moral education in a modern world. This research may contribute to the discussion on moral education for minority groups, especially where they are a distinct minority in a society where they are surrounded by different cultural values. The growing cultural diversity in the Western world requires that through moral and civic education, schools explicitly expose their students, and especially minority groups, to the diverse interpretations of values and to the need to both respect differing interpretations, on the one hand, and to challenge them, on the other.     

A new instrument for measuring pre-service biology teachers' pedagogical content knowledge: The PCK-IBI

Teachers' pedagogical content knowledge (PCK) is highly important for effective design and implementation of school teaching. Thus, the current status, development and efficacy of this knowledge, its relationships with teaching quality parameters, and its impact on students' learning processes and success, require rigorous examination. Thoroughly validated, objective and reliable test instruments that are highly sensitive to changes in variables of proven knowledge-related relevance in teacher education are also required. Previous attempts to design such instruments for assessing science teachers' PCK have largely focused on mathematical content. Therefore, here we present an instrument (the pedagogical content knowledge in biology inventory, PCK-IBI), based on conceptualizations of teachers' professional competence, for assessing secondary school pre-service biology teachers' PCK. In a series of three evaluations and refinements it was tested with samples of N = 274 and N = 432 German pre-service as well as one sample of n = 65 German pre-service and n = 35 German in-service biology teachers. Item analysis, scale analysis and empirically obtained indicators of validity suggest that the final 34-item-version of the PCK-IBI is unidimensional, provides objective test scores and enables reliable and valid registration of pre-service biology teachers' PCK. Thus, hypotheses regarding specific aspects of the model on which the PCK-IBI's construction is based on are empirically supported. The results of our study provide empirical support for the instrument's potential utility.     

Improving Biology Performance with Workshop Groups

This 2-year quasi-experiment evaluated the effect of peer-led workshop groups on performance of minority and majority undergraduate biology students. The workshop intervention used was modeled after a program pioneered by Treisman (1992). Majority volunteers randomly assigned to workshops (n = 61) performed significantly better than those assigned to the control group (n = 60, p < 0.05) without spending more time studying. Workshop minority students (n = 25) showed a pattern of increasing exam performance in comparison to historic control minority students (n = 21), who showed a decreasing pattern (p < 0.05). Volunteers (n = 121) initially reported that biology was more interesting and more important to their futures than to nonvolunteers' (n = 435, p < 0.05). Volunteers also reported higher levels of anxiety related to class performance (p < 0.05). The relationship of anxiety to performance was moderated by volunteer status. Performance of volunteers was negatively associated with self-reported anxiety (r = –0.41, p < 0.01). Performance of nonvolunteers was unrelated to self-reported anxiety (r = –0.02). Results suggest elevated anxiety related to class performance may increase willingness to participate in activities such as workshop interventions. In addition, students who volunteer for interventions such as workshops may be at increased risk of performance decrements associated with anxiety. Even so, workshop programs appear to be an effective way to promote excellence among both majority and minority students who volunteer to participate, despite the increased risk of underperformance associated with higher levels of anxiety.     

What drives students to complete online courses? What drives faculty to teach online? Validating a measure of motivation orientation in university students and faculty

Although online student enrollment has shown double digit growth for almost a decade and academic leaders recognize that online education is necessary for enrollment growth, little is known about what motivates students to enroll in or faculty to teach face-to-face (F2F) versus online courses. The psychometric properties of a motivation scale were examined with students (n = 235) and faculty (n = 104) at a large, public, urban university in the southeastern USA. Analyses revealed that the scale was reliable as intrinsic and extrinsic motivation for online and F2F courses were similarly constructed for students and faculty; additionally, results revealed that motivations for online and F2F education are distinct concepts. Findings also demonstrated that online extrinsic motivation predicted the number of online courses students completed, while F2F intrinsic motivation negatively predicted the number of online courses a faculty member had taught. These results address several limitations with existing motivation measures and enhance the ability to predict student and faculty outcomes in online education.     

The Basic Psychological Needs in Exercise Scale: Measurement Invariance Over Gender

This study examined the extent of measurement invariance of the Basic Psychological Needs in Exercise Scale responses (BPNES; Vlachopoulos & Michailidou, 2006) across male (n = 716) and female (n = 1,147) exercise participants. BPNES responses from exercise participants attending private fitness centers (n = 1,012) and community exercise programs (n = 851) were used. The 3-factor BPNES confirmatory factor analysis model, discriminant validity, and scale reliability were supported for both male and female participants separately. The multisample models supported the configural invariance, partial metric invariance, partial measurement error invariance, and partial scalar invariance of the BPNES responses across gender. Both male and female participants attached the same meaning to the constructs assessed by the BPNES items. The BPNES score invariance properties support tests of the needs universality hypothesis offered by self-determination theory across gender in exercise and meaningful comparison of the autonomy, competence, and relatedness construct latent means across gender.     

The Orientation to Life Questionnaire: Validation of a Measure to Assess Older Adults’ Sense of Coherence

Increasingly, the literature suggests that the sense of coherence (SOC) positively influences well-being in later life. This study reports the assessment of the following psychometric properties: distributional properties, construct, criterion and external-related validities, and reliability of the Orientation to Life Questionnaire (OtLQ) in an cross-national population of older adults. We recruited 1291 community-dwelling older adults aged between 75–102 years (M = 83.9; SD = 6.68). Convenience sampling was used to gather questionnaire data. The construct validity was asserted by confirmatory factor analysis and convergent and discriminant validity. Moreover, criterion and external-related validities, as well as distributional properties and reliability, were also tested. Data gathered with the 29-items OtLQ scale showed overall good psychometric properties in terms of distributional properties, construct, criterion, and external-related validities, as well as reliability. Three factors were validated for the OtLQ scale: (a) comprehensibility; (b) manageability; and (c) meaningfulness. We validated the three-factor OtLQ scale, which produced valid and reliable data for a cross-national sample with older adults. Hence, it is an adequate instrument for assessing sense of coherence among older people in health care practice and program development contexts.     

Predicting Proficiency on Statewide Assessments: A Comparison of Curriculum-Based Measures in Middle School

ABSTRACT

A key tool in multitiered systems of support is the use of curriculum-based measures to predict which students are at risk for academic failure. However, there are few studies that examine which measures are most suitable for students in middle school. The authors examine the reliability of predicting outcomes on state assessments for 3 commonly used curriculum-based measures at the middle school level. Data were collected from a middle school in the Midwest that regularly administers 3 different curriculum-based measures. Reading Curriculum-Based Measure (R-CBM), Maze, and Multiple-Choice Reading Comprehension (MCRC) were given to students in Grades 7 (n = 238) and 8 (n = 256). Logistic regression was used to examine each measure in predicting outcomes on the Michigan Education Assessment Program Reading assessment. Results indicated that MCRC more accurately predicted outcomes than R-CBM or maze (Grade 7 e^β = 1.75, Grade 8 e^β = 1.68). Limitations and recommendations for future research are discussed.     

A comparison of teachers' and school psychologists' perceptions of the importance of CHC abilities in the classroom

The broad cognitive abilities defined by the Cattell–Horn–Carroll (CHC) theory have been shown to predict school achievement. However, the ecological validity of these constructs has not been studied in classroom settings. This study compares ratings by a sample of teachers (n = 53) and school psychologists (n = 86) of the importance of the CHC cognitive abilities in the classroom. The scale demonstrated adequate reliability (total scale α = .93, median α = .74), although evidence of construct validity varied between teachers and school psychologists. Both teachers and school psychologists rated quantitative ability, crystallized knowledge, and fluid reasoning as most important to school success. However, school psychologists rated short‐term memory and quantitative ability as more important than did the teachers. Importance of these differences for consultation is discussed. © 2009 Wiley Periodicals, Inc.     

A Measure of Counselor Competency

Counselor educators need to be able to demonstrate their effectiveness in training new counselors; however, currently few valid or reliable measures exist for assessing educators' impact. The authors describe the development of such an instrument, the Counseling Skills Scale. They began by revising an existing scale and then they solicited feedback from experts and a focus group. They used the instrument to compare beginning counselors‐in‐training with those who had completed a counseling skills course. Finally, they conducted an item analysis. A paired t test showed significant improvements in counseling skills (t = 4.51, p < .000) from pretest to posttest. Cronbach's alpha showed internal consistency to be .90.     

Predictive validity of the K-ABC for exceptional preschoolers

This 5-year follow-up study examined the predictive validity of the Kaufman Assessment Battery for Children (K-ABC) for 39 children identified during preschool as exhibiting language impairment (n = 10), behavior control deficits (n = 13), or normal language and behavioral development (n = 16). Mean age at follow-up was 9.75 years. The results generally supported the predictive validity of the K-ABC (p<.001). However, analyses by group indicated that the relationship between baseline K-ABC and follow-up K-ABC, language, and achievement measures for the language-impaired subjects was weak (p>.05). Although these results must be interpreted cautiously because of the small sample size, they suggest that for young children likely to be referred as at risk for future learning problems, the K-ABC may not be useful for prediction of later cognitive skills. Implications for practitioners are discussed.     

Development,Dissemination, and Assessment of a Food Safety Systems Management Curriculum for Agribusiness Students in Armenia

This study addresses the development, dissemination, and assessment of a Food Safety System Management (FSSM) curriculum offered to college‐aged, agribusiness students in Yerevan, Armenia. Prior to beginning the program, demographic data were collected and a paper‐based pretest was administered to access the food safety knowledge, behavior, and attitude of participants (n = 29). For assessment of a skill, participants’ handwashing techniques were videotaped and scored before the program commenced. Immediately after completion of the entire curriculum, a paper‐based post‐test with identical questions for food safety knowledge, behavior, and attitude was administered and handwashing skills were assessed. ANOVA with repeated measures was used to evaluate significant differences (α = 0.05) for food safety knowledge using a pretest, post‐test, and a 3‐mo follow‐up. A paired t‐test was used to evaluate handwashing skills before and after the curriculum was presented. The pretest score (44.93%, ± 2.87) for food safety knowledge (n = 29) differed significantly (P <0.0001) when compared with the post‐test score (73.21%, ± 3.28) and the 3‐mo follow‐up (n = 23) score (67.76%, ± 3.93). Participants’ (n = 9) handwashing skills prior to delivery of the FSSM curriculum differed significantly (P <0.0001), when compared to handwashing skills after completion of the curriculum. Students’ food safety attitudes and behavior assessed using a five‐point Likert scale, also improved significantly as a result of the FSSM program. The 3‐mo follow‐up survey on food safety attitude and behavior was consistent with the post‐test survey results. The information from this project may be of interest to education experts, Extension professionals, food industry personnel, or regulatory agencies, in the development and dissemination of an international food safety program.     

A qualitative study of perceptions of bullying in Irish primary schools

This small-scale research examined young children’s, aged six to seven (n = 8), perceptions and understanding of bullying in Irish primary schools. It also included the views of the children’s parents (n = 8) and teachers (n = 2) on bullying. The participants’ views were obtained through semi-structured interviews which were analysed using the constant comparative method as per grounded theory approach. The results revealed the complexity of young children’s interactions in school and the difficulty that the adults around them have in accurately defining and addressing bullying behaviour. The data indicate the need for parents and teachers to listen attentively and sensitively to children’s accounts of bullying and to provide consistent advice on how to address bullying.     

Contrasting executive function development among primary school children from Hong Kong and Germany

Previous research findings indicate that young children from East Asia outperform their counterparts from Europe and North America on executive function (EF) tasks. However, very few cross-national studies have focused on EF development during middle childhood. The current study assessed the EF performance of 170 children in grades 2 and 4 from Hong Kong (n = 80) and Germany (n = 90) in a cross-sectional design. Children completed tasks assessing the main components of EF, namely inhibition (child-friendly Stroop task), updating (Object Span task), and shifting (Contingency Naming task). Results of multilevel models showed that all three EF measures differentiated well between younger and older children across the full sample. However, contrary to our hypothesis and previous research, we did not find any significant differences in EF performance between children from Hong Kong and Germany at primary school age. Our findings highlight the possibility that issues related to the measurement of EF and features specific to Hong Kong and Germany underlie our results.

     

Sensitivity of Four Subtests of the Test of Everyday Attention for Children (TEA‐Ch) to Stimulant Medication in Children with ADHD

Children with attention deficit hyperactivity disorder (ADHD) were examined on four subtests of the Test of Everyday Attention for Children (TEA‐Ch) when on and off stimulant medication. Performance was assessed relative to 18 individually age‐matched controls. Children with ADHD performed significantly worse on TEA‐Ch measures when off compared to when on stimulant medication. This was found in both predominantly inattentive (n = 6) and combined inattentive and hyperactive‐impulsive (n = 12) subtypes. The age‐matched controls significantly improved with repeated testing on most TEA‐Ch measures. Significant differences were found between the unmedicated children with ADHD and age‐matched controls on sustained attention (Score! and Walk Don’t Walk) and attention control measures (Same and Opposite Worlds). When the ADHD group was on stimulant medication, with the exception of the Walk Don’t Walk subtest, no significant differences were found between them and the age‐matched controls. Unlike the TEA‐Ch subtests, the significant differences between the two groups on the Test of Word Reading Efficiency (TOWRE) subtests remained when attentional status was altered in the children with ADHD. The study supports further investigations of the TEA‐Ch as a measure sensitive to changes in stimulant medication in children with ADHD.