The reliability of test scores for the pervasive developmental disorders rating scale

The Pervasive Developmental Disorders Rating Scale (PDDRS; Eaves, 1993) is a screening instrument used in the assessment of autistic disorder. In this study, the reliability of test scores for the PDDRS was examined with three samples. The first sample consisted of 456 participants ranging in age from 1 to 12 years old and the second sample consisted of 111 participants in the 13 to 24 year‐old range. Additionally, the test‐retest reliability of scores for the PDDRS was examined with a sample of 40 participants. The results indicated that coefficient alpha for the PDDRS Total Score was adequate for screening purposes (r = .89) for both age groups. The results of the test‐retest study also suggested that PDDRS had adequate test‐retest reliability (r = .92) for the PDDRS Total Score. © 2002 Wiley Periodicals, Inc. Psychol Schs 39: 605–611, 2002.     

FACTOR ANALYSIS OF THE K–ABC FOR GROUPS OF ANGLO AND MEXICAN AMERICAN CHILDREN

Factor analyses of the Kaufman Assessment Battery for Children (K–ABC) were performed on separate groups of Anglo (n = 100) and Mexican American (n = 100) fifth-grade children to determine the comparability of underlying structures and to examine the existence of possible bias in construct validity of the K–ABC for each group. The subjects were selected from two contiguous school districts and stratified by grade, socioeconomic status (SES), and language status. A principal factor analysis produced two factors in the Mental Processing area and three factors in the total battery (Mental Processing plus Achievement areas) for the two groups. Examination of the coefficients of congruence indicated factorial similarity across four of five factors. Furthermore, the factors that emerged for the Anglo and Mexican American groups corresponded to the scales comprising the K–ABC. The results of the investigation provide some evidence for the construct validity of the K–ABC for the two ethnic groups. Further test bias research on the K–ABC is recommended.     

Measuring procrastination: Psychometric properties of the Norwegian versions of the Irrational Procrastination Scale (IPS) and the Pure Procrastination Scale (PPS)

Procrastination has been defined in different ways. Two instruments—the Irrational Procrastination Scale (IPS) and the Pure Procrastination Scale (PPS)—focus on a core problem in procrastination—the irrational delay of intended behavior. The present paper examined the psychometric properties of the Norwegian translations of these scales. In five samples with students as well as non-students (aggregated n?=?1045), standard psychometric properties of the instruments were assessed and their factor structures were compared in replication analyses. In addition, correlations between the instruments as well as other instruments (i.e., the Susceptibility to Temptation Scale and the Satisfaction with Life Scale) were examined to determine convergent and divergent validity. Overall, the results indicated that both IPS and PPS are suitable for use as measures of procrastination.     

Attitudes of preschool and primary school pre-service teachers towards inclusive education

Teachers’ attitudes towards inclusion are important as they have the primary responsibility of implementing inclusive education. Attitudes at the beginning of teaching careers are likely to predict future attitudes. Some studies show a drop in attitudes after leaving university education. Using the Teachers’ Attitudes Towards Inclusion (Amended) questionnaire, 465 pre-service teachers (located in Victoria, Australia) from primary school and preschool streams were examined to determine the effect of a number of independent factors on Total Inclusion Score; a measure of attitudes towards inclusion. Two-way ANOVAs revealed module (unit) and year of study to be significant factors. A multiple regression showed the factors combined accounted for 10% of the variance in Total Inclusion Score. Participants who had studied a module (unit) on inclusive education or were in later years of study were more positive towards inclusive education based on Total Inclusion Score from the questionnaire. No significant differences for Total Inclusion Score were found between pre-service teachers that study primary school teaching or preschool teaching. It is concluded that studying a module on inclusive education is a particularly important factor in the development of pre-service teacher attitudes towards inclusion.     

RELIABILITY AND STRUCTURAL VALIDITY OF THE TEACHER RATING SCALES OF EARLY ACADEMIC COMPETENCE

Currently, there are few strengths‐based preschool rating scales that sample a wide array of behaviors believed to be essential for early academic success. The purpose of this study was to assess the factor structure of a new measure of early academic competence for at‐risk preschool populations. The Teacher Rating Scales of Early Academic Competence (TRS‐EAC) includes two broad scales (Early Academic Skills and Early Academic Enablers) and was completed by 60 teachers for 440 children enrolled in Head Start and public preschool classrooms. Evidence from two exploratory factor analyses supported a five‐factor solution for the Early Academic Skills Scale (Creative Thinking, Critical Thinking Skills, Numeracy, Early Literacy, and Comprehension) and a five‐factor solution for the Early Academic Enablers Scale (Approaches to Learning, Social and Emotional Competence, Fine Motor Skills, Gross Motor Skills, and Communication). TRS‐EAC scores also demonstrated good to excellent reliability and were related to children's performance on direct measures of early academic skills.     

Reliability and validity estimates of the Brigance K&1; screen based on a sample of disadvantaged preschoolers

The reliability and validity properties of the Brigance K&1; screen were examined with a sample of 134 Head Start children preparing to enter kindergarten. Reliability estimations indicated high interrater agreement and high overall internal consistency and test–retest reliabilities. Construct validation procedures included examination of the Screen's correlations with the cognitive processing and achievement subscales of the K‐ABC. Prediction/outcome analyses, intended to explore the test's accuracy in predicting special education status at the end of preschool, indicated a relatively high false negative rate and a moderate true positive rate. © 1999 John Wiley & Sons, Inc.     

Assessing Undergraduate Education from Graduating Seniors’ Perspective: Peer Institutions Provide the Context

This paper presents a comparative research study as a model for assessing undergraduate education. This evaluation model used Factor Analysis to create scales, tested the reliability of these scales, and used Analysis of Variance to compare the primary institution with five types of comparable institutions. The value of this statistical/methodological evaluation model was shown. Results are based on Class of l998survey responses from 244 graduating seniors at the primary institution and 1481 students at 39peer institutions. Comparative analyses identified business courses, faculty, career preparation and impact on students’ technological skill as strengths and students’ knowledge of arts and foreign languages and campus social life as areas for improvement at the primary institution. Recommendations advocated publicising students’ superior satisfaction with courses, faculty and career preparation; using these results as baseline data for future curriculum evaluation; and continuing efforts to enhance campus social life. This revised version was published online in June 2006 with corrections to the Cover Date.     

Teacher interpersonal behaviour and student achievement in English as a Foreign Language classrooms in China

We examined the relationship between English as a Foreign Language (EFL) teachers’ interpersonal behaviour and students’ fluency in English in secondary education in China. A total of 160 students from four classes in the southwest part of China were asked to assess their teachers’ interpersonal behaviour using the Questionnaire on Teacher Interaction (QTI). This was the first time that the QTI was successfully translated and used (in EFL classrooms) in China. Cronbach’s α reliability coefficients for the scales were adequate, while confirmatory factor analyses provided support for the theoretical framework behind the questionnaire. Results showed that teacher uncertainty was negatively correlated with student achievement. Furthermore, the degree of teacher cooperation with students was the only significant predictor for student achievement, but its effect disappeared when student background variables were taken into account. Results also indicated a discrepancy between students’ perceptions of preferred and actual teacher interpersonal behaviour. The tolerant-authoritative profile was the most common interpersonal style based on Chinese students’ perceptions.     

Measuring self-efficacy,aptitude to participate and functioning in students with and without impairments

Including vulnerable groups of students such as students with learning disabilities in mainstream school research, require ethical considerations and questionnaire adaptation. These students are often excluded, due to low understanding or methodologies generating inadequate data. Students with disability need be studied as a separate group and provided accessible questionnaires. This pilot study aims at developing and evaluating student self-reported measures, rating aspects of student experiences of school-based Physical Education (PE). Instrument design, reliability and validity were examined in Swedish secondary school students (n = 47) including students, aged 13, with intellectual disability (n = 5) and without impairment and test–retested on 28 of these students. Psychometric results from the small pilot-study sample were confirmed in analyses based on replies from the first wave of data collection in the main study (n = 450). Results show adequate internal consistency, factor structure and relations between measures. In conclusion, reliability and validity were satisfactory in scales to measure self-efficacy in general, in PE, and aptitude to participate. Adapting proxy ratings for functioning into self-reports indicated problems. Adequacy of adjustments made were confirmed and a dichotomous scale for typical/atypical function is suggested for further analyses.     

The development of dance attitude scales

This research report describes the development of dance attitude scales which were 'grounded' in the opinions of groups of 11-16-year-old pupils in six schools throughout England. Factor analyses involving an initial sample of 368 male and female secondary school pupils produced four embryonic scales which were then tested with a sample of 1,668 adolescents. Satisfactory internal reliability coefficients were achieved and scale intercorrelations provided evidence of the scales as distinct measures. Further analyses undertaken to test validity employing data from the larger sample indicated that two of the proposed scales, Ballet and Male Dancers, may be valid measures of attitude, although less confidence can be placed in the third and fourth scales. Suggestions are made for the development and application of the inventory.     

The measure of classroom stress and burnout among gifted and talented students

The development of the Student Stress Inventory (SSI) and the cross-validation of the Maslach Burnout Inventory (MBI) are presented. First, gifted student data (n = 311) were subjected to factor analyses for both the SSI and the MBI to assess factorial validity; five stress and three burnout factors were evident. Second, the construct validity of both the stress and burnout constructs was examined in relationship to classroom tedium and the quality of school life. Also, 14 child stress experts assisted in analyzing content validity; the majority of these rated SSI items as being relevant to very relevant to student stress. With respect to SSI reliability, alphas ranged from .63 to .85; similarly, MBI alphas ranged from .63 to .86. Additionally, most of SSI and MBI scales and subscales were moderately to strongly interrelated. Finally, an inspection of the concurrent validity of the stress and burnout constructs revealed significant relationships between stress, burnout, tedium and, to a degree, quality of school life variables.     

Measuring the potential for child maltreatment: the reliability and validity of the Adult Adolescent Parenting Inventory--2

OBJECTIVE: The field of child protection needs reliable and valid methods of assessing the potential for child abuse and neglect. The purpose of this study was to examine the psychometric properties of the Adult Adolescent Parenting Inventory--2 (AAPI-2), Form B, using a sample of 309 low-income, rural families in a southern state. METHOD: The AAPI-2 is a 40-item survey designed to assess the parenting and child rearing attitudes of adult and adolescent parent and pre-parent populations. Each of the five AAPI-2 scales was (a) examined using factor analysis in order to determine the unidimensionality of the scale, (b) evaluated based on estimates of the scales reliability in order to determine the consistency with which the construct was measured, and (c) when possible, examined to determine if it is related to other constructs in meaningful and expected ways. RESULTS: While the factor structure reported by the developer was not fully confirmed in this sample, there is some evidence that the instrument is measuring at least two of the constructs it purports to measure and that the total score may be useful. Correlations with other instruments measuring parenting behavior and child behavior were significant, and in the expected direction, offering some support for the validity of the AAPI-2. CONCLUSIONS: While the AAPI-2 appears to measure attitudes related to harsh or neglectful parenting, caution should be used in the interpretation of the individual AAPI-2 scales.     

Concurrent and Longitudinal Relations between Children's Playground Behavior and Social Preference, Victimization, and Bullying

Prior research with contrived play groups suggests that how children interact with one another can influence their social relationships, but few studies have been carried out to determine if this is the case in naturalistic settings. This study examined the concurrent and longitudinal links between four observational measures of 8- to 9-year-old children's (N = 89) playground behaviors/peer contacts (Alone, Conversation, Group Size, and Network) and three sociometric measures of their peer relationships (Social Preference, Bully, and Victim). The latter were assessed at 2 points within a school year, the first corresponding with the playground observations and the second 5 months later. Several of the concurrent correlations were found to be significant. For boys, Group Size was positively correlated with Bully Score and Social Preference Score, but negatively correlated with Victim Score; and time Alone was positively correlated with Victim Score. For girls, time Alone was positively correlated with Victim Score; Network was negatively correlated with Bully Score but positively correlated with Social Preference Score; and Group Size was positively correlated with Social Preference Score. The longitudinal analyses indicated that for boys, elevated levels of time Alone and, separately, Conversation, predicted the highest increases in Victim Score. For girls, low levels of time Alone predicted the sharpest increases in Social Preference Score. There was also some marginally significant evidence, p < .06, that among girls, high levels of time Alone predicted the greatest increases in Bully Score, and high levels of Conversation predicted the greatest increases in Social Preference Score. The theoretical and practical importance of these links between children's nonaggressive playground behaviors and their emerging peer relationships are discussed.     

Scale for assessing undergraduates’ interdisciplinary competences related to the smart living industry

In this study, a scale was constructed to aid college educators in developing interdisciplinary courses for smart living industry–related talent cultivation. The scale, named the Undergraduate Student Interdisciplinary Competences for the Smart Living Industry (USIC_SLI) scale, was developed on the basis of a literature review and a two-phase expert survey. A pilot test was performed, and exploratory and confirmatory factor analyses were conducted to understand the scale’s reliability and validity. The final version of the scale comprises five subscales (i.e. communication, reflection, practice, technology values, and entrepreneurship) and 25 items. The Cronbach’s α of the scale was 0.92, and that of the subscales ranged from 0.82 to 0.89. Structural equation modelling revealed that the theoretical model and observation data of the scale were compatible, and the results indicated that the scale had appropriate validity and reliability.     

The measurement of classroom management self‐efficacy: a review of measurement instrument development and influences

Teachers' self‐efficacy (SE) in their classroom management capabilities is thought to be an important factor in teachers' overall judgements of their teaching SE. Low SE in classroom management has been linked to teacher attrition and burnout, and reduced student learning outcomes. This article provides the first comprehensive review of classroom management as a factor in the construct of teacher SE. Twenty‐five peer‐reviewed articles published from 1984 to 2009 that reported on the use of SE scales containing at least one novel classroom management self‐efficacy (CMSE) item were reviewed. The validity and reliability of CMSE scales and items were found to be very good, with classroom management items pertaining to maintaining order and control the most frequent category included. Approximately one in four items in the SE scales reviewed was CMSE item, and, in general, CMSE items were not linked explicitly to classroom management research or contemporary psychological or philosophical approaches.     

The relationships between Chinese higher education students' epistemic beliefs and their judgmental standards of searching for literature online: undergraduate versus graduate comparisons

The main purpose of this study was to examine the relationships between Chinese higher education students' epistemic beliefs and their judgmental standards of searching for literature online. Data were collected from 449 higher education students (152 college students and 297 graduate students) in Beijing via two self-reported questionnaires: one was the Epistemic Beliefs Questionnaire (EBQ), including four scales (Innate/Fixed Ability, Learning Effort/Process, Authority/Expert Knowledge, and Certainty of Knowledge); the other was the Online Judgmental Standards of Searching for Literature Questionnaire (OJSSLQ), consisting of six scales (Multiple sources, Authority, Content, Quantitative Indicators, Clarity, and Ease of Access). Through exploratory factor analyses, this study confirmed the reliability and validity of the EBQ and OJSSLQ. Further analyses indicated that there were significant differences between college and graduate students for the Content and Ease of Access judgmental standards of searching for literature online whereby graduate students had higher standards for these two factors, but there were no differences for the other factors. Correlation analysis between the EBQ and OJSSLQ was conducted for the college and graduate students. An interplay between the students' epistemic beliefs and their evaluative standards of searching for literature online was found. For example, the results indicated that both college and graduate students with the epistemic belief that learning requires great efforts and processes (Learning Effort/Process) had the tendency to judge the academic information by the standards of Authority and Content (i.e. checking the authority of literature or carefully reading the content). This study also found that epistemic beliefs might increasingly play a role in the students' judgmental standards of searching for literature online as they progressed into advanced study.     

Learning Environment and its Association with Student Satisfaction Among Mathematics Students in Brunei Darussalam

This article reports a study of lower secondary mathematics classroom learning environment in Brunei Darussalam and its association with students' satisfaction with learning mathematics among a sample of 1565 students from 81 classes in 15 government secondary schools. Students' perceptions of the classroom learning environments were assessed with a version of the My Class Inventory (MCI) that had been modified for the Brunei context. The study revealed a satisfactory factor structure for a refined three-scale version of the MCI assessing cohesiveness, difficulty and competition. This finding is noteworthy because the factorial validity of the MCI has not previously been established in past research in other countries. Also each scale displayed satisfactory internal consistency reliability and discriminant validity and was able to differentiate between the perceptions of students in different classes. A one-way MANOVA revealed that students generally perceived a positive learning environment in mathematics classes. Also the study supported earlier research suggesting that boys and girls hold different perceptions of the same classroom learning environments. Relationships between student satisfaction and classroom environment were investigated using simple and multiple correlation analyses, using both the individual student and class mean as units of analysis. Associations between satisfaction and the learning environment were statistically significant both at student and class levels for most MCI scales. This revised version was published online in August 2006 with corrections to the Cover Date.     

Evaluating tertiary teaching: A New Zealand perspective

The purpose of this research was to test the applicability of two American instruments designed to assess tertiary students' evaluations of teaching effectiveness with New Zealand students. The scales were found to have high internal consistency reliability coefficients, most of the items were seen to be appropriate, and every item was considered of importance by at least some of the students. In addition, all but the Workload/Difficulty items clearly differentiated between “good,” “average,” and “poor” lectures. Further analyses generally supported both the factor structure identified in earlier research and the convergent and discriminate validity of the scales from both instruments. This research has provided strong support for the applicability of these American instruments for evaluating effective teaching at a New Zealand university.     

Teachers' self‐reported pedagogical practices toward socially inhibited,hyperactive, and average children

This study examined teachers' self‐reported pedagogical practices toward socially inhibited, hyperactive, and average kindergartners. A self‐report instrument was developed and examined in three samples of kindergartners and their teachers. Principal components analyses were conducted in four datasets pertaining to 1 child per teacher. Two dimensions, Behavior Regulation and Socioemotional Support, emerged, which could be measured with internally consistent scales. Preliminary validity support was obtained for them. Multilevel comparisons revealed that teachers reported more behavior regulation for hyperactive versus inhibited and average children, more socioemotional support for inhibited versus hyperactive and average children, and more socioemotional support for hyperactive versus average children in two samples. Exploratory analyses of the other (i.e., random) sample of children yielded corresponding effects of hyperactivity on behavior regulation, and social inhibition on socioemotional support, but no effect of hyperactivity on socioemotional support. Results are discussed in terms of the saliency of behavior differences. © 2006 Wiley Periodicals, Inc. Psychol Schs 43: 635–651, 2006.