Employing teachers' ratings in selection of achievement tests in reading and mathematics with a behaviorally disturbed population

The usefulness of a particular standardized achievement test with a specific population may be determined largely on the basis of experience. Sixty-six behaviourally disturbed students were administered portions of a test battery including the Reading Recognition subtest of the Peabody Individual Achievement Test (PIAT), PIAT Reading Comprehension, the Reading subtest of the Wide Range Achievement Test (WRAT), and Stanford Diagnostic Reading Test (SDRT); PIAT Mathematics, WRAT Arithmetic, Stanford Diagnostic Mathematics Test (SDMT), and KeyMath Diagnostic Arithmetic Test. Toward the end of the academic year, teachers estimated students' grade levels in reading and mathematics. Results indicated that, in mathematics, the SDMT and the PIAT predicted teachers' ratings equally well and better than the other tests; in reading, all tests predicted teachers' ratings equally well except for the PIAT Reading Comprehension, which performed less well than others. Explanations for these results are offered, together with suggestions for identifying achievement tests suitable to specific populations.     

The effect of success or failure on self-efficacy and task persistence of conduct-disordered children

Twenty-four children with conduct disorders were familiarized with a pattern-matching task, and their self-efficacy expectations for this task were assessed. Subjects were then given either “Success” or “Failure” feedback for a series of similar problems, and their self-efficacy was reassessed. Finally, task persistence was evaluated by allowing subjects to attempt as many additional pattern-matching problems as they wished, with all subjects receiving failure feedback. Results indicated that, although the two groups of subjects were initially similar, the success group's self-efficacy was significantly higher following feedback. The success group also attempted significantly more problems while later receiving failure feedback, and there was a significant positive correlation between task persistence and the second self-efficacy rating. These findings were related to Bandura's self-efficacy theory and to educational programming for conduct-disordered children.     

Evaluating the Comparability of Paper‐ and Computer‐Based Science Tests Across Sex and SES Subgroups

As access and reliance on technology continue to increase, so does the use of computerized testing for admissions, licensure/certification, and accountability exams. Nonetheless, full computer‐based test (CBT) implementation can be difficult due to limited resources. As a result, some testing programs offer both CBT and paper‐based test (PBT) administration formats. In such situations, evidence that scores obtained from different formats are comparable must be gathered. In this study, we illustrate how contemporary statistical methods can be used to provide evidence regarding the comparability of CBT and PBT scores at the total test score and item levels. Specifically, we looked at the invariance of test structure and item functioning across test administration mode across subgroups of students defined by SES and sex. Multiple replications of both confirmatory factor analysis and Rasch differential item functioning analyses were used to assess invariance at the factorial and item levels. Results revealed a unidimensional construct with moderate statistical support for strong factorial‐level invariance across SES subgroups, and moderate support of invariance across sex. Issues involved in applying these analyses to future evaluations of the comparability of scores from different versions of a test are discussed.