Scaling Performance Assessments: A Comparison of One-Parameter and Two-Parameter Partial Credit Models

In one study, parameters were estimated for constructed-response (CR) items in 8 tests from 4 operational testing programs using the l-parameter and 2- parameter partial credit (IPPC and 2PPC) models. Where multiple-choice (MC) items were present, these models were combined with the 1-parameter and 3-parameter logistic (IPL and 3PL) models, respectively. We found that item fit was better when the 2PPC model was used alone or with the 3PL model. Also, the slopes of the CR and MC items were found to differ substantially. In a second study, item parameter estimates produced using the IPL-IPPC and 3PL-2PPC model combinations were evaluated for fit to simulated data generated using true parameters known to fit one model combination or ttle other. The results suggested that the more flexible 3PL-2PPC model combination would produce better item fit than the IPL-1PPC combination.     

A Second-Order Longitudinal Model for Binary Outcomes: Item Response Theory Versus Structural Equation Modeling

Measuring academic growth, or change in aptitude, relies on longitudinal data collected across multiple measurements. The National Educational Longitudinal Study (NELS:88) is among the earliest, large-scale, educational surveys tracking students’ performance on cognitive batteries over 3 years. Notable features of the NELS:88 data set, and of almost all repeated measures educational assessments, are (a) the outcome variables are binary or at least categorical in nature; and (b) a set of different items is given at each measurement occasion with a few anchor items to fix the measurement scale. This study focuses on the challenges related to specifying and fitting a second-order longitudinal model for binary outcomes, within both the item response theory and structural equation modeling frameworks. The distinctions between and commonalities shared between these two frameworks are discussed. A real data analysis using the NELS:88 data set is presented for illustration purposes.     

Coloured overlays and their benefit for reading

Children in mainstream schools compared text on white paper with identical text covered in turn by each of ten differently‐coloured plastic overlays. More than 50% reported improved perception with one or more colours, and were given the best colour to use. About half used the overlays for more than three months and their reading speed increased when the overlays were used. In Study I children were examined twice using different methods and examiners. 47% chose the same colour on both occasions, and showed the greatest improvement in reading fluency, reliable at retest. In Study II children were issued with a random colour, and the greatest improvements in reading speed occurred when the random colour was the same as that previously chosen. Phonological reading strategies were not related to visual symptoms, or the benefit from overlays. Across individuals, reading speed varied by a factor of more than three, for good and poor readers. Study III provided estimates of the prevalence of improvements based on a sample of 426 children from 12 schools: 5% of children read more than 25% faster with a coloured overlay.     

More Than Manga

This paper describes a partnership project between Hazel Grove High School, Stockport and Cornerhouse Gallery, Manchester, during June 2001. In celebration of National Children’s Art Day, all year 10 students (14–15 year olds) spent a full day at the Cornerhouse, engaging with different types of manga (the Japanese word for comic). Pupils explored its diversity and developed their own storyboards and graphic styles. Pupils worked alongside artist, Adela Jones, with each pupil making their own sculptural comic book at school the following week. All artwork produced was exhibited either at the Cornerhouse or at school in celebration of the project. This was a unique experience for all pupils and staff, and the outcomes of the project exceeded all expectations.     

The Relationship Between Career Maturity and Work Commitment in a Sample of Australian High School Students

The present study reports on a study conducted with 377 Australian students enrolled in grades 9 through 12. The Australian version of the Career Development Inventory (CDI-A; Lokan, 1984) and a work commitment measure modified for the Australian context (Rowley & Feather, 1987) were administered. Analyses were conducted with the four subscales of the CDI-A as the dependent measures, and two levels of work commitment (high/low), four levels of age (14–17) and gender (female/male) as the independent variables. Work commitment was moderately correlated with all subscales of the CDI-A. Gender differences were evident on work commitment and career maturity. A striking finding was the strong relationship between work commitment and the knowledge component of career maturity for females. Findings are discussed in the context of changing educational and labour market opportunities and the role of education programs in career maturity development.     

Can training improve marker accuracy at detecting contract cheating? A multi-disciplinary pre-post study

Contract cheating occurs when students outsource assessed work. In this study, we asked experienced markers from four disciplines to detect contract cheating in a set of 20 discipline-specific assignments. We then conducted a training workshop to improve their detection accuracy, and afterwards asked them to detect contract cheating in 20 new assignments. We analysed the data in terms of sensitivity (the rate at which markers spotted contract cheating) and specificity (the rate at which markers spotted real student work). Pre-workshop marker sensitivity was 58% and specificity was 83%. Post-workshop marker sensitivity was 82% and specificity was 87%. The increase in sensitivity was statistically significant, but the increase in specificity was not. These results indicate that markers can often detect contract cheating when asked to do so, and that training may be helpful in improving their accuracy. We suggest that markers’ suspicions may be crucial in addressing contract cheating.     

A Critical Reflection on Career Development

The science and professional practices of vocational psychology and career development are brought into question via a critical polemic informed by the work of Foucault, with a particular focus on the application of theory and techniques of objective assessment and psychometrics. It is asserted that the scientific and professional discourse and constructs of traditional approaches to career development have been reified. The context of this discourse is discussed with respect to the risk that career development scientists and practitioners have become unwitting or complicit instruments of a broader economic and political discourse. Their alignment with the client is ultimately questioned.     

Modifications in children's goals when encountering obstacles to conflict resolution

Previous studies have demonstrated that children's goals are associated with their success in peer relationships. The current study extends earlier findings by examining changes in children's goals during hypothetical conflicts. Participants were 252 children ages 9 to 12 years old (133 boys, 119 girls). As predicted, children's goals changed significantly when they encountered obstacles to conflict resolution, and these changes were predictive of their subsequent strategy choices. Both aggressive- and submissive-rejected children were more likely to evidence antisocial changes in their goals, including an increased desire to retaliate. They also showed reluctance to forego instrumental objectives. Other findings highlighted the need to investigate the combinations of goals children pursue as predictors of their strategies and the quality of their peer relationships.