Relating Unidimensional IRT Parameters to a Multidimensional Response Space: A Review of Two Alternative Projection IRT Models for Scoring Subscales

A practical concern for many existing tests is that subscore test lengths are too short to provide reliable and meaningful measurement. A possible method of improving the subscale reliability and validity would be to make use of collateral information provided by items from other subscales of the same test. To this end, the purpose of this article is to compare two different formulations of an alternative Item Response Theory (IRT) model developed to parameterize unidimensional projections of multidimensional test items: Analytical and Empirical formulations. Two real data applications are provided to illustrate how the projection IRT model can be used in practice, as well as to further examine how ability estimates from the projection IRT model compare to external examinee measures. The results suggest that collateral information extracted by a projection IRT model can be used to improve reliability and validity of subscale scores, which in turn can be used to provide diagnostic information about strength and weaknesses of examinees helping stakeholders to link instruction or curriculum to assessment results.     

Psychometric properties of a youth self-report measure of neglectful behavior by parents

Objective

This study aimed to empirically assess psychometric properties of a multi-dimensional youth self-report measure of neglectful behavior by parents.

Method

Data were gathered from 593 12-year-old youth participating in the Longitudinal Studies of Child Abuse and Neglect (LONGSCAN) consortium; 272 also had data at age 14. Youth responded to a 25-item measure of their experiences of neglect. Expert raters classified items into 4 factors, followed by confirmatory factor analyses. We evaluated cross group measurement equivalence by gender and longitudinal measurement equivalence from age 12 to age 14. Validity was assessed by the relationships between factor scores and (1) neglect reports to child protective services (CPS), (2) quality of parent-child interactions, and (3) parental monitoring.

Results

A 3-factor model (Physical Needs, Emotional Support, and Parental Monitoring) of neglect was obtained, with equivalence across gender and longitudinally (age 12-14). The pattern of correlations between the factor scores, CPS reports, and measures of the parent-child relationship offered modest to moderate support for convergent validity.

Conclusions

The findings suggest a promising and relatively brief youth self-report measure of neglect to help advance research in this area.     

Education and training for young people at risk of becoming NEET: findings from an ethnographic study of work‐based learning programmes

This report provides a summary of findings from an ethnographic study of work‐based learning provision for 16–18‐year‐olds who would otherwise fall into the UK Government category of not in education, employment or training (NEET). The research project took place in the north of England during 2008–2009, and investigated the biographies, experiences and aspirations of young people and practitioners working on Entry to Employment (E2E) programmes in four learning sites. The detailed research findings are reported in four papers covering the conceptual background to E2E, and the experiences of learners, tutors and Connexions personal advisers involved with the programme. This report highlights and synthesises some of the key issues raised by these papers and looks ahead to a three‐year longitudinal study of NEET young people which is intended to continue and extend this work, providing an opportunity to follow this group during a period of far‐reaching economic and political change.     

Testing to enhance retention in human anatomy

Recent work in cognitive psychology has shown that repeatedly testing one's knowledge is a powerful learning aid and provides substantial benefits for retention of the material. To apply this in a human anatomy course for medical students, 39 fill-in-the-blank quizzes of about 50 questions each, one for each region of the body, and four about the nervous system, were developed. The quizzes were optional, and no credit was awarded. They were posted online using Blackboard, which provided feedback, and they were very popular. To determine whether the quizzes had any effect on retention, they were given in a controlled setting to 21 future medical and dental students. The weekly quizzes included questions on regional anatomy and an expanded set of questions on the nervous system. Each question about the nervous system was given three times, in a slightly different form each time. The second quiz was given approximately half an hour after the first one, and the third was given one week after the second to assess retention. The quizzes were unpopular, but students showed robust improvement on the questions about the nervous system. The scores increased by almost 9% on the second quiz, with no intervention except viewing the correct answers. The scores were 29% higher on the third quiz than on the first, and there was also a positive correlation between the grades on the quizzes and the final examination. Thus, repeated testing is an effective strategy for learning and retaining information about human anatomy.     

Individual differences in memory-monitoring accuracy

The reliability of memory-monitoring accuracy was examined in two studies. In Study 1, college students recalled answers to general knowledge questions and rated confidence in the answers. Odd-even reliability of monitoring accuracy was not significantly different from zero; students with at least 20 correct and 20 incorrect answers had higher reliability when the odd and even subsets of questions were matched on recall accuracy. The best reliability was observed when the distribution of confidence ratings was equated across odd and even question subsets, and students had at least 20 confidence judgments at each level. In Study 2, a 100-item mutiple-choice general knowledge test led to odd-even reliability for confidence-recognition accuracy that was fairly high, relative to previous research, but well below desired levels. For FOK-recognition, odd-even reliability was significantly different from zero, but low. These data indicate that current methods allow an individuals' monitoring accuracy to be assessed with low to moderate reliability. Suggestions for further research are offered.     

Educating Teachers to Teach Multiplicative Structures in the Middle Grades

The middle-grades mathematics related to multiplicative structures has undergone careful scrutiny over the past decade. Researchers have identified the types of reasonings involved; the difficulties students have with the concepts and why these difficulties might occur; and the interconnections within this content area. On the basis of this research we make four recommendations for the preparation and professional development of teachers. The recommendations deal with different but related forms of reasoning: quantitative reasoning, multiplicative reasoning, proportional reasoning, and reasoning with rational numbers. Problematic issues that follow from the recommendations are discussed. This revised version was published online in July 2006 with corrections to the Cover Date.     

Optimization of handheld gauge sizes for rocker measurements of skate blades and bobsleigh runners

This work uses numerical methods to investigate the feasibility of modifying an instrument used in speed skating to analyze blades from four different ice sports. The instrument, a handheld rocker gauge, is adapted to create a device that can effectively profile other types of skate blades and bobsleigh runners. Since there are significant differences between short and long-track blades one could expect a difference in the gauges used to study these blades. Despite this expectation, the same gauge is used in both disciplines. The usefulness of these gauges has been proven in speed skating so it is expected that they should also be useful to study hockey blades and bobsleigh runners. To optimize the gauge size for different blade types we digitize the profile of a blade, which we use to simulate gauge data. Then we use that gauge data to reconstruct the profile and compare it to the original digital profile. The result is compared for various gauge sizes and the gauge size is optimized for each of the four disciplines. The only commercially available device seems optimal for bobsleigh and long track speed skating. Smaller gauges are recommended for analyzing short track speed skates and hockey skates.

‘You don’t want to stand out as the bigger one’: exploring how PE and school sport participation is influenced by pupils and their peers

Background: Population health concerns related to physical inactivity and obesity appear in policy documents, government campaigns and popular media across western societies. Children and young people have been targeted for physical activity promotion and schools have been positioned as sites for intervention. In particular, Physical Education and school sport (PESS) has been framed as a key part of the solution. While some interventionist programmes in schools have reported positive outcomes, they have also been criticised for stigmatising fatness, contributing to a culture of surveillance and fuelling body image anxieties. Despite ongoing work to ameliorate these critical issues by addressing physical activity promotion discourses, curricula and teaching practices many of the same challenges persist. In seeking alternative explanations (and solutions) this paper shifts attention to exploring the role of pupils and their peers.

Purpose: While the critical literature on health and physical education has been illuminating, few studies explore the role of pupils and their peers. Further research is necessary to understand how school peers contribute to pupils’ engagement with PESS. This paper, therefore, draws on Bourdieu’s notion of physical capital and seeks to understand how pupils’ physical activity is influenced by lived-body experiences in school spaces.

The study: Data were produced from a 6-month bricolage-based study with pupils (N?=?29, aged 13–14) across four diverse school settings in England. Multiple qualitative methods were deployed to enhance methodological rigour with what is often a challenging age group for research. Data were interpreted and theorised using the concept of physical capital.

Findings: Pupils themselves play a significant part in establishing the physical body as a symbol of power and status in school settings. Participants understood the health risks of being both underweight and obese, but they regarded obesity as being more problematic because of the immediate social risks of ‘standing out as the bigger one’. Following this rationale, participants sought to accumulate physical capital through engaging in exercise as a purposeful calorie-burning activity intended to avoid the pity, abnormality and derision which is expected to be directed towards overweight pupils. Furthermore, during PESS in clear view of peers, distinctions between pupils’ physical capital could be made by recognising differences in sporting skill. In this context, physical capital mediated engagement in PESS in various ways.

Conclusion: This study has revealed that peers play a significant part in constructing the lived-body experiences of young people. In order to address the criticisms raised about some school-based health promotion interventions, it is crucial to attend to pupils’ relationships with peers as well as addressing policies, curricula and teaching practices. Being sensitive to peer relationships and their understanding of health may help teachers and health promoters decide how to manage the spaces where PESS takes place.