Validating Student Score Inferences With Person‐Fit Statistic and Verbal Reports: A Person‐Fit Study for Cognitive Diagnostic Assessment

The goal of this study was to investigate the usefulness of person‐fit analysis in validating student score inferences in a cognitive diagnostic assessment. In this study, a two‐stage procedure was used to evaluate person fit for a diagnostic test in the domain of statistical hypothesis testing. In the first stage, the person‐fit statistic, the hierarchy consistency index (HCI; Cui, 2007 ; Cui & Leighton, 2009 ), was used to identify the misfitting student item‐score vectors. In the second stage, students’ verbal reports were collected to provide additional information about students’ response processes so as to reveal the actual causes of misfits. This two‐stage procedure helped to identify the misfits of item‐score vectors to the cognitive model used in the design and analysis of the diagnostic test, and to discover the reasons of misfits so that students’ problem‐solving strategies were better understood and their performances were interpreted in a more meaningful way.     

Feedback complexity and corrective efficiency

College undergraduates read a 2400-word passage, responded to 16 multiple-choice questions, and received one of four types of feedback following their responses. Complexity of feedback was inversely related to both error correctability and criterion efficiency taken as a ratio of feedback study time to post-test corrects. The results were discussed in terms of depth of processing and instructional comprehension.     

Considering the Role of Self-Study of Teaching and Teacher Education Practices Research in Transforming Urban Classrooms

We explore the first four articles in this Special Issue of Studying Teacher Education to identify challenges to the self-study of teaching and teacher education practices (S-STEP) methodology, and how this methodology supports the work of teachers and teacher educators working in urban settings. We respond to these articles by identifying strategies and tools that might be used by S-STEP researchers to strengthen the presentation of their work and to explore the challenges to transforming classrooms using this methodology.     

Towards an adolescent friendly methodology: accessing the authentic through collective reflection

The re-emergence of student voice presents a challenge to schools and researchers to become more responsive to the voice of adolescents in education and in research. However, the poor articulation of the nature of student voice to date is confirmation of the complex and important nature of the personal advocacy and human agency that is involved in all student voice activities. This lack of clarity leads to interpretations of student voice that range in authenticity from token to active and meaningful (Hart, R. 1997. Children's Participation: The Theory and Practice of Involving Young Citizens in Community Development and Environmental Care. Earthscan Publications. London: UNICEF). Researchers who are guided by more traditional methodologies may implement methods that are appropriate for adults yet are not sensitive to the needs and interests of the young person whose perspectives are usually the focus of the research. This research found that while an advocacy and empowerment worldview supports student voice research, adolescents also prefer a methodology that is agentic, socially based, reflective and embodied (Dempster, N., A. Lizzio, M. Keeffe, J. Skinner, and D. Andrews. 2010. “The Contributions of Research Design and Process Facilitation in Accessing Adolescent views of Leadership.” Leading and Managing 16 [2]: 77–89). Adolescent perspectives on research processes and methods are valuable in helping researchers to choose more responsive approaches to sharing understandings with adolescents, so that research designs may be challenging, meaningful and rewarding for all participants.