Reconceptualizing Validity for Classroom Assessment

This article explores the shortcomings of conventional validity theory for guiding classroom assessment practice and suggests additional theoretical resources from sociocultural theory and hermeneutics to complement and challenge conventional theory. To illuminate these concerns and possibilities in a concrete context, the author uses her own classroom experience in teaching a qualitative research methods course. The importance of examining cases of assessment practice in context for developing, teaching, and evaluating validity theory is discussed.     

Inclusive schooling policy: An educational detective story?

Since the publication of the Salamanca statement (UNESCO 1994), inclusive schooling has formed a growing part of the deliberations of the special education community. Inclusive schooling research in Australia in the main continues to reproduce traditions of the special education field, emphasising the dominant psychological perspectives that have been superimposed on inclusive education discourses. At the fifth International Congress of Special Education (ISEC 2000) held in Manchester, ‘the death knell of the concept of special education’ (ISEC 2000) was announced. The concept proposed by Mike Oliver, Professor of Disability Studies at the University of Greenwich, asserts an end to understandings of diversity dependent on medical, psychological and charity-based discourses. From a recent study of inclusive schooling policy, and drawing from poststructuralist methodology, I suggest an approach to research, policy development and practice that questions traditionalist theorising in the special education field. Reflecting on the implementation of the Inclusion of Students with Disabilities Policy (DECCD 1995) in the Tasmanian government school system, I outline my alignment with Oliver’s view and highlight how questions of epistemology and reconstructions of research methodologies are central to rethinking understandings of difference. I also illustrate a methodological orientation that offers possibilities for a different science to take place, thereby understanding diversity as multiple and contradictory — and beyond the single ‘detective story’ (Gough 1998) of the medical, psychological and charity-based discourses that circulate in schools as the populist conceptions of ‘inclusion’.     

Shifting the focus of validity for test use

The conventional focus of validity in educational measurement has been on intended interpretations and uses of test scores. Empirical studies of test use by teachers, administrators and policy-makers show that actual interpretations and uses of test scores in context are invariably shaped by local users’ questions, which frequently require attention to multiple sources of evidence about students’ learning and the factors that shape it, and depend on local capacity to use such information well. This requires a more complex theory of validity that can shift focus as needed from the intended interpretations and uses of test scores that guide test developers to local capacity to support the actual interpretations, decisions and actions that routinely serve local users’ purposes. I draw on the growing empirical literature on data use to illustrate the need for an expanded theory of validity, point to theoretical resources that might guide such an expansion, and suggest a research agenda towards these ends.     

Portfolios, Accountability, and an Interpretive Approach to Validity

How can the results of classroom-based portfolio assessment be communicated outside the classroom? How might a portfolio-based assessment system be designed and implemented? How can we evaluate the merits of portfolio-based assessments?     

Effects of a Teacher‐Designed and Teacher‐Led Numerical Board Game Intervention: A Randomized Controlled Study with 4‐ to 6‐Year‐Olds

The purpose of the current pilot study was to examine the effects of a teacher‐designed and teacher‐led numerical board game intervention. Fifty‐four 4‐ to 6‐year‐olds were randomly assigned to either the number board game intervention or an active control group. Relative to the control group, children who received the number game intervention demonstrated significant improvements on a numeral identification task. This finding is significant in so far as numeral identification skills play a critical role in more advanced numerical and mathematical reasoning. There was no evidence of training‐related improvements on any of the other tasks. In addition to the intervention effects, the present study provides an example of a successful teacher‐researcher collaboration, providing new insights into the making of bidirectional relations between research and practice.     

Verbal discussions about social problem-solving between friends and non-friends

In the field of developmental social psychology there is a consensus concerning the social nature of intelligence. In spite of the important empirical investigations in this field over the last fifteen years, the influence of the quality of a relationship on joint problem-solving and learning is still poorly understood. This explorary study investigated the influence of socio-affective context on the interactive modalities surrounding social problem-solving discussions conducted with 32 dyads of 8-year-old Swiss francophone children. Sociometric interviews with children and teachers were carried out to identify the following naturally-ocurring socio-affective contexts: reciprocal friendship (RF), asymmetrical friendship (AF) and reciprocal absence of friendship (“reciprocal non-friendship” RNF; excluding enemies). Comparisons of verbal exchanges and dyadic performance across the three groups suggests that reciprocal friendship facilitates collaboration and the organization of collective work. Two rival hypotheses opposing socio-affective proximity (reciprocal friendship) and socio-affective distance (asymmetrical friendship and reciprocal absence of friendship) are discussed with respect to the influence of social interactions on social problem-solving.