Designing and Validating Assessments of Complex Thinking in Science

Typical assessment systems often measure isolated ideas rather than the coherent understanding valued in current science classrooms. Such assessments may motivate students to memorize, rather than to use new ideas to solve complex problems. To meet the requirements of the Next Generation Science Standards, instruction needs to emphasize sustained investigations, and assessments need to create a detailed picture of students’ conceptual understanding and reasoning processes.

This article describes the design process and potential for automated scoring of 2 forms of inquiry assessment: Energy Stories and MySystem. To design these assessments, we formed a partnership of teachers, discipline experts, researchers, technologists, and psychometricians to align curriculum, assessments, and rubrics. We illustrate how these items document middle school students’ reasoning about energy flow in life science. We used evidence from review by science teachers and experts in the discipline; classroom experiments; and psychometric analysis to validate the assessments, rubrics, and automated scoring.     

Education policy mobility: reimagining sustainability in neoliberal times

This paper is concerned with the twinning of sustainability with priorities of economic neoliberalization in education, and in particular via the mobility or diffusion of education policy. We discuss the literature on policy mobility as well as overview concerns regarding neoliberalism and education. The paper brings these analyses to bear in considering the uptake of sustainability in education policy. We ask to what extent sustainability as a vehicular idea may be twinning with processes of neoliberalization in education policy in ways that may undermine aspirations of, and action on, environmental sustainability. Toward the end of the paper, we draw on data from an empirical study to help elucidate how the analytic frames of policy mobility can inform our analyses of the potential concerns and possibilities of sustainability as a vehicular idea. In particular, we investigate how sustainability and related language have been adopted in the policies of Canadian post-secondary education institutions over time. The paper closes by suggesting the potential implications of the proceeding analyses for policymakers, practitioners, and researchers concerned with sustainability in education policy.