Managing What We Can Measure: Quantifying the Susceptibility of Automated Scoring Systems to Gaming Behavior

As methods for automated scoring of constructed‐response items become more widely adopted in state assessments, and are used in more consequential operational configurations, it is critical that their susceptibility to gaming behavior be investigated and managed. This article provides a review of research relevant to how construct‐irrelevant response behavior may affect automated constructed‐response scoring, and aims to address a gap in that literature: the need to assess the degree of risk before operational launch. A general framework is proposed for evaluating susceptibility to gaming, and an initial empirical demonstration is presented using the open‐source short‐answer scoring engines from the Automated Student Assessment Prize (ASAP) Challenge.     

Mapping migrant vernacular discourses: Mestiza consciousness,nomad thought,and Latina/o/x migrant movement politics in the United States

ABSTRACT

This essay reads the Latina/o/x migrant vernacular discourses that emerge out of pro-migrant activism. Anzaldúa’s notion of mestizaje – a logic of border consciousness – is put into conversation with Deleuze’s notion of nomad thought – a logic of movement – to inform a rhetorical strategy for reading the vernacular archive of social movement discourse. The “No Papers, No Fear” is one such social movement that demonstrate the logic of mestizaje/nomadism in their communication strategies. This study illuminates three tensions that define the ways Latina/o/x migrants in the US navigate the spaces of citizenship: tensions between movement/stasis, migrant identity/national identity, and fear/safety.