Effects of Multimedia versus Live Professional Development on Teachers’ and Students’ Performance Related to the Question Exploration Routine

In each of two studies, teachers were randomly assigned to either a Virtual Workshop (VW) group that used a computerized professional development program or an Actual Workshop (AW) group that participated in face-to-face professional development, including discussion, feedback, and collaboration. In both studies, teachers’ posttest scores related to their knowledge of the Question Exploration Routine and their plans for using it were significantly higher than their pretest scores. In Study 2, both groups’ posttest scores with regard to implementation and planning of the routine were significantly greater than their pretest scores. There were no significant differences between the groups at posttesting on any measure. The posttest knowledge scores of the whole groups of students and the subgroups of students with LD being taught by both groups of teachers were significantly higher than their pretest scores. All teachers indicated that they were satisfied with the training and the routine. VW teachers in both studies indicated that they were satisfied with the software program.     

Managing What We Can Measure: Quantifying the Susceptibility of Automated Scoring Systems to Gaming Behavior

As methods for automated scoring of constructed‐response items become more widely adopted in state assessments, and are used in more consequential operational configurations, it is critical that their susceptibility to gaming behavior be investigated and managed. This article provides a review of research relevant to how construct‐irrelevant response behavior may affect automated constructed‐response scoring, and aims to address a gap in that literature: the need to assess the degree of risk before operational launch. A general framework is proposed for evaluating susceptibility to gaming, and an initial empirical demonstration is presented using the open‐source short‐answer scoring engines from the Automated Student Assessment Prize (ASAP) Challenge.     

The ethics of polyvocal ethnography: empowering vs. textualizing children and teachers

Polyvocal approaches allow researchers and informants to interact on a more equal footing and informants’ voices to be heard in the final text. But research methods intended to empower informants also can be a source of unanticipated authorial power ‐ the power to confront informants with unsolicited self‐reflections and to textualize people's lives and words. The authors reflect on those ethical dilemmas in this article.