Measure the Place Before You Measure the People: new alternatives for quality assessment

Enthusiasm for interventions designed to improve organizational quality has far outpaced interest in assessing their effects. This article describes two procedures for systematic quality assessment. First, distributional assessment provides a way to monitor individual, group or unit performance by establishing real and maximum‐feasible parameters. Second, a cost assessment system based on utility analysis provides a way to assign dollar values and benefits to quality interventions targeted at specific jobs and job functions. Both procedures are described and illustrated. They resolve a long‐standing problem with quality assessment, arising from the difficulty of accounting for situational influences which can constrain the effects of interventions designed to improve organizational performance, product or service delivery, and customer satisfaction.     

The Impact of Speedometry on Student Knowledge,Interest, and Emotions

Given the dearth of high-quality curriculum materials aligned with the new standards (NGSS and CCSS) and low student persistence in STEM fields, we sought to develop and test a STEM curriculum that would improve student knowledge, interest, and emotions. A cluster randomized control trial was conducted to assess the impact of Speedometry, a two-unit STEM curriculum that uses familiar toy cars to explore math and science concepts. A total of 1,615 fourth-grade students across 48 classrooms and 17 schools in an urban district participated in the study. Using a 3-level multilevel model (students nested within teachers and schools) and controls for student and teacher characteristics, we found that Speedometry led to significant increases in student knowledge and positive emotions such as excitement. Speedometry also led to significant decreases in negative emotions such as boredom, frustration, and confusion. The curriculum was implemented with high fidelity as evidenced by classroom observations and teacher self-reports.     

Designing a machine to learn about the ethics of robotics: the N-reasons platform

We can learn about human ethics from machines. We discuss the design of a working machine for making ethical decisions, the N-Reasons platform, applied to the ethics of robots. This N-Reasons platform builds on web based surveys and experiments, to enable participants to make better ethical decisions. Their decisions are better than our existing surveys in three ways. First, they are social decisions supported by reasons. Second, these results are based on weaker premises, as no exogenous expertise (aside from that provided by the participants) is needed to seed the survey. Third, N-Reasons is designed to support experiments so we can learn how to improve the platform. We sketch experimental results that show the platform is a success as well as pointing to ways it can be improved.     

What is political incivility?

Using 23 novel indicators and a 1,000+ sample representative of a full undergraduate population we examined: how much consensus there was about perceptions of the incivility/civility of various categories of speech/behavior; and whether political incivility is a unidimensional or multidimensional latent construct. Confirmatory factor analyses suggest perceived political incivility is a multidimensional construct. Insulting utterances, deception, and behaviors tending to shut down inclusive ongoing discussion can be treated as distinct, underlying aspects of incivility. More than 75% of respondents viewed all 23 indicators, except issue-oriented attacks, as very, mostly, or somewhat uncivil. If replicated on a representative national sample, standardized indicators of political incivility should be constructed and routinely employed in national surveys of political attitudes and behavior.     

Modifying Knowledge,Emotions, and Attitudes Regarding Genetically Modified Foods

The purpose of this study was to explore whether conceptual change predicted emotional and attitudinal change while learning about genetically modified foods (GMFs). Participants were 322 college students; half read a refutation text designed to shift conceptual knowledge, emotions, and attitudes, while the other half served as a control group. The results suggest that the refutation text effectively facilitated change in conceptual knowledge, emotions, and attitudes. The hypothesized relationship among the variables was explored using structural equation modeling. The analysis showed that when participants experienced knowledge change toward more scientifically accepted conceptions of GMFs, their emotions became more positive and less negative, which predicted a subsequent shift toward more-positive attitudes. The results suggest that change in emotions mediates the relationship between conceptual and attitudinal change. Several theoretical and practical implications are discussed including the impact that these findings may have on science education.     

Response to intervention

This introduction provides a context for the other articles included in this volume. The Learning Disabilities Initiative, a multiyear effort at the Office of Special Education Programs, has been focused on a more efficient and effective process for determining specific learning disability eligibility.     

Scientist role models in the classroom: how important is gender matching?

Gender-matched role models are often proposed as a mechanism to increase identification with science among girls, with the ultimate aim of broadening participation in science. While there is a great deal of evidence suggesting that role models can be effective, there is mixed support in the literature for the importance of gender matching. We used the Eccles Expectancy Value model as a framework to explore how female science role models impact a suite of factors that might predict future career choice among elementary students. We predicted that impacts of female scientist role models would be more pronounced among girls than among boys, as such role models have the potential to normalise what is often perceived as a gender-deviant role. Using a mixed-methods approach, we found that ideas about scientists, self-concept towards science, and level of science participation changed equally across both genders, contrary to our prediction. Our results suggest that engaging in authentic science and viewing the female scientist as personable were keys to changes among students, rather than gender matching between the role model and student. These results imply that scientists in the schools programmes should focus on preparing the visiting scientists in these areas.     

Characteristics of a cognitive tool that helps students learn diagnostic problem solving

Three related studies replicated and extended previous work (J.A. Danielson et al. (2003), Educational Technology Research and Development, 51(3), 63–81) involving the Diagnostic Pathfinder (dP) (previously Problem List Generator [PLG]), a cognitive tool for learning diagnostic problem solving. In studies 1 and 2, groups of 126 and 113 veterinary students, respectively, used the dP to complete case-based homework; groups of 120 and 199, respectively, used an alternative method. Students in the dP groups scored significantly higher (p = .000 and .003, respectively) on final exams than those in control groups. In the third study, 552 veterinary students responding to a questionnaire indicated that the dP’s gating and data synthesis activities aided learning. The dP’s feedback and requirement of completeness appear to aid learning most.