Test Takers and the Validity of Score Interpretations

This article argues that test takers are as integral to determining validity of test scores as defining target content and conditioning inferences on test use. A principled sustained attention to how students interact with assessment opportunities is essential, as is a principled sustained evaluation of evidence confirming the validity or calling into question the inferences for individual students. Three innovative assessment systems are highlighted to illustrate where and how the developers might handle diverse test taker needs and learning characteristics. ONPAR measures challenging content using multisemiotic methods and novel item types, designing items to handle multiple profiles so they are accessible for most students. Dynamic Learning Maps has built an innovative network of learning maps, and multiple pathways designed to model how diverse students acquire knowledge. To support their assessments, the National Center and State Collaborative has built an exemplary web of educator resources such as content modules and guides in order to support differentiated learning.     

Role of concept definition, teaching examples, and practice on concept learning from prose

Two experiments were performed to evaluate the effects of definition adjunct questions on concept learning. Each experiment included 132 undergraduates at a large midwestern university. In both experiments, subjects studied a passage containing matched or unmatched application questions only, matched or unmatched application questions preceded by a definition question, definition questions only, or no questions at all. The critical attributes of the to-be-learned concepts were more salient in the sets of examples and nonexamples presented in the matched application questions than in the unmatched application questions. Subjects took a criterion test which consisted of novel matched and unmatched application questions. In both experiments, only unmatched application adjunct questions preceded by a definition question produced significantly higher performance on the criterion questions than definition questions only. The discussion focused on the importance of definition questions for effective use of different types of application questions.     

An exploratory investigation of the effect of working in an environmentally themed facility on the conservation‐related knowledge,attitudes and behavior of staff

In the past decade, we have seen an increased focus on measuring the impact of zoos, aquariums, and other free‐choice learning environments on the conservation‐related knowledge, attitudes and behavior of the visiting public. However, no such studies have been conducted on the impact of such environments on the staff working in these facilities – the very staff that in turn interact with the public on a daily basis. Clearly these interactions are recognized as being important; for example, the thousands of staff employed by Disney’s Animal Kingdom are regularly provided with conservation‐related training – both formal, in‐class experiences, as well as more informal experiences with animals; these are a mixture of compulsory and freely chosen experiences. An exploratory qualitative study was conducted to investigate the impact of working at Disney’s Animal Kingdom on staff knowledge, attitudes, and behavior related to animals and their conservation. The resulting findings offer preliminary evidence that working in an environmentally themed setting has a positive impact on all of these variables, and that particular experiences – notably experiences in back‐of‐house animal holding areas and with animal staff – are key. These findings suggest that further investigation into the impact of working in such learning settings could be fruitful in understanding the role that the work place plays in supporting the free‐choice learning of staff. This is important both from the perspective of the staff themselves, and in relation to the impact that these individuals may have on visitors to free‐choice learning settings.     

Causal Connections Between Mathematical Language and Mathematical Knowledge: A Dialogic Reading Intervention

The acquisition of early mathematical knowledge is critical for successful long-term academic development. Mathematical language is one of the strongest predictors of children's early mathematical success. Findings from previous studies have provided correlational evidence supporting the importance of mathematical language to the development of children's mathematics skills, but there is limited causal evidence supporting this link. To address this research gap, 47 Head Start children were randomly assigned to a mathematical language intervention group or a business-as-usual group. Over the course of eight weeks, interventionists implemented a dialogic reading intervention focused on quantitative and spatial mathematical language. At posttest, students in the intervention group significantly outperformed the students in the comparison group not only on a mathematical language assessment, but on a mathematical knowledge assessment as well. These findings indicate that increasing children's exposure to mathematical language can positively affect their general mathematics skills. This study is an important first step in providing causal evidence of the importance of early mathematical language for children's general mathematical knowledge and the potential for mathematical language interventions to increase children's overall mathematics abilities.     

The use of engineering design scenarios to assess student knowledge of global,societal, economic,and environmental contexts

Product archaeology as an educational approach asks engineering students to consider and explore the broader societal and global impacts of a product's manufacturing, distribution, use, and disposal on people, economics, and the environment. This study examined the impact of product archaeology in a project-based engineering design course on student attitudes and perceptions about engineering and abilities to extend and refine knowledge about broader contexts. Two design scenarios were created: one related to dental hygiene and one related to vaccination delivery. Design scenarios were used to (1) assess knowledge of broader contexts, and (2) test variability of student responses across different contextual situations. Results from pre- to post-surveying revealed improved student perceptions of knowledge of broader contexts. Significant differences were observed between the two design scenarios. The findings support the assumption that different design scenarios elicit consideration of different contexts and design scenarios can be constructed to target specific contextual considerations.     

Restorying as political action: authoring resistance through youth media arts

ABSTRACT

This article explores the lived realities for young people growing up and learning in a climate of racial discrimination, religious intolerance, misogyny, and xenophobia, and how school-sponsored and school-supported uses of digital media can afford young people opportunities to navigate their experiences of social injustice and resist exclusionary discourses and practices. In a collaborative inquiry into the practices of two youth media producers, we explore how these counternarrative efforts are forms of restorying, in which young people write themselves into existence in ways that can reconfigure school spaces. Framed in Black feminist and critical cosmopolitan perspectives, this article considers how young people use new media tools in school to engage the narrative imagination and build the worlds they want to live in, simultaneously representing the political histories and realities of their everyday worlds and imagining alternative futures. We explore the ways schools can create opportunities for youth to engage in these new media practices that re-author themselves and the institutional spaces they encounter – and how these opportunities are situated within broader intersectional forms of systemic inequity and oppression.     

“I'm just not that great at science”: Science self-efficacy in arts and communication students

Research in science education confirms the importance of self-efficacy in students' persistence and success in the sciences. The current study examined the role of science self-efficacy in nonspecialist, arts and communication-oriented students encountering science in a general education context. Participants (N = 275) completed a beginning- and end-of-semester survey including a Science Self-Efficacy Scale, a “connection to science” measure—the Inclusion of Science in Self Scale—and a Science Anxiety Scale. Participants also responded to two open-ended “sources of science efficacy” questions, and provided background/demographic information and access to their academic records. Results showed a significant increase in science self-efficacy and connection to science—although no change in science anxiety—over the course of the semester. The observed shift in self-efficacy for minority and international students was of particular note. These students started the course with lower confidence but, by the end of the semester, reported comparable science self-efficacy, and achieved similar grades to their White/Non-Hispanic and US resident classmates. Contrary to expectations, science self-efficacy did not predict performance in the class. However, students' self-reported sources of efficacy indicated increased confidence in using science in daily life, and confirmed the value of mastery experiences and of personally meaningful, student-centered course design in scaffolding student confidence. Results are discussed in terms of the individual and instructional factors that support science self-efficacy and student success in this unique, general education science environment.     

Increasing tootling: The effects of a peer‐monitored group contingency program on students' reports of peers' prosocial behaviors

In most educational ecologies, attention and consequences are focused on inappropriate behavior. Often students observe and report peers' antisocial behavior (i.e., tattle) and teachers investigate and consequent (i.e., punish) those behaviors. In the current study, a withdrawal design was used to investigate a corollary system. Fourth‐grade students were trained to observe and report peers' prosocial behaviors (i.e., tootle), and interdependent group contingencies and public posting were used to reinforce those reports. Although the first intervention phase showed much variability, subsequent phases showed that an intervention composed of public posting and interdependent group contingencies increased prosocial behavior reports. Results are discussed in terms of using this system to increase student and teacher awareness of and reinforcement for incidental prosocial behaviors. © 2000 John Wiley & Sons, Inc.