Evaluating the Consistency of Test Content Across Two Successive Administrations of a State-Mandated Science Assessment

Educational tests used for accountability purposes must represent the content domains they purport to measure. When such tests are used to monitor progress over time, the consistency of the test content across years is important for ensuring that observed changes in test scores are due to student achievement rather than to changes in what the test is measuring. In this study, expert science teachers evaluated the content and cognitive characteristics of the items from 2 consecutive annual administrations of a 10th-grade science assessment. The results indicated the content area representation was fairly consistent across years and the proportion of items measuring the different cognitive skill areas was also consistent. However, the experts identified important cognitive distinctions among the test items that were not captured in the test specifications. The implications of this research for the design of science assessments and for appraising the content validity of state-mandated assessments are discussed.     

Whole school support for vulnerable children: the evaluation of a part‐time nurture group

The positive impact that nurture groups can offer is well documented. This study aims to describe the evaluation of a nurture group intervention across six schools. In contrast to previous research, children accessed the group for a maximum of four mornings per week. The findings show that this model did not comprise the gains reported in previous studies. The results show a significant positive effect on the children with reference to their behaviour both in school and at home. In addition, the intervention appears to have contributed further to the whole school system. Schools reported an improved ethos and an increased capacity to support children with social and emotional difficulties. This paper concludes by considering the new Scottish Curriculum guidelines A curriculum for excellence and whether the principles and theoretical underpinnings of nurture groups can be fully integrated into a mainstream environment.     

The Role of Scientist Mentors on Teachers’ Perceptions of the Community of Science During a Summer Research Experience

This study focuses on the mentor relationships between science teachers and their scientist mentors in a summer Research Experience for Teachers program at a United States national laboratory facility. Using mixed methods, the authors surveyed and interviewed (semi-structured) the eleven participating teachers before and after the program. The authors also observed the teachers with their mentors each week. During these observations, three different types of mentoring relationships were observed. The authors highlight these through case studies of three teachers, each of whom experienced one of the three relationships. These case studies include their pre and post survey and interview data as well as classroom observations following the program. The results show that the mentoring relationship positively influences teachers?? views of scientific inquiry. The participating teachers felt a sense of membership in the science community as a result of the mentoring they received from their scientists and/or other members of their research group (i.e. graduate students, post doctorates). The three cases demonstrate that teachers felt a higher sense of ownership when they were ??discovering?? information that was new to their scientist or ??translating?? their work. All three types of mentoring relationships improved teachers?? understanding of scientific inquiry, which can translate into the classroom.     

Librarian integration in a four-year medical school curriculum: a timeline

The Taubman Health Sciences Library (THL) is integrated in all four years of the University of Michigan Medical School (UMMS) curriculum. Information resources are introduced at strategic points throughout the curriculum so that students receive training at times when they are most likely to need the resource. Most of the core instruction sessions are taught in teams that consist of librarians and UMMS faculty, which provides unique learning opportunities for students. This article describes each THL instruction activity in the four-year undergraduate UMMS curriculum and provides commentary on the overall effectiveness of this integrated approach to instruction.     

TAKING A “SIMPLE VIEW” OF THE DYNAMIC INDICATORS OF BASIC EARLY LITERACY SKILLS AS A PREDICTOR OF MULTIPLE MEASURES OF THIRD‐GRADE READING COMPREHENSION

The purpose of this study was to examine the validity evidence of first‐grade Dynamic Indicators of Basic Early Literacy Skills (DIBELS) scores for predicting third‐grade reading comprehension scores. We used the “simple view” of reading as the theoretical foundation for examining the extent to which DIBELS subtest scores predict comprehension through both word recognition and language comprehension. Scores from the DIBELS Oral Reading Fluency (ORF) subtest, a measure of word recognition speed and accuracy, strongly and significantly predicted multiple measures of reading comprehension. No other DIBELS subtest score explained additional variance beyond DIBELS ORF. Although experimental DIBELS Word Use Fluency (WUF) was significantly correlated with a language comprehension measure and measures of reading comprehension, WUF scores did not predict reading comprehension beyond ORF scores. Alternatively, first‐grade Peabody Picture Vocabulary Test scores did predict additional, significant variance in reading comprehension, beyond DIBELS ORF.     

Identifying Indicators of Behavior Change: Insights From Wildfire Education Programs

Environmental educators are challenged to document behavior changes, because change rarely depends solely on outcomes of education programs, but on many factors. An analysis of 15 communities in the United States that have increased their preparedness for wildfire allowed us to explore how education programs encouraged individual and community change. Agency-sponsored adult educational programs helped communities change their philosophy about firefighting, pass ordinances that restrict individual property rights, and empower residents to reduce their wildfire risk. This article explores several outcomes of these programs and offers suggested indicators of change that might be useful for education program evaluation.     

Diversity and Power in Public Speaking Textbooks

The frequency of gender and ethnic groups in positions of power represented in photographs in the top 10 public speaking textbooks were investigated. Men are pictured in power positions more often than are women. In photos displaying multiple ethnicities, with or without Caucasians, people of other ethnicities were more likely to be shown in positions of power than were Caucasians. This discrepant finding is particularly interesting in light of the consistent finding on gender.     

Working Through Political Entertainment: How Negative Emotion and Narrative Engagement Encourage Political Discussion Intent in Young Americans

This study examines how a political entertainment film (Man of the Year) can impact an individual's political discussion intent after the same political topic is made salient in a subsequent news story. In addition, a process of communication influence is assessed when the roles of negative emotion and narrative engagement are considered as potential mediators of the relationship between political entertainment film viewing and political discussion intent. Seven hypotheses serve as the foundation for this experimental study, and structural equation modeling was used to test these hypotheses. Results reveal there was no direct influence of political entertainment film viewing on political discussion intent, but there was an indirect effect through negative emotion. Furthermore, narrative engagement emerged as a predictor of political discussion intent and a mediator of the association between negative emotion and political discussion intent.     

Measuring Teacher Attitudes Toward Instructional Technology: A Confirmatory Factor Analysis of the TAC and TAT

In this article the authors present a confirmatory factor analysis of the Teachers’ Attitudes Toward Computers (TAC) and the Teachers’ Attitudes Toward Information Technology (TAT) scales by Christensen and Knezek (1996, 1998) using large samples from three states. The TAC was reduced from 98 items and nine factors to 35 items and eight factors, while maintaining superior psychometric properties. The TAT was reduced from 50 items and five factors to 20 items measuring five factors, similarly maintaining excellent psychometric properties. The authors also developed a combined short form of both instruments using 42 items to measure 11 factors for use in situations where parsimony is critical.