On the evaluation of systemic science education reform: Searching for instructional sensitivity

We propose a multilevel‐multifaceted approach to evaluating the impact of education reform on student achievement that would be sensitive to context and small treatment effects. The approach uses different assessments based on their proximity to the enacted curriculum. Immediate assessments are artifacts (students' products) from the enactment of the curriculum; close assessments parallel the content and activities of the unit/curriculum; proximal assessments tap knowledge and skills relevant to the curriculum, but topics can be different; and distal assessments reflect state/national standards in a particular knowledge domain. To provide evidence about the sensitivity of the multilevel approach in ascertaining outcomes of hands‐on science programs we administered close, proximal, and distal performance assessments to evaluate the impact of instruction based on two Full Option Science System units—Variables, and Mixtures and Solutions—in a Bay Area school district. Results indicated that close assessments were more sensitive to the changes in students' pre‐ to post‐test performance than proximal assessments. © 2002 Wiley Periodicals, Inc. J Res Sci Teach 39: 369–393, 2002     

Observations on the temporal correlates of reading failure

The definitions of developmental dyslexia andtemporal processing are discussed and severalconstruals of what a temporal processingdeficit might entail are illustrated. Then,using a framework developed by Farmer & Klein(1995), the proposal that a temporal processingdeficit (in vision, audition, or both) might bethe root cause of some proportion of cases ofdevelopmental dyslexia is introduced andvarious research strategies for testing thisproposal are identified. The symposium paperswhich address this general question using arange of these strategies are then criticallyreviewed. It is noted that whereas reading isa recent artifact not yet subject to any directselection pressure, its normal performancerequires the use of, and connections between,the highly evolved modules for visual patternrecognition and language. Within vision andlanguage redundant coding, which permitsperformance in the face of injuries anddegraded input, also makes it difficult todetect subtle deficits (whether temporal, ornot) unless precise tests are used. Yet suchdeficits may degrade performance on tasks (suchas reading) which require the non-copiousconnections between vision and language. Theefficacy of this pathway, I suggest, ismeasured by performance on the rapidautomatized naming (RAN) test.     

The influence of discussion groups in a case-based learning environment

The common practice of using discussion groups during case-based learning makes the role of discussion important in these learning environments. However, little empirical research has been done to investigate the influence of discussion on performance and motivation in case-based learning. The purpose of this article is to present the results of a study conducted to examine the role of discussion groups in a case-based environment. College students completed two cases either individually or in small discussion groups. Measures included two case analyses, an attitude survey, time on task, and document analysis. Results revealed significant performance and time differences between instructional methods on the first case, but not on the second case. In addition, results indicated significant differences in student attitudes between treatments. Overall, participants who worked in groups liked their method significantly better than those who worked alone, felt they learned more working in a group than they would have working alone, and expressed a preference for working in a group if they had to do the class over again. Implications for implementing case-based learning and future research are discussed. Anna E. Flynn is Vice President and NAPM Associate Professor with the National Association of Purchasing Management.     

Exploring Innovative Entrepreneurship and Its Ties to Higher Educational Experiences

The purpose of this paper was to explore innovative entrepreneurship and to gain insight into the educational practices and experiences that increase the likelihood that a student would graduate with innovative entrepreneurial intentions. To this end, we administered a battery of assessments to 3,700 undergraduate seniors who matriculated in the spring of 2007; these students attended one of five institutions participating in this study. Results showed that, after controlling for a host of personality, demographic, educational, and political covariates, taking an entrepreneurial course and the assessments faculty use as pedagogical strategies for teaching course content were significantly related to innovation intentions. Implications for higher education stakeholders are discussed.     

Education to Promote Positive Attitudes About Aging

ABSTRACT

This longitudinal study examined what a one-time intervention about aging does to the attitudes of high-school students toward aging. Early findings from the study support previous research that indicates ageist attitudes formed in early childhood become difficult to change as children reach adolescence. This research further supports the need for aging education to begin in early childhood.     

Response bias in follow-up studies of college students

The problems of response bias in longitudinal studies of college students are examined. An extensive follow-up questionnaire was sent to 1,253 college seniors who had participated in a similar survey as freshman four years earlier. Careful measure of student responsiveness in relation to various techniques designed to increase the proportion of responders (e.g., postcard, telephone contact) were kept.The less responsive groups were significantly different from their more responsive counterparts on nearly a dozen variables representing a wide variety of content areas, including academic achievement, self-concept, alcohol consumption, social deviance, and major choice preferences. Controlling for sex and socioeconomic status served to reduce, but not eliminate, these biases. Overall, the results indicate that researchers cannot account for follow-up nonresponse bias by making statistical adjustments according to data available at initial testing. The results are discussed in light of identifying the reasons for nonresponse, and attempting to develop categories of nonresponders who may be motivated to cooperate by different types of follow-up techniques.     

A meta‐analysis of school‐wide positive behavior support: An exploratory study using single‐case synthesis

Positive Behavior Support (PBS) for behavioral problems was included in the 1997 Individuals With Disabilities Education Act reauthorization, reflecting the increased implementation and strengthening empirical evidence for PBS in schools. Whereas PBS can be used reactively, its flexibility has led to a popular comprehensive school‐wide model used for prevention. School‐Wide Positive Behavioral Support (SWPBS) has been used across a variety of school environments and various demographics and has been evaluated using a variety of different outcome measures. The authors conducted a meta‐analysis of SWPBS research spanning 16 years and 20 articles. Specifically, single‐case studies were evaluated using a regression‐based procedure. Results show promising early trends in the data across dependent variables with a need for further research in specific areas. © 2011 Wiley Periodicals, Inc.