The consequences of “school improvement”: Examining the association between two standardized assessments measuring school improvement and student science achievement

For more than half a century concerns about the ability of American students to compete in a global workplace focused policymakers' attention on improving school performance generally, and student achievement in science, technology, engineering, and mathematics (STEM) specifically. In its most recent form—No Child Left Behind—there is evidence this focus led to a repurposing of instructional time to dedicate more attention to tested subjects. While this meant a narrowing of the curriculum to focus on English and mathematics at the elementary level, the effects on high school curricula have been less clear and generally absent from the research literature. In this study, we sought to explore the relationship between school improvement efforts and student achievement in science and thus explore the intersection of school reform and STEM policies. We used school‐level data on state standardized test scores in English and math to identify schools as either improving or declining over three consecutive years. We then compared the science achievement of students from these schools as measured by the ACT Science exams. Our findings from three consecutive cohorts, including thousands of high school students who attended 12th grade in 2008, 2009, and 2010 indicate that students attending improving schools identified by state administered standardized tests generally performed no better on a widely administered college entrance exam with tests in science, math and English. In 2010, students from schools identified as improving in English scored nearly one‐half of a point lower than their peers from declining schools on both the ACT Science and Math exams. We discuss various interpretations and implications of these results and suggest areas for future research. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 804–830, 2012     

Investigating the quality of project-based science and technology learning environments in elementary school: a critical review of instruments

This paper provides a systematic review of instruments that have the potential to measure the quality of project-based science and technology (S&T) learning environments in elementary school. To this end, a comprehensive literature search was undertaken for the large field of S&T learning environments. We conducted a horizontal bottom-up analysis of the aspects measured by the retrieved instruments and their operationalisation. We distinguish 11 components. The most frequently evaluated components are prior knowledge and backgrounds, connection with reality, science as inquiry and level of initiative and group work. Overall, the results suggest a considerable diversity in the operationalisation of the components found. Particularly, for connection with reality, science as inquiry and level of initiative and group work, this is related to (1) the object of measurement (e.g. variety in aspects evaluated) and (2) the extent to which the used concepts are clarified. Consequently, some scales, items and questions were found to be a closer fit with aspects of project-based learning environments than others. Additionally, most of the retrieved instruments cover science and not technology or project-based education. This review can be used when searching for a scale, item or question to measure particular aspects of S&T learning environments.     

The effect of authentic project-based learning on attitudes and career aspirations in STEM

Can engaging college students in client-centered projects in science, technology, engineering, and mathematics (STEM) coursework increase interest in STEM professions? The current study explored the effectiveness of project-based learning (PjBL) courses on student attitudes, major choice, and career aspirations in STEM. Framed in expectancy-value and social cognitive career choice models, we examined the effect of engaging in at least one authentic, project-based course during the first four semesters of college on student STEM attitudes and career aspirations in a quasi-experimental study with a sample of (N = 492) natural science and engineering students. STEM self-efficacy and subjective task value variables (STEM attainment, intrinsic and utility value of STEM courses, and relative cost associated with engaging in STEM courses) were examined as mediators of the relationship between classroom project-based experiences and STEM career aspirations. Gender and underrepresented minority status were also examined. We found that engaging in at least one project-based course during the first four semesters affected student perceptions of STEM skills, perceptions of the utility value of participating in STEM courses, and STEM career aspirations. Furthermore, we found that the effect of project-based courses on STEM career aspirations was mediated by STEM skills and perceptions of course utility. The effect of PjBL was not moderated by race or gender. We highlight areas of future research and the promise of PjBL for engaging students in STEM professions.     

Negative school factors and their influence on math and science achievement in TIMSS 2003

The aim of the present study was to conduct an analysis of TIMSS (Trends in International Mathematics and Science Study) 2003 database and to determine how negative school factors, such as aggression, are associated to the mathematical and science achievement of students. The analyses were conducted separately for national and international data. National analyses for Slovenia show significant associations between math and science achievement and the experience of aggressive behaviour. Students who experienced aggressive behaviour scored lower in math and science, both in the fourth and in the eighth grade. The results of the regression analysis show that negative factors, such as aggressive behaviour, are good predictors of educational achievement in Slovenia. International analyses for the selected countries (high‐ and low‐achieving countries from the whole TIMSS population) confirm that this type of finding is culturally impartial as well as valid for the level of achievement both in math and in science.     

The impact of scienceware and foundations on students' attitudes towards science and science classes

In this paper, we describe changes in students' ideas about science classes, attitudes about science, and motivations for studying science, in a classroom designed to support projectbased science learing. Using a survey designed to provide a measure of students' attitudes towards science classes and science, we have compared students enrolled in a traditional high school biology course, with students enrolled in an integrated, project-based science course called Foundations I. Survey responses were analyzed to look at differences between and within two groups of students over the course of one school year. In general, the results of this study suggest that providing students with opportunities to collect and analyze their own data in science classes results in a change in students' ideas about science classrooms. Foundations I students' increased tendency to agree with statements about using information, drawing conclusions, and thinking about problems, implies a change in their understanding of what it means to do science in school. These students, in contrast to students in the traditional Biology course, no longer describe their science experience as one of memorization, textbook reading, and test taking. Instead they see science class as a place in which they can collect data, draw conclusions, and formulate and solve problems.     

初中生科学史学习状况的调查与分析

对重庆市初中生的科学史学习现状开展了调查。调查表明,初中生对科学史学习持认同态度,但对科学史学习缺少主动意识;科学家的生平轶事是学生最感兴趣的内容;学生认为学习科学史最主要的作用是提高其学习兴趣;升学的压力和教师对科学史教学的重视程度是影响学生学习科学史的主要因素。提出了教师应充分挖掘科学史的＂渗透＂因素、不断提高自身科学史素养,以及采取多种途径促进学生学习科学史等建议。     

Adolescents' motivation to select an academic science-related career: the role of school factors,individual interest,and science self-concept

Many researchers consider a lacking interest in science and the students' belief that science is too demanding as major reasons why young people do not strive for science-related careers. In this article, we first delineated a theoretical framework to investigate the importance of interest, self-concept, and school factors regarding students' career preferences. Then, we tested the expected effects on a sample of German 9th-grade students (N = 7,813). We focused on two school factors: the amount of (additional) science activities and the real-life applications in science classes. The multi-level analysis showed that school factors were highly relevant for the students' interest in science and science self-concept. In turn, interest in science and science self-concept affect the students' interest in science-related careers. We conclude that focusing on the link between individual and school characteristics is important for the understanding of students' interest in science-related careers.     

Testing one premise of scientific inquiry in science classrooms: Examining students' scientific explanations and student learning

In this study, we analyzed the quality of students' written scientific explanations found in notebooks and explored the link between the quality of the explanations and students' learning. We propose an approach to systematically analyzing and scoring the quality of students' explanations based on three components: claim, evidence to support it, and a reasoning that justifies the link between the claim and the evidence. We collected students' science notebooks from eight science inquiry‐based middle‐school classrooms in five states. All classrooms implemented the same scientific‐inquiry based curriculum. The study focuses on one of the implemented investigations and the students' explanations that resulted from it. Nine students' notebooks were selected within each classroom. Therefore, a total of 72 students' notebooks were analyzed and scored using the proposed approach. Quality of students' explanations was linked with students' performance in different types of assessments administered as the end‐of‐unit test: multiple‐choice test, predict‐observe‐explain, performance assessment, and a short open‐ended question. Results indicated that: (a) Students' written explanations can be reliably scored with the proposed approach. (b) Constructing explanations were not widely implemented in the classrooms studied despite its significance in the context of inquiry‐based science instruction. (c) Overall, a low percentage of students (18%) provided explanations with the three expected components. The majority of the sample (40%) provided only claims without any supporting data or reasoning. And (d) the magnitude of the correlations between students' quality of explanations and their performance, were all positive but varied in magnitude according to the type of assessment. We concluded that engaging students in the construction of high quality explanations may be related to higher levels of student performance. The opportunities to construct explanations in science‐inquiry based classrooms, however, seem to be limited. © 2010 Wiley Periodicals, Inc. J Res Sci Teach 47: 583–608, 2010     

初中生理科课程学习动机与学习策略的调查研究

采用问卷调查形式,研究了初中生学习理科课程的学习动机与学习策略的发展情况.经过标准比数据处理,结果发现初中生在理科课程学习中内、外动机是相互促进的,二者对学习策略的影响都很显著.学习理科课程时监控策略运用最多,而精加工策略运用水平不高,这可能与传统的教学方式有关.     

Leveraging the power of peer-led learning: investigating effects on STEM performance in urban high schools

The Peer Enabled Restructured Classroom (PERC) is an instructional innovation developed to address gaps in science, technology, engineering, and math (STEM) in urban high schools. The PERC model changes instruction from teacher led to peer led by bringing peer students into the classroom to lead small-group work. Our study sought to provide empirical evidence in support of the peer-led model as a means of improving STEM learning for tutored students in urban schools. We used propensity score matching to evaluate the innovation's impact on students’ achievement on standardized end-of-course tests in two 9th-grade courses – Integrated Algebra and Biology. Results suggest that by the 2nd year of implementation, enrolment in PERC Biology increased the likelihood of passing. Similar effects were not observed for PERC Integrated Algebra, but when comparing cohorts, we found that the 2nd year was twice as likely to pass as the 1st year. We discuss implications for programme improvement.     

Teaching and learning with ICT within the subject culture of secondary school science

This paper reports some of the findings from the science subject design initiative team in the ESRC Interactive Education Project at the University of Bristol. The subject culture of secondary school science, characterised by a content‐laden curriculum and assessment, but also with a tradition and requirement for practical work, is briefly described to give a picture of the environment in which the use of ICT was planned. Six science teachers, working in UK comprehensive schools, with between 2 and 18 years experience in the classroom planned subject design initiatives (SDI) in which practical work was simulated by software. Team discussions and individual interviews following the SDIs are summarised and early conclusions presented about the resulting shift in pedagogic approach and subject culture.     

Scientific epistemic beliefs, conceptions of learning science and self-efficacy of learning science among high school students

This study examined the relationships among Taiwanese high school students’ scientific epistemic beliefs, conceptions of learning science, and self-efficacy of learning science. The questionnaire responses gathered from 377 high school students in Taiwan were utilized to elicit such relationships. The analysis of the structural equation model revealed that students’ absolutist scientific epistemic beliefs led to lower-level conceptions of learning science (i.e. learning science as memorizing, preparing for tests, calculating, and practicing) while sophisticated scientific epistemic beliefs might trigger higher-level conceptions of learning science (i.e. learning science as increase of knowledge, applying, and attaining understanding). The students’ lower-level conceptions of learning science were also found to negatively associate with their self-efficacy of learning science, while the higher-level conceptions of learning science fostered students’ self-efficacy. However, this study found that students who viewed scientific knowledge as uncertain (advanced epistemic belief) tended to possess lower self-efficacy toward learning science.     

Trajectories of self-perceived math ability,utility value and interest across middle school as predictors of high school math performance

Although many studies have documented developmental change in mathematics motivation, little is known about how these trends predict math performance. A sample of 288 participants from the United States reported their perceived math ability, math utility value and math interest in 5th, 7th and 9th grades. Latent growth curve models estimated developmental trajectories in each of these constructs. Mathematics interest and utility value decreased across time, but there was no significant change in self-perceived math ability. Slopes and intercepts of all mathematics motivation variables correlated with one another. Even when controlling for prior mathematics performance, students who self-reported high math ability in 5th grade had higher standardised test scores than their peers in high school five years later. Neither math utility value nor math interest intercepts or slopes predicted later performance. Understanding the predictors of math performance is important for supporting students’ success in science, technology, engineering and mathematics careers.     

Gender ratios in high school science departments: The effect of percent female faculty on multiple dimensions of students' science identities

To examine how school characteristics are tied to science and engineering views and aspirations of students who are underrepresented in science and engineering fields, this mixed‐methods study explores relationships between aspects of students' science identities, and the representation of women among high school science teachers. Quantitative analyses tested the hypothesis that percent female faculty would have a positive effect on girls' science interests, and perceptions in particular, given the potentially greater availability of women role models. Findings indicate that percent female science faculty does not have an effect on a range of science measures for both male and female students, including the ways in which they understand scientific practice, their science self‐concept, and their interest in science‐related college majors. As qualitative data demonstrate, this could reflect practical constraints at schools where female faculty are concentrated and narrow perceptions of science teachers and “real” science. © 2007 Wiley Periodicals, Inc. J Res Sci Teach 44: 980–1009, 2007     

The contribution of TIMSS to the link between school and classroom factors and student achievement

Worldwide, the interest of policy-makers in participating in studies from the International Association for the Evaluation of Educational Achievement (IEA), such as Trends in International Mathematics and Science Study (TIMSS) has been growing rapidly over the past two decades. These studies offer the opportunity to relate the teaching and learning context to student achievement. This article presents the results of a systematic review of the research literature on TIMSS. Its main purpose is to find out to what extent TIMSS has contributed to insights into ‘what works in education and what does not’, particularly with regard to school and classroom factors. The review was guided by a generic framework developed within the tradition of educational effectiveness research. The review showed that: (a) since 2000, the number of publications which use TIMSS data for secondary analyses aimed at explaining differences in student achievement has increased strongly; (b) a number of studies, especially older ones, did not take account of the specific sample and test design of TIMSS; and (c) there are large differences between countries in school and classroom factors associated with student achievement. In the light of these results, we discuss the benefits and limitations of country and system comparisons.     

Gender and high school chemistry: student perceptions on achievement in a selective setting

This paper reports on research undertaken in a middle-class Australian school. The focus of the research was on the relationship between gender and students’ engagement with high school chemistry. Achievement data from many OECD countries suggest that middle-class girls are achieving equally as well as, if not better than, boys in many subjects. This has led to claims that the ‘girls and science’ agenda is no longer necessary, and indeed may have been detrimental to boys’ achievements in science subjects. The data collected from students at this site indicate that at this school this agenda is far from a completed one. These data indicate that whilst girls’ achievement levels are comparable with those of the boys, for many students chemistry is still perceived as a masculine subject. Hence, the girls in the chemistry classrooms at this school construct themselves, and are constructed, as outsiders in the subject.     

Effects of active‐learning experiences on achievement,attitudes, and behaviors in high school biology

Active‐learning labs for two topics in high school biology were developed through the collaboration of high school teachers and university faculty and staff and were administered to 408 high school students in six classrooms. The content of instruction and testing was guided by State of Texas science objectives. Detailed teacher records describing daily classroom activities were used to operationalize two types of instruction: active learning, which used the labs; and traditional, which used the teaching resources ordinarily available to the teacher. Teacher records indicated that they used less independent work and fewer worksheets, and more collaborative and lab‐based activities, with active‐learning labs compared to traditional instruction. In‐class test data show that students gained significantly more content knowledge and knowledge of process skills using the labs compared to traditional instruction. Questionnaire data revealed that students perceived greater learning gains after completing the labs compared to covering the same content through traditional methods. An independent questionnaire administered to a larger sample of teachers who used the lab‐based curriculum indicated that they perceived changing their behaviors as intended by the student‐centered principles of the labs. The major implication of this study is that active‐learning–based laboratory units designed and developed collaboratively by high school teachers and university faculty, and then used by high school teachers in their classrooms, can lead to increased use of student‐centered instructional practices as well as enhanced content knowledge and process learning for students. © 2007 Wiley Periodicals, Inc. J Res Sci Teach 44: 960–979, 2007     

Contextualizing instruction: Leveraging students' prior knowledge and experiences to foster understanding of middle school science

Contextualizing science instruction involves utilizing students' prior knowledge and everyday experiences as a catalyst for understanding challenging science concepts. This study of two middle school science classrooms examined how students utilized the contextualizing aspects of project‐based instruction and its relationship to their science learning. Observations of focus students' participation during instruction were described in terms of a contextualizing score for their use of the project features to support their learning. Pre/posttests were administered and students' final artifacts were collected and evaluated. The results of these assessments were compared with students' contextualizing scores, demonstrating a strong positive correlation between them. These findings provide evidence to support claims of contextualizing instruction as a means to facilitate student learning, and point toward future consideration of this instructional method in broader research studies and the design of science learning environments. © 2007 Wiley Periodicals, Inc. J Res Sci Teach 45: 79–100, 2008