The contribution of TIMSS to the link between school and classroom factors and student achievement

Worldwide, the interest of policy-makers in participating in studies from the International Association for the Evaluation of Educational Achievement (IEA), such as Trends in International Mathematics and Science Study (TIMSS) has been growing rapidly over the past two decades. These studies offer the opportunity to relate the teaching and learning context to student achievement. This article presents the results of a systematic review of the research literature on TIMSS. Its main purpose is to find out to what extent TIMSS has contributed to insights into ‘what works in education and what does not’, particularly with regard to school and classroom factors. The review was guided by a generic framework developed within the tradition of educational effectiveness research. The review showed that: (a) since 2000, the number of publications which use TIMSS data for secondary analyses aimed at explaining differences in student achievement has increased strongly; (b) a number of studies, especially older ones, did not take account of the specific sample and test design of TIMSS; and (c) there are large differences between countries in school and classroom factors associated with student achievement. In the light of these results, we discuss the benefits and limitations of country and system comparisons.     

Examining the mediating effect of science self-efficacy on the relationship between metavariables and science achievement

Current studies reveal that meta-level variables are very important in learning; however, little research has been devoted to the role of metaconceptual and meta-affective variables on student achievement. With the aim of filling this gap in the literature, the present study investigated the relationship between metavariables (metaconceptual awareness, metaconceptual regulation, affective awareness, and affective regulation) and science achievement with the mediating effect of science self-efficacy through structural equation modeling. A total of 576 eighth grade students participated in the study. Results indicated that science self-efficacy partially mediated the relationship that metaconceptual regulation and affective regulation have with science achievement. In other words, students who monitor and evaluate their existing conceptions and follow, control, and adapt their emotions are likely to have high science self-efficacy and then high science achievement. In addition, metaconceptual awareness, metaconceptual regulation, and affective regulation positively predicted science self-efficacy, which was itself a positive predictor of science achievement. The findings imply that metavariables are essential components of science achievement via self-efficacy.     

Gender and high school chemistry: student perceptions on achievement in a selective setting

This paper reports on research undertaken in a middle-class Australian school. The focus of the research was on the relationship between gender and students’ engagement with high school chemistry. Achievement data from many OECD countries suggest that middle-class girls are achieving equally as well as, if not better than, boys in many subjects. This has led to claims that the ‘girls and science’ agenda is no longer necessary, and indeed may have been detrimental to boys’ achievements in science subjects. The data collected from students at this site indicate that at this school this agenda is far from a completed one. These data indicate that whilst girls’ achievement levels are comparable with those of the boys, for many students chemistry is still perceived as a masculine subject. Hence, the girls in the chemistry classrooms at this school construct themselves, and are constructed, as outsiders in the subject.     

Effect of project-based learning on high school students' state-mandated,standardized math and science exam performance

In a technologically driven society, math and science students in the United States are falling further and further behind their international counterparts, resulting in an influx of STEM focused, reformed K-12 schools, including schools focused on project-based learning (PBL). This article reports a study of the effectiveness of PBL on high school students' performance on state mandated standardized mathematics and science achievement measures. Manor New Tech High School is a nationally recognized model STEM school, with a diverse student population, where all instruction is delivered through PBL. Although there is ample research suggesting that PBL is advantageous for increasing STEM learning compared to conventional teaching approaches, there is a lack of studies randomly assigning students to receive PBL. Further, some of the effects observed for students attending project-based schools could be due to a self-selection bias for students or parents that choose such an alternative learning environment. This study addresses both of these concerns and found that students taught through PBL, as a group, matched performance of conventionally taught students on all science 11th grade and mathematics 9th, 10th, and 11th grade TAKS achievement measures and exceeded performance by a scale score increase of 133 for the 10th grade science TAKS measure by (B = 133.082, t = 3.102, p < .05). One possible explanation of the differences observed in this study could be the TAKS instrument used to capture student math and science achievement that interprets “real-life applications” of content differently between math and science questions. These results align with literature on the effects of PBL and deepen our understanding of these effects by providing a controlled study with random assignments to the PBL experience. Future research looking at the effect of PBL on achievement on the PISA could be beneficial in identifying benefits of PBL implementation in schools.     

Examining school leadership effects on student achievement: the role of contextual challenges and constraints

The present study examined indirect effects of principal leadership on the mathematics achievement of 254,475 15-year-old students from 10,313 schools in 32 OECD economies. Results showed that the students could be divided into three categories (Disadvantaged, Average, and Privileged) differing in levels of student SES and prior achievement, parental academic expectations, and access to school resources. Results also showed that principal leadership effects accounted for a greater proportion of between-school achievement variance for Disadvantaged vis-à-vis Privileged or Average students. In particular, instructional leadership had the largest positive effect on Disadvantaged vis-à-vis other students’ achievement via the mediating variables of teacher autonomy and morale. Distributed leadership negatively affected the achievement of Disadvantaged but not other students. The negative effects of principal goal-setting were the largest while those of principal problem-solving were the smallest for Disadvantaged students. The study contributes to the literature by examining contextual influences on the leadership–achievement relationship.     

Teaching science as a language: A “content‐first” approach to science teaching

Our research project was guided by the assumption that students who learn to understand phenomena in everyday terms prior to being taught scientific language will develop improved understanding of new concepts. We used web‐based software to teach students using a “content‐first” approach that allowed students to transition from everyday understanding of phenomena to the use of scientific language. This study involved 49 minority students who were randomly assigned into two groups for analysis: a treatment group (taught with everyday language prior to using scientific language) and a control group (taught with scientific language). Using a pre–post‐test control group design, we assessed students' conceptual and linguistic understanding of photosynthesis. The results of this study indicated that students taught with the “content‐first” approach developed significantly improved understanding when compared to students taught in traditional ways. © 2008 Wiley Periodicals, Inc. J Res Sci Teach 45: 529–553, 2008     

The association between principal leadership and student achievement: A multivariate meta-meta-analysis

A multivariate random-effects meta-meta-analysis was conducted to synthesize the association between principal leadership and student achievement. A total of 12 prior meta-analyses with 18 effect sizes were included in this meta-meta-analysis. The quantitative analysis showed that principal leadership has a statistically significant positive relationship with student achievement (Cohen's d = 0.34). The qualitative analyses revealed that: (a) with the accumulation of knowledge, there appears to have been a trend toward more consistent and precise estimates of principal leadership's effect on student achievement; (b) there was still not enough evidence to argue a specific leadership model or practice is more effective in improving student achievement than others; and (c) the educational contexts seem to moderate the effect of principal leadership. The significance and limitations of the current study, as well as the recommendations for future research, are discussed.     

Testing one premise of scientific inquiry in science classrooms: Examining students' scientific explanations and student learning

In this study, we analyzed the quality of students' written scientific explanations found in notebooks and explored the link between the quality of the explanations and students' learning. We propose an approach to systematically analyzing and scoring the quality of students' explanations based on three components: claim, evidence to support it, and a reasoning that justifies the link between the claim and the evidence. We collected students' science notebooks from eight science inquiry‐based middle‐school classrooms in five states. All classrooms implemented the same scientific‐inquiry based curriculum. The study focuses on one of the implemented investigations and the students' explanations that resulted from it. Nine students' notebooks were selected within each classroom. Therefore, a total of 72 students' notebooks were analyzed and scored using the proposed approach. Quality of students' explanations was linked with students' performance in different types of assessments administered as the end‐of‐unit test: multiple‐choice test, predict‐observe‐explain, performance assessment, and a short open‐ended question. Results indicated that: (a) Students' written explanations can be reliably scored with the proposed approach. (b) Constructing explanations were not widely implemented in the classrooms studied despite its significance in the context of inquiry‐based science instruction. (c) Overall, a low percentage of students (18%) provided explanations with the three expected components. The majority of the sample (40%) provided only claims without any supporting data or reasoning. And (d) the magnitude of the correlations between students' quality of explanations and their performance, were all positive but varied in magnitude according to the type of assessment. We concluded that engaging students in the construction of high quality explanations may be related to higher levels of student performance. The opportunities to construct explanations in science‐inquiry based classrooms, however, seem to be limited. © 2010 Wiley Periodicals, Inc. J Res Sci Teach 47: 583–608, 2010     

Undergraduate student perceptions of the use of ultrasonography in the study of “Living Anatomy”

Ultrasonography is a noninvasive imaging modality, and modern ultrasound machines are portable, inexpensive (relative to other imaging modalities), and user friendly. The aim of this study was to explore student perceptions of the use of ultrasound to teach “living anatomy”. A module utilizing transthoracic echocardiography was developed and presented to undergraduate medical, science, and dental students at a time they were learning cardiac anatomy as part of their curriculum. Relevant cardiac anatomy was explored on a student volunteer and images were projected in real‐time to all students via an AV projection system. Students were asked to complete a questionnaire about the learning experience and were given the opportunity to provide open feedback. The students' evaluations of this learning experience were very positive. They agreed or strongly agreed that it was an effective way to teach anatomy (90% medical; 77% dental; 100% science) and that it was incorporated in a way that promoted reinforcement of the lecture material (83% medical; 76% dental; 100% science). They agreed or strongly agreed with statements that the experience was innovative (93% medical; 92% dental; 100% science) and stimulated interest in the subject matter (86% medical; 75% dental; 96% science), and that they would like to see more modules, exploring other anatomical sites, incorporated into the curricula (83% medical; 72% dental; 100% science). We believe that ultrasound could be a useful tool, in conjunction with traditional teaching methods, to reinforce the learning of anatomy of a variety of different undergraduate student groups. Anat Sci Educ. © 2010 American Association of Anatomists.     

Examining the effect of teachers' adaptations of a middle school science inquiry‐oriented curriculum unit on student learning

Reform based curriculum offer a promising avenue to support greater student achievement in science. Yet teachers frequently adapt innovative curriculum when they use them in their own classrooms. In this study, we examine how 19 teachers adapted an inquiry‐oriented middle school science curriculum. Specifically, we investigate how teachers' curricular adaptations (amount of time, level of completion, and activity structures), teacher self‐efficacy (teacher comfort and student understanding), and teacher experience enacting the unit influenced student learning. Data sources included curriculum surveys, videotape observations of focal teachers, and pre‐ and post‐tests from 1,234 students. Our analyses using hierarchical linear modeling found that 38% of the variance in student gain scores occurred between teachers. Two variables significantly predicted student learning: teacher experience and activity structure. Teachers who had previously taught the inquiry‐oriented curriculum had greater student gains. For activity structure, students who completed investigations themselves had greater learning gains compared to students in classrooms who observed their teacher completing the investigations as demonstrations. These findings suggest that it can take time for teachers to effectively use innovative science curriculum. Furthermore, this study provides evidence for the importance of having students actively engaging in inquiry investigations to develop understandings of key science concepts. © 2010 Wiley Periodicals, Inc., J Res Sci Teach 48: 149–169, 2011     

Examining the yields of growth feedback from science teachers and students' intrinsic valuing of science: Implications for student- and school-level science achievement

Students' science knowledge and skills are considered critical to growing the intellectual capital on which societies rely to innovate and prosper. However, recent research has documented notable declines in students' intrinsic valuing of science and science achievement in Australia and other western countries. As a result, there have been calls to investigate factors at both the student- and school-level that can improve intrinsic valuing of and achievement in science. Growth feedback from science teachers to students has been identified as one such factor. Growth feedback, which specifically targets individual student growth and improvement, is considered an effective form of teacher feedback. Because recent research has demonstrated the benefits of effective teacher feedback on intrinsic valuing of science and the positive link between intrinsic valuing of science and science achievement, the present investigation examined (at both the student- and school-level) the extent to which growth feedback in science predicts intrinsic valuing of science and the extent to which intrinsic valuing predicts science achievement and mediates the relationship between growth feedback and achievement. This study examined this hypothesized process with the 2015 Australian PISA sample (N = 14,530 students in N = 758 schools) via a multilevel structural equation model. Findings indicated that at both the student- and school-level, growth feedback significantly predicted intrinsic valuing, and intrinsic valuing significantly predicted achievement; growth feedback also had significant indirect effects of achievement via intrinsic valuing. Taken together, our findings indicate that there are personal and whole-school yields for science achievement from the experiences of growth feedback in and intrinsic valuing of science.     

The role of perceived classroom goal structures,self-efficacy,and engagement in student science achievement

Background: Numerous studies have been conducted to investigate the factors related to science achievement. In these studies, the classroom goal structure perceptions, engagement, and self-efficacy of the students have emerged as important factors to be examined in relation to students’ science achievement.

Purpose: This study examines the relationships between classroom goal structure perception variables (motivating tasks, autonomy support, and mastery evaluation), engagement (behavioral, emotional, cognitive, and agentic engagement), self-efficacy, and science achievement.

Sample: The study participants included 744 seventh-grade students from 9 public schools in two districts of Gaziantep in Turkey.

Design and methods: Data were collected through the administration of four instruments: Survey of Classroom Goals Structures, Engagement Questionnaire, Motivated Strategies for Learning Questionnaire, and Science Achievement Test. The obtained data were subjected to path analysis to test the proposed model.

Results: Students’ perceptions of classroom goal structures (i.e. motivating tasks, autonomy support, and mastery evaluation) were found to be significant predictors of their self-efficacy. Autonomy support was observed to be positively linked to all aspects of engagement, while motivating tasks were found to be related only to cognitive engagement. In addition, mastery evaluation was shown to be positively linked to engagement variables, except for cognitive engagement, and self-efficacy and engagement (i.e. behavioral, emotional, and cognitive engagement) were observed to be significant predictors of science achievement. Finally, results revealed reciprocal relations among engagement variables, except for agentic engagement.

Conclusions: Students who perceive mastery goal structures tend to show higher levels of engagement and self-efficacy in science classes. The study found that students who have high self-efficacy and who are behaviorally, emotionally, and cognitively engaged are more successful in science classes. Accordingly, it is recommended that science teachers utilize inquiry-based and hands-on science activities in science classes and focus on the personal improvement of the students. Furthermore, it is also recommended that they provide students with opportunities to make their own choices and decisions and to control their own actions in science classes.     

Progressive drawing: A novel “lid–opener” and “monotony–breaker”

An innovative strategy called “progressive drawing” was used at the beginning (lid‐opener) and later (monotony‐breaker) during gross anatomy lectures. Diagrams were drawn on the classroom blackboard with anatomic structures added one by one. Students identified and labeled the diagrams and predicted the next structures to be drawn. Students felt that the strategy helped to activate prior knowledge, created interest in the current lecture, and made lecture sessions more interactive. The strategy has appeal for visual, auditory, read/write, and kinesthetic learners. Anat Sci Educ, 2010. © 2010 American Association of Anatomists.