Examining the Big-Fish-Little-Pond Effect on Students' Self-Concept of Learning Science in Taiwan Based on the TIMSS Databases

The purpose of this study is to examine the relationship between student self-concept and achievement in science in Taiwan based on the big-fish-little-pond effect (BFLPE) model using the Trends in International Mathematics and Science Study (TIMSS) 2003 and 2007 databases. Hierarchical linear modeling was used to examine the effects of the student-level and school-level science achievement on student self-concept of learning science. The results indicated that student science achievement was positively associated with individual self-concept of learning science in both TIMSS 2003 and 2007. On the contrary, while school-average science achievement was negatively related to student self-concept in TIMSS 2003, it had no statistically significant relationship with student self-concept in TIMSS 2007. The findings of this study shed light on possible explanations for the existence of BFLPE and also lead to an international discussion on the generalization of BFLPE.     

Negative school factors and their influence on math and science achievement in TIMSS 2003

The aim of the present study was to conduct an analysis of TIMSS (Trends in International Mathematics and Science Study) 2003 database and to determine how negative school factors, such as aggression, are associated to the mathematical and science achievement of students. The analyses were conducted separately for national and international data. National analyses for Slovenia show significant associations between math and science achievement and the experience of aggressive behaviour. Students who experienced aggressive behaviour scored lower in math and science, both in the fourth and in the eighth grade. The results of the regression analysis show that negative factors, such as aggressive behaviour, are good predictors of educational achievement in Slovenia. International analyses for the selected countries (high‐ and low‐achieving countries from the whole TIMSS population) confirm that this type of finding is culturally impartial as well as valid for the level of achievement both in math and in science.     

Science self-beliefs and science achievement of adolescents in Gulf Cooperation Council countries

This study explored the predictive effects of science self-beliefs on science achievement for 24,680 13-year-old students from Gulf Cooperation Council member countries – Bahrain, Kuwait, Oman, Qatar, Saudi Arabia and the United Arab Emirates – who participated in the Trends in International Mathematics and Science Study (TIMSS) 2007. The performance of adolescent students in Qatar and Saudi Arabia on the TIMSS 2007 science assessment was significantly below the TIMSS scale average. Adolescent students’ science beliefs had both positive and negative predictive effects on science achievement across the Gulf Cooperation Council member countries.     

School Science Achievement in Japan and Singapore: A Tale of Two Cities

This paper compares and contrasts school science achievement between two top scoring nations, Japan and Singapore, on the Third International Mathematics and Science Study (TIMSS) assessments. The first part of the study is devoted to examining cross-national comparisons on selected background questions administered in the TIMSS survey, while the second part examines selected educational attributes and practices that might help explain their consistently high achievement in science. Attention to TIMSS data has chiefly focused on the achievement gap between US and other nations. This report moves beyond US deficit comparisons to examine results and programs of high achieving nations to better inform efforts to close the gaps.     

Can Computer Use Hurt Science Achievement? The USA Results from PISA

A surprising result of the Third International Mathematics and Science Study (TIMSS) is that computer use was negatively associated with high student achievement in some countries. More specifically, the students from all three countries who indicated that they use computers in the classroom most frequently were those with the lowest achievement on the TIMSS in 1995. For the purpose of this study, a similar comparison was made for 15-year-old U.S.A. students, based on the data from the Program for International Student Assessment (PISA). The results of this study show that it is not computer use itself that has a positive or negative effect on the science achievement of students, but the way in which computers are used. For example, after controlling for the student's socioeconomic status in the United States of America, the results indicated that the students who used computers frequently at home, including for the purpose of writing papers, tended to have higher science achievement. However, the results of this study also show that science achievement was negatively related to the use of certain types of educational software. This indicates a result similar to that found in the TIMSS data, which might reflect the fact that teachers assign the use of the computer and of educational software to the lower achieving students more frequently, so that these students can obtain more personal and direct feedback through educational software.     

Relationship between affect and achievement in science and mathematics in Malaysia and Singapore

Background : The Trends in International Mathematics and Science Study (TIMSS) assesses the quality of the teaching and learning of science and mathematics among Grades 4 and 8 students across participating countries.

Purpose : This study explored the relationship between positive affect towards science and mathematics and achievement in science and mathematics among Malaysian and Singaporean Grade 8 students.

Sample : In total, 4466 Malaysia students and 4599 Singaporean students from Grade 8 who participated in TIMSS 2007 were involved in this study.

Design and method : Students’ achievement scores on eight items in the survey instrument that were reported in TIMSS 2007 were used as the dependent variable in the analysis. Students’ scores on four items in the TIMSS 2007 survey instrument pertaining to students’ affect towards science and mathematics together with students’ gender, language spoken at home and parental education were used as the independent variables.

Results : Positive affect towards science and mathematics indicated statistically significant predictive effects on achievement in the two subjects for both Malaysian and Singaporean Grade 8 students. There were statistically significant predictive effects on mathematics achievement for the students’ gender, language spoken at home and parental education for both Malaysian and Singaporean students, with R ² = 0.18 and 0.21, respectively. However, only parental education showed statistically significant predictive effects on science achievement for both countries. For Singapore, language spoken at home also demonstrated statistically significant predictive effects on science achievement, whereas gender did not. For Malaysia, neither gender nor language spoken at home had statistically significant predictive effects on science achievement.

Conclusions : It is important for educators to consider implementing self-concept enhancement intervention programmes by incorporating ‘affect’ components of academic self-concept in order to develop students’ talents and promote academic excellence in science and mathematics.     

The Relationship between Students' Achievement and their Self-perception of Competence and Rigour of Mathematics and Science: A cross-national analysis

This study applies theory linking students' self-perceived competence with academic achievement, using data from the Third International Mathematics and Science Study (TIMSS). Within-country data generally show a positive relationship between student achievement and self-perceived competence in mathematics and science. However, when one examines this relationship between countries, the opposite relationship occurs, i.e. countries with higher student self-evaluations usually performed poorly on the TIMSS tests and vice versa. Similarly, countries with a high proportion of students perceiving the subjects as being easy performed poorly on the TIMSS tests and vice versa. This pattern exists for both mathematics and science at grades 3, 4, 7 and 8. The authors suggest that this pattern may reflect low academic expectations and standards in low performing countries and high academic expectations and standards in high performing countries.     

USING INTERNATIONAL STUDY SERIES AND META-ANALYTIC RESEARCH SYNTHESES TO SCOPE PEDAGOGICAL DEVELOPMENT AIMED AT IMPROVING STUDENT ATTITUDE AND ACHIEVEMENT IN SCHOOL MATHEMATICS AND SCIENCE

Taking lower-secondary schooling within the English educational system as an example, this paper illustrates the contribution of two bodies of international scholarship to the scoping of research-based pedagogical development aimed at improving student attitude and achievement in science and mathematics. After sketching the English context of systemic reform, the paper uses findings from the Trends in International Mathematics and Science Study (TIMSS) series to illuminate changes in performance, analysed within a framework of cross-system and between-subject comparison. Contrary to the optimistic picture from national assessment, the TIMSS findings suggest that systemic reform has produced fundamental gains only in student achievement in mathematics, and serious declines in student attitude towards both mathematics and science. Prompted by more favourable patterns elsewhere, the paper then triangulates the findings of recent meta-analytic research syntheses to identify promising lines of pedagogical development. Despite important differences in the conceptual frameworks and analytic methods of these syntheses, reasonably robust conclusions can be drawn about the effectiveness of four teaching components: domain-specific inquiry for student achievement in both subjects, student attitude in science, and learning processes in mathematics; cooperative group work for learning and attitude in science; contextual orientation for achievement in science; and active teaching for achievement in mathematics. Equally, discrepancies between findings or insufficiencies of evidence highlight a number of impacts particularly deserving deeper analysis or further investigation: cooperative group work on achievement outcomes, differing forms of learning assessment on both attitude and achievement outcomes, contextual orientation on outcomes in mathematics, and active teaching on outcomes in science.     

International assessment: A Rasch model and teachers' evaluation of TIMSS science achievement items

The Trends in International Mathematics and Science Study (TIMSS) is a comparative assessment of the achievement of students in many countries. In the present study, a rigorous independent evaluation was conducted of a representative sample of TIMSS science test items because item quality influences the validity of the scores used to inform educational policy in those countries. The items had been administered internationally to 16,009 students in their eighth year of formal schooling. The evaluation had three components. First, the Rasch model, which emphasizes high quality items, was used to evaluate the items psychometrically. Second, readability and vocabulary analyses were used to evaluate the wording of the items to ensure they were comprehensible to the students. And third, item development guidelines were used by a focus group of science teachers to evaluate the items in light of the TIMSS assessment framework, which specified the format, content, and cognitive domains of the items. The evaluation components indicated that the majority of the items were of high quality, thereby contributing to the validity of TIMSS scores. These items had good psychometric characteristics, readability, vocabulary, and compliance with the assessment framework. Overall, the items tended to be difficult: constructed response items assessing reasoning or application were the most difficult, and multiple choice items assessing knowledge or application were less difficult. The teachers revised some of the sampled items to improve their clarity of content, conciseness of wording, and fit with format specifications. For TIMSS, the findings imply that some of the non‐sampled items may need revision, too. For researchers and teachers, the findings imply that the TIMSS science items and the Rasch model are valuable resources for assessing the achievement of students. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 1321–1344, 2012     

The contribution of TIMSS to the link between school and classroom factors and student achievement

Worldwide, the interest of policy-makers in participating in studies from the International Association for the Evaluation of Educational Achievement (IEA), such as Trends in International Mathematics and Science Study (TIMSS) has been growing rapidly over the past two decades. These studies offer the opportunity to relate the teaching and learning context to student achievement. This article presents the results of a systematic review of the research literature on TIMSS. Its main purpose is to find out to what extent TIMSS has contributed to insights into ‘what works in education and what does not’, particularly with regard to school and classroom factors. The review was guided by a generic framework developed within the tradition of educational effectiveness research. The review showed that: (a) since 2000, the number of publications which use TIMSS data for secondary analyses aimed at explaining differences in student achievement has increased strongly; (b) a number of studies, especially older ones, did not take account of the specific sample and test design of TIMSS; and (c) there are large differences between countries in school and classroom factors associated with student achievement. In the light of these results, we discuss the benefits and limitations of country and system comparisons.     

Students’ motivational beliefs in science learning,school motivational contexts,and science achievement in Taiwan

ABSTRACT

Taiwanese students are featured as having high academic achievement but low motivational beliefs according to the serial results of the Trends in Mathematics and Science Study (TIMSS). Moreover, given that the role of context has become more important in the development of academic motivation theory, this study aimed to examine the relationship between motivational beliefs and science achievement at both the student and school levels. Based on the Expectancy-Value Theory, the three motivational beliefs, namely self-concept, intrinsic value, and utility value, were the focuses of this study. The two-level hierarchical linear model was used to analyse the Taiwanese TIMSS 2011 eighth-grade student data. The results indicated that each motivational belief had a positive predictive effect on science achievement. Additionally, a positive school contextual effect of self-concept on science achievement was identified. Furthermore, school-mean utility value had a negative moderating effect on the relationship between utility value and science achievement. In conclusion, this study sheds light on the functioning of motivational beliefs in science learning among Taiwanese adolescents with consideration of the school motivational contexts.     

An instructional intervention's impact on the science and literacy achievement of culturally and linguistically diverse elementary students

This research examined the impact of the first‐year implementation of an instructional intervention to promote achievement and equity in science and literacy for culturally and linguistically diverse elementary students. The research addressed three areas: (a) overall science and literacy achievement, (b) achievement gaps among demographic subgroups, and (c) comparison with national (NAEP) and international (TIMSS) samples of students. The research involved 1,523 third‐ and fourth‐grade students at six elementary schools in a large urban school district. Significance tests of mean scores between pre‐ and posttests indicate statistically significant increases on all measures of science and literacy at both grade levels. While achievement gaps widened with third graders on some of the measures, the gaps tended to narrow with fourth graders. The results based on item‐by‐item comparisons with NAEP TIMSS samples of students indicated overall positive performance of the students in the research at the end of the school year. © 2005 Wiley Periodicals, Inc. J Res Sci Teach 42: 857–887, 2005     

Science achievement, gender differences, and experimental work in classes in Slovenia as evident in TIMSS studies

Since 1999, Slovenia has been in the process of introducing nine years of compulsory education to replace the previous eight-year system of compulsory education. Under the new system, the school entry age is six years rather than the former seven years. This reform of the system necessitated a number of other changes, such as those relating to the curriculum and teaching approaches. The purpose of this study was to compare the “new” Slovenian science curriculum with the “old” to ascertain if different relationships exist between the two in terms of achievement and gender, attitudes toward science, and the amount of experimental work undertaken by students in school. Data from the IEA TIMSS 2003 study were used to analyze these relationships. The analyses employed basic statistics and log-linear modeling of the effects of gender, school system, amount of experimental work in school, and students’ science achievement. Compared to students taught under the old curriculum, students taught under the new curriculum performed slightly better on the overall science test. A large decrease in gender differences in achievement was also apparent. The relationship between experimental work and achievement strengthened. Conducting experiments at every lesson related to lower student achievement, while conducting experiments during half of the science lessons related to higher achievement. These findings have a clear message for teachers and policymakers. A moderate amount of time devoted to student experimental work seems to raise science achievement of students as well as promote more positive attitudes toward learning science.     

Differences between multiple choice items and constructed response items in the IEA timss surveys

In international large-scale surveys, constructed response (CR) items are increasingly being used and multiple-choice (MC) items are being used less frequently. In this article the two item types will be compared in terms of any differences they have on national mean scores. TIMSS 1995 and TIMSS 1999 data have been used. Are there different effects of the question types for mathematics and science? Does the introduction of open-ended items into the math and science tests affect the math and science achievement results?     

Multilevel Effects of Student and Classroom Factors on Elementary Science Achievement in Five Countries

This study examined the effects of individual student factors and classroom factors on elementary science achievement within and across five countries. The student‐level factors included gender, self‐confidence in science and home resources. The classroom‐level factors included teacher characteristics, instructional variables and classroom composition. Results for the USA and four other countries, Singapore, Japan, Australia and Scotland, were reported. Multilevel effects were examined through Hierarchical Linear Modelling, using the Trends in International Mathematics and Science Study 2003 fourth grade dataset. Overall, the results showed that selected student background characteristics were consistently related to elementary science achievement in countries investigated. At the student level, higher levels of home resources and self‐confidence and at the classroom level, higher levels of class mean home resources yielded higher science scores on the TIMSS 2003. In general, teacher and instructional variables were minimally related to science achievement. There was evidence of positive effects of teacher support in the USA and Singapore. The emphasis on science inquiry was positively related to science achievement in Singapore and negatively related in the USA and Australia. Recommendations for practice and policy were discussed.     

A Cross-grade Comparison to Examine the Context Effect on the Relationships Among Family Resources,School Climate,Learning Participation,Science Attitude,and Science Achievement Based on TIMSS 2003 in Taiwan

This study aimed to examine whether the relationships among family resources, school climate, learning participation, science attitude, and science achievement are different between primary school students and junior high school students within one educational system. The subjects included 4,181 Grade 4 students and 5,074 Grade 8 students who participated in TIMSS 2003 in Taiwan. Using structural equation modeling, the results showed that family resources had significant positive effects for both groups of learners. Furthermore, a context effect for the structural relationship between school climate, learning participation, and science achievement was revealed. In the primary school context, Grade 4 students who perceived positive school climate participated in school activities more actively, and had better science performance. However, in the secondary school context, learning participation had a negative impact and led to lower science achievement. The implications about this result in relation to the characteristics of the two educational contexts in Taiwan were further discussed.     

The effect of teacher–student gender matching: Evidence from OECD countries

While some educators argue that teacher–student gender matching improves student performance, there is little empirical evidence to support this hypothesis. This paper assesses the impact of teacher–student gender matching on academic achievement across fifteen OECD countries using data from the Trends in International Mathematics and Science Study (TIMSS). One attractive feature of TIMSS is that it provides information on test scores and teacher characteristics, including gender, for both math and science thereby allowing for student fixed effects estimation. The results provide little support for the conjecture that students benefit from teacher–student gender matching.     

The quality of secondary education in the Middle East and North Africa: what can we learn from TIMSS’ results?

Research on educational quality has been scarce in the Middle East and North Africa (MENA) region, whereas the debates over educational quality date from 1966 in the USA with the Coleman Report. Fortunately TIMSS (Trends in International Mathematics and Science Study) starts to fill this gap by providing data on students’ achievement and for many MENA countries this is the first time that such data are available. The paper gives an overview of the quality of education in MENA using TIMSS’ 2007 data. The research questions addressed here are why is achievement low? And why is the gap between the top‐performing countries and MENA countries large? In order to answer these questions, the paper focuses on several aspects: the first is the inefficiency of acquiring the language, the second is the inefficiency of time devoted to homework, the third is the meagre intended curriculum which is translated into a weaker implemented curriculum, the fourth aspect deals with the inefficiency of public resources devoted to the education sector. Finally, the paper highlights two other factors believed to affect students’ achievement: family background and students’ attitudes towards mathematics and science.     

Trends in gender differences in mathematics and science (TIMSS 1995–2003)

This article investigates changes in gender differences evident in the performance of grade 8th grade students participating in the Trends in International Mathematics and Science Study (TIMSS) between 1995 and 2003. Gender specific results and patterns found in TIMSS 1995 were compared with later cycles of the study in order to address the question of how far the mathematics and science gender gap has narrowed over time. Using a regression approach to compare the trend data, the findings indicated no major changes for mathematics but it appears that the gap in science may be closing, especially in the previously male dominated content areas of chemistry and physics.