区域教育质量评估学业工具的研发

学生学业测评是教育质量测评的重要组成部分。国内外学业质量测评以数学、科学、阅读为主要领域,强调对素养的考查,测评框架包括内容维度和认知过程,测试题目由客观题和主观题构成,并初步实现计算机化测试。区域学业质量测评工具的设计借鉴国际经验,从内容维度和认知过程考查学生的数学和阅读素养,测试题目覆盖所有的维度,实现了年度间结果的可比较。未来区域教育质量评估学业工具的研发,应与诊断性评价相结合,逐步采用计算机化测试,将信息技术运用于过程性学习和评价。     

义务教育阶段学生科学学业成就评价框架的初步开发

义务教育阶段科学学业成就监测是新课程改革的重大研究课题.它是客观公正地评价义务教育新课程科学教育改革的整体效果、科学全面地检测学生学习水平的重要工具,也是新课程科学教育改革课程决策的重要参考依据.全面深入地分析与借鉴PISA、TIMSS、NAEP等国际性学生评价项目,吸收认知目标分类理论、教育测量与评价理论的最新成果,厘清新课程科学学业成就监测的设计理念,梳理评价维度,整体设计评价框架,并初步开发试题编制模型与质量保证技术,能为新课程科学教育评价改革提供参考.     

TIMSS2011数学教育评价框架及运行研究

本专题报告通过研究TIMSS2011数学评价框架及其实测试题构成,比较历次TIMSS测试框架的变化以及测试结果的变化,对照TIMSS问卷调查(家庭环境、学校资源和风气、教师配备、课堂教学),深入分析影响学生数学学业成就的关键因素。借鉴TIMSS数学评价的研究成果,对探讨改进我国中小学数学教育评价提出思考和建议。     

TIMSS2007科学测评:框架、工具与启示

TIMSS2007科学测评基于各参与国家的科学课程制订了评价框架,并开发了标准化的科学测评工具.在剖析TIMSS2007科学测评的评价框架基础上,对测评工具的开发、设置和命题特点等进行分析,提出对我国基于新课程的学业成就评价改革的启示.     

TIMSS对小学生数学认知的评价研究

国际数学与科学教育趋势研究（TIMSS）注重对小学生数学认知的评价。TIMSS的数学认知评价框架分为“知道”“应用”和“推理”三级水平,并划分为较低、中等、较高和高级四个国际基准。TIMSS2019研究显示,小学生的数学认知存在不平衡性,即“知道”水平的优势小于“应用”与“推理”水平、“推理”水平表现略显不佳,且存在性别差异。我国内地学生虽没有参与TIMSS测试,但借助对其的研究,有助于引导我们加强对小学生数学认知的评价与研究,关注小学生高阶思维的评价和小学生数学问题解决全过程的评价。     

TIMSS 2011科学测评框架概况、变化及启示

TIMSS是由国际教育成就评价协会发起和组织的国际教育评价研究和评测活动。新公布的TIMSS 2011科学测评框架主要由内容维度、认知维度和科学探究维度三个部分组成,相对于TIMSS 2007科学测评框架,它有了一些新变化,这些变化反映了TIMSS测评的新趋势,对我国基础教育科学课程评价改革有一定的启示和借鉴意义。     

国际学生评价TIMSS和PISA的比较与反思

TIMSS和PISA评价都是大规模跨国学生表现评价。TIMSS主要评价4年级和8年级学生在数学和科学课程上的成就,PISA主要评价15岁学生在义务教育将近结束时为成人生活做准备的数学、科学和阅读素养。它们循环的评价周期、时代性的评价内容和新颖的题型设计吸引了众多国家参加,成为了参与国进行教育决策和研究的指示器。     

TIMSS和PISA数学测评框架及试题的比较

<正>一、背景介绍TIMSS(国际数学和科学趋势研究)是由国际教育成就评价协会(简称IEA)组织和发起的国际性教育评价测试,主要测量各国学生在数学和科学上的学习成就,研究各国在课程、教学等背景因素上的差异.1995年,IEA组织并发起了第三次国际数学和科学测评(Third International Mathematics and Science Study).这次活动简称为TIMSS,共有41个国家或地区的50万名     

TIMSS数学评价框架趋势研究

作为大型国际评价项目.TIMSS具有较成熟、完善的评价框架.因此研究TIMSS评价框架的变化趋势,能够为我国数学教育评价提供一定的启示.为此,该文从认知和内容两个维度,对TIMSS2003和TIMSS2007的数学评价框架进行了分析,经研究发现,TIMSS重视内容的基础性,内容的实用性、学生的基本认知能力,学生的数学化能力.这对我国数学教育评价提供了几点启示:我国数学教育评价应继续关注学生的基础知识和基本技能、关注学生的发展,避免被功利化.     

国际学生评价TIMSS和PISA的比较与反思

TIMSS和PISA评价都是大规模跨国学生表现评价.TIMSS主要评价4年级和8年级学生在数学和科学课程上的成就,PISA主要评价15岁学生在义务教育将近结束时为成人生活做准备的数学、科学和阅读素养.它们循环的评价周期、时代性的评价内容和新颖的题型设计吸引了众多国家参加,成为了参与国进行教育决策和研究的指示器.     

International assessment: A Rasch model and teachers' evaluation of TIMSS science achievement items

The Trends in International Mathematics and Science Study (TIMSS) is a comparative assessment of the achievement of students in many countries. In the present study, a rigorous independent evaluation was conducted of a representative sample of TIMSS science test items because item quality influences the validity of the scores used to inform educational policy in those countries. The items had been administered internationally to 16,009 students in their eighth year of formal schooling. The evaluation had three components. First, the Rasch model, which emphasizes high quality items, was used to evaluate the items psychometrically. Second, readability and vocabulary analyses were used to evaluate the wording of the items to ensure they were comprehensible to the students. And third, item development guidelines were used by a focus group of science teachers to evaluate the items in light of the TIMSS assessment framework, which specified the format, content, and cognitive domains of the items. The evaluation components indicated that the majority of the items were of high quality, thereby contributing to the validity of TIMSS scores. These items had good psychometric characteristics, readability, vocabulary, and compliance with the assessment framework. Overall, the items tended to be difficult: constructed response items assessing reasoning or application were the most difficult, and multiple choice items assessing knowledge or application were less difficult. The teachers revised some of the sampled items to improve their clarity of content, conciseness of wording, and fit with format specifications. For TIMSS, the findings imply that some of the non‐sampled items may need revision, too. For researchers and teachers, the findings imply that the TIMSS science items and the Rasch model are valuable resources for assessing the achievement of students. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 1321–1344, 2012     

国际科学素养测评对我国科学学科测评的启示

本文在分析PISA、TIMSS和NEAP三项国际学生科学素养测评现状的基础上,提出对我国科学素养测评的启示:1.明确测评目标和测试框架,在深入研究课程教材的基础上设计恰当的试题;2.根据测评目标,采用科学的测评方法和工具;3.多维度收集学生学业成绩信息,进行合理解释。     

The contribution of TIMSS to the link between school and classroom factors and student achievement

Worldwide, the interest of policy-makers in participating in studies from the International Association for the Evaluation of Educational Achievement (IEA), such as Trends in International Mathematics and Science Study (TIMSS) has been growing rapidly over the past two decades. These studies offer the opportunity to relate the teaching and learning context to student achievement. This article presents the results of a systematic review of the research literature on TIMSS. Its main purpose is to find out to what extent TIMSS has contributed to insights into ‘what works in education and what does not’, particularly with regard to school and classroom factors. The review was guided by a generic framework developed within the tradition of educational effectiveness research. The review showed that: (a) since 2000, the number of publications which use TIMSS data for secondary analyses aimed at explaining differences in student achievement has increased strongly; (b) a number of studies, especially older ones, did not take account of the specific sample and test design of TIMSS; and (c) there are large differences between countries in school and classroom factors associated with student achievement. In the light of these results, we discuss the benefits and limitations of country and system comparisons.     

Large‐scale diagnostic assessment: comparison of eighth graders’ mathematics performance in the United States,Singapore and Israel

A diagnostic model for large‐scale assessment was applied to TIMSS data to compare mathematics performance of eighth graders from three countries—the US, Singapore, and Israel. Compared were attribute mastery probabilities for content, skills and cognitive processes underlying students’ performance on the 1999 TIMSS‐R mathematics test. Also compared were the proportions of students from the three samples in each of eight hierarchically ordered clusters of knowledge states. The results indicated significant differences in favour of the Singaporean sample on most attributes underlying the test. The results were discussed in light of the cultural context of education in the respective countries.     

Why Students Answer TIMSS Science Test Items the Way They Do

The purpose of this study was to explore how Year 8 students answered Third International Mathematics and Science Study (TIMSS) questions and whether the test questions represented the scientific understanding of these students. One hundred and seventy-seven students were tested using written test questions taken from the science test used in the Third International Mathematics and Science Study. The degree to which a sample of 38 children represented their understanding of the topics in a written test compared to the level of understanding that could be elicited by an interview is presented in this paper. In exploring student responses in the interview situation this study hoped to gain some insight into the science knowledge that students held and whether or not the test items had been able to elicit this knowledge successfully. We question the usefulness and quality of data from large-scale summative assessments on their own to represent student scientific understanding and conclude that large scale written test items, such as TIMSS, on their own are not a valid way of exploring students' understanding of scientific concepts. Considerable caution is therefore needed in exploiting the outcomes of international achievement testing when considering educational policy changes or using TIMSS data on their own to represent student understanding.     

Using TIMSS and PISA results to inform educational policy: a study of Russia and its neighbours

In this paper, we develop a multi-level comparative approach to analyse Trends in International Mathematics and Science Survey (TIMSS) and Programme of International Student Achievement (PISA) mathematics results for a country, Russia, where the two tests provide contradictory information about students’ relative performance. Russian students do relatively well on the TIMSS mathematics test but relatively poorly on the PISA. We compare the performance of Russian students with different levels of family academic resources over the past decade on these tests compared to students with similar family resources in Russia’s neighbours and to Russian students studying in Latvian and Estonian Russian-medium schools. These comparisons and interviews with educators in Latvia and Estonia help us understand why students in Russia may perform lower on the PISA and to draw education policy lessons for improving international test performance generally and Russian students’ PISA mathematics performance specifically.     

A comparison of PISA and TIMSS 2003 achievement results in mathematics

This study compares the Programme for International Student Assessment (PISA) 2003 Mathematics results with the Trends in International Mathematics and Science Study (TIMSS) 2003 Grade 8 mathematics results, using country mean scores for 22 participants of both studies. It is found that Western countries generally performed better in PISA than in TIMSS, and Eastern European and Asian countries generally performed better in TIMSS than in PISA. Furthermore, two factors, content balance and years of schooling, can account for 93% of the variation between the differential performance of countries in PISA and TIMSS. Consequently, the rankings of countries in the two studies can be reconciled to a reasonable degree of accuracy.     

教育改革浪潮中的"指南针"——美国TIMSS研究的特点和影响分析

在众多的参与国中,美国对所收集的TIMSS各类信息进行了较为深入的研究,对国家教育政策的走向也产生了深远的影响。本文首先总结了美国TIMSS研究在研究对象、研究内容以及宣传手段方面所存在的特点,在此基础之上就TIMSS研究对美国教育所产生的影响进行了考察,从联邦和地方的教育改革、新型研究方法—录像带研究、联邦教育权力的扩张、教育意识从个性主义向标准化的转变四个层面进行了分析。     

PISA与TIMSS中有关数学评价的比较分析

PISA与TIMSS是近年来较为活跃的两个国际评价项目,它们在评价的目的、使用的评价框架以及试题的形式等方面有所不同,但其中又包含一定的相似的成分,对二者异同的分析将有助于我们进一步认识数学课程实施及数学素养评价的要素和关键。     

Using data mining to predict K–12 students' performance on large‐scale assessment items related to energy

This article reports a study on using data mining to predict K–12 students' competence levels on test items related to energy. Data sources are the 1995 Third International Mathematics and Science Study (TIMSS), 1999 TIMSS‐Repeat, 2003 Trend in International Mathematics and Science Study (TIMSS), and the National Assessment of Educational Progress (NAEP). Student population performances, that is, percentages correct, are the object of prediction. Two data mining algorithms, C4.5 and M5, are used to construct a decision tree and a linear function to predict students' performance levels. A combination of factors related to content, context, and cognitive demand of items and to students' grade levels are found to predict student population performances on test items. Cognitive demands have the most significant contribution to the prediction. The decision tree and linear function agree with each other on predictions. We end the article by discussing implications of findings for future science content standard development and energy concept teaching. © 2007 Wiley Periodicals, Inc. J Res Sci Teach 45: 554–573, 2008