Sources of difficulty in assessment: example of PISA science items

ABSTRACT

The understanding of what makes a question difficult is a crucial concern in assessment. To study the difficulty of test questions, we focus on the case of PISA, which assesses to what degree 15-year-old students have acquired knowledge and skills essential for full participation in society. Our research question is to identify PISA science item characteristics that could influence the item’s proficiency level. It is based on an a-priori item analysis and a statistical analysis. Results show that only the cognitive complexity and the format out of the different characteristics of PISA science items determined in our a-priori analysis have an explanatory power on an item’s proficiency levels. The proficiency level cannot be explained by the dependence/independence of the information provided in the unit and/or item introduction and the competence. We conclude that in PISA, it appears possible to anticipate a high proficiency level, that is, students’ low scores for items displaying a high cognitive complexity. In the case of a middle or low cognitive complexity level item, the cognitive complexity level is not sufficient to predict item difficulty. Other characteristics play a crucial role in item difficulty. We discuss anticipating the difficulties in assessment in a broader perspective.     

Making Sense of Bali: Unintended outcomes of study abroad programs

Study abroad programmes for teacher education students are increasingly being evaluated to determine their effectiveness in achieving intended outcomes. There is a danger, however, that such evaluations will ignore valuable but unintended and serendipitous outcomes of such programmes. This paper investigates an example of such an outcome, the development of a critical perspective towards media constructions of ‘otherness’. In 2002 a group of Australian teacher education students undertook an intensive in‐country Indonesian language programme. The course included mornings of formal immersion language classes and afternoons of cultural experiences with local students. Throughout and following the programme the students were interviewed and wrote about their changing perceptions of Indonesia and the implications of the experience for their professional development. Soon after their return Indonesian–Australian relations were challenged by the terrorist attack in the tourist heart of Bali. Two hundred and two people, including many Australian tourists, were killed in the bomb blast. In some cases the students were personally acquainted with Australian victims. As part of their reflection upon their in‐country experience the students were asked to comment upon whether, and in what ways, the Bali bombings might have affected their perceptions of Indonesia. The students were highly critical of the ethnocentric and stereotyped way in which the Australian media depicted Indonesians in their reporting of the bombing. These students were concerned with the effect that such media constructions might have upon Australian attitudes towards Indonesia and were prepared to challenge such media constructions in the classroom.     

论中小学教师信息素养的构建及其培养途径

在教育信息化背景下,加强和提高中小学教师信息素养是一项紧迫而重要的任务。进一步明确中小学教师信息素养的内涵,积极构建中小学教师信息素养的科学体系,通过有效途径和方法大力提高中小学教师的信息素养,对提升中小学教师队伍的整体素质,提高中小学教师实施素质教育的能力,促进中小学教师专业化发展具有重要意义。     

维吾尔族受众语言习得与媒介素养研究

以教育部课题调研数据为基础,旨在研究特定语言习得背景下新疆维吾尔族受众的媒介素养,分析其特点并在此基础上结合维吾尔语主流媒体资源优势对其发展提出了建议。     

论英语教师语言测试素养的培养

随着英语测试特别是大规模标准化测试在当代社会当中的重要性日益凸显,英语教师的语言测试素养的培养也逐渐成为国内外学者关注的问题。本文首先探讨了语言测试素养的定义,然后从英语教师的职业属性、大规模标准化测试给英语教师的冲击以及测试对于教、学的促进作用等三方面探讨培养语言教师测试素养的重要性,并提出了语言测试素养的培养途径。     

基于教育信息化的高等职业院校教师信息素养养成分析

教育信息化不仅改变了传统的教育教学模式,对高等职业院校教师的信息素养也提出了新的要求。本文阐述了教师信息素养构成,提出提高教师的信息素养的若干培养途径。     

超高性能混凝土的微观特征——应用统计纳米压痕技术表征

介绍纳米压痕原理,通过应用统计纳米压痕技术,表征超高性能混凝土的微结构,描述其微观机械特性.特别是,通过统计纳米压痕（SNT）、扫描电子显微镜（SEM）及X射线衍射（XRD）的研究发现,在界面区的纤维矩阵是无缺陷的.     

试论中国受众媒介素养

谣言危害巨大,传播网络化使之无时无处不在,防治谣言成为一个世界性的课题。＂谣言止于智者＂,防治谣言的根本途径是开展媒介素养教育,提高公众媒介素养。     

论用户信息技术素养教育

本文在分析信息素养涵义的基础上，提出了信息技术素养是用户信息素养前提条件的想法。通过对图书馆进行信息技术素养教育优势的分析，探讨了图书馆开展信息技术素养教育的途径。     

企业信息能力基本框架研究

面对国际国内激烈的竞争环境和市场的进一步开放，本文从企业生存与发展的战略高度出发，分析了企业信息能力的基本框架．它包括企业信息能力的评价标准，企业信息能力的作用，中外企业在信息能力方面的差距和提高企业信息能力的建设．