When Assessment Validation Neglects Any Strand of Validity Evidence: An Instructive Example from PISA

The Standards for Educational and Psychological Testing identify several strands of validity evidence that may be needed as support for particular interpretations and uses of assessments. Yet assessment validation often does not seem guided by these Standards, with validations lacking a particular strand even when it appears relevant to an assessment. Consequently, the degree to which validity evidence supports the proposed interpretation and use of the assessment may be compromised. Guided by the Standards, this article presents an independent validation of OECD's PISA assessment of mathematical self-efficacy (MSE) as an instructive example of this issue. OECD identifies MSE as one of a number of “factors” explaining student performance in mathematics, thereby serving the “policy orientation” of PISA. However, this independent validation identifies significant shortcomings in the strands of validity evidence available to support this interpretation and use of the assessment. The article therefore demonstrates how the Standards can guide the planning of a validation to ensure it generates the validity evidence relevant to an interpretive argument, particularly for an international large-scale assessment such as PISA. The implication is that assessment validation could yet benefit from the Standards as what Zumbo calls “a global force for testing”.     

PISA与TIMSS中有关数学评价的比较分析

PISA与TIMSS是近年来较为活跃的两个国际评价项目,它们在评价的目的、使用的评价框架以及试题的形式等方面有所不同,但其中又包含一定的相似的成分,对二者异同的分析将有助于我们进一步认识数学课程实施及数学素养评价的要素和关键。     

走近PISA——国际学生评价项目综述

国际学生评价项目(PISA)自2000年公布第一次研究报告以来,已完成了一个周期的调查评价,本文概括介绍了PISA的产生和发展过程,测试主题和主要发现,国际影响及未来的研究计划,以利更多地借鉴其中的有益成分。     

走近PISA——国际学生评价项目综述

国际学生评价项目（PISA）自2000年公布第一次研究报告以来,已完成了一个周期的调查评价。本文概括介绍了PISA的产生和发展过程,测试主题和主要发现,国际影响及未来的研究计划。以利更多地借鉴其中的有益成分。     

国外中小学数学教育评价研究述评及其启示

数学是基础教育中最为重要的学科之一,世界各国政府和教育部门对数学教育评价都十分重视。美国国家评价管理委员会、国际教育成就评价协会、国际经济合作与发展组织等近年来分别开发了NAEP、TIMSS以及PISA等多个评价项目,对中小学数学教育质量进行系统测查。相关研究中恰当的目标设置、明确的评价范畴以及科学、严格的研究设计等多个方面对我国的数学教育质量评价研究均具有重要的启示和借鉴意义。     

认知心理学视角下的翻译过程模式实证探研

通过有声思维法对受试者在英译汉翻译过程中所采用的翻译策略进行研究,结果表明译者在翻译过程中遵循了基于认知心理学信息加工理论所构建的翻译过程模式,并证明该翻译过程模式是成立的;翻译过程就是问题解决的过程,也是决策的过程。     

英语阅读中的元认知策略训练

有关元认知的理论和实验研究表明,元认知策略的培养是提高阅读教学的有效途径之一。要提高学生英语阅读的能力,教师应该在平时的阅读教学过程中对学生进行元认知知识的讲授和策略的训练。     

翻译任务中的不确定性管理及元认知行为研究

在翻译任务理解、迁移和语言的再生过程中,不确定性是时有发生的,为了保证流畅的、质量较高的翻译,对不确定性进行管理是十分有必要的。基于此,分析元认知行为和翻译过程中不确定性管理的关系。同时,提出了有声思维法在翻译教学中的应用,以期充分发挥它的指导作用。     

数学自我效能研究综述

数学自我效能是影响学生学业表现的重要因素,是特殊自我效能研究的重要领域.国内外关于数学自我效能的研究已有很多.今后对数学自我效能的研究应注意以下几点:(1)增加测量数学自我效能的新方式,增加测量的针对性;(2)探索数学自我效能的结构、机制及发展规律性;(3)探索数学自我效能的培养与干涉途径.     

基于“有声思维”策略的大学英语阅读教学设计

在当今许多英语教学强调听说能力的同时,阅读能力仍然是学生学习英语的基本技能之一,教师如何引导学生提高阅读理解能力就显得十分重要。文章通过分析“有声思维”作为提高学生阅读理解能力的策略,分析了它在具体阅读教学中的应用。     

非文学翻译的译者伦理之实证研究

运用有声思维法,选取5名高校教师和5名职业译者为研究对象,研究他们在非文学翻译中对于翻译伦理的运用情况。研究发现,受试在再现原作和恪守职业道德这两种伦理上没有差别,差别体现在对文化和委托人要求的关注程度,翻译伦理的选择与受试的职业、经验有关。     

天津学生数学学习的性别差异——来自PISA的结果

数学学习的性别差异一直是人们关心的问题。PISA 2012测评结果显示,虽然天津男生与女生数学学习成绩不存在差异,但男女生数学学习的驱动力、动机和自我信念还是有明显差异。与男生相比,女生学习的坚持性、问题解决的开发性、对自身解决数学问题能力的自信更差,而数学焦虑更强,更倾向于将数学学习失败的责任归咎于自身以外的因素。     

关于大学数学实验课的教学思考

本文论述了数学实验课的特点和教学模式,对数学实验课的教学现状提出了几点思考。     

The genre of poetry: secondary school students' conventional expectations and interpretive operations

This study examined secondary school students' knowledge of the conventions and aesthetic operations that theorists hypothesize are associated with the poetic genre. Students read texts presented visually both in the shape of poems as well as prose. The identification of a text as a poem triggered significantly more references to the conventional expectations as well as greater appreciation of aesthetic elements that add a layer of meaning. Students also spent longer thinking about the poem‐shaped texts and rated the poems as more enjoyable, challenging, emotionally engaging, and as eliciting more imagery. If poetry triggers the tendency to engage in active and meaningful thinking by guiding us to see language in new ways, it may be one more reason to include it in the secondary school English curriculum.     

An analysis of teachers’ self-reported competencies for teaching metacognition

For successful reading experiences in native and/or foreign/second language, individuals need to benefit from not only cognitive strategies but also metacognitive strategies. Although research found reading comprehension and performance increase following metacognitive trainings, such findings may not transfer into mainstream classrooms as easily for several reasons. This study, therefore, aimed to disseminate the phenomenon of teaching metacognition with an emphasis on teacher’s instrumental role during classroom learning. More specifically, it investigated language instructors’ metacognition and their self-reported competencies for teaching metacognition. It also examined whether and how self-reported competencies changed following a professional development (PD) module of teaching for metacognition. Utilising Metacognitive Awareness Inventory (MAI) and think aloud protocols for instructional planning, this study found most participants were either highly metacognitive or metacognitive individuals. It was also found that most participants were initially not knowledgeable about and/or competent in teaching metacognition. Following PD, highly metacognitive teachers developed authentic lesson plans manifesting metacognition instruction while metacognitive teachers adopted similar instructional designs presented during the PD. Besides, half of the participants appreciated teaching metacognitively following the PD. Finally, under the light of these findings, future research and policy adjustments were proposed.