A Validity Argument in Support of the Use of College Admissions Test Scores for Federal Accountability

In 2018, 26 states administered a college admissions test to all public school juniors. Nearly half of those states proposed to use those scores as their academic achievement indicators for federal accountability under the Every Student Succeeds Act (ESSA); many others are planning to use those scores for other accountability purposes. Accountability encompasses a number of different uses and subsumes a variety of claims. For states proposing to use summative tests for accountability, a validity argument needs to be developed, which entails delineating each specific use of test scores associated with accountability, identifying appropriate evidence, and offering a rebuttal to counterclaims. The aim of this article is to support states in developing a validity argument for use of college admission test scores for accountability by identifying claims that are applicable across states, along with summarizing existing evidence as it relates to each of these claims. As outlined by The Standards for Educational and Psychological Testing, multiple sources of evidence are used to address each claim. A series of threats to the validity argument, including weaker alignment with content standards and potential influences in narrowing teaching, are reviewed. Finally, the article contrasts validity evidence, primarily from research on the ACT, with regulatory requirements from ESSA. The Standards and guidance addressing the use of a “nationally recognized high school academic assessment” (Elementary and Secondary Education Act (ESEA), Negotiated Rulemaking Committee; Department of Education) are the primary sources for the organization of validity evidence.     

Comment on Cizek's "More Unintended Consequences of High-Stakes Testing"

This discussion provides a response to Gregory Cizek's "More Unintended Consequences of High-Stakes Testing." The current policy debate is characterized by extreme positions both for and against testing, and Cizek's article balances positive consequences against antitesting critics. However, there is no evidence that high-stakes testing per se has substantial positive consequences–although there is optimism that aligned educational systems, in which testing is a component, may lead to higher levels of student attainment.     

心理测量学中效度概念的新发展

本文简单回顾心理测量学中效度概念发展的三个阶段,并着重分析了效度概念在现阶段的新发展——构想效度理论。可以看出,效度概念是一个不断发展的动态过程,随着研究内容的丰富化,研究方法也日益多样化。现阶段的构想效度已经足以容纳所有可能为分数的解释提供支持的证据。对效度概念的完整认识,有助于我们从一个更为宽阔的角度去认识测验的效力和实质。     

Education Through School and Community Coöperation

To a surprising degree, how you communicate determines your effectiveness as a teacher. Relationships are built on communication and easily destroyed by it. (Charles 2000, 48–49)     

大规模教育考试科学属性之理论和实践思考

大规模教育考试的科学属性至少应该包括教育和心理测量学约束要求和考试的社会学约束要求两个层面。考试分数的可靠性、考试结果解释和使用的有效性、考试的公平性和考试对社会、学校教育教学的影响是考试科学属性的基本要素,这是考试的目的和结果的使用决定的,每一要素都有其独特的科学内涵。考试实践中,无论是考试测量目标的制定,试卷结构的确定,考试内容样本的采集,试题情景材料的选择和设问,难度的设置,考试后的评价等都应该围绕提高考试的科学性、提高考试的质量进行。     

Reading Testing and Its Validity——with the analysis on some CET—4 sample tests

In this paper,the author discusses reading testing and its validity,and the requirements of reading to test takers as well as the principles which determine the validity of reading testing. By analyzing two GET - 4 model test( reading section), he shows how to make a test of great validity so as to ensure the accuracy and objectiveness of a test.     

论语言测试的信度和效度

语言测试研究是应用语言学的一个分支,信度和效度是语言测试领域中的两个重要概念.信度指的是考试结果的可靠性;效度指的是考试达到预定目的的程度.本文介绍了信度和效度的定义、测量方法、影响因素,并指出了语言测试中二者的相互关系是既相互依存,又相互排斥的关系.     

Taking the Time to Improve the Validity of Low-Stakes Tests: The Effort-Monitoring CBT

The attractiveness of computer-based tests (CBTs) is due largely to their capability to expand the ways we conduct testing. A relatively unexplored application, however, is actively using the computer to reduce construct-irrelevant variance while a test is being administered. This investigation introduces the effort-monitoring CBT, in which the computer monitors examinee effort (based on item response time) in a low-stakes test and displays warning messages to those exhibiting rapid-guessing behavior. The results of an experimental study are presented, which showed that an effort-monitoring CBT increased examinee effort and yielded more valid test scores than a conventional CBT. Thus, unlike previous research that has focused on identifying rapid-guessing behavior after it has occurred, the effort-monitoring CBT proactively attempts to suppress rapid-guessing behavior. This innovative testing procedure extends the capabilities of measurement practitioners to manage the psychometric challenges posed by unmotivated examinees.