高中学业水平考试:功能、命题与成绩使用

高中学业水平考试是新课程改革背景下出现的新型教育考试。它考查中学生的知识掌握水平、学科素养、学习能力,应该成为高校招生的重要评价指标之一,并能为社会用人单位提供有用的信息。高中学业水平考试的命题组卷,应关注的首要指标是试题有无较全面地覆盖课程标准要求的内容,以及试题的难度范围是否足够广泛。作为高考招生的指标之一,高中学业水平考试成绩合格或达到一定等级应该成为一个关键的录用前提条件。至于考生取得哪个等级的学业水平考试成绩可以被录用,则最终取决于招生院校和专业的要求。     

Using rasch measurement to score,evaluate, and improve examinations in an anatomy course

Any examination that involves moderate to high stakes implications for examinees should be psychometrically sound and legally defensible. Currently, there are two broad and competing families of test theories that are used to score examination data. The majority of instructors outside the high‐stakes testing arena rely on classical test theory (CTT) methods. However, advances in item response theory software have made the application of these techniques much more accessible to classroom instructors. The purpose of this research is to analyze a common medical school anatomy examination using both the traditional CTT scoring method and a Rasch measurement scoring method to determine which technique provides more robust findings, and which set of psychometric indicators will be more meaningful and useful for anatomists looking to improve the psychometric quality and functioning of their examinations. Results produced by the more robust and meaningful methodology will undergo a rigorous psychometric validation process to evaluate construct validity. Implications of these techniques and additional possibilities for advanced applications are also discussed. Anat Sci Educ 7: 450–460. © 2014 American Association of Anatomists.     

网络试题库与考试系统的建设与探索

在现代教育技术的推动下,网络考试克服了传统考试模式的一些不足,成为高校考试改革发展的新趋势.在网络试题库建设与网络考试的实践基础上,分析了网络考试的优缺点,并对试题库建设及网络考试的注意事项进行了具体阐述,希望对高校网络试题库建设与网络考试提供有益参考.     

A psychometric evaluation of the digital logic concept inventory

Concept inventories hold tremendous promise for promoting the rigorous evaluation of teaching methods that might remedy common student misconceptions and promote deep learning. The measurements from concept inventories can be trusted only if the concept inventories are evaluated both by expert feedback and statistical scrutiny (psychometric evaluation). Classical Test Theory and Item Response Theory provide two psychometric frameworks for evaluating the quality of assessment tools. We discuss how these theories can be applied to assessment tools generally and then apply them to the Digital Logic Concept Inventory (DLCI). We demonstrate that the DLCI is sufficiently reliable for research purposes when used in its entirety and as a post-course assessment of students’ conceptual understanding of digital logic. The DLCI can also discriminate between students across a wide range of ability levels, providing the most information about weaker students’ ability levels.     

论《关于费尔巴哈的提纲》第二条的价值意蕴简

《关于费尔巴哈的提纲》第二条,无论是在文本翻译方面还是意义阐释方面,仍存在一些争议与补充.之所以存在差异,主要是由于语言表达的灵活性,以及解读路径的多元化.通常第二条被视为马克思的认识论转向,即提出实践是检验真理的唯一标准,这是毋庸置疑的.然而,任一文本的意义都需要深度发掘与耕犁.因此,对第二条的解读非但不能止步于此,更需要不断前行.可以说,在原有解读的基础上,进一步拓宽对《关于费尔巴哈的提纲》第二条的研究维度,将有利于深化文本的理解与意义的阐释.     

110米跨栏跑中的心理技能训练

运用心理技能训练的一般原理和方法,并结合跨栏运动的特点,探讨心理技能训练在跨栏跑中的运用。指出心理技能训练必须与身体训练及战术训练结合,才能收到较好的效果。     

Effects of multimedia on psychometric characteristics of cognitive tests: A comparison between technology-based and paper-based modalities

The study aims to investigate the effects of delivery modalities on psychometric characteristics and student performance on cognitive tests. A first study assessed the inductive reasoning ability of 715 students under the supervision of teachers. A second study examined 731 students’ performance on the application of the control-of-variables strategy in basic physics but without teacher supervision due to the COVID-19 pandemic. Rasch measurement showed that the online format fitted to the data better in the unidimensional model across two conditions. Under teacher supervision, paper-based testing was better than online testing in terms of reliability and total scores, but contradictory findings were found in turn without teacher supervision. Although measurement invariance was confirmed between two versions at item level, the differential bundle functioning analysis supported the online groups on the item bundles constructed of figure-related materials. Response time was also discussed as an advantage of technology-based assessment for test development.     

The role of linguistic features in science and math comprehension and performance: A systematic review and desiderata for future research

There is a growing body of research on the role of linguistic features (LF) in comprehension and performance in science and math. Of particular interest is which LF facilitate or hinder comprehension. In this systematic review, we provide an overview of findings on LF at the word, sentence and text levels, on comprehension and performance in science and math. Our literature search revealed n = 40 articles included in this review. Overall, the role of LF in comprehension and performance in science and math is complex, with findings varying across the different LF. For each LF, we discuss the findings and uncover remaining questions. In the general discussion, we uncover strengths and weaknesses of previous research and discuss open questions before making eight recommendations and identifying tasks for future research aiming to understand the complex nature of LF.     

Beyond item analysis: Connecting student behaviour and performance using e-assessment logs

Traditional item analyses such as classical test theory (CTT) use exam-taker responses to assessment items to approximate their difficulty and discrimination. The increased adoption by educational institutions of electronic assessment platforms (EAPs) provides new avenues for assessment analytics by capturing detailed logs of an exam-taker's journey through their exam. This paper explores how logs created by EAPs can be employed alongside exam-taker responses and CTT to gain deeper insights into exam items. In particular, we propose an approach for deriving features from exam logs for approximating item difficulty and discrimination based on exam-taker behaviour during an exam. Items for which difficulty and discrimination differ significantly between CTT analysis and our approach are flagged through outlier detection for independent academic review. We demonstrate our approach by analysing de-identified exam logs and responses to assessment items of 463 medical students enrolled in a first-year biomedical sciences course. The analysis shows that the number of times an exam-taker visits an item before selecting a final response is a strong indicator of an item's difficulty and discrimination. Scrutiny by the course instructor of the seven items identified as outliers suggests our log-based analysis can provide insights beyond what is captured by traditional item analyses.

Practitioner notes

What is already known about this topic

• Traditional item analysis is based on exam-taker responses to the items using mathematical and statistical models from classical test theory (CTT). The difficulty and discrimination indices thus calculated can be used to determine the effectiveness of each item and consequently the reliability of the entire exam.

What this paper adds

• Data extracted from exam logs can be used to identify exam-taker behaviours which complement classical test theory in approximating the difficulty and discrimination of an item and identifying items that may require instructor review.

Implications for practice and/or policy

• Identifying the behaviours of successful exam-takers may allow us to develop effective exam-taking strategies and personal recommendations for students.
• Analysing exam logs may also provide an additional tool for identifying struggling students and items in need of revision.