教育教学能力测试的GT和多面Rasch模型分析

本研究以概化理论和多面Rasch模型为工具,对某市教育教学能力测试的一批实测结果进行了分析,旨在探索影响此类测试评分的因素及其作用机制,为完善测试设计和评分培训提供依据。研究结果表明,影响教育教学能力测试的主要因素是任务难度、评委宽严、评委的跨任务一致性和任务的跨考生难度。当前的教育教学能力测试只适宜做相对决策,不适宜做绝对决策。建议在以后的测试中通过提高测试任务的数量和加强对评分员的针对性培训来提高评分可靠性。

Analyze the Data of Teaching Capability Assessment Based on Generalizability Theory and Many-facet Rasch Measurement

This study analyzes the data of Teaching Capability Assessment based on GT and MFRM, which are to explore the influence of the scoring factors and their mechanism so as to provide the basis to improve the test design and rating training. The analysis of the two methods provides us with complementary information. GT is more helpful in the ways of design of measurement, and MFRM is more helpful in the ways of measurement of individual elements within each facet and detecting aberrant responses. The main factors affecting Teaching Capability Assessment are tasks difficulty, judger＇s severity, judger＇s consistency across tasks and task difficulties across participants. The current Teaching Capability Assessment is only suitable for relative decision not absolute decision. By increasing the number of tasks and carrying out targeted trainings can improve the reliability of Teaching Capability Assessment.