Summative Evaluation

Summative evaluation is defined as the process of determining the value, effectiveness, or efficiency of an object to form a decision–making basis about that object. In this article, we present an overview of one major aspect of summative evaluation–the planning process–and then present essays on five topics that we believe are difficult issues most often faced in the conduct of summative evaluation. These five topics are: (a) client commitment to evaluation; (b) evaluating the training organization; (c) evaluating management training; (d) institutionalizing the evaluation process; and (e) the conduct of cost benefit studies.     

Utilizing Summative Evaluation Through External Peer Review of Teaching

This article examines the dichotomy between summative and formative evaluation of teaching and suggests a new model for reviewing teaching that utilizes colleagues from other campuses (external review) as a means of summative evaluation. Traditionally student evaluations and on-campus peer-based review of teaching (internal review) discourage innovations in teaching assessments because they are used for summative purposes. Based on research conducted as a part of the AAHE Peer Review of Teaching National Project, this article argues that summative evaluation of teaching should be based on external review leaving internal review primarily for formative purposes.Jere W. Morehead: Jere W. Morehead received his Juris Doctorate from the University of Georgia     

Teachers' Instructional Use of Summative Student Assessment Data

This study examines the extent to which classroom teachers self-report using summative assessment data in formative ways to shape instruction. A Web-based survey was administered to elementary, middle, and high school teachers in a large, suburban school district in central Virginia. Teachers reported administering a variety of summative assessments with varying frequency, and analyzing data at the aggregate level, most often using central tendency statistics. Useful methods for disaggregating data by content standards or student subgroups were not as frequently reported. Regardless of the methods of data analysis, a majority of teachers reported using assessment results to evaluate their instructional practice and make adjustments to support student learning. The results suggest, however, that teachers engaged in a cursory analysis of student performance fairly regularly but conduct more in-depth analyses less often. The study raises questions about how teachers can effectively use summative data for instructional purposes.     

教师教学效果的电子过程评估与终结性评估差别的实证研究

电子过程评估是采用数字化手段日常性地记录教师线上的教学行为,然后依照预定的指标给予评价,终结性评价是在学期结束时对教师教学行为的一次性评价,多数是人工操作的。文章采用2019-2020年G大学的40 762份电子过程评估的数据与终结性评估的数据进行回归分析,发现两者存在显著性区别,而且发现这些区别与教师的职称高度相关。据此提出高校教师要 注意线上教学的特点,参照电子过程评估的指标改进自己的教学,尤其是年轻教师;同时对电子过 程评估提出要规范评估步骤、改进评估指标、自动地向老师进行教学情况反馈、加强评估结果对教 师的激励等建议。     

学生评教的标准化处理

学生评教是教学反馈的重要环节及教学考评的一项重要内容,因此学生评教数据如何利用才是我们要讨论的重点。作者认为,学生评教分数在进行标准化处理后可以作为考评依据,因为标准化结果在很大程度上可以消除学生们(评委们)心目中标准的差异。     

Professional Ethics in Teaching: Towards the development of a code of practice

This article provides a theoretical discussion of the process of developing a professional code of ethics for teachers. Two underlying assumptions pervade the article. Firstly, that increased awareness of the ethical dimensions and responsibilities of teaching is essential for both enhanced professionalism and, more significantly, improved practice. Secondly, that while a code of ethics may not advance the ultimate route to such awareness, it should be able to contribute broadly and positively to a deeper examination of ethics in teaching as long as its limitations are recognised and acknowledged. Six key issues and questions that highlight the complexities that those involved in the development of a code of professional ethics should address are discussed. While this article intends to provoke thoughts relevant to any organisation grappling with its own ethical code, its primary context is the Ontario College of Teachers (Ontario, Canada), whose work in this area is newly emerging.     

论学生评教中的质性评价

学生评教作为大学教学质量保障体系的一种重要制度,往往推崇量化评价的方式。 学生评教作为西方社会的舶来品,由于中西文化差异,量化评教在我国实施过程中形成“鸡肋”困境。 突破这一困境需要转变学生评教的评价范式,适时引进质性评价的方式。文章从理念层面阐析质性研究的范式在学生评教活动中的适切性,论证质性评教的合理性,从实践层面解析质性评价在学生评价中的实施路径,论证质性评教的可行性,并分析质性评价在学生评教中存在的困难,找准提高质性评教成效的着力点,以此促进学生评教有效性的达成。     

Student Perspectives on Teaching and its Evaluation

The research on student ratings of instruction, while voluminous, has had minimal focus on the perceptions of the students who do the ratings. The current study explored student perspectives on course and teacher ratings as well as some issues related to teaching effectiveness and faculty roles. It was found that students are generally willing to do evaluations and to provide feedback, and have no particular fear of repercussions. However, they have little confidence that faculty or administrators pay attention to the results, and do not even consult the ratings themselves. The students view teaching and advising as the most important roles that should be played by faculty, yet project that faculty, while also viewing teaching as the most important, would rank research above the more student-interactive advising. Canonical correlations among various scales reveal a strong emphasis on such issues of the importance of faculty respect for student views.     

Faculty Views of Student Evaluation of College Teaching

The literature abounds with psychometric studies of course evaluation measures and articles debating the merits of student ratings of instruction, but little research has focused on faculty perceptions of this procedure. In the present study faculty perceptions are explored at a teachers' college where evaluation is carried out annually on a sample of courses. The sample includes 101 instructors who completed the research questionnaire. Faculty attitudes reflected a broad range of responses towards validity of student ratings, and their usefulness for improving instruction. Although overall attitudes were mildly positive, few instructors reported changing instruction as a result of student ratings. Moreover, few supported sending evaluation results directly to college administrators or publishing them for student consumption.     

浅析高校学生评教

学生评教是学生作为评价主体对教师的教学工作做出的评价,在实际的教学过程中发挥着积极的作用,是学校教学质量监控体系中不可或缺的重要一环。本文阐述了学生评教的意义、作用及影响因素。     

Measuring Longitudinal Gains in Student Learning: A Comparison of Rasch Scoring and Summative Scoring Approaches

This study pioneers a Rasch scoring approach and compares it to a conventional summative approach for measuring longitudinal gains in student learning. In this methodological note, our proposed methodology is demonstrated using an example of rating scales in a student survey as part of a higher education outcome assessment. Such assessments have become increasingly important worldwide for purposes of institutional accreditation and accountability to stakeholders. Data were collected from a longitudinal study by tracking self-reported learning outcomes of individual students in the same cohort who completed the student learning experience questionnaire (SLEQ) in their first and final years. Rasch model was employed for item calibration and latent trait estimation, together with a scaling procedure of concurrent calibration incorporating a randomly equivalent group design and a single group design to measure the gains in self-reported learning outcomes as yielded by repeated measures. The extent to which Rasch scoring compared to the conventional summative scoring method in its sensitivity to change was quantified by a statistical index namely relative performance (RP). Findings indicated greater ability to capture learning outcomes gains from Rasch scoring over the conventional summative scoring method, with RP values ranging from 3 to 17% in the cognitive, social, and value domains of the SLEQ. The Rasch scoring approach and the scaling procedure presented in the study can be readily generalised to studies using rating scales to measure change in student learning in the higher education context. The methodological innovations and contributions of this study are discussed.     

高校学生评教的新途径：焦点小组法

焦点小组法是一种定性研究方法,在进行教学评价时,选取5-9个学生在自由开放、不受拘束的讨论气氛下对其任课教师的教学进行深入讨论并提出评价意见,从而获得真实可靠的评价资料.在教学评价上,焦点小组法可以作为传统评价方法的补充.     

Student Teaching Feedback and Evaluation: Results From a Seven-State Survey

Recent surveys have provided some guidance and recommendations for the student teaching component in early childhood teacher preparation, but specific information on the focus of supervision and evaluation of student teachers is limited. The current study surveyed 128 early childhood programs in 2- and 4-year institutions of higher education across seven states. The study collected data in areas such as which students receive feedback, how students are supervised and evaluated, and what types of assessment tools contribute to the evaluation. Results indicate that across 2- and 4-year institutions, language and literacy are a strong focus of feedback for student teachers, as well as child development, planning, and adult–child interactions. Student teachers are typically supervised through on-site visits that range in number and length fairly dramatically across 2- and 4-year institutions. Finally, the use of specific tools for evaluation varies across programs; about a quarter of programs surveyed use a published tool to evaluate student teachers. The majority of programs use an evaluation tool that is based on local, state, or national standards. Findings are discussed in terms of early childhood teacher preparation programs and the continuing discussions of recommendations for student teaching.     

高校内部质量保证工作:学生评教

我国许多高校正在建立并开始运行校内教育质量保证体系。学生评教是其中的重要工作之一。本文主要针对高校教师和质量保证工作人员,详细阐述外国和中国香港一些高校学生评教的做法,力求在认识上有所启发,在工作上有所指导和参照。其中包括拟订学校对教师课堂教学的质量要求,精心设计问卷调查表,细心运作学生评教的调查全过程,关于学生评教可靠性与正确性的研究综述,强调培育和提升学校质量文化的重要性。     

英语教学中的形成性评价与终结性评价

本文介绍了形成性评价、终结性评价以及它们的重要性,尤其是形成性评价在我国英语教学领域的应用价值。因为中国的英语教学评价体系可能存在一定的缺陷,它们在某种程度上阻碍了学生的全面发展。关于如何恰当实施形成性评价和终结性评价,本文提出了一些建议。     

略论高校教师理解学生评教

文章分析了高校开展学生评教的外部原因和内部动因,认为学生评教要充分发挥其功能,需要教育工作者的理解、配合和支持。     

Assessment and Evaluation in Social Work Education: Formative and Summative Approaches

Despite a wealth of tacit knowledge in academia regarding effective teaching strategies and a rich theoretical and empirical knowledge base on student learning, social work instructors wishing to identify appropriate ways to measure teaching and learning have little evidence to guide them. This article presents a framework for assessment of student learning and evaluation of instructor teaching that distinguishes between formative methods, which support an ongoing process of improvement, and summative methods, which represent a measure of competence or mastery. While summative methods are often used to meet institutional or programmatic goals, formative methods bridge assessment and evaluation and can result in a more reflective, constructive, and productive experience for both instructors and students.