The use of keywords for delivering immediate performance feedback on teacher competence development

Literature shows that feedback that is specific, immediate and goal-oriented is effective on (pre-service) teachers’ performance. Synchronous coaching gives this kind of feedback. Due to immediateness of feedback, pre-service teachers can suffer from cognitive load. We propose a set of standardised keywords through which this performance feedback can be delivered – each keyword acts as a summary for the feedback message. The construction and the selection of the keywords is aimed at the reduction of message ambiguity, while at the same time a low level of cognitive load on the pre-service teacher must be maintained. An in vivo pilot-study with 40 respondents (pre-service teachers and their coaches) supported our hypothesis that usage of such sets of standardised keywords will mitigate the levels of ambiguity and cognitive load. These findings and other considerations for additional research using immediate performance are addressed.     

我国教师需要研究述评

我国以往对教师需要的研究比较侧重于理论层次,主要是从教育学、心理学视角来进行的,着重点在于城市中的教师。我们要对以往教师需要的研究进行反思,以期新的相关研究在研究方法、研究视角、研究重点、研究内容诸方面有所突破。     

Promoting assessment for learning through curriculum-based performance standards: teacher responses in the Northern Territory of Australia

Governments in Australia claim that standards-based reforms to schooling will result in greater use of assessment for and as learning. This study analyses the assessment practices that evolved within the planned curricula for senior secondary schooling in the Northern Territory of Australia during standards-based reforms. Case-study methodology was used, with each of the six teachers participating forming one case. The data collected and analysed included the texts created by the six participating teachers from a range of subject areas as they planned to enact the new curriculum. Semi-structured interviews were also conducted with each of the six teachers. The findings indicate that the inclusion of subject-based performance standards in the curriculum for senior schooling did not result in teachers planning a curriculum that included assessment practices for actively engaging students in learning.     

Calibrating assessment literacy through benchmarking tasks

Abstract

In calibration tasks students assess exemplar texts using criteria against which their own work will be assessed. Typically, these tasks are used in the context of training for peer assessment. Little research has been conducted on the benefits of calibration tasks, such as benchmarking, as learning opportunities in their own right. This paper examines a dataset from a long-running benchmarking task (～500 students per semester, for four semesters). We investigate the relationship of benchmarking performance to other student outcomes, including ability to self-assess accurately. We show that students who complete the benchmarking perform better, that there is a relationship between benchmarking performance and self-assessment performance, and that students appreciate the support for learning that benchmarking tasks provide. We discuss implications for teaching and learning flagging the potential of calibration tasks as an under-explored tool.     

Beyond cultural competence: transforming teacher professional learning through Aboriginal community-controlled cultural immersion

ABSTRACT

This paper problematises the concept of cultural competence in teacher professional learning arguing instead for opportunities to develop critical reflexivity in the ongoing construction of a pedagogical cultural identity. In the Aboriginal context within Australia, this research study demonstrates how attaining cultural knowledge, understandings and skills is most effective when professional learning is delivered by local Aboriginal cultural knowledge holders. This research study analyses the New South Wales Aboriginal Education Consultative Group Connecting to Country cultural immersion programme for local communities and schools. A mixed methods approach, analysing quantitative and qualitative data from questionnaires and interviews, highlights the significant impact this experience has on teachers in building relationships with local Aboriginal community members. Teachers reported learning new knowledge about local Aboriginal people, culture, history and issues that challenged their assumptions, personal and collective positioning and pedagogical approaches to teaching Aboriginal students. Implications from the study identify the significance of privileging Indigenous ways of knowing, being and doing in order to realise culturally responsive schooling and empower teachers as critically reflective change agents in their schools. It further identifies the need for significant human and financial investment so that all teachers can engage with this authentic and potentially transformative professional learning experience.     

Assessment of mathematics and reading performance: An examination of the correspondence between direct assessment of student performance and teacher report

Teacher judgments have been identified as a primary source of information regarding student academic achievement. Research examining the accuracy of teachers' judgments in assessing students' academic abilities has shown relatively high accuracy. However, previous studies have relied primarily on norm‐referenced measures to obtain estimates of students' achievement in reading and mathematics. Recent developments in the assessment of students' academic skills, such as Curriculum‐Based Measurement (CBM), provide a direct estimate of students' skill levels in basic areas such as reading and mathematics. The purpose of the present study was to examine the extent to which teachers' perceptions of students' reading and mathematics skills corresponded to direct estimates of students' reading and mathematics skills. Two second‐grade teachers estimated the reading and mathematics skills of 33 second‐grade students. Results of this study indicated that teachers were not accurate in assessing their students' mathematics functioning. Teachers were more accurate in assessing the occurrence of Mastery mathematics levels in basic addition, but were very inaccurate in assessing the occurrence of Mastery, Instructional, or Frustrational mathematics levels in all other skills assessed. In reading, teachers' judgment accuracy varied as a function of grade‐level material and instructional level. Specifically, teachers experienced considerable difficulty accurately identifying students who were reading at a Mastery level in grade‐level or above‐grade‐level material. © 2006 Wiley Periodicals, Inc. Psychol Schs 43: 247–265, 2006.     

科学合理的高职院校教师绩效考核体系的构建

通过对高职院校现有的教师绩效考核制度的分析,指出了存在的将教学绩效评价等同于教学绩效管理、绩效考核标准不明确、绩效考核缺乏沟通与反馈等问题,提出要实施绩效考核,应明确职责、确定考核定位、确定考核体系、严格执行考核程序、设置考核申诉程序等解决办法.建立科学合理的教师绩效考核制度的原则是：使所设工作量科学、客观,并考虑单位内外的公平性,同时使所设指标具有可测性、全面性、可比性和可行性等.在制度实施过程中应注意对评价者的选择及权重的确定,所设体系应具有高弹性,充分考虑指标的导向性并合理使用评价结果等问题.     

Teaching through assessment: reconsidering the transfer problem through a convergence of technology and assessment in early childhood teacher education

This article considers the impact of the ‘transfer problem’ from a personal perspective. Drawing on experiences in teacher educator as preservice teacher, a practicing educator and later a preservice educator the author examines how she has seen and experienced the transfer problem and the potential for teacher education to enact a separation between theory and practice. The convergence of technology and assessment is presented to argue a case for a pedagogical approach used by the author referred to as ‘teaching through assessment’. The approach is theorised drawing on concepts from cultural-historical theory including, leading activity, learning activity and reflection to describe the potential for technology to appropriate a range of forms and functions that make it suitable for reconsidering how the transfer problem might be approached in teacher education classrooms.     

Classroom-based assessment: Changing knowledge and practice through preservice teacher education

In this paper, the author investigates how the working assessment theories and practices of preservice teachers change in the enactment of those theories and practices in a mentored learning environment. Following 38 secondary English teacher candidates across time, the author tracks preservice teacher growth in knowledge about classroom-based assessment and assessment-driven planning. Teacher candidates reported they were strongly influenced by professional dialogue about planning and assessment in both campus classes and mentored field experiences. Although most teacher candidates grew to accept alternative assessments as valuable evidence sources indicating student learning, they recorded concerns that fell into five overlapping categories: designing goals; rubrics, grading and fairness; grading and motivation; validity of assessments; and time required to plan this way.     

Teacher performance assessment in teacher education: an example in Malaysia

As part of a cross-cultural collaboration, a teacher performance assessment (TPA) was implemented during 2009 in three Malaysian institutes of teacher education. This paper reports on the TPA for graduating primary teachers in Malaysia. The investigation focused on the pre-service teachers’ perceptions about whether the TPA provided them with an opportunity to document successfully their professional learning and professional practice. Successful completion of the Malaysian TPA was closely aligned to successful relationships, support and collaboration between Malaysian lecturers and pre-service teachers, and between pre-service teachers and their classroom teachers. Overall, the TPA did provide pre-service teachers with an opportunity to focus on the connection between theory and professional learning during field-work, and to become reflective evidence-based practitioners. Recommendations for improving the assessment of pre-service teachers are discussed.     

Evaluating teacher performance in language learning classes: the gap between students and department administrators

ABSTRACT

Using data from multiple evaluation instruments to evaluate university teachers’ teaching quality has been popular in practice; however, the inconsistency of these evaluation results has not received sufficient attention. This study intended to fill the gap by investigating the main reasons for the discrepancy in teaching performance that resulted from student evaluation surveys and classroom observations of two administrators from the English department in one of the largest universities in Vietnam. Student evaluation surveys (n = 604) suggested that teachers performed better in activities that focused on instructional techniques than when promoting classroom interaction and student engagement. Structural equation models further showed that activities that engaged them in learning and promoted classroom interaction had a strong positive effect on their overall satisfaction with their teachers’ performances. However, interviews with administrators from the department revealed the conflicting finding that they felt that teachers whose teaching performance was less satisfactory should focus primarily on instructional techniques.     

Curricular responses to multiculturalism: An overview of teacher education courses in Australia

This paper investigates the extent to which Australian teacher education institutions have responded to multicultural issues. Data relating to the number and nature of courses offered throughout Australia indicate that curricular provisions in most institutions were at a token level only. Three case studies are presented which illustrate both this tokenism and the preferred model of the permeation of multiculturalism throughout the curriculum.     

Evaluating the use of computers in science assessment: Considerations and recommendations

The use of computers in science assessment is viewed through the eyes of the program evaluator by examining six considerations: (1) purpose of computer use in assessment, (2) value of program evaluation models, (3) possible harmful side effects of assessment, (4) nature of imbedded questions, (5) definition of treatment, and (6) computers and the classroom context. Following a discussion of the considerations, four recommendations are offered in regard to continuing to study the use of computers for assessment (examples provided), utilizing the ideas contained in program evaluation models, capitalizing on several interesting, novel possibilities for evaluation design, and combining qualitative and quantitative techniques (mixed methodologies) into the evaluation procedures.     

Teaching the writing of psychological reports through formative assessment: peer and teacher review

This paper describes the teaching of psychological report writing at Karolinska Institutet and the efforts to improve it through the introduction of formative assessment applied as peer and teacher review. 48 fourth-year psychology students were required to write a psychological report. Half of the students also participated in a non-mandatory peer review of a first draft. All students handed in a preliminary version of the report, had it reviewed by the teachers and made alterations before handing in a final version. The results showed that both peer review and teacher review were valuable methods in the teaching of psychological report writing.     

Encouraging teacher development through embedding reflective practice in assessment

Learning to become a teacher is a developmental process, part of which is learning to become a reflective practitioner. The authors have implemented a structured approach to developing the habits of critical reflection, the purpose of which is to guide their university students (who are pre-service teachers) to progress through the stages of teacher development and to facilitate self-motivated professional growth. Their attempts to incorporate into these pre-service teachers' learning the ‘practice’ part of reflective practice have included the development of different kinds of practical and applied tasks. In turn, their attempts to incorporate the ‘reflective’ part of reflective practice have involved the embedding in assessment activities of different scaffolds for metacognitive reflection. Their innovative processes of embedding reflection in assessment have been guided by Dewey's and Schön's views of reflection, their own views of the teacher education process, and Brookfield's conception of ‘critical lenses’ which can be used as a scaffold to structure professional growth and development.