Effective teacher? Student self-evaluation of development and progress on a teacher education programme

This article examines 28 teachers’ views about their teacher education requirements. The participants were enrolled on a one-year full-time pre-service teacher education programme with a focus on post-compulsory education and training. The study examines how student teachers’ self-evaluations against aspects of teaching professional practice changed, developed and evolved over the duration of the course. The results reveal a statistically significant improvement in self-evaluation when all areas of professional expertise are considered. In addition, the study reports a decline, as the programme progresses, in student-assessed need to learn about specific aspects of teaching.     

Organisational self-evaluation and teacher education for community relations in a transforming society?

During 2004, the School of Education at the University of Ulster embarked on an innovative three-year project designed to embed community relations objectives within initial teacher education. With the advent of more peaceful times in Northern Ireland, this was a precipitous time for initial teacher educators to review the preparation given to beginner teachers for teaching in an increasingly pluralist society emerging from conflict. The present paper reports on one very specific and time-limited element of the broader project. That is, development work designed to investigate the possibilities of using processes of self-review and evaluation as a lever for improvements in initial teacher education for community relations. Following a brief contextualisation, the background to, and the development of, a set of materials designed to support rigorous and systematic self-review of all aspects of provision in a university-based initial teacher education department is described. The Community Relations Index for Initial Teacher Education (Cr-ITE) was envisaged as being of use to initial teacher education establishments in order to help teacher educators take responsibility for rigorous learning from their practice, whilst placing inclusive values at the centre of organisational development. The final section includes further critical reflection on the role of organisational self-review in transforming teacher education for inclusion in a society emerging from longstanding communal conflict.     

School self-evaluation instruments and cognitive validity. Do items capture what they intend to?

School self-evaluation (SSE) often makes use of questionnaires in order to sketch a picture of the school. How respondents cognitively process questionnaire items determines the validity of SSE results. Still, one readily assumes that respondents interpret and answer items as intended by the instrument developer (referred to as cognitive validity), but it remains unclear whether they do. This study tested an exemplary SSE instrument by focusing on the extent to which SSE results are cognitively valid, and on the extent to which differences in cognitive validity can be attributed to respondents and/or items. Cognitive interviews with 20 participants made respondents’ answering processes manifest. Results show that, overall, fewer than 50% of respondents’ processes of interpreting and elaborating on items are cognitively valid. Cross-classified multilevel analyses indicate that various hierarchical levels, respondents and items, are significant in explaining differences in cognitive validity, but not for all stages of the answering process.     

Instruments for school self-evaluation: lost in translation? A study on respondents’ cognitive processing

School self-evaluation (SSE), as an important leverage for quality assurance, often relies on surveys among staff members to collect information on the schools’ functioning. The extent to which respondents cognitively process items as developers intended them determines the cognitive validity of SSE results. However, it is unclear what problems occur in respondents’ cognitive processes which lead to cognitively invalid SSE results and how respondents’ positions in the school affects these cognitive processes. This study draws on cognitive interviews conducted with 20 teachers and principals to understand their thinking process while answering an SSE survey. Cognitively invalid results were analysed using a content analysis to identify problems in respondents’ cognitive processes. Findings showed that respondents experience semantic and syntactical issues when interpreting items. While elaborating, problems were found regarding items’ topic and focus, particularly concerning whom to make a statement about. Issues also emerged in the response stage, especially that the ‘don’t know’ option was not used as intended. Respondents’ positions influence their understanding about whom a statement is required and how self-evident some items are to them. These problems should be taken into account by developers of SSE surveys and other instruments that intend to measure organisational characteristics.     

Aligning professional development,school self-evaluation and principals’ performance standards: a UAE case study

The Abu Dhabi Education Council (ADEC) has introduced professional development (PD) plans and professional standards for school administrators. This was initiated to galvanise the ongoing school reforms. In addition, the Irtiqaa Framework, a school self-evaluation programme that contributes to the broad agenda of school reforms and changes, is currently implemented in public schools throughout the entire Emirate of Abu Dhabi. This study explores school administrators’ experiences of the PD offered in their schools, querying how aligned they are with the school self-evaluation and principal’s performance standards. The research employed a qualitative case-study approach. Semi-structured interviews were used as tools for data collection and they were conceptualised within the framework of the administrators’ performance standards and school-self-evaluation-Irtiqaa documents provided by ADEC. Researchers conducted semi-structured interviews with 14 school administrators, including principals, vice principals, and academic principals that represent six cycle-1 public schools. Findings and recommendations presented highlight the areas of improvement needed for more effective professional development that is not only in synchrony with school demands in times of change, but also in alignment with professional requirements that enhance effective school self-evaluation.     

Self-evaluation accuracy and satisfaction with performance: Are there affective costs or benefits of positive self-evaluation bias?

This paper examines how self-evaluation biases may influence satisfaction with performance. A review of theoretical positions suggests there are two views, both of which are supported by studies involving laboratory tasks. The first view predicts affective costs, and the second affective benefits of positive self-evaluation bias. We test the opposing predictions with the data of a study in which fifth-graders’ self-evaluation, performance, and satisfaction with performance were measured before and after a four-week arithmetic training program. Our findings support the benefit view, that is, students with a negative self-evaluation bias rated their satisfaction with performance significantly less than those with positive bias, even though both performed comparably.     

The effects of feedback on achievement,interest and self-evaluation: the role of feedback’s perceived usefulness

The impact of two types of written feedback (process-oriented, grade-oriented) on changes in mathematics achievement, interest and self-evaluation was compared – with a particular focus on the mediating role of feedback’s perceived usefulness. Participants, 146 ninth graders (aged 14 to 17?years), were assigned to either a process-oriented or a grade-oriented experimental feedback condition. They worked on mathematics tests, received feedback on their test results and completed surveys measuring feedback’s perceived usefulness, interest and self-evaluation. Results of path analysis showed that process-oriented feedback was perceived as more useful than grade-oriented feedback and that feedback’s perceived usefulness had a positive effect on changes in achievement and interest. Consistent with this, process-oriented feedback had a greater positive indirect effect than grade-oriented feedback on changes in mathematics achievement and interest via its perceived usefulness. There were no such effects on changes in self-evaluation. Potential explanations for these findings, educational implications and possible directions for future research are discussed.     

The principal’s role in the post-evaluation process.—How does the principal engage in the work carried out after the schools self-evaluation?

This article refers to a study on how the school principal engaged in the process after a school self-evaluation. The study examined how two primary schools followed up the evaluation. Although they both used the same evaluation tool, the schools’ understanding and application of results differed greatly. This paper describes and discusses the post evaluation process based on Erik Johnsen’s ideal leadership model (2002). It argues that formal leadership makes a difference in the use of the school evaluation for development by providing a proper context for knowledge sharing and reflection. This involves the prioritization and facilitation of individual and organisational reflection for learning, as well as transformation of knowledge through interaction across the whole school.