Impact of school inspections on improvement of schools—describing assumptions on causal mechanisms in six European countries

School inspection is used by most European education systems as a major instrument for controlling and promoting the quality of schools. Surprisingly, there is little research knowledge about how school inspections drive the improvement of schools and which types of approaches are most effective and cause the least unintended consequences. The study presented in this paper uses interviews with inspection officials and a document analysis to reconstruct the “program theories” (i.e. the assumptions on causal mechanisms, linking school inspections to their intended outcomes of improved teaching and learning) of Inspectorates of Education in six European countries. The results section of the paper starts with a summary of the commonalities and differences of these six national inspection models with respect to standards and thresholds used, to types of feedback and reporting, and to the sanctions, rewards and interventions applied to motivate schools to improve. Next, the intermediate processes through which these inspection models are expected to promote good education (e.g. through actions of stakeholders) are explained. In the concluding section, these assumptions are critically discussed in the light of research knowledge.     

The regulation of teaching as symbolic politics: rituals of order,blame and redemption

This article explores the school inspection as a political ritual for the management of tensions between competition and equality inherent in neo-liberal educational regulatory regimes. At the centre of the article is a case study of how teachers in an allegedly failing working-class English primary school coped with issues of social class, educational success-and-failure and an Office of Standards in Education (OFSTED) inspection and related accountability measures. National educational policy – relative performance data and inspection – generated a crisis within the school, and intervened in teacher discourse about the role of social class in pupil attainment. Whereas previous scholarship on OFSTED and inspections has emphasised their harmful effects on teachers and teaching practice, the current article broadens the focus from regulatory to political issues, from specific schools to the stability of the educational order more generally. Based on this case study, situated within a broader analysis of shifting discourses about social class and education in English educational policy, I argue that (1) the current regulatory regime makes ‘failure’ inevitable, thereby posing a symbolic problem for policy-makers and politicians; (2) by identifying failure and allocating blame, the inspection ritual fulfils an important symbolic function; which (3) serves to buttress the legitimacy of the neo-liberal educational order.     

What Teachers and Headteachers Think about Inspection

This is a study of 14 inspections of primary and secondary schools carried out by local inspectors in five widely separated areas during 1992 and 1993. The inspection approaches varied and in two cases followed the new OFSTED pattern. Reactions to inspection were gathered through interviews with headteachers and discussions with groups of teachers. Teachers’ reactions are described in relation to: the preparation for inspection; the inspectors as individuals; the inspection process; reporting and follow‐up. It is suggested that some of the concerns associated with these issues will be met by the new OFSTED arrangements. However, OFSTED practice may be less satisfactory in meeting other concerns such as the provision of adequate teacher feedback and the organisation of follow‐up advice and support     

Inspection and emotion

In this paper I explore the emotional impact of inspection on the staff of a school in the two years between Ofsted1 1. Office for Standards in Education, the school inspection service in England. View all notes inspections. Using data from one school undergoing inspection, I argue that the negative emotional impact of inspection of teachers goes beyond the oft‐reported issues of stress and overwork. Teachers experience a loss of power and control, and the sense of being permanently under a disciplinary regime can lead to fear, anger and disaffection. This perhaps calls into question the whole issue of seeking school improvement by way of a system which creates such a negative emotional impact.     

The place of emotions while inspecting schools: reflections of two Ofsted inspectors

This article investigates the role of emotions of inspectors while inspecting schools as reported by inspectors themselves within an education context of increased accountability that arguably privileges rationality over emotions. The study is built on an emotion management framework that regards emotions not only as unavoidably natural and intimately linked to ‘rational’ judgements that people make, but also that such judgements are social constructions used to regulate expression of emotions. In-depth interview data of one retired and another, semi-retired Office for Standards in Education, inspectors were thematically analysed to assess the extent to which their emotions formed part of school inspections. In the absence of an officially sanctioned narrative of inspectors’ emotions during inspections, two kinds of self-prescribed emotions emerged as key findings: emotions for accountability, to which inspectors gave expression, and emotions for improvement, that they suppressed. For an inspection body that needs to ensure both accountability and improvement of schools to justify its viability, these research claims open up a new area of discussion that should lead to a review of inspection body’s stance on emotions and individual inspectors’ self-reflections on the moral as well as professional obligation to pursue both emotions for accountability and improvement.     

浅析督导工作的质量管理

督导工作是教学管理工作的重要组成部分，应开展经常性和阶段性的检查、监督、评估与指导。在质量管理实践中，可采取以下四个步骤：三检查、三听课、三评价、三反馈。紧紧围绕以上四个环节抓质量管理已初见成效。这极大地调动了教师的积极性。许多教师在压力中提升自己，通过各种途径，进一步提高自己的教学水平。     

‘We're all in this game whether we like it or not to get a number of As to Cs.’ Design and technology teachers' struggles to implement creativity and performativity policies

Education reform in England has seen many policies and initiatives introduced by central government. This article discusses two such policies, performativity and creativity. Performativity has been central to the government's agenda of raising standards and includes monitoring mechanisms such as Office for Standards in Education (Ofsted) inspections, performance management and school league tables, all of which are used to measure or judge the value or worth of a school or individual teacher. At the same time as policies on performativity have been implemented, policy makers have introduced a number of policies to encourage creativity in education. This article foregrounds teachers of design and technology (D&T) at secondary level (11–16 years), describing how they struggled to implement both strategies. Teachers valued creativity and thought it was an important part of the subject, but the pressure to be seen to be performing and getting favourable positions in school league tables and Ofsted inspections meant the teaching of D&T became rather formulaic, which allowed very little opportunity for creative learning. Individual interviews were conducted with 14 D&T teachers across six schools and an open‐ended email survey was conducted with a further 17 D&T teachers from 15 schools during the preliminary phase of a research and intervention project. In addition, 69 D&T teachers across eight schools completed a questionnaire at the start of the main intervention period. Data from 126 student interviews across six schools are used to support the teacher data outlined above.     

The deployment,training and teacher relationships of teaching assistants supporting pupils with autistic spectrum disorders (ASD) in mainstream secondary schools

Growing numbers of pupils with autistic spectrum disorders (ASD) are attending mainstream schools, and increasing numbers of additional staff are being deployed to support them. Recent research has cast doubt on the effectiveness of this support, by highlighting issues relating to deployment and training, and to relationships with class teachers. This study, conducted by Wendy Symes, who is a Research Associate at the University of Manchester, and Neil Humphrey, who is Professor of Education in the same university, interviewed 15 teaching assistants supporting pupils with ASD in four mainstream secondary schools in the north‐west of England to explore these issues. Analysis yielded several key findings. The majority of teaching assistants worked with just one pupil at a time and worked in a variety of lessons. Their role primarily involved helping pupils to stay focused and follow instructions. Many teaching assistants had no experience of ASD prior to starting their job. The amount of training received varied, but all felt that generic training about ASD was not helpful. A lack of time for joint planning with teachers was raised as a key concern. These findings are discussed in relation to the growing literature on inclusive education for pupils with ASD.     

Development and Pilot Testing of a Food Safety Curriculum for Managers and Staff of Residential Childcare Institutions (RCCIs)

Food safety training materials, targeted for residential childcare institution (RCCI) staff of facilities of 20 residents or less, were developed, piloted, and evaluated. The goal was to assist in the implementation of a Hazard Analysis Critical Control Points (HACCP)‐based food safety plan as required by Food and Nutrition Service/United States Department of Agriculture. RCCI staff and instructor training manuals, Food Safety Basics: Food Safety Education for RCCIs was developed and pilot tested in RCCIs in both Rhode Island and Massachusetts. The program was evaluated by participants and pre‐/posttraining onsite inspector and microbial assessments. The core curriculum contained 3 modules and corresponding activities: Module 1: cause, prevention, and strategies to reduce foodborne illness; Module 2: components of a HACCP‐based food safety plan and standard operating procedures; and Module 3: actual food safety plan development, including instructions for implementation and corresponding monitoring procedures required. There were 50 to 82 RCCI staff members that attended 2 or 3 modules. Participants rated the modules 4.5 ± 0.4, 4.3 ± 0.4, and 4.4 ± 0.4 out of 5‐point Likert scale (1 = strongly disagree, 5 = strongly agree) for teaching modules 1, 2, and 3, respectively. The evaluations assessed their understanding of key topic areas taught. Onsite inspections showed improvement in many critical food safety issues. Some deficiencies still appeared to be problematic, such as refrigerator temperature monitoring and issues with storage and cross‐contamination.     

The return of the native: the blurred boundaries of insider/outsider research in an English secondary school

This paper outlines the methodological issues I faced during my research as a ‘returning native’ in an English secondary school. The empirical research took the form of a three‐year case study and used some ethnographic methods, as it comprised interviews carried out over a period of three academic years in the school in which I was once employed as a teacher. I was also given the opportunity to work in the school as a consultant in the lead‐up to and during its Office for Standards in Education, Children’s Services and Skills (OfSTED) inspection. This enabled me to conduct interviews, observe, interact in informal conversations and participate in the inspection week. In this paper I explore the unique role of the insider‐researcher, or returning native. Not only was this a school in which I had previously worked, but actually participating in the inspection added new layers of complex loyalty.     

Insights gained by schools and emotional consequences of school inspections. A review of evidence

This study systematically reviews research evidence regarding two questions: (1) to what extent do schools gain insight into the quality of their own functioning as a result of an inspection? and (2) what are the emotional consequences of inspections experienced by school staff?

It provides a review of empirical research studies published as full-length articles in scientific journals and proceedings of international conferences, symposia and workshops, as well as in books or as book chapters, from 1995 until 2012. Both quantitative and qualitative data are considered. The review process identified 35 relevant publications that met the criteria for inclusion.

The review leads to the conclusion that inspections fail to contribute significantly to schools’ self-understanding, but that they lead to a severe negative emotional impact on school staff. Furthermore it is concluded that the current evidence base shows several gaps, mainly related to underlying explanatory features that contribute to the occurrence of these effects.     

How can the inspection process enhance improvement in special schools?

Abstract

The new system for the inspection of special schools was introduced in England in September 1994, using common criteria as those used for mainstream schools. One of the main purposes of inspection stated by the Office for Standards in Education (OFSTED) is school improvement. This paper presents the perceptions of headteachers of the inspection process arising from the first inspections carried out during September‐December 1994. The evidence base used on these inspections is also considered. These data are used to suggest that school improvement can be enhanced by the inspection process under certain conditions. A preliminary exploration of these conditions is provided in the paper. Implications for the school inspection process, school self‐review and future research questions are identified.     

Assessment by Interview and Portfolio in a Graduate School Program

Assessment plays an integral role in teaching and learning in higher education and teachers have a strong interest in debates and commentaries on assessment as and for learning. In a 1-year graduate entry teacher preparation program, the temptation is to emphasize assessment in an attempt to ensure students “cover” everything as part of a robust preparation for the profession. The risk is that, for students, assessment drives curriculum, and time spent in the completion of assignments is no guarantee of either effective learning or authentic preparation for teaching. Interviews as assessment provide an opportunity for a learning experience as well as an authentic task, since students will shortly be interviewing for employment in a “real world” situation. This paper reports on a project experimenting with interview panels as authentic assessment with preservice early childhood teachers. At the end of their first semester of study, students enrolled in the Graduate Diploma of Education program at the Queensland University of Technology in Australia were required to participate in a panel interview where they were graded by a panel made up of three faculty staff and one undergraduate student enrolled in the 4-year Bachelor of Education program. Students and panel members completed a questionnaire on their experience after the interview. Results indicated that both students and staff valued the experience and felt it was authentic. Results are discussed in terms of how the assessment interview and portfolio presentation supports graduating students in their preparation for employment interviews, and how this authentic assessment task has benefits for both students and teaching staff.     

Comparing effects and side effects of different school inspection systems across Europe

In this article, different inspection models are compared in terms of their impact on school improvement and the mechanisms each of these models generates to have such an impact. Our theoretical framework was drawn from the programme theories of six countries’ school inspection systems (i.e. the Netherlands, England, Sweden, Ireland, the province of Styria in Austria and the Czech Republic). We describe how inspection models differ in the scheduling and frequency of visits (using a differentiated or cyclical approach), the evaluation of process and/or output standards, and the consequences of visits, and how these models lead to school improvement through the setting of expectations, the use of performance feedback and actions of the school's stakeholders. These assumptions were tested by means of a survey of principals in primary and secondary schools in these countries (n?=?2239). The data analysis followed a three-step approach: (1) confirmatory factor analyses, (2) path modelling and (3) fitting of multiple-indicator multiple-cause models. The results indicate that Inspectorates of Education that use a differentiated model (in addition to regular visits), in which they evaluate both educational practices and outcomes of schools and publicly report inspection findings of individual schools, are the most effective. These changes seem to be mediated by improvements in the schools’ self-evaluations and the schools' stakeholders’ awareness of the findings in the public inspection reports. However, differentiated inspections also lead to unintended consequences as principals report on narrowing the curriculum and on discouraging teachers from experimenting with new teaching methods.     

Surveillance,Governmentality and moving the goalposts: The influence of Ofsted on the work of schools in a post-panoptic era

This paper asks the question: to what extent do inspection regimes, particularly the Office for Standards in Education (Ofsted), influence the work of a school, and how might that influence be conceptualised? It draws on an ESRC-funded study of ‘policy enactments in secondary schools’, which was based on case-study work in four ‘ordinary’ schools. Here the data set is re-examined to understand the extent to which Ofsted had an ongoing influence on the work of the leadership, management and teachers in these schools. We undertook a process of secondary analysis of the data from the project and found that the influence of the inspection agenda was strong in the schools, policy decisions were often being made to conform to Ofsted’s expectations and the influence on leadership and management was clearly apparent. In resisting this agenda we also found that schools to some extent performed ‘the good school’ for inspections. Finally, we relate this empirical evidence to conceptions of governmentality and post-panopticism to shed new light on their theoretical relevance to contemporary inspection regimes.     

The Assurance of Standards at Masters level: An empirical investigation

This article presents the findings of a study of 94 Postgraduate Taught Masters programmes (PGTMs) offered in twelve Higher Education Institutions (HEIs) in the UK. It is based on interviews with administrators and with degree programme directors. Documentation was also analysed. The study was commissioned by the HEQC/QAA as a result of the recommendations of the Harris and Dearing Reports. The study reveals wide variation in regulatory frameworks relating to Masters programmes and in the design of programmes, but consensus on the defining characteristics of work at this level and the nature of benefits that students obtain. While institutional procedures for initial approval and validation appear to be rigorous and effective, the ongoing assurance and monitoring of standards is heavily dependent on the external examiner system and informal academic networks with virtually no systematic staff development or benchmarking in place. Several issues are identified in relation to the proposed national typology of courses/levels.     

Good intentions: teaching and specialist support staff perspectives of student disclosure of mental health issues in post-secondary education

This article reports findings from a qualitative case study, as part of which staff perspectives of student disclosure of mental health issues in an Australian post-secondary vocational education setting were explored. Twenty teaching and specialist support staff from four vocational education and training institutions participated in individual semi-structured interviews. Institutional policies and practices related to the management of disability at each site provided contextual information relevant to the staff experience. All data were analysed thematically. Staff participants strongly supported student disclosure of mental health issues. Staff linked the likelihood of course success for students experiencing mental illness with disclosure and the implementation of educational supports. Findings draw attention to subtle differences in constructions of student disclosure reported by the specialist support staff and the teachers: differences in perspective which were consistent across locations. This study highlights the influence of personal experience of mental illness and institutional processes for educational adjustment on staff perspectives of student disclosure. Implications of the current practices in post-secondary education student support services are discussed. Further research on disclosure beliefs among teachers and specialist support staff, in a wider range of educational settings, would allow for a deeper exploration of issues raised by this study.     

Creative Approaches to Raising Achievement of Adult Learners in English Further Education

abstract

The IMPEL2 Project is a JISC‐funded eLib Project based at the University of Northumbria at Newcastle. It has been engaged in a 2‐year (1996‐98) investigation of organisational and cultural change in the increasingly electronic environment in UK Higher Education HE. The selection of Case Study sites was purposive; some had participated in the previous IMPEL1 study. A qualitative methodology, using analysis of documentation, semi‐structured interviews and questionnaires, has been used to examine complex and sometimes sensitive issues.

Through Case Studies at 24 Universities and HE Colleges and over 300 interviews, with a range of academic staff, library and information services staff and computer services staff, the Project team has gained insights into the impacts of electronic information provision on academic and student users, the impacts of resource based learning and training, and considered the implications for the training and development of library staff.

This article gives some of the findings of the IMPEL2 Project on supporting students in resource based learning. It considers why it is beneficial to support students and highlights the recent changes in HE which make academic support of students vital to their success.

The article outlines the evidence of the IMPEL2 Project which suggests that certain kinds of support are needed including the provision of appropriate resources, access to these resources, the teaching of skills to students and the provision of on‐going advice, guidance and support. Finally the implications for academic staff are considered.     

Study of Teacher Practices in Health Sciences in Brazil

Abstract

This study involved fourteen semistructured interviews with teaching staff at a Brazilian university. These interviews were aimed at unveiling possible transformations caused by distance education in classroom teaching and in medical assistance practices. The discourses collected were analyzed using qualitative methods and divided into groups with convergent meanings, resulting in the following units: Infrastructure, Personal Use of Information Technology Resources, Impressions of Distance Education, Intensity of Dedication, Interactivity, Benefits of Distance Education, Teaching Practices, and Changes in Assistance. Results suggest that virtual teaching has resulted in positive changes in the professor–student relationship that allow improvements in interactivity and the creation of different expectations from those observed in classroom practice. There was a significant appropriation of the technological resources and pedagogical activities used in online courses for classroom teaching practice. Also observed was the transfer of knowledge to the personal and medical assistance spheres.