Explaining effects and side effects of school inspections: a path analysis

There are large differences between schools with regard to how they are affected by a school inspection. This study provides quantitative evidence about the extent to which perceived effects and side effects of an inspection are related to the inspection’s judgement on the school, to features of the inspection, and to school features. This study draws on quantitative data collected from 2,202 teachers in Flemish primary and secondary schools that had recently been inspected. Using path analysis, it investigates the existence and strength of relationships between the perceived effects and side effects of inspection, on the one hand, and the perceived inspection quality, the perceived school’s policy-making capacities, and the inspection judgement, on the other hand. The analysis reveals that most effects and several side effects are predominantly explained by the perceived inspection quality. Emotional side effects during inspection are best predicted by the school’s policy-making capacities.     

The effect of school inspections on school improvement

This study uses a school-level longitudinal control-group design to examine how teachers and principals of inspected versus uninspected schools perceive school improvement at their schools. During the phasing in of school inspections in the states of Berlin and Brandenburg (Germany), both inspected and uninspected schools were surveyed with respect to school improvement activities over a 1-year period. The main finding is that principals’ and teachers’ perceptions of school quality were highly stable, irrespective of the introduction of school inspections. The results show school inspections had a comparatively low impact on the aspects of school quality measured here.     

History,nation and school inspections: the introduction of citizenship education in elementary schools in late nineteenth-century Sweden

It was in the late nineteenth century that teaching in Sweden’s elementary schools began its transformation from a religious education to a broader, national citizenship education that included history and geography. International research has pointed to a connection between the introduction of school inspections and the reform of public education during this period. In Sweden, however, the practice of inspection has not been explored at any length. This article therefore considers the part played by school inspections in the implementation of a more extensive curriculum in Swedish elementary schools in the period 1860–1900, with a particular focus on the subject of history, using a study of inspection reports from the diocese of Uppsala. It is argued that school inspectors had a key role in initiating reform at the local level, but also that the move towards broader-based citizenship education was not a simple, straightforward process.     

Comparing effects and side effects of different school inspection systems across Europe

In this article, different inspection models are compared in terms of their impact on school improvement and the mechanisms each of these models generates to have such an impact. Our theoretical framework was drawn from the programme theories of six countries’ school inspection systems (i.e. the Netherlands, England, Sweden, Ireland, the province of Styria in Austria and the Czech Republic). We describe how inspection models differ in the scheduling and frequency of visits (using a differentiated or cyclical approach), the evaluation of process and/or output standards, and the consequences of visits, and how these models lead to school improvement through the setting of expectations, the use of performance feedback and actions of the school's stakeholders. These assumptions were tested by means of a survey of principals in primary and secondary schools in these countries (n?=?2239). The data analysis followed a three-step approach: (1) confirmatory factor analyses, (2) path modelling and (3) fitting of multiple-indicator multiple-cause models. The results indicate that Inspectorates of Education that use a differentiated model (in addition to regular visits), in which they evaluate both educational practices and outcomes of schools and publicly report inspection findings of individual schools, are the most effective. These changes seem to be mediated by improvements in the schools’ self-evaluations and the schools' stakeholders’ awareness of the findings in the public inspection reports. However, differentiated inspections also lead to unintended consequences as principals report on narrowing the curriculum and on discouraging teachers from experimenting with new teaching methods.     

Risk-based school inspections in the Netherlands: A critical reflection on intended effects and causal mechanisms

This paper compares and contrasts the program theory of the reenacted Supervision Act to the Supervision Act of 2003. We describe how the expectations about how schools should be inspected, the effect such inspections are expected to have, and how these effects should be realized have changed over the past years as a result of changing paradigms of governance and the supervision of schools. An ex ante evaluation of the program theory shows that the changed inspection methods are likely to be less effective compared to the previous paradigm.     

Effectiveness and perceived usefulness of follow-up classroom observations after school inspections in Northern Germany

School inspection is an external evaluation method that aims to promote the improvement of instruction in several European countries. One typical feature of a school inspection is classroom observation. In order to improve the effectiveness of school inspections in enhancing classroom practices in Lower Saxony (a large federal state in Northern Germany), a follow-up classroom observation was implemented at several secondary schools. The aim of the current study was to evaluate the effects of this treatment on lesson development and its perceived usefulness using an online questionnaire. In total, 436 teachers in the treatment group and 161 teachers in the control group participated in the study. The results show a very small effect of follow-up classroom observations on lesson development in schools. Teachers rate the usefulness of this intervention as rather low. However, follow-up classroom observations seem to have a larger impact on lesson development in schools with a lower level of cooperation among teachers.     

Reconsidering school politics: educational controversies in Sweden

School politics in Sweden has recently moved in a conservative direction, emphasising the importance of conventional school subjects, stronger teacher authority and more discipline in the classroom. At the same time, consensus on the utility of such measures is lacking in the school debate. The conservative approach is often criticised as misleading and behind the times in relation to contemporary knowledge demands. This article examines and discusses the relevance of this critique. The main argument is that the conservative approach has a better matching with a previous phase in the history of Swedish school politics and that conventional schooling is difficult to combine with two of the major goals of schooling today – the diffusion of democracy and multipurpose skills. From this perspective, the political notion of schooling seems decoupled from the broader domain of public demands on education. To alleviate this problem school politics should draw less on the pedagogical ideas of essentialism and more on the historical legacy of progressivism in the Swedish education system.     

Insights gained by schools and emotional consequences of school inspections. A review of evidence

This study systematically reviews research evidence regarding two questions: (1) to what extent do schools gain insight into the quality of their own functioning as a result of an inspection? and (2) what are the emotional consequences of inspections experienced by school staff?

It provides a review of empirical research studies published as full-length articles in scientific journals and proceedings of international conferences, symposia and workshops, as well as in books or as book chapters, from 1995 until 2012. Both quantitative and qualitative data are considered. The review process identified 35 relevant publications that met the criteria for inclusion.

The review leads to the conclusion that inspections fail to contribute significantly to schools’ self-understanding, but that they lead to a severe negative emotional impact on school staff. Furthermore it is concluded that the current evidence base shows several gaps, mainly related to underlying explanatory features that contribute to the occurrence of these effects.     

From reform to reform: how school reforms are motivated and interrupted – the case of ‘school inspections’ in Germany

ABSTRACT

In this article, we analyse the implementation and change of a specific school reform in Germany using the example of external school evaluation in Lower Saxony: the school inspection. We investigate how and why a newly implemented reform is itself subject to reform shortly afterwards. We begin with a historical background of German school reforms over the last 40 years. Then, we consider school reforms through the lens of organisational theory. Finally, we combine the historical and theoretical perspectives on school reforms placing particular emphasis on more recent developments in external school evaluation. Based on these considerations, we elaborate some theses on reform and routine in schools.     

Setting expectations for good education: how Dutch school inspections drive improvement

With decentralisation becoming increasingly widespread across Europe, evaluation and accountability are becoming key issues in ensuring quality provision for all (Altrichter & Maag Merki, 2010; Eurydice, 2004). In Europe, the dominant arrangement for educational accountability is school inspections. The purpose of this research is to identify and analyse the ways in which school inspections in The Netherlands impact on the work of schools. The results of 2 years of survey data of principals and teachers in primary and secondary schools show that inspection primarily drives change indirectly, through encouraging certain developmental processes, rather than through more direct and coercive methods, such as schools reacting to inspection feedback. Specifically, results indicate that school inspections which set clear expectations on what constitutes “good education” for schools and their stakeholders are strong determinants of improvement actions; principals and schools feel pressure to respond to these prompts and improve their education.     

Risk-based school inspections: impact of targeted inspection approaches on Dutch secondary schools

In most countries, publicly funded schools are held accountable to one inspectorate and are judged against agreed national standards. Many inspectorates of education have recently moved towards more proportional risk-based inspection models, targeting high-risk schools for visits, while schools with satisfactory student attainment levels are excluded from inspections. This paper looks into these newer inspection models and aims to enhance our understanding of the potential effectiveness of such targeted models on student attainment and other performance indicators. Random effects models, analyzing changes in schools over time, indicate that targeted inspections particularly have an effect on student attainment in literacy in weak schools, while also impacting on student satisfaction, student numbers and student-staff ratios.     

The development of the middle school in Sweden: Research and evaluation

The development of the middle school in Sweden is discussed. The historical development is described, with the focus on the creation of teaching traditions as a result of a parallel school system. In the development of the comprehensive school system after World War II, these traditions influenced the forming of the content of the new school.The conflicts around the comprehensive school showed the need for educational research in order to improve decision making. The relation between educational planning, curriculum development and educational research is analyzed.In the seventies a new direction in educational policy emerged, aiming at a more decentralized school system. These changes in the political governing of education are analyzed and discussed in relation to research and the role of educational research in policy making and evaluation of reforms.     

Effects and side effects of inspections and accountability in education: an overview of empirical studies

This paper presents an overview of studies into effects and side effects of control mechanisms in education. We focus on effects and side effects of inspection visits and public performance indicators. A first conclusion is that the studies do not provide us with a clear answer to the question of whether inspections have positive causal effects on the quality of schools. Results of studies of publications on public performance indicators are more unambiguous. They lead us to the conclusion that although principals and teachers believe performance indicators are important, parents and pupils take very little notice of these indicators when choosing schools. A third conclusion concerns the occurrence of side effects of school inspections and other control mechanisms in education. Several of the studies discussed clearly refer to the existence of these side effects, such as ‘window dressing’ and other types of ‘gaming’.     

The unintended consequences of school inspection: the prevalence of inspection side-effects in Austria,the Czech Republic,England, Ireland,the Netherlands,Sweden, and Switzerland

It has been widely documented that accountability systems, including school inspections, bring with them unintended side effects. These unintended effects are often negative and have the potential to undo the intended positive effects. However the empirical evidence is limited. Through a European comparative study we have had the rare opportunity to collect empirical evidence and study the effects (both intended and unintended) of school inspections (a key system of accountability) in a systematic way, across seven countries. We present the findings of the unintended effects in this paper. Survey self-report responses from school principals in each country, with differing school inspection systems, are analysed to measure the prevalence of these unintended effects and to investigate the part played by pressure to do well in inspections. A key finding is that increasing pressure in school inspection systems is associated with the undesired effect of the narrowing and refocusing of the curriculum and instructional strategies. We also show that a proportion of school principals admit to misrepresenting the school in data sent to the inspectorate and show evidence for formalisation/proceduralisation (excessive focus on records) and ossification (fear of experimentation in teaching), although these factors are less related to changes in pressure.     

Moral impasses in sustainability education? Empirical results from school geography in Austria and Germany

Abstract

The expert-driven and normative character of sustainability education aims to promote societal transformation and global change. While some authors underline the ethical claims of education, others have criticized that there is a problematic tendency to prescribe certain actions beyond ethical education. The article aims to provide an empirical contribution, including students’ and teachers’ perspectives, and geography textbooks, to the debate. Based on the results of an empirical study with 1001 secondary school students in Austria and Germany, we discuss the “ethical turn” and the moral code in sustainability education. The questionnaires are completed with students’ drawings, qualitative interviews with geography teachers and an analysis of geography textbooks. We argue that most students have a precise idea what sustainability and sustainable behavior means, but they harbor right-wrong binary perceptions of sustainable lifestyles. Many students lack knowledge of the interdependence of consumption and production networks, which impedes the understanding of complex sustainability patterns. Therefore, we recommend pluralistic and interconnected perspectives in sustainability, in the frame of school geography. A more democratic classroom contributes to develop an own moral compass. Additionally, passion and participatory approaches can help students reflect on their affective relationships with consumer goods and consider alternative consumption-production paradigms.     

Comparing active game-playing scores and academic performances of elementary school students

In the educational sciences, many discussions on the use of computer games occur. Most of the scientists believe that traditional computer games are time-consuming software and that game-playing activities negatively affect students’ academic performance. In this study, the accuracy of this general opinion was examined by focusing on the real game-playing scores of an elementary school students in Turkey. First, researchers selected a single-player strategy game. Second, the selected game was given to 105 fifth-grade students, who had not played it before, so that they could play it over a 30-minute period. The most successful student of the group finished the 23rd level of the game and collected 8152 points in total. In order to investigate the correlation between strategy game performance and academic performance, researchers derived the students’ average exam scores for six different courses (mathematics, physical science, science and technology, visual arts, music, and social sciences) from official documents. At the end of the study, it was found that participants’ mathematical or physical science skills were positively correlated with game success; however, a negative relationship was not exists between an individual's computer game success and academic performance.     

Access to education and political candidacy: Lessons from school openings in Sweden

How does availability of education affect who becomes a political representative? Theorists have pointed out that access to education is a key to a well-functioning democracy, but few empirical studies have examined how changes in the access to education influence the chances of becoming a politician. In this paper, we analyze the effects of a large series of school openings in Sweden during the early 20th century, which provided adolescents with better access to secondary education. We use administrative data pertaining to the entire Swedish population born between 1916 and 1945. According to our empirical results, the opening of a new lower secondary school in a municipality increased the baseline probability of running for political office by 10–20%, and the probability of holding office by 20–30%.     

Experiences of beginning teachers in a school‐based mentoring program in Sweden

Even though teacher education has been successful in preparing students for their future profession, the classroom reality can differ greatly from the inservice training. Many novice teachers therefore find the transition from student teacher to inservice teacher overwhelming To support beginning teachers, mentoring programs—where more experienced teachers support novice teachers—have become commonplace in many schools worldwide. In Sweden, mentoring for beginning teachers has been a frequent feature of support since 2001. This study, conducted in Sweden, examines seven novice teachers and the impact the mentoring process had upon them during their first‐year teaching. Based on interviews, it was found that these experienced both professional and personal support from their mentors. The study also showed the significance of observant leaders within the mentorship program following up on the development of the mentor–mentee relationship.