The impact of national educational policies on student achievement: a European study

This paper investigates the impact of national policies for improving teaching and the school learning environment (SLE) on student achievement. In each participating country (i.e., Belgium/Flanders, Cyprus, Germany, Greece, Ireland, and Slovenia), a sample of at least 50 schools was drawn and tests in mathematics and science were administered to all Grade 4 students (N = 10,742) at the beginning and end of school year 2010–2011. National policies were measured through (a) content analysis of policy documents, (b) interviews with policymakers, and (c) head-teacher questionnaires. Multilevel analyses revealed that most aspects of national policies for teaching and SLE were associated with student achievement in each subject irrespective of the source of data used to measure them. Implications are, finally, drawn.     

A dynamic approach to school improvement: main features and impact

This paper refers to the dynamic approach to school improvement (DASI) which attempts to contribute to the merging of educational effectiveness research and school improvement. The main underlying assumptions and the implementation phases of DASI are discussed. Moreover, a study aiming to compare the impact of DASI in helping schools to reduce bullying is presented. The results reveal that DASI has a stronger impact on improving school factors and reducing bullying than other approaches to school improvement. Suggestions for further research investigating the sustainability of DASI on school effectiveness are provided and policy implications are drawn.     

The effects of the use of a school self-evaluation instrument

School quality care has become important in many Western countries. A number of self-evaluation instruments have been developed in response. The goal of these instruments is improving the quality of education. One such system, ZEBO, was developed for performing quality assessment in Dutch primary schools. The use of this self-evaluation instrument was studied in 79 primary schools in The Netherlands over a period of 5 years. The results of the multilevel analyses with repeated measures show that the use of the self-evaluation results had no effect on pupil achievement scores (so far). However, it did have other effects, for example, an impact on the professional development of teachers.     

Participation in extracurricular activities and student achievement: evidence from German all-day schools

The major aim of educational effectiveness research is to examine and explain school, class, and teacher differences with respect to relevant educational criteria. Until now, in the large majority of studies, language and mathematics scores were used as a criterion. In the present study, the educational track students choose at the start of secondary education (at the age of 12) and their success in the chosen curriculum are examined in relation to primary school and classes (Grades 1 to 6). Two-level models show that students had higher aims in secondary education if they had attended primary Catholic schools and/or primary schools with high average curriculum advice. The latter schools were also highly effective with respect to achievement, and their students had a high socioeconomic status and background. Multilevel models with a cross-classified structure showed no direct long-term effects of primary schools and classes.     

School policy on teaching and school learning environment: direct and indirect effects upon student outcome measures

School policy on teaching and the school learning environment (SLE) are the main school factors of the dynamic model of educational effectiveness (Creemers & Kyriakides, 2008 Kyriakides, L. and Tsangaridou, N. 2008. Towards the development of generic and differentiated models of educational effectiveness: A study on school and teacher effectiveness in physical education. British Educational Research Journal, 34: 807–838. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). A longitudinal study in which 50 primary schools, 108 classes, and 2369 students participated generated evidence supporting the validity of the dynamic model. This article reports the results of a re-analysis of the data of this study in order to search for direct and indirect effects of school factors included in the model. Using multilevel structural equation modelling techniques, indirect effects of school policy on teaching and SLE upon achievement in mathematics and Greek language are demonstrated. Implications of findings are drawn. Comparing the results of the multilevel direct and indirect effect model with those from using a multilevel regression model, we demonstrate the importance of choosing appropriate conceptual models and using relevant methodological approaches to understand the dynamic nature of educational effectiveness.     

Education Reform and Reconstruction as a Challenge to Research Genres: Reconsidering School Effectiveness Research and Inclusive Schooling

This project investigates the impact of the dynamic approach to school improvement (DASI) aiming to help schools face and reduce bullying through integrating research on bullying with educational effectiveness research (EER). A network of approximately 15 schools in each participating country (i.e., Belgium, Cyprus, England, Greece, and The Netherlands) received support to use DASI in order to improve the functioning of school factors included in the dynamic model of educational effectiveness which are associated with reduction of bullying. The Revised Olweus Bully/Victim Questionnaire was administered to students of the experimental (n = 1461) and control (n = 1535) group at the beginning and at the end of the intervention. With the use of multilevel modelling techniques, it was found that schools which made use of DASI were able to reduce bullying at a significantly higher level than the schools of the control group. Implications for the development of effective policies and practices in reducing bullying are drawn.     

School self-evaluation for development: The case for and reflections on a training programme

Abstract

This paper explores the case for schools conducting their own self-evaluation to serve the dual purpose of professional development within schools and accountability demands from external sources. The paper is in three parts. The first outlines the argument and benefits for schools conducting their own case study evaluation of their curriculum policies and practices, indicating how this approach is both similar to and different from external case study of schools. The second describes a training programme designed and implemented by the author to support schools in conducting evaluations that are valid, credible and useful. The third presents the participants' and author's reflections on the training and its outcomes and, through an example from one of the schools involved, illustrates what school self-evaluation looks like grounded in the actual experience of undertaking the process. From the evidence presented, the paper concludes that educational professionals, with appropriate support and training, are more than equal to the task of conducting credible and valid case study school self-evaluations.     

The school effectiveness movement: origins,shortcomings and future possibilities

ABSTRACT

This paper argues that the school effectiveness/school improvement movement has provided an antidote to the pessimism and fatalism of the 1970s. However, it is deficient in four important respects: (1) it places too much emphasis on the notion of progressive school management as the dynamic of change; (2) it fails to take full account of the characteristics of the education system as a whole; (3) it shows little regard for issues of social class; (4) it has little to say about issues of curriculum content and pedagogy.     

Perceptions of the school self-evaluation process: the case of Abu Dhabi

The Abu Dhabi Education Council (ADEC) has initiated educational change and school improvements. As part of the school reform agenda, ADEC has introduced school self-evaluation-Irtiqaa (SSE-Irtiqaa). This research probes the effectiveness of school administrators (SAs), including principals, vice principals, academic principals, and heads of faculty, and their perceptions of the implications and implementation of SSE-Irtiqaa. The study also intends to improve school quality and help benchmark Abu Dhabi public schools with international academic standards, by tracing challenges faced during the SSE-Irtiqaa process. Public SAs are the participants of this study. This research is an exploratory case study that employed a qualitative research tool. Semi-structured individual interviews were conducted with 14 administrators representing 6 public schools in Abu Dhabi. Findings and recommendations shed light on the areas and paths of development required to facilitate and improve the SSE-Irtiqaa process.     

Site selection in school district research: a measure of effectiveness using hierarchical longitudinal growth models of performance

School districts in the USA are an active area of study in education research as findings have shown that some districts find success in certain contexts while others struggle. However, the research domain has had few actionable methods for site selection for in-depth qualitative studies. This study analyses all districts in the state of Ohio (n = 610) from 2005–2006 through 2012–2013 using a two-level hierarchical linear growth model to identify districts that significantly outperform or underperform background and demographic variables in the Ohio Performance Index (PI) Score, factors outside the influence of the district administration. The aim of the study is to provide a framework for selecting comparison and contrast sites for district effectiveness research (DER). Additionally, the model captures school-level variance within districts controlling for average district performance. Fifteen outperforming districts are named as potential sites for in-depth qualitative studies of district effects in comparison to similar districts at the norm.     

Differences between secondary schools: A study about school context,group composition,school practice,and school effects with special attention to public and Catholic schools and types of schools

The results indicate that in Flanders secondary schools of different denomination and of different school type (based on their curriculum offerings) differ with respect to several characteristics. With respect to the educational framework, learning environment and learning climate differences between schools are small and differences are more situated within schools. Multilevel analysis reveals that almost 19% of the variance in mathematics achievement is at school level. The effect of denomination is small and disappears when student background (which is related to school practice) is taken into account. The effect of school type remains important when controlled for student background and denomination. Group composition, the social and learning climate, and the opportunity to learn seem to matter and explain almost 90% of the school effect. They also explain more than four fifths of the effect of school type (and denomination together) which accounts for 65% of the school level variance.     

The effects of classroom and school environments on student engagement: the case of high school students in Abu Dhabi public schools

Drawing on data from a merged data set from a student survey and a parent survey that were conducted in the Emirate of Abu Dhabi in 2013, this article uses a multilevel framework to investigate the effects of individual characteristics and the classroom and school environments on high school students’ school engagement in a modernising education system that is different from Western ones. The results of the three-level model revealed that while students’ attributes remained strong predictors of their school engagement, the social and organisational environment of classrooms and school also greatly shaped the extent to which students emotionally and cognitively engaged with their school and learning. This study provided evidence to support the interactive nature of the impact of multilevel environments on student engagement. The policy and research implications were also discussed in the empirical context of Abu Dhabi.     

Educational inequality in Colombia: family background,school quality and student achievement in Cartagena

This study examines the effects of family socio‐economic disadvantage and differences in school resources on student achievement in the city of Cartagena, Colombia. Using data from the ICFES and C‐600 national databases, we conduct a multilevel analysis to determine the unique contribution of school‐level factors above and beyond family background. The results from the hierarchical linear models show that while family socio‐economic background significantly affects student achievement, school composition and school resources explain as much as half of the effects of family background. More specifically, the achievement gap in public schools is explained in large part by differential resource allocation and concentration of poor students in public schools, which in turn lowers student achievement.     

A multilevel study of self-beliefs and student behaviors in a group problem-solving task

Relationships among self-construal, self-efficacy, and group behaviors during a group problem-solving task with friends and acquaintances were hypothesized. The sample comprised 126 students in Grades 8–11, from 5 randomly selected government high schools, organized into 42 groups. Data collection involved self-reports and observations. Self-report data measured self-construal, self-efficacy for working with friends, and self-efficacy for working with acquaintances, and the observational data captured salient student behaviors. Data were analyzed using exploratory factor analysis and multilevel modeling. Self-efficacy for working with acquaintances was related to the development of ideas and also the critical review of ideas in groups. This study provides insights into the relatively underexplored phenomena of group work with friends and acquaintances.     

The contribution of TIMSS to the link between school and classroom factors and student achievement

Worldwide, the interest of policy-makers in participating in studies from the International Association for the Evaluation of Educational Achievement (IEA), such as Trends in International Mathematics and Science Study (TIMSS) has been growing rapidly over the past two decades. These studies offer the opportunity to relate the teaching and learning context to student achievement. This article presents the results of a systematic review of the research literature on TIMSS. Its main purpose is to find out to what extent TIMSS has contributed to insights into ‘what works in education and what does not’, particularly with regard to school and classroom factors. The review was guided by a generic framework developed within the tradition of educational effectiveness research. The review showed that: (a) since 2000, the number of publications which use TIMSS data for secondary analyses aimed at explaining differences in student achievement has increased strongly; (b) a number of studies, especially older ones, did not take account of the specific sample and test design of TIMSS; and (c) there are large differences between countries in school and classroom factors associated with student achievement. In the light of these results, we discuss the benefits and limitations of country and system comparisons.     

Unravelling gender composition effects on rule-breaking at school: a focus on study attitudes

Previous research on consequences of schools' gender composition has mostly investigated students' socio-emotional well-being and achievement, while students' academic attitudes and behavioural outcomes – including school deviancy – have been studied less. Moreover, most studies compared single-sex and coeducational schools, and did not focus on the proportion of girls at school. Starting from reference group theory, we hypothesise that boys attending schools with a higher proportion of girls adopt the latter's positive study attitudes, rendering them less susceptible to disruptive behaviour. Conversely, girls in schools with more boys are expected to adopt the latter's negative study attitudes, consequently being more likely to misbehave. Multilevel analyses on data from the Flemish educational assessment, consisting of 5961 girls and 5638 boys in 81 schools, showed that both boys and girls valued studying more and were less likely to misbehave at school when proportionally more girls attended their school. Implications are discussed.     

Trajectories of math achievement and perceived math competence over high school and postsecondary education: effects of an all-girl curriculum in high school

This study investigated the benefits of all-girls' classroom instruction in math and/or science during Grades 9 and/or 10, within the context of a public co-educational high school. There were 118 participants in this longitudinal investigation: 26 girls in the all-girl classes, as well as 42 girls and 50 boys in the regular co-educational program. A range of pre-existing achievement, background, and psychological characteristics were included as covariates to ensure comparability of the groups. Individual growth curve modeling was used to examine how math achievement and perceived math competence changed over the course of high school and postsecondary education. Change was found to be nonlinear for both constructs (with math achievement starting high, dipping, and then recovering; and with perceived competence doing the opposite). The all-girl intervention appeared to act as a protective mechanism against the temporary decline in math achievement experienced by both co-ed boys and co-ed girls.     

Dynamics of community participation,student achievement and school management: the case of primary schools in a rural area of Malawi

School management in many sub-Saharan African countries has been enhanced through community participation in an attempt to improve education quality. This study uses field research in a rural district of Malawi to assess how community and parent participation differs between schools, the intentions of communities and parents when carrying out activities in schools, and the mechanism promoting active participation in schools. In high-achieving schools, but not in low-achieving schools, communities and parents were actively involved in events aimed at improving student achievement. Communities and parents considered most highly prioritised activities that directly influenced student achievement, including hiring volunteer teachers, arranging extra classes and holding mock examinations. Community participation did not directly improve student achievement. Instead, when communities and parents actively participated in a school, school management improved, ensuring better student achievement. The implications of this finding are discussed in relation to community participation.     

Towards an operationalized and effective school self-evaluation system: An ongoing action research study in Chinese secondary schools since 2011

School self-evaluation (SSE) is an effective mechanism that helps schools to put in place strategies to improve an aspect of school quality. By implementing an action research study of SSE in 24 Chinese secondary schools across seven cities since 2011, the present study generalizes and proposes an operationalized and effective SSE system to illustrate how to operationalize SSE effectively. The system was developed in three essential parts: (a) constructing the measurement model of SSE, which included identifying the framework and indicators to determine the primary evaluation contents, and designing operational evaluation modules to apply SSE indicators to school practices and integrate them into routine school operations; (b) establishing a cooperation mechanism between internal SSE groups and external “facilitative friends” to conduct SSE with different roles allocated; and (c) summarizing detailed implementation procedures and key strategies to implement a cyclical, regular and sustainable SSE process step by step.