The impact of school self-evaluation upon student achievement: a group randomisation study

This paper investigates the impact of three different approaches to establishing School Self Evaluation (SSE) mechanisms upon student achievement. Using group randomisation, four groups of schools were created. Different types of support were provided to the first three groups of schools in order to help them establish SSE mechanisms, whereas no SSE mechanism was established in any of the schools of the fourth group. In the first group, school stakeholders were offered the opportunity to develop their own SSE mechanisms and design their own improvement strategies. The second group followed the same process in designing SSE mechanisms as the first, but before introducing this approach support was offered to the stakeholders in order to address and reduce their concerns about SSE. The third group was asked to develop SSE mechanisms and take decisions for their improvement strategies which were in line with the knowledge base of educational effectiveness research. All three experimental groups had better results than the control group, but the impact of the third approach on student achievement was higher than the impact of the other two approaches to SSE. Implications for research on SSE are drawn.     

School self-evaluation: self-perception or self-deception? The impact of motivation and socially desirable responding on self-evaluation results

ABSTRACT

In order to enhance the quality of education, school self-evaluation (SSE) has become a key strategy in many educational systems. During an SSE process, schools describe and evaluate their own functioning, often by administering questionnaires among teachers. However, it is unknown to what extent SSE questionnaire results are distorted by respondents’ tendencies towards socially desirable responding and their motivation to fill in an SSE questionnaire. This study reports on a path analysis, performed on the results of an authentic SSE with 382 participants. Results indicate that socially desirable responding and motivation have indeed an impact on SSE results. However, the effects are differential and depend on the variable of interest. These findings can have serious implications, and should be taken into account when drawing conclusions and taking (school) policy decisions within the framework of an SSE process.     

Irish teachers,starting on a journey of data use for school self-evaluation

With much of the literature on school self-evaluation (SSE) stressing the importance of data use, this article explores how teachers in Irish post-primary schools are coming to terms with this new challenge. Since 2012, all schools in Ireland are required to engage in SSE for the purpose of improving student outcomes. For the first time, teachers and school leaders are being asked to systematically gather and analyse various types of data, devise improvement plans and implement improvements. Despite such demands, the compulsory education system in Ireland operates within a low-stakes accountability environment, with an absence of published school league tables and no consequences for poor school performance. It is also interesting to explore the introduction of a school improvement process that requires data as evidence for self-evaluation, but where very little data currently exists compared to other jurisdictions and where the discourse of data use in schools is relatively new.This article outlines the experience of 13 post-primary schools that were supported by the DCU Centre for Evaluation, Quality and Inspection to complete an SSE process, during which, each school gathered and analysed a range of data. This study is part of a larger action research project which explores various aspects of the implementation of SSE in schools, including models of support and continuing professional development for schools. This article looks specifically at the use of data by the schools involved. The key research questions ask: what data was gathered by the schools and what was the attitude to and experience of data-use among teachers? In doing so, this article explores some of the current research questions in relation to data use in schools. Overall, the findings indicate that schools gathered a range of data, which was mainly quantitative due to a focus on quantitative target setting. Despite a generally positive attitude to the usefulness of data and the skills learned, participants did not appear convinced that they would be involved in data use on an ongoing basis.     

以评促建:构建教师发展学校建设长效机制的路径——浙江省的经验与反思

科学有效的评价体系可为教师发展学校建设提供目标与动力,以评促建是构建教师发展学校建设长效机制的有效路径.浙江省通过政府部门、高校与中小学多元主体的协同合作,在标准化评价指标的指导下,以自评与他评相结合的方式,对教师发展学校的协同合作、组织管理、资源保障、课程建设几方面进行评价,在以评促建方面积累了诸多经验.但其中也逐渐暴露出一些问题,如第三方评价对评价结果客观性的消极影响、评价工具不够完善、评价内容不够全面、评价过程过于烦琐和不够深入等问题.未来可从完善第三方评价、改良评价工具、丰富评价内容、优化评价方式等方面着手,推动教师发展学校长效运行.     

为每所学校配备优秀校长——美国中小学校长支持策略研究

优秀的校长在学校改进、教师留职和学生成绩提升等方面发挥着重要作用。通过采取有效的校长支持策略,为每所学校配备优秀校长,已经成为当前美国中小学缩小学生成绩差距、保障教育公平的重要举措。美国有效的中小学校长支持策略主要包括:创新校长培养方式,解决校长频繁更替问题;创建一贯制的校长职业管道,提升校长的领导效能;建立支持取向的校长评价制度,持续改进校长的行为;利用联邦政府拨款,扩大校长专业学习和专业发展机会;建立校长才能管理系统,促进优质校长人力资源的公平分配。     

Evaluating the quality of self-evaluations: The (mis)match between internal and external meta-evaluation

This article focuses on school self-evaluations (SSE). It addresses whether SSE meets quality indicators and whether differences can be found between the quality judgments of school principals and inspectors. Data stem from two complementary data collections: population data of school inspections and a survey of a representative sample of school principals. The results show that principals and the inspectorate declare themselves on average to be satisfied with the quality of the self evaluations. However, their judgments do not match. This raises questions about the validity and reliability of the evaluation by principals and the inspectorate. The article deals with the limitations of self-reporting by principals and of the inspectorate's framework and methodology in evaluating the quality of school self evaluations.     

Drivers for student and parent voice in school self-evaluation activities: A cross-country analysis of Flanders (Belgium), Ireland and Portugal

School self-evaluation (SSE) has become a key strategy in terms of safeguarding educational quality. In order to reach its full potential, it is argued that parents and students should be given a role in an SSE process, as they can help understand the complex environment in which schools operate. However, little is known about how different education systems include parent and student voice in SSE activities, and what driving factors at the individual, system and organisational level can foster this. This study reports on an international survey among school management team members in Flanders (Belgium), Ireland and Portugal. The results show statistically significant differences between countries in terms of parent and student voice in SSE. In particular, driving factors at the system and organisational level are found to explain differences in parent and student voice inclusion in SSE. The paper discusses the implications for researchers, policymakers, and the field of practice.     

Improving the quality of education through self-evaluation in Dutch secondary schools

In countries with a governance structure in which responsibility for the quality of education is shared between government and school boards, the past decades school self-evaluation has been stimulated as a way to encourage continuous quality improvement. However, working on the goals of quality assurance and school improvement at the same time is a challenge in general. To make a valuable contribution to both goals, the self-evaluation effort has to be of sufficient quality itself. In this article, we present a research-based framework for school self-evaluation (SSE) composed of both content and process factors that allows to evaluate the quality of self-evaluation in schools. We then used this model to evaluate the experiences in a comprehensive self-evaluation project that has been designed and used to help Dutch secondary schools promote the quality of student care. Our sample encompassed 79 Dutch secondary schools involved in this project. The findings show that the quality of SSE depends on the quality of the instruments (content) and process factors. However, to make a valuable contribution to school improvement and thereby the quality of education in The Netherlands more attention is needed for a balance between internal and external supervision and the role of school managers in the process of SSE.For future research more insight is needed in the challenges of meeting the content and process conditions of school self-evaluations, the governance and supervision issue at the level of schoolboards, the competence of change management in schools and the effects of SSE on the quality of education.     

学校改进视角下办学质量评价的实践探索

推进学校持续改进是国际社会提升学校办学质量的重要路径和方向。因此,基于学校改进构建的办学质量评价维度及指标是实施学校办学质量评估的基本依据,其对了解学校发展质量,找准学校发展着力点和短板具有重要意义。为此,从目标、过程和结果研制维度构建了学校办学质量评价维度和指标,并在F教育集团加以实践应用,取得了很好的评估效果。研究表明,基于学校改进建立学校办学质量评价指标,应秉持学校持续发展理念,突出课程与教学改革重点,紧扣学生综合素质发展目标,着力校长胜任力,并把握学校特色与文化着眼点,这是全面评估学校办学质量,找准学校办学质量改进点的关键所在。     

Building resilient schools in Russia: effective policy strategies*

The article uses the framework of resiliency to examine the strategies of principals in schools working under challenging socio-economic conditions that show higher-than-expected educational results. We collected a unique set of data within the Russian ‘National monitoring of education markets and organisations’ programme. This work continues the study, begun in 2014, of the peculiarities of the functioning conditions, management and educational strategies of different groups of schools (urban, rural, implementing higher-level programmes, private, etc.), where authors supplement the economic indicators of school performance with socio-economic contextual factors. A contextualisation model was applied to distinguish the resilient schools studied and the socio-economic characteristics for each school. The typical strategies of principals of resilient schools are as follows: recruiting more successful students from other schools, the branding of the school, creating a culture of high expectations for staff and students, and a less bureaucratic management style.     

中小学中国画课堂教学评价指标体系建构——基于“以学习者为中心”的理念

当前中小学中国画课堂教学仍以“教”为主,未能充分调动学生学习的主动性。倡导“以学习者为中心”的中国画课堂教学能更好地引导中小学生感受中国画的博大精深和艺术魅力。依据“以学习者为中心”的理论及我国美术课程标准、核心素养的基本理念和要求,采用德尔菲法、层次分析法等方法,构建包含3个一级指标、6个二级指标、22个三级指标为主要内容的中小学中国画课堂教学评价指标体系,并通过确定各指标的权重,实现对中小学中国画课堂教学评价指标的量化评价。经过对具体教学案例的试测,证明此评价体系具有较高的信度,能比较全面地评价中小学中国画课堂教学质量。     

新西兰中小学校评价体系:构成、特点及启示

新西兰具有国际公认的高效的中小学校评价体系。他们成立了专门的评价机构,构建了包括结果性指标和过程性指标的学校评价指标框架,采用了外部评价和内部评价两种评价方式。其学校评价充分发挥了问责和促进学校改进的双重功能,保障了新西兰基础教育质量的提升。新西兰中小学校评价体系的特点主要有:成立了独立的第三方评价机构、评价目标紧紧围绕国家教育改革目标、将内部评价视为促进学校改进的核心、开展个性化的外部评价、内部评价和外部评价有机结合、重视评价队伍的能力建设、强调评价的科学性和公平性。借鉴新西兰的经验,我国可成立专门的中小学校评价机构,强化学校评价的诊断和改进功能,引导和支持学校开展内部评价,提升评价的科学性水平。     

Improving The Quality of Education Through School-Based Management: Learning From International Experiences

School-based management is being increasingly advocated as a shortcut to more efficient management and quality improvement in education. Research, however, has been unable to prove conclusively such a linkage. Especially in developing countries, concerns remain about the possible detrimental impact of school-based management on school quality; equity among different schools in the same system; the motivation of and relationships between principals and teachers; and financial as well as administrative transparency. The present study defines school-based management and, in view of its implementation in different world regions, examines some of its advantages and disadvantages. In particular, the author explores the strategies which must accompany school-based management in order to ensure a positive impact on quality. These are found to include (1) guaranteeing that all schools have certain basic resources; (2) developing an effective school-support system; (3) providing schools with regular information on their performance and advice on how they might improve; and (4) emphasizing the motivational element in the management work of the school principal.     

Improving the School Learning Environment to Reduce Bullying: An Experimental Study

A framework based on research on bullying and on educational effectiveness was offered to schools to assist them in developing strategies and actions to improve their learning environment, their policy for teaching, and their evaluation mechanisms in order to reduce bullying. At the beginning and end of the intervention, the Revised Olweus Bully/Victim Questionnaire and a teacher questionnaire measuring three school factors (school policy for teaching, school learning environment, and school evaluation) were administered to the experimental and control groups. This experimental study reveals that the intervention had both a direct impact on the reduction of bullying and an indirect impact through improving the school factors. Implications for research into supporting schools to reduce bullying are given.     

Improving The Quality of Education Through School-Based Management: Learning From International Experiences

School-based management is being increasingly advocated as a shortcut to more efficient management and quality improvement in education. Research, however, has been unable to prove conclusively such a linkage. Especially in developing countries, concerns remain about the possible detrimental impact of school-based management on school quality; equity among different schools in the same system; the motivation of and relationships between principals and teachers; and financial as well as administrative transparency. The present study defines school-based management and, in view of its implementation in different world regions, examines some of its advantages and disadvantages. In particular, the author explores the strategies which must accompany school-based management in order to ensure a positive impact on quality. These are found to include (1) guaranteeing that all schools have certain basic resources; (2) developing an effective school-support system; (3) providing schools with regular information on their performance and advice on how they might improve; and (4) emphasizing the motivational element in the management work of the school principal.     

Pupil mobility in schools and implications for raising achievement

This paper examines the causes of pupil mobility and good practice in schools to address mobility issues. Pupil mobility is defined as ‘a child joining or leaving school at a point other than the normal age at which children start or finish their education at that school’. The first part draws upon evidence of a survey, which explores the views of headteachers on the nature and causes of pupil mobility in schools and the priority they give to addressing pupil mobility issues in their schools. It examines the cause of mobility in schools in the context of mobile groups. This is followed by the challenges for managing mobility and strategies to address pupil mobility in schools. The second part of the paper outlines successful strategies that minimize the effects of mobility in schools. Evidence is drawn from case‐study research and focuses on the school systems, pastoral care and access to learning which combine to support the induction, assessment and monitoring of newly arrived pupils in school and effective use of data for self‐evaluation. Examples of flexible curriculum organization, innovative approaches to additional support and effective administrative procedures are drawn upon. Evidence reflects the views of a range of school staff, parents/carers and pupils in the case‐study school, as well as the judgements of senior researchers. Policy implications for government and for all concerned with school performance are highlighted, as well as many practical suggestions for raising achievement of mobile pupils     

Reducing exclusions whilst developing effective intervention and inclusion for pupils with behaviour difficulties

abstract

This article draws upon a recent evaluation study of developments in behaviour/discipline systems in an inner-city secondary school over a period of 5 years (including a 3 year O°action research' cycle). The methodology involved the collection and analysis of data from a combination of qualitative and quantitative approaches with reference to other school performance indicators. Elements of the study are discussed in order to help bridge the theory/practice divide and to share practical research findings with other schools.     

Soziale Disparit?ten und die ?ffnung des Sekundarschulsystems

Efforts to break the link between the school type attended and the qualification awarded are seen an important step in the modernization of Germany??s tracked secondary school system. However, it remains disputed whether these efforts have reduced social disparities or in fact increased them. This study examined the transition from lower secondary education in academic- and intermediate-track schools to upper secondary education in general and vocational gymnasium schools in the state of Baden-Württemberg. When indicators of parental social background and school-leaving qualifications were controlled, the opening of upper secondary education was found to be associated with a decrease in the social selectivity of upper secondary education for intermediate-track students. At the same time, for those intermediate-track students who were entitled to enter upper secondary education, social background had predictive effects on the transition decision; however, the overall size of these effects was low.     

美国 AACSB 卓越商科教育质量认证的特点与启示

参与商学院国际认证已成为国内商科教育追求卓越、增强国际竞争力的一种重要战略手段。本研究从认证程序、认证范围、认证标准等方面简要介绍了AACSB 国际认证的基本框架,着重从关注组织使命的陈述、影响与创新,重视利益相关者对认证过程的全员参与,关注学生学习保障机制的构建等方面剖析了卓越商科教育质量认证的主要特点,并从推动本科层次“ 中国式”商学院认证体系建立、促进商学院内部质量文化共识形成、推进学习结果评价为抓手的长效质量保障机制构建等方面,为国内不同层次的商科教育尤其中外合作办学商科教育走向卓越提供参考价值。     

Enhancing Early Childhood Development Through Arts Integration in Economically Disadvantaged Learning Environments

Education in the arts continues to struggle for inclusion in PreK-12 classrooms as public schools face increasing challenges from high stakes testing, Common Core politics, and endless budget cuts. Advocates point to the growing body of research linking art education to academic achievement as justification for arts’ continued inclusion in the curriculum. In its 2005 report, the National Association of State Boards of Education highlighted this research trend and called for stronger emphasis on arts in educational curricula (Meyer in Arts Educ Policy Rev 106(3):35–40, 2005). Yet despite the evidence, school districts across the nation have been slow to include more arts programming within the classroom. This study, however, examines one school district that did. In a collaborative project between a large urban school district and a local arts and science council, an arts integration program called Wolf Trap was implemented in economically disadvantaged pre-Kindergarten and first-grade classrooms at selected schools across the district. Objectives of the program were to: (a) improve school readiness skills among participants; (b) increase capacity of classroom teachers to learn and implement effective arts-based teaching strategies; and (c) increase the capacity of teaching artists to acquire and model effective arts-based teaching strategies. This study evaluates the effectiveness of the program using data from the teaching artists, classroom teachers, and the external evaluators. We discuss the program in detail and explain the methodology used in our evaluation. Finally, we present evidence that indicates the program’s success and we offer recommendations for program stakeholders.