Observing instructional quality in the context of school evaluation

Observational measures of instructional quality are used in both research and evaluation contexts. In European school evaluation systems, one main intended use of classroom observation results is to inform schools' instructional improvement efforts. This study examined the quality of such diagnostic information in the context of a school evaluation system in Germany. The factor analytic results indicate that the empirical structure of the observation instrument lacks correspondence with its original normative model but does mirror a five-factor model based on recent literature, including classroom management, two different aspects of student orientation, cognitive activation, and classroom assessment. The generalizability analyses show that both indicators and observers represent important sources of measurement error. Additionally, their magnitude is larger for shorter observations (lesson segments). At least two, sometimes three, observers and between five and ten indicators per dimension are needed to achieve sufficiently reliable results, but results importantly depend on which dimension of instructional quality is being assessed.     

From reform to reform: how school reforms are motivated and interrupted – the case of ‘school inspections’ in Germany

ABSTRACT

In this article, we analyse the implementation and change of a specific school reform in Germany using the example of external school evaluation in Lower Saxony: the school inspection. We investigate how and why a newly implemented reform is itself subject to reform shortly afterwards. We begin with a historical background of German school reforms over the last 40 years. Then, we consider school reforms through the lens of organisational theory. Finally, we combine the historical and theoretical perspectives on school reforms placing particular emphasis on more recent developments in external school evaluation. Based on these considerations, we elaborate some theses on reform and routine in schools.     

Data use by Flemish school principals: impact of attitude,self-efficacy and external expectations

There is an increasing expectation that school principals use data to develop and justify school policy. There is also a strong belief among a wide variety of stakeholders that the quality of decisions within the school increases in proportion to the extent to which these decisions are based on good data. In most schools, however, it appears that data use is still quite limited. Research shows that the school principal plays a key role in data use in schools. In the present study, we examine the impact of external expectations, attitude and self-efficacy on the use of data by principals. The results of a survey among 451 school principals in Flanders show that affective aspects of attitude exhibit the strongest correlation with data use by principals. The impact of cognitive attitude and self-efficacy is statistically significant, but quite limited. The same applies to the perception of external school development-orientated and accountability-orientated expectations to use data.     

Equivalence and performance gaps in Swedish school inspection: context and the politics of blame

This article analyses and critically discusses how context is relevant when constructing and upholding an equivalent education for all within the neo-liberal educational regime of marketisation and accountability. At the centre of the article is a study of national school inspection reports in four municipalities in Sweden, exploring performance gaps, equality and justice in an educational system, that for decades has emphasised universal welfare, justice and equality. By drawing on the concept of ‘the politics of blame’, findings show that accountability and blame are constructed in complex ways. Although teachers and schools are blamed for low expectations with little contextual consideration by Swedish Schools Inspectorate, local governments are blamed for not redistributing resources. This can both challenge and strengthen the contemporary regime in governing education.     

中职生学校生活质量评定量表的编制

参照澳大利亚教育研究评议会《学校生活质量量表（QSLS）（中学版）》,结合中职生学校生活现状,编制《中职生学校生活质量评定量表》,对426名中职生进行测试,并对测试结果进行了探索性因素分析.研究结果表明：中职生学校生活质量包含学校认同感、校园环境、自我认知、同伴关系、师生关系、成就感、积极情感和消极情感8个因子.利用新量表进一步对468名中职生进行测试,对测试结果进行验证性因素分析,发现模型拟合度较好.量表具有良好的信度与效度,可以作为中职生学校生活质量评定的工具.     

Whole school approaches to education for sustainable development: a model that links to school improvement

This study applies a model of school organisation developed by one of the authors to investigate school improvement processes leading to a whole school approach in Education for Sustainable Development (ESD) literature. The model is operationalized to a survey instrument and distributed to Swedish upper secondary teachers. The instrument provides empirical indications of teachers’ perceptions of their schools in terms of four major dimensions of an ESD whole school approach, the importance assigned to a holistic vision, routines and structures, professional knowledge creation, and practical pedagogical work. The aims of the study are to compare the teachers’ perception of their school organisation. We compare perceptions of teachers working in schools actively implementing ESD and teachers in comparable reference schools. Comparisons are also made between teachers from schools applying different strategies and quality approaches in implementing ESD. The results indicate that, relative to teachers in ordinary schools, those in ESD schools perceive their school organisations to have higher quality and coherence, with greater potential to support teaching and pedagogical work in practice. However, there is substantial variation in perceptions of teachers from different ESD schools. The model’s robustness is validated by coherence of earlier results in the same schools.     

The role of feedback from the school leader during teacher evaluation for teacher and school improvement

Since the turn of the century, teacher evaluation has been introduced around the world with the intent to improve teaching. However, in the literature on teacher evaluation, often findings reveal critical accounts about the effectiveness of feedback in teacher evaluation for teacher and school improvement. This article presents a qualitative study in eight schools where teachers did indicate to find the feedback they discussed with school leaders during teacher evaluation processes useful. In this study, we investigate whether we can identify what teachers actually do with this feedback and which factors contribute to their response. Our findings demonstrate the importance of school organizational characteristics and an integrated leadership approach for the feedback response of teachers. Also, our findings reveal how teacher evaluation is used in these schools to further school improvement.     

The Regime of Self-Evaluation: Self-Conception for Teachers and Schools

Self-evaluation in inspection policy has become a global phenomenon. The idea is that it increases levels of teacher and school autonomy, wherein both schools and teachers have more ownership and responsibility over their work. In turn, such a process has allowed for greater accountability, which is then said to provide high quality education and, therefore, greater competitive advantage amongst knowledge-based economies. In both England and Ireland, self-evaluation has become a demanding procedure that is meant to complement external inspections of schools and teachers. In this article, I will argue that self-evaluation, whilst having the potential to become a worthwhile endeavour, does not live up to its name. In the first instance, the criteria used for self-evaluation are not internally generated but externally imposed. Thus, I would like to discuss the extent to which visions of ‘good’ or ‘bad’ education developed by inspecting bodies influence the way in which teachers and schools assess themselves. Furthermore, I will raise questions as to what appropriate criteria for teaching might look like. In doing so, I shall try to show that what is now current is a debased form of self-evaluation that is not only detrimental to the self-perception of teachers, but inadequate to what any coherent notion of the ‘self’ might be. In light of work by the philosopher Charles Taylor in particular, I will argue that the self is not something that can be examined in the way that is imagined in these inspection systems but is rather something dynamic and unfixed, constituted within a wider community of practice and, therefore, not amenable to evaluation in quite the way that is supposed.     

No child,no school,no state left behind: schooling in the age of accountability 1

Why and under which conditions do international student assessment programmes like PISA have success? How can the results of these assessments be useful for advocates of different, even contradictory, policies? What might explain different patterns of using assessment as a tool for school governance? Drawing on historical and comparative research, and using PISA as an example, this paper provides a frame for discussing these and other questions around the international rise of accountability as a key tool of social change. The basic argument is that even though accountability is a global phenomenon, the ways and means of enacting and encountering accountability are not. How accountability is experienced depends on deeply engrained ‘constitutional mind‐sets’, i.e. diverse cultures of conceptualizing the relation between the public and its institutions.     

教师教育课程教学质量评价标准的构建--基于CIPP评价模式的视角

教师教育课程是教师教育质量提高的关键所在,科学合理的教师教育课程教学评价的标准是培养高水平教师的重要因素,也是教师教育教学质量持续不断提高的有效保障。目前,我国教师教育课程教学存在的诸多问题无不与教师教育课程教学评价的标准有关。在当前我国高等教育“质量工程”和教师教育课程改革的大背景下,应用CIPP评价模式评价教师教育课程教学质量,对促进学生发展、教师发展、课程改进和教学资源优化配置等具有重要的价值。     

基于“学岗交融”高职教学模式教学质量评价体系的研究

文章以“就业导向、工学交替”理念为基础,研究“学岗交融”高职教学模式教学质量评价体系,以专业、学业、企业为评价要素,着重构建“以学生为本”及“以职业能力形成为核心”的质量评价体系.     

依恋与青少年学业的关系及对素质教育的启示

依恋的类型是个体判断自我是否有价值、他人是否能够依赖的依据。自我系统中的自我价值感是学生在学习中能够自主学习,能够在应对压力情境时表现出稳定情绪的核心。安全型依恋使得个体发展过程中学习动机由外在向内在平稳过渡,有着内在动机倾向的学生在面对挑战性任务时比较不容易放弃,也能取得较好的表现。     

The neo-liberal education policies of epimeleia heautou: caring for the self in school markets

The paper argues that neo-liberal education policy has capitalized on a historical concern to care for the self, or the Greek epimeleia heautou. We discuss epimeleia heautou in relation to education policies that emphasize greater choice in curriculum offerings, and in relation to school choice policies more generally. Thus, a premise of our argument is that school choice policies accommodate a much greater range of selves to be cared for. The analysis examines the neo-liberal subject, homo ?conomicus, in relation to education policy that produces choices of the self and choices for its care. We conclude by discussing conceptions of the self in relation to two aporias of neo-liberal educational equality produced through ethnic-specific schools.     

Using growth models to monitor school performance: comparing the effect of the metric and the assessment

This paper investigates whether inferences about school performance based on longitudinal models are consistent when different assessments and metrics are used as the basis for analysis. Using norm-referenced (NRT) and standards-based (SBT) assessment results from panel data of a large heterogeneous school district, we examine inferences based on vertically equated scale scores, normal curve equivalents (NCEs), and nonvertically equated scale scores. The results indicate that the effect of the metric depends upon the evaluation objective. NCEs significantly underestimate absolute individual growth, but NCEs and scale scores yield highly correlated (r >.90) school-level results based on mean initial status and growth estimates. SBT and NRT results are highly correlated for status but only moderately correlated for growth. We also find that as few as 30 students per school provide consistent results and that mobility tends to affect inferences based on status but not growth – irrespective of the assessment or metric used.     

Federal policy and the teacher labor market: exploring the effects of NCLB school accountability on teacher turnover

The media suggest that accountability pressure increases teacher stress and drives teachers away from teaching, resulting in teachers leaving disadvantaged schools that serve larger proportions of poor and minority students. However, no prior work has systematically examined the changes in the national trends of teacher turnover in response to No Child Left Behind (NCLB) school accountability. Drawing on nationally representative samples of schools and teachers from the Schools and Staffing Surveys and Teacher Follow-Up Surveys from 1993–2009, this study applied difference-in-differences approaches to examine the effects of NCLB on teacher turnover. We found a weak increase in the average rate of teachers transferring involuntarily to other schools following school-initiated separations, particularly in disadvantaged schools that served larger proportions of poor and minority students. We also observed that NCLB reduced the involuntary attrition rates of teachers. Importantly, the policy effect is indistinguishable from zero on voluntary transfer between schools or voluntary leaving the teaching profession.     

Secondary school transition for children with special educational needs: a literature review

Successful transition from primary to secondary school is important for psychosocial well‐being. Children with special educational needs (SEN) may face additional complexities at transition, although the impact of this process on children's psychosocial adjustment has been underexplored. The article aims to review systematically the literature exploring the impact of transition on the concerns and psychosocial adjustment of children with SEN in comparison to typically developing children. Published studies were identified through a systematic search of six electronic databases. Articles fulfilling inclusion criteria were reviewed and a quality criteria system was developed to rank studies. Children with specific learning difficulties perceive lower levels of social support and more peer victimisation after transition than typically developing children, but methodological limitations and the modest number of studies restricted the conclusions that could be drawn.     

The importance of adjusting for pupil background in school value-added models: A study of Progress 8 and school accountability in England

In the UK, USA and elsewhere, school accountability systems increasingly compare schools using value-added measures of school performance derived from pupil scores in high-stakes standardised tests. Rather than naïvely comparing school average scores, which largely reflect school intake differences in prior attainment, these measures attempt to compare the average progress or improvement pupils make during a year or phase of schooling. Schools, however, also differ in terms of their pupil demographic and socioeconomic characteristics and these factors also predict why some schools subsequently score higher than others. Many therefore argue that value-added measures unadjusted for pupil background are biased in favour of schools with more ‘educationally advantaged’ intakes. But others worry that adjusting for pupil background entrenches socioeconomic inequities and excuses low-performing schools. In this article we explore these theoretical arguments and their practical importance in the context of the ‘Progress 8’ secondary school accountability system in England, which has chosen to ignore pupil background. We reveal how the reported low or high performance of many schools changes dramatically once adjustments are made for pupil background, and these changes also affect the reported differential performances of regions and of different school types. We conclude that accountability systems which choose to ignore pupil background are likely to reward and punish the wrong schools and this will likely have detrimental effects on pupil learning. These findings, especially when coupled with more general concerns surrounding high-stakes testing and school value-added models, raise serious doubts about their use in school accountability systems.