Diversity in school performance feedback systems

As data-based decision making is receiving increased attention in education, more and more school performance feedback systems (SPFSs) are being developed and used worldwide. These systems provide schools with data on their functioning. However, little research is available on the characteristics of the different SPFSs. Therefore, this study reflects on the characteristics of SPFSs to provide feedback designers and users arguments for making sound choices in selecting SPFSs with particular characteristics. The results of our study show that the 5 SPFSs selected for the purpose of comparison differ with respect to features related to data gathering and data analysis processes, the content, and the numerical measures and representation modes used. A wide variety can be detected in terms of the complexity and accuracy of data modeling. Users need to be properly informed about the underlying rationale for the features of each SPFS, and on the limitations and strengths of the performance indicators used.     

The effects of the use of a school self-evaluation instrument

School quality care has become important in many Western countries. A number of self-evaluation instruments have been developed in response. The goal of these instruments is improving the quality of education. One such system, ZEBO, was developed for performing quality assessment in Dutch primary schools. The use of this self-evaluation instrument was studied in 79 primary schools in The Netherlands over a period of 5 years. The results of the multilevel analyses with repeated measures show that the use of the self-evaluation results had no effect on pupil achievement scores (so far). However, it did have other effects, for example, an impact on the professional development of teachers.     

The use of performance feedback in school improvement in Louisiana

Although school performance feedback is available in schools all over the world, there is a dearth of information about the use made of feedback and about the effects of its use. This paper presents case study research into the use of school performance feedback and its’ perceived effects. All schools used the feedback in writing school improvement plans, but the extent of genuine school improvement varied across schools as did the perceived effects of the use of performance feedback. The results highlight various factors which may promote or impede the use of school performance feedback and its effects.     

The impact of feedback on school performance

Over the past few years Research Data Services (RDS), part of the National Foundation for Educational Research (NFER), has led numerous large‐scale, longitudinal projects. Feedback to schools has been provided for all of these projects, and has been in the form of sets of tables and charts and electronic files illustrating pupil performance and progress in each school compared with national norms. This study sought to establish what differences the ongoing provision of feedback has made to the participating schools. The main thrust of the study was a statistical analysis of the most current National Pupil Dataset. Using this dataset, the overall impact on pupil performance in the participating schools of their participation in projects where feedback is used could be examined. In general, the findings presented in this paper suggest that school feedback does have an impact on key stage 2 performance.     

Teaching data use and school leadership

This case study uses evidence collected for accreditation and programme improvement at a small university Master's and certification programme in Educational Leadership Development to describe efforts to help leadership candidates use data during the programme's final internship experience. Programme features supporting the growth of candidates' instructional leadership skills are discussed as are the challenges faculty encountered supporting leadership candidates' efforts to use data to lead change projects. Suggestions for evaluating programmes' ability to teach evidence-based leadership practice are offered at the paper's conclusion.     

The utilisation of a school self‐evaluation instrument

School quality care has become important in many Western countries. Expectations are high, but little is known about the nature and extent of the use of self‐evaluation instruments within schools. From this longitudinal study into the use of a Dutch school self‐evaluation instrument, it became clear that schools vary in the extent to which they are able to make use of self‐evaluation results. A minority of schools in this study were able to use the self‐evaluation results for developing measures at the school and classroom level to improve the quality of education. Potential causes for the findings and alternatives for promoting the utilisation of school self‐evaluation instruments are discussed.     

The development of student feedback literacy: the influences of teacher feedback on peer feedback

Abstract

Although the concept of student feedback literacy has drawn increasing attention in higher education, empirical research on this matter is still in its infancy. In the area of peer feedback, little research has investigated the role of teacher follow-up feedback on peer feedback in the development of student feedback literacy. To address the research gap, a multiple-case study of three Chinese master’s students enrolled in an academic writing course was conducted, drawing on the students’ drafts with peer feedback, teacher written feedback on that peer feedback, semi-structured interviews, retrospective verbal reports, observation field notes and class documents. Three students’ epistemological and practical knowledge about, attitudes towards, and self-efficacy beliefs in peer feedback were found to improve at different paces and to different degrees. However, considerable individual variations were observed with two high-achieving, highly motivated participants becoming more feedback-literate than their under-achieving, minimally motivated peer. Teacher feedback on peer feedback was found to have distinct impacts on individual students, depending on learner factors including language ability, beliefs and motivation. These findings suggest that teacher feedback on peer feedback, if consistently provided and compatible with learner factors, can scaffold both cognitive and social-affective aspects of student feedback literacy.     

The role of feedback from the school leader during teacher evaluation for teacher and school improvement

Since the turn of the century, teacher evaluation has been introduced around the world with the intent to improve teaching. However, in the literature on teacher evaluation, often findings reveal critical accounts about the effectiveness of feedback in teacher evaluation for teacher and school improvement. This article presents a qualitative study in eight schools where teachers did indicate to find the feedback they discussed with school leaders during teacher evaluation processes useful. In this study, we investigate whether we can identify what teachers actually do with this feedback and which factors contribute to their response. Our findings demonstrate the importance of school organizational characteristics and an integrated leadership approach for the feedback response of teachers. Also, our findings reveal how teacher evaluation is used in these schools to further school improvement.     

The student experience of piloting multi-modal performance feedback tools in health and social care practice (work)-based settings

The aim of this study was to evaluate newly developed performance feedback tools from the student perspective. The tools were innovative in both their mode of delivery and the range of stakeholders they involved in the feedback process. By using the tools in health and social care settings, students were able to engage in interprofessional assessment of common competences and obtain performance feedback from a range of stakeholders not commonly involved in work-based learning; these included peers and service users. This paper discusses the ways in which the performance feedback tools were developed by a collaborative programme and compares their delivery, across a wide range of professions and work-based settings, in paper-based, web-based and mobile formats. The tools were evaluated through a series of profession-specific focus groups involving 85 students and 7 professions. The data were analysed thematically and reduced to three key categories: mode of delivery, assessment tool dynamics and work-based issues. These will be discussed in detail. The students agreed that the structured way of capturing and documenting feedback from several sources would support their practice placement learning. The reflective nature of the tools and the capacity for guiding reflection was also welcomed. The concepts of gaining service user, peer and/or interprofessional feedback on performance were new to some professions and evoked questions of reliability and validity, alongside appreciation of the value they added to the assessment process.     

The use of keywords for delivering immediate performance feedback on teacher competence development

Literature shows that feedback that is specific, immediate and goal-oriented is effective on (pre-service) teachers’ performance. Synchronous coaching gives this kind of feedback. Due to immediateness of feedback, pre-service teachers can suffer from cognitive load. We propose a set of standardised keywords through which this performance feedback can be delivered – each keyword acts as a summary for the feedback message. The construction and the selection of the keywords is aimed at the reduction of message ambiguity, while at the same time a low level of cognitive load on the pre-service teacher must be maintained. An in vivo pilot-study with 40 respondents (pre-service teachers and their coaches) supported our hypothesis that usage of such sets of standardised keywords will mitigate the levels of ambiguity and cognitive load. These findings and other considerations for additional research using immediate performance are addressed.     

The effect of school inspections on school improvement

This study uses a school-level longitudinal control-group design to examine how teachers and principals of inspected versus uninspected schools perceive school improvement at their schools. During the phasing in of school inspections in the states of Berlin and Brandenburg (Germany), both inspected and uninspected schools were surveyed with respect to school improvement activities over a 1-year period. The main finding is that principals’ and teachers’ perceptions of school quality were highly stable, irrespective of the introduction of school inspections. The results show school inspections had a comparatively low impact on the aspects of school quality measured here.     

Professional attitudes to the use of pupil performance data in English secondary schools

This paper presents findings from an exploratory survey of teachers' perceptions, understanding, and use of pupil performance data in English secondary schools and examines the extent to which these are associated with school-level performance and a range of factors, including teachers' positions of responsibility. The survey was supplemented by a series of in-depth interviews. Use and availability of pupil performance data was found to be widespread, but classroom teachers reported significantly lower levels of use and understanding. The research also reveals a data-use hierarchy in schools, with many indicating that some data are accessible only to school leaders or provided pre-interpreted. Most teachers make regular use of their own sources of pupil data, which is seen as at least as useful as “official” data, which poses challenges for policymakers in raising levels of use and creating a “mixed economy” of sources.     

Special support and neighbourhood school allocation in Finland: a study on parental school choice

Although freedom of parental school choice has expanded to the Finnish education system, the government has maintained the principle of neighbourhood school allocation. Moreover, the Finnish education system has recently undergone a reform of its special needs education; all pupils are entitled to receive support in three categories of general, intensified or special. The focus of this article is to examine parental positions on school choices in relation to the parents’ social class and their children’s support needs in basic education. The results of the study are based on a quantitative questionnaire, which collected responses from 208 participants drawn primarily from four different municipalities in Finland. The study found that the category of a child’s support, rather than the socio-economic class of the parents, determined the child’s school allocations. Furthermore, the more support the parents felt their children needed, the more importance they placed on special education practices and less on the neighbourhood school allocation. In addition, the parents’ opinions were found to differ based on social class, rather than category of support. In conclusion, we argue that the social segregation of students with special educational needs can be avoided, if the principle of neighbourhood school allocation is preserved.     

Analysing support in inclusive education systems – a comparison of inclusive school development in Iceland and Canada since the 1980s focusing on policy and in-school support

ABSTRACT

This paper compares the systems of support in inclusive education in Canadian and Icelandic schools. The rationale for comparing these two support systems is grounded in the idea that they were developed in two countries with a long tradition of inclusive school development. They shifted the responsibility and the necessity of support for all learners towards the regular school, as it is embedded in the Salamanca Statement. The comparison is based on research findings from two comprehensive qualitative studies on inclusive education (Óskarsdóttir 2017. “Constructing Support as Inclusive Practice: A Self-Study.” Doctoral Thesis University of Iceland, Reykjavík; Koepfer 2013. Inclusion in Canada. Bad Heilbrunn: Klinkhardt) and is focused on the role of support as an integral part of inclusive practices. A system of support can be considered an inevitable pillar of inclusive education, in order to remove barriers, to enable participation in educational and social activities and to ensure equitable access to learning. Although the organisation and implementation of support is contextualised and bound in different historical and political frameworks, this international comparison shows that both countries – with all its ambivalences and conflictual settings – emphasise a human-rights based understanding of inclusion. They on a cultural transformation process of schools to implement support for all pupils.     

The development of student feedback literacy: enabling uptake of feedback

Student feedback literacy denotes the understandings, capacities and dispositions needed to make sense of information and use it to enhance work or learning strategies. In this conceptual paper, student responses to feedback are reviewed and a number of barriers to student uptake of feedback are discussed. Four inter-related features are proposed as a framework underpinning students’ feedback literacy: appreciating feedback; making judgments; managing affect; and taking action. Two well-established learning activities, peer feedback and analysing exemplars, are discussed to illustrate how this framework can be operationalized. Some ways in which these two enabling activities can be re-focused more explicitly towards developing students’ feedback literacy are elaborated. Teachers are identified as playing important facilitating roles in promoting student feedback literacy through curriculum design, guidance and coaching. The implications and conclusion summarise recommendations for teaching and set out an agenda for further research.     

The effect of electronic performance support systems on self-regulated learning skills

Electronic performance support systems (EPSSs) are the software programs commonly used in commercial environments since the early 1990s. These software programs are generally called performance-based systems and focus on the complete job rather than providing individual development. For that reason, the usage of these systems in learning environments has not been sufficiently investigated. In this empirical study, availability of using EPSS software for learning processes was investigated in order to contribute to the literature. An EPSS software was developed for undergraduate students to use in programming language courses and the effects of the software on students' self-regulation based learning skills were investigated. During the treatment process, while the experimental group was supported with EPSS, traditional teaching continued in the control group. The results of the study showed that there was no statistically significant difference between the groups in terms of motivational beliefs; however, there were significant differences in terms of cognitive, metacognitive, and resource management strategies.     

Data use by Flemish school principals: impact of attitude,self-efficacy and external expectations

There is an increasing expectation that school principals use data to develop and justify school policy. There is also a strong belief among a wide variety of stakeholders that the quality of decisions within the school increases in proportion to the extent to which these decisions are based on good data. In most schools, however, it appears that data use is still quite limited. Research shows that the school principal plays a key role in data use in schools. In the present study, we examine the impact of external expectations, attitude and self-efficacy on the use of data by principals. The results of a survey among 451 school principals in Flanders show that affective aspects of attitude exhibit the strongest correlation with data use by principals. The impact of cognitive attitude and self-efficacy is statistically significant, but quite limited. The same applies to the perception of external school development-orientated and accountability-orientated expectations to use data.     

Co-constructing distributed leadership: district and school connections in data-driven decision-making

The purpose of this paper is to examine leadership practices in school systems that are implementing data-driven decision-making employing the theory of distributed leadership. With the advent of No Child Left Behind Act of 2001 (NCLB) in the US, educational leaders are now required to analyse, interpret and use data to make informed decisions in all areas of education, ranging from professional development to student learning. The emphasis on data-driven decision-making practices to bring about improved student outcomes is relatively a new feature of the education reform landscape and thus requires educators to learn and develop new competences. Leadership is one crucial bridge that can support and direct these new learning efforts. Using qualitative data from a case study of four urban school systems, the authors’ findings indicate that: (1) leaders at all levels co-constructed the vision and implementation of productive data-driven decision-making by creating an ethos of learning and continuous improvement rather than one of blame; (2) in order to give data relevance, leaders also distributed decision-making authority in a manner that empowered different staff members to utilise their expertise; and (3) the school systems directed their resources on building human and social capacity mainly by focusing on modelling and knowledge brokering amongst their staff. The paper concludes with a discussion of research and policy implications based on the findings.     

The use of a custom-built online environment for communication with and support of student-teachers during school placement

School Placement is recognised as a central component of Initial Teacher Education (ITE) programmes for the professional development and personal growth of student-teachers. It is also acknowledged to be a particularly challenging time for students during which they require support and guidance from their ITE tutors. In this regard, online environments hold much potential to facilitate greater communication between student-teachers and tutors during school placements. This paper considers the communicative features of a custom-built online environment for teacher education in the context of a concurrent ITE degree. It identifies a number of positive outcomes from the use of this system with regard to communication between student-teachers and their tutors. These include a more sustained and dialogical engagement between student-teacher and tutor throughout the duration of the placement, enhanced levels and quality of support that tutors can extend to student-teachers while on placement and more productive face-to-face communication between tutors and students.