How can we evaluate the effectiveness of grammar schools in England? A regression discontinuity approach

Previous research evaluating grammar school effectiveness has generally relied on snapshot or longitudinal regression models to deal with pre-existing differences between grammar school pupils and those in non-selective schools. These passive designs are based on correlations, and cannot demonstrate clear positive causal relationships between grammar school attendance and subsequent attainment. After accounting for the variables available for the analysis, pupils in different schools might still have distinct and unmeasured characteristics which threaten the validity of any conclusions drawn. Given that a randomised trial is not feasible under current conditions, this study addresses the limitations of previous research, using a regression discontinuity design (RDD) approach. This is the first use of RDD to attempt to make a robust causal inference about the effectiveness of grammar schools in one local authority in England. However, the authority, the Department for Education and the schools would not provide the individual data on pupils’ 11+ entry test scores, and the scores obtained could not be uniquely matched to Key Stage 4 outcomes. While the model presented suggests that there is an advantage to grammar school attendance, the incomplete data means that the study is more a feasibility trial of this strong design than any kind of definitive test intended to settle the debate on grammar school effectiveness. Conducting this design with national data on grammar school selection would create the most powerful evidence so far. To promote an effective and equitable education system for generations to come, those advocating the expansion of grammar schools should make the responsible decision to disclose all grammar school selection data for the purposes of research.     

How do we rate? An evaluation of online student evaluations

This paper analyses the popular RateMyProfessors (RMP) website where students evaluate instructors in higher education. A study was designed to measure (1) the awareness and utilisation of the RMP website, (2) the internal and external validity of the RMP ratings in measuring teaching effectiveness, and (3) variation in the above across disciplines. It is concluded that the category of ratings, created by the website, establishes an anti‐intellectual tone that manifests itself in comments about instructors’ personality, easiness of workload and entertainment value rather than knowledge attained.     

How do different types of schools prepare students for life at Cambridge?

Twenty students from different educational backgrounds within the UK were interviewed to investigate how well they considered their secondary school education had prepared them for the educational and social demands of an ‘elite’ university and life within its most traditional colleges. The study asked them how they perceived students from different educational backgrounds and how they thought they were perceived. Entering a traditional Cambridge college was found to be easiest for students from prestigious ‘public schools’ within the private educational sector. State school students were more likely to experience anxiety, and those who adapted successfully were likely to have strong independent learning skills and a robust sense of self-efficacy. The study suggests that students coming from state schools to Cambridge are making a more difficult academic and social transition than students from private schools, for which they are given no special support.     

Sustainable schools programmes: what influence on schools and how do we know?

This paper focuses on our experience of researching the influence of ResourceSmart Schools, a sustainable schools programme in Victoria, Australia. Drawing on ideas from programme theory and realist synthesis, we illustrate and reflect upon our approach to conceptualising, investigating and generating evidence about the programme’s impacts and influence in participating schools. This distinction is deliberate: it helps distinguish between efforts to understand the impacts that a programme has within schools (programme impact), and efforts to understand what it is about a programme that is influential in bringing about those impacts (programme influence). Drawing on evidence from our work in this project and the wider literature, we argue for a more nuanced discussion and more sophisticated investigations into the complexities of programme influence, rather than impacts only. Our conclusions suggest key areas of development for our own work, the provision of environmental and sustainability education, and their evaluation and research more broadly.     

CS1: how will they do? How can we help? A decade of research and practice

ABSTRACT

Background and Context: Computer Science attrition rates (in the western world) are very concerning, with a large number of students failing to progress each year. It is well acknowledged that a significant factor of this attrition, is the students’ difficulty to master the introductory programming module, often referred to as CS1.

Objective: The objective of this article is to describe the evolution of a prediction model named PreSS (Predict Student Success) over a 13-year period (2005–2018).

Method: This article ties together, the PreSS prediction model; pilot studies; a longitudinal, multi-institutional re-validation and replication study; improvements to the model since its inception; and interventions to reduce attrition rates.

Findings: The outcome of this body of work is an end-to-end real-time web-based tool (PreSS#), which can predict student success early in an introductory programming module (CS1), with an accuracy of 71%. This tool is enhanced with interventions that were developed in conjunction with PreSS#, which improved student performance in CS1.

Implications: This work contributes significantly to the computer science education (CSEd) community and the ITiCSE 2015 working group’s call (in particular the second grand challenge), by re-validating and developing further the original PreSS model, 13 years after it was developed, on a modern, disparate, multi-institutional data set.     

Considering the role of traditional and specialist schools: do school experiences impact the emotional well‐being and self‐esteem of adults with dyslexia?

While increasing attention is being paid to the influence of specialist and traditional school settings on the emotional well‐being and self‐esteem of children with dyslexia, there appears to be a need for more attention to how different educational settings may impact adulthood. To respond to this gap, this study by assistant professors Blace A. Nalavany and Lena W. Carawan, and graduate student Lashaunda J. Brown, all at East Carolina University, explores how the role of traditional and specialist school settings may have long‐term effects in adulthood. The findings reveal that educational experiences have a compelling impact on the emotional health and self‐esteem of adults with dyslexia. Implications reveal that there are important lessons to learn from specialist schools that can benefit traditional school settings.     

How do schools affect inequalities in political participation: compensation of social disadvantage or provision of differential access?

Abstract

Both direct and indirect influences have been assumed to impact the transmission of political orientations within families. A lower socioeconomic status is related to lower intended political participation of adolescents. Within this context, schools play a crucial role in political socialisation, as citizenship education is assumed to either equalise or maintain these social disparities. We analyse a sub-dataset of the International Civic and Citizenship Education Study 2016 which includes 14-year-old students in four European countries: Belgium (Flanders), Denmark, Germany (North Rhine-Westphalia) and the Netherlands. Multi-level regression analyses reveal that formal citizenship education compensates the relationship between students’ socioeconomic status and intended electoral participation in Denmark, Germany (NRW) and the Netherlands, but not in Belgium (FL). Further, the composition of school classes is related to the perception of an open classroom climate in each of the four countries and to participation in civic activities at school in three countries.     

Formal body bequest program in Nigerian medical schools: When do we start?

Human body dissection is a prerequisite for the training of health professionals and the conduct of medical research. However, most Nigerian medical schools experience difficulty obtaining an adequate and regular supply of human tissue. Presently, the major source of anatomical material comes from unclaimed bodies collected from hospital mortuaries. However, one sure way to ensure a regular supply of bodies for anatomical dissection is to establish a whole body bequest program among the departments of anatomy in Nigerian medical schools. If such a program were to be supported by an appropriate legislative act of parliament, the supply of acceptable cadavers for anatomical teaching and research would be substantially increased. The author advocates for establishing a whole body bequest program among Nigerian medical schools.     

How do instructional designers evaluate? A qualitative study of evaluation in practice

This study employed a qualitative research design to investigate how instructional designers use evaluation in everyday design practice. While past research has examined how designers spend their time, how they generally make decisions, and expert-novice differences, little attention has been paid to use of context, input, process, or product evaluation, from the perspective of practicing designers. Based on interviews of practitioners, our findings included ten themes regarding how designers use evaluation to improve their products. While these results substantiate to some degree the claim that practitioners believe clients will not pay for formal evaluations, they also suggest that practitioners use evaluation in important but less formal ways. Other conclusions regarding the role of evaluation in design are provided and future directions for training and research are discussed.     

How do apes ape?

In the wake of telling critiques of the foundations on which earlier conclusions were based, the last 15 years have witnessed a renaissance in the study of social learning in apes. As a result, we are able to review 31 experimental studies from this period in which social learning in chimpanzees, gorillas, and orangutans has been investigated. The principal question framed at the beginning of this era, Do apes ape? has been answered in the affirmative, at least in certain conditions. The more interesting question now is, thus, How do apes ape? Answering this question has engendered richer taxonomies of the range of social-learning processes at work and new methodologies to uncover them. Together, these studies suggest that apes ape by employing a portfolio of alternative social-learning processes in flexibly adaptive ways, in conjunction with nonsocial learning. We conclude by sketching the kind of decision tree that appears to underlie the deployment of these alternatives.     

How did I do?

A rookie police officer was out for his first ride in a cruiser with an experienced partner. A call came in telling them to     

How do teachers coordinate their work? A framing approach

Since the 1970s, schools have been characterized as loosely coupled systems, meaning that the teachers’ work is weakly coordinated at the local level. Nonetheless, few studies have focused on the local variations of coordination modes, their sources and their nature. In this article, the process of local coordination of the teachers’ work is analyzed, using a sociocognitive approach. A longitudinal study of the framing process conducted during two years in one school is presented, in order to capture the parallel evolution of the teachers’ cognitive structures and the school’s social structures. The results show that: (1) the framing process is at the heart of political games, meaning that the local definition of teaching and its conditions represent an important issue for the teachers; and that (2) the cognitive structures that emerge from the framing process appear to some extent to be decoupled from the teachers’ actual practices, contributing only partially to the local process of the teachers’ work coordination.     

How do national regulations for publicly subsidized private schools work in a decentralized context?

Contrary to decentralization trends, recent policy recommendations suggest stronger regulations for educational public-private partnerships to improve quality for disadvantaged populations. We conducted a comparative analysis of the implementation of recentralized regulations for contracted schools in two Colombian subnational jurisdictions with different outcomes. Our findings indicate that a high dependency between local government and contracted schools to increase enrollment and secure schools’ financial stability leads to collusion between these actors against centralized regulations. By contrast, a lower dependency favours the alignment of goals between national and local governments, which improves selection and monitoring of contracted schools. This second scenario, however, requires high local capacity and considerable public-school supply—two conditions ignored by the theoretical propositions that support recentralized regulations. Our conclusions discuss the limitations of market regulation approaches to fix problems of contracted schools, and the dilemmas of improving quality of public-private partnerships in contexts of weak governance and conflicting pressures.