The effect of adaptivity on the reliability coefficient in adaptive comparative judgement

Comparative Judgement (CJ) is an increasingly widely investigated method in assessment for creating a scale, for example of the quality of essays. One area that has attracted attention in CJ studies is the optimisation of the selection of pairs of objects for judgement. One approach is known as adaptive comparative judgement (ACJ). It has been claimed in the literature that ACJ produces very high reliability, often higher than can be obtained by conventional marking. Bramley showed by simulation that adaptivity can substantially inflate the apparent reliability in ACJ. The empirical study described here compared an adaptive with a non-adaptive CJ study using GCSE English essays. An all-play-all set of comparisons of a subset of the essays allowed the extent of scale inflation to be quantified: the reported adaptive reliability was 0.97 whereas the deflated value was 0.84. The value from the non-adaptive study was 0.72. However, the scale from the non-adaptive study correlated slightly higher with external variables, suggesting the non-adaptive study was no less valid than the adaptive one.     

Books and articles of academic interest

Books and articles of academic interest     

Transforming engagement: a case study of building intrinsic motivation in a child with autism

This longitudinal case study of a 10‐year‐old girl with autism and severe communication impairment measures the impact of the MORE (Means, Opportunities, Reasons and Expectations) approach to enhancing engagement and communication. Through detailed observation of video data over a period of 28 months, engagement behaviours including interaction with adults and following adult directions increased, while resistant behaviours such as kicking, hitting and pushing adults away decreased. Fluctuation between different ‘states’ demonstrated that the frequency and duration of engagement was influenced by the MORE approach and an emphasis on developing intrinsic motivation. In order to enable further efficacy research, core features of the intervention and the changes in engagement over time are described.     

A Deluge of Directives: conflict between collegiality and managerialism in the post-ERA primary school

The paper examines the impact of the plethora of innovations associated with the 1988 Education Reform Act (ERA) on the management of whole-school change in the primary school. Based upon qualitative data from a national sample of 50 schools in England and Wales, it documents the growing tensions between collegial and top-down managerial approaches. These are evidenced in the changing nature of working collaboratively in primary schools, in the creation of new management structures, in the me of school development plans and in the growth of quality assurance mechanisms, particularly in relation to preparation for Office for Standards in Education (OFSTED) inspections. There are conflicting interpretations of terms such as ‘collegiality’, ‘collaboration’, ‘teamwork’ and ‘whole-school approaches’ and there have been subtle shifts in their meaning and in their realisation in practice in the pre-and post-ERA context.     

A Methylome‐Wide Association Study of Trajectories of Oppositional Defiant Behaviors and Biological Overlap With Attention Deficit Hyperactivity Disorder

In 671 mother–child (49% male) pairs from an epidemiological birth cohort, we investigated (a) prospective associations between DNA methylation (at birth) and trajectories (ages 7–13) of oppositional defiant disorder (ODD), and the ODD subdimensions of irritable and headstrong; (b) common biological pathways, indexed by DNA methylation, between ODD trajectories and attention deficit hyperactivity disorder (ADHD); (c) genetic influence on DNA methylation; and (d) prenatal risk exposure associations. Methylome‐wide significant associations were identified for the ODD and headstrong, but not for irritable. Overlap analysis indicated biological correlates between ODD, headstrong, and ADHD. DNA methylation in ODD and headstrong was (to a degree) genetically influenced. DNA methylation associated with prenatal risk exposures of maternal anxiety (headstrong) and cigarette smoking (ODD and headstrong).     

‘Being yourself’: everyday ways of doing and being gender in a ‘rights-respecting’ primary school

This paper engages with some everyday ways of doing and being gender which proceed from a dominant liberal rights policy and practice discourse within one English ‘rights-respecting’ primary school in England. Drawing on three ethnographic vignettes of data from different spaces within the school, it utilises a Butlerian analytic to interrogate the kinds of subjects that children are entitled and obliged to be as they take up different subject positions proposed to them in the school. The paper engages with this empirical data, to foster and ignite critical sensibilities, especially as these relate to ‘taken-for-granted’ discourses of children’s rights which presume the participation of all children regardless of their differently gendered subjectivities. This analysis puts in question the universal, normative and essentialising effects of the category of the rights-respecting child as always unproblematic and forever productive.