A comparative judgement approach to the large-scale assessment of primary writing in England

ABSTRACT

Writing assessment is a key feature of most education systems, yet there are limitations with traditional methods of assessing writing involving rubrics. In contrast, comparative judgement appears to overcome the reliability issues that beset the assessment of performance assessment tasks. The approach presented here extends previous work on comparative judgement by directly involving teachers in a large number of schools in the judging of young pupils’ writing. To ensure quality control the process incorporated a process of ‘anchoring’ that ensured that teachers could not artificially inflate their own pupils’ scores. The approach was used to assess the writing of 55,599 primary pupils in England in 2017–2018. Overall, the results showed that a comparative judgement approach to writing incorporating anchoring shows promise in providing a fair and robust large-scale method to assess writing.     

The Effect on Achievement of Interaction between Self-Concept and Instructional Method

Hypotheses predicting ordinal interactions between self-concept and high and low guidance methods of instruction were tested with 92 elementary school subjects. Treatments were presented as self-instructional, programmed materials. The content was Latin and Greek morphographs. General and academic self-concept were independent variables, the dependent variables being recall and two types of transfer skill. Multiple regression analysis showed the interaction terms to be nonsignificant. However, when the analyses were conducted by school attended by subjects, significant disordinal interactions, in a direction the reverse of those hypothesized, were found.     

Differential Item Functioning in Biodata: Opportunity Access as an Explanation of Gender- and Race-Related DIF

Investigations of differential item functioning (DIF) have been conducted mostly on ability tests and have found little evidence of easily interpretable differences across various demographic subgroups. In this study, we examined the degree to which DIF in biographical data items referencing academically relevant background, experiences, and interests was related to differences in judgments about access to these experiences by members of different gender and race subgroups. DIF in the location parameter was significantly related (r = –.51, p < .01) to gender differences in perceived accessibility to experience. No significant relationships with accessibility were observed for DIF in the slope parameter across gender groups or for the slope and location parameters associated with DIF across Black and White groups. Practical implications for use of biodata and theoretical implications for DIF research are discussed.     

Characteristics of Successful Collaborations to Produce Educated Software Engineering Professionals

Currently, a large gap exists between the number of open software engineering positions and the number of qualified software engineers to fill those positions. The Industry/University (I/U) subgroup of the Working Group on Software Engineering Education and Training (WGSEET) is investigating active collaborations between companies and universities in which non-software professionals and practitioners without formal software education are reeducated to become software engineers. This paper describes the current status of work performed by the I/U subgroup in the investigation of reeducation collaborations. It is our goal to identify the common characteristics of successful collaborations in order to provide guidance to universities and companies when constructing a collaborative program, as well as to promote future collaborations. In this paper, we report on the current activity of the I/U subgroup, describe the features of successful collaborations identified so far in our research, and provide some conclusions as to the usefulness of such collaborations.     

Using Open Learning Methods Effectively in a Developing Country

Abstract

Based on personal experience, this article examines the value and practicality of using open learning methods and audiovisual materials in a developing country. It also suggests a method by which a strategy for using open learning in developing countries may be developed.     

Changing primary education in Palestine: Pulling in several directions at once

This article uses concepts from Bernstein's theory of curriculum and pedagogic practice (1971, 1977, 1990, 1996) in order to understand the micro-processes of schooling and, in particular, to locate and understand the type of pedagogy proposed for Palestinian schools by the Integrated Learning Project (ILP) whose introduction and trajectory in the wider social context is located, adopting Bernstein's model of cultural reproduction (1990). Three means were employed for data collection: non-participant classroom observation; informal and semi-structured interviews; and interrogation of secondary sources, relying heavily on official and school documents. A conversational modality of interview with key persons responsible for planning, training and monitoring of the ILP was also used in order to provide contextual data about policy processes. What was revealed suggested that even though there were some changes in particular areas in school practice, it does not seem that they can be regarded as amounting a child-centred pedagogy. There was little evidence to show that teachers in general were working effectively toward meeting pupils' different needs.