A logic of appropriation: enacting national testing (NAPLAN) in Australia

This paper explores how the strong policy push to improve students’ results on national literacy and numeracy tests – the National Assessment Program, Literacy and Numeracy (NAPLAN) – in the Australian state of Queensland influenced schooling practices, including teachers’ learning. The paper argues the focus upon improved test scores on NAPLAN within schools was the result of sustained policy pressure for increased attention to such foci at national and state levels, and a broader political context in which rapid improvement in test results was considered imperative. However, implementation, (or what this paper describes more accurately as ‘enactment’) of the policy also revealed NAPLAN as providing evidence of students’ learning, as useful for grouping students to help improve their literacy and numeracy capabilities, and as a stimulus for teacher professional development. Drawing upon the sociology of Pierre Bourdieu, the paper argues that even as more political concerns about comparing NAPLAN results with other states were recognised by educators, the field of schooling practices was characterised by a logic of active appropriation of political concerns about improved test scores by teachers, for more educative purposes. In this way, policy enactment in schools is characterised by competing interests, and involving not just interpretation, translation and critique but active appropriation of political concerns by teachers.     

Funding,reputation and targets: the discursive logics of high-stakes testing

This paper provides insights into teacher and school-based administrators’ responses to policy demands for improved outcomes on high-stakes, standardised literacy and numeracy tests in Australia. Specifically, the research reveals the effects of the National Assessment Program – Literacy and Numeracy (NAPLAN), and associated policies, in the state of Queensland. Drawing suggestively across Michel Foucault’s notions of disciplinary power and subjectivity, and Pierre Bourdieu’s concept of social fields, the research utilises interviews with teachers and school-based administrators to reveal how high-stakes, standardised testing practices served to discursively constitute performative teacher subjectivities around issues of funding, teacher and school reputation and target-setting within what is described as the ‘field of schooling practices’. The paper argues that the contestation evident within this field is also reflective and constitutive of more educative schooling discourses and practices, even as performative logics dominate.     

Governing teacher learning: understanding teachers’ compliance with and critique of standardization

This paper examines how policy pressure for increased performance on standardised measures of student achievement influenced the teacher learning practices that arose in a school setting in Queensland, Australia. Drawing upon research and theorising of governing by numbers, and applications to the governance of education, and particularly teachers’ learning, the research analyses how a group of Year 3 teachers collaborated to better inform themselves about the nature of their students’ learning. The research reveals that the governance of teachers’ learning under current policy conditions was manifest through both teachers’ compliance with and critique of a strong focus upon school, regional, state and national data – specifically, students’ attainment in ‘leveled’ readers and other school-based standardised measures of reading and mathematics, and school, state and regional results on national literacy and numeracy tests. There is little research that highlights the tensions around these numbers as governing technologies in relation to specific formal, ongoing instances of teacher professional development practices. The research cautions against the influence of such governing processes for how they potentially narrow teachers’ attention to more standardized measures of students’ learning, even as teachers may critique these more reductive effects.     

School leaders’ identification of school level and teacher practices that influence school improvement in national numeracy testing outcomes

Since 2008, all Australian students in Years 3, 5, 7 and 9 have been assessed in literacy and numeracy through an annual National Assessment Program—Literacy and Numeracy (NAPLAN) test. In 2015, a team of mathematics education researchers across Australia conducted a nationwide research project to identify school practices and policies that were consistent between schools that showed growth and/or improvement in their NAPLAN numeracy results. This paper reports findings from three case study schools, using a school improvement framework to interpret evidence gathered from the schools’ principals and school leaders. The study has particular implications for policy makers and school leaders who may be seeking ways to improve mathematical practices in their own jurisdictions and schools.     

‘To be numerate is to be someone…’: Tracing the doings of students labelled ‘at risk’

Scores from the Australian National Assessment Program—Literacy and Numeracy (NAPLAN) identify students ‘at risk’ of not meeting minimum standards deemed necessary for future success in school and employment. The NAPLAN tests include items related to numeracy but also mathematics content and skills. Research in the area of mathematics education examining the effectiveness of pedagogical interventions in improving student scores on NAPLAN and other international measures is not only shaped by the standardised testing regime, it also effectively corrals the problem within the school context. As such, it is unable to answer questions related to other factors implicated in the lives of those who continue to ‘fail’ in relation to numeracy outcomes. This paper critically examines the type of funded research being done in relation to numeracy and mathematics education, the ‘social’ turn and the disconnect between this research and the widening ‘gap’ in NAPLAN numeracy outcomes. It argues for a research approach informed by institutional ethnography that begins with the ‘doings’ of individual students labelled ‘at risk’.     

Education as a ‘risky business’: Theorising student and teacher learning in complex times

This paper employs sociological literature on risk and the commodification of education to explain current schooling practices in a context of increased concerns about students’ behaviour and results on standardised tests of achievement. Drawing upon teacher and student learning practices in three school sites in south-east Queensland, Australia, the article reveals how specific tests, packages and programmes have been employed as technologies of governance to minimise the risk of adverse student behaviour, maximise student outcomes on standardised tests, and provide teachers with discrete learning experiences construed as improving such outcomes. The sum total of these foci is the construction of education as an increasingly ‘risky business’ which employs a myriad of products and tests to manage perceived and actual risks. The paper also reveals how these products and processes constitute student misbehaviour and inadequate teacher and student learning as ‘risk objects’ requiring constant intervention, but which also inhibit inclusion in schooling settings, and challenge teachers’ professionalism.     

Standards-based accountability: reification,responsibility and the ethical subject

Over the last two decades, teachers in Australia have witnessed multiple incarnations of the idea of ‘educational accountability’ and its enactment. Research into this phenomenon of educational policy and practice has revealed various layers of the concept, particularly its professional, bureaucratic, political and cultural dimensions that are central to the restructuring of educational governance and the reorganization of teachers’ work. Today, accountability constitutes a core concept of neoliberal policy-making in education, both fashioning and normalizing what counts as teacher professionalism in the ‘audit society.’ This article focuses specifically on the recent introduction by the Australian Federal Government of standardised literacy testing in all states across Australia, and raises questions about the impact of this reform on the work practices of English literacy teachers in primary and secondary schools. We draw on data collected as part of a major research project funded by the Australian Research Council, involving interviews with teachers about their experiences of implementing standardised testing. The article traces the ways in which teachers’ work is increasingly being mediated by standardised literacy testing to show how these teachers grapple with the tensions between state-wide mandates and a sense of their professional responsibility for their students.     

Relationships of surveillance,assurance and recognition: early career primary teachers’ engagement with discourses of accountability and performance

Anecdotal evidence suggests that Irish primary teachers, and particularly those working in disadvantaged schools, are coming under increasing pressure to orient their practices towards satisfying the exigencies of accountability and performativity (Conway, P. F., and R. Murphy. 2013. “A Rising Tide Meets a Perfect Storm: New Accountabilities in Teaching and Teacher Education in Ireland.” Irish Educational Studies 32 (1): 11–36. doi:10.1080/03323315.2013.773227). Focusing specifically on early career teachers (ECTs) in Irish designated disadvantaged primary schools, this paper investigates ECTs’ engagement with discourses of accountability and performance and its influence on their daily practices. Semi-structured, life-history interviews were conducted with 18 participants drawn from three urban designated disadvantaged schools. Local conditions (level of disadvantage, the intensity and concentration of students’ needs, and school culture), as well as participants’ career stage, impacted upon the way ECTs engaged with, and/or mediated the influence of the strong, neoliberal performativity discourse. Participants’ engagement with the literacy and numeracy standardised testing process was characterised by relationships of surveillance which were held in tension with contradictory and conflicting relationships of assurance and recognition that the DEIS literacy and numeracy programmes and positive standardised test scores fostered. The findings indicate that the nature of these relationships, coupled with the demanding social context in which they begin their careers, is orienting ECTs towards the use of more structured and control oriented pedagogies.     

The (hidden) injuries of NAPLAN: two standardised test events and the making of ‘at risk’ student subjects

Standardised testing regimes, including the National Assessment Program Literacy and Numeracy (NAPLAN) in Australia, have impacted on relationships between and within schools, and on teachers’ work and on pedagogies. Previous analyses of the effects of NAPLAN have been generated outside of the test situation: frequently through attitudinal surveys and qualitative interviews. This article takes as its point of departure two intensely affective events associated with the NAPLAN test day itself. These events erupted in two qualitative studies of students’ schooling experiences: a study of students’ experiences of NAPLAN and a study of students’ experiences of student voice at school. We ask, after Deleuze and Guattari, What can a NAPLAN test do? Exploring the entangled corporeal (physical and embodied) and incorporeal (psychic and subjectivating) wounds effected in and through these events, we analyse the dynamic constitution and re-constitutions of ‘at risk’ categorisations. While the NAPLAN test is not claimed to cause physical and psychical injury, we argue that standardised test conditions, in these singular events, are inextricably entwined with the formation of particular students’ schooled subjectivities.     

A preliminary analysis of teacher perceptions of the effects of NAPLAN on pedagogy and curriculum

This paper reports preliminary survey findings of Western Australian and South Australian teacher perceptions of the impact of NAPLAN on curriculum and pedagogy in their classroom and school. The paper examines how teachers perceive the effects of NAPLAN on curriculum and pedagogy and whether these perceptions mediated by the teacher’s gender, the socioeconomics of the school, the State and the school system in which the teacher works. Teachers report that they are either choosing or being instructed to teach to the test, that this results in less time being spent on other curriculum areas and that these effects contribute in a negative way to the class environment and the engagement of students. This largely agrees with a body of international research that suggests that high-stakes literacy and numeracy tests often results in unintended consequences such as a narrow curriculum focus, a return to teacher-centred instruction and a decrease in motivation. Analysis suggests there is a relationship between participant responses to the effect of NAPLAN on curriculum based on the characteristics of which State the teacher taught in, the socioeconomic status of the school and the school system in which they were employed (State, Catholic, and Independent).     

Secondary school students’ attitudes towards numeracy: an Australian investigation based on the National Assessment Program—Literacy and Numeracy (NAPLAN)

International and national testing of numerical and language skills has become a regular part of educational systems in many countries. In Australia, the National Assessment Program—Literacy and Numeracy (NAPLAN) has been used since 2008 to carry out regular tests of literacy and numeracy amongst school students nationally. Since the numeracy components of this program are based on work carried out in school mathematics classes, it seems reasonable that tests represent an evaluation of mathematical ability, albeit at the simpler and introductory levels. However, there has been little investigation of students’ ideas about numeracy, and the role that their attitudes towards numeracy may have on their results on the numeracy components of NAPLAN tests. This study carries out an empirical investigation of ideas about and attitudes towards numeracy, and their relation to NAPLAN scores for a sample of 735 lower secondary students from two schools in New South Wales, Australia. Attitudes are measured using a modified form of the Students’ Attitudes Towards Statistics, (SATS-36) test (Schau in Survey of attitudes towards statistics, http://www.evaluationandstatistics.com, 2003), and conceptions of numeracy are obtained from phenomenographic analysis of an open-ended response item. The overall conclusion, that students’ understanding of the concept of numeracy and their attitudes towards numeracy are related to their performance in numeracy tests, represents a potentially important result both for students and their teachers.     

Investigating the use of the National Assessment Program – Literacy and Numeracy (NAPLAN) test results

The National Assessment Program – Literacy and Numeracy (NAPLAN) is a nationwide testing program for literacy and numeracy in Australia. Several studies explored and used NAPLAN numeracy test results as a source of valuable data and a potential means to improve education. This paper presents a systematic literature review to investigate the use of NAPLAN numeracy test results in those peer-reviewed articles in relation to the purposes of NAPLAN results mentioned by the Australian Curriculum, Assessment and Reporting Authority (ACARA). Findings showed a variety of uses of the NAPLAN numeracy test results in these studies. Most of the studies used the test results to map student progress and identify strengths and weaknesses in teaching. A significant number of studies used the NAPLAN numeracy test results that differ from the purposes mentioned by ACARA. The review concluded that there is currently insufficient use which reflects the purpose of NAPLAN test results.     

Learning to Draw and Drawing to Learn

Young children enter formal schooling with a repertoire of modes of representation with which they try to make sense of the world – drawing, modelling, role play, storying, emergent literacy and numeracy. In drawing they use mark making for kinesthetic pleasure and later learn to repeat patterns and shapes intentionally. From these repeated marks they begin to explore the potential of drawings to represent what they know. A parallel set of drawing strategies with an explicit communicative function develop through social relationships at home or in pre-school/care settings. Children observe and mimic modes of representation and absorb the semiotics modelled by adults or older children in the community/culture[s] in which they are reared. On entering formal school, the messages children receive from the culture of classrooms is that the modes of representation that are valued are the formal symbolic modes of literacy and numeracy whereas teachers perceive drawing as useful for occupational or recreational purposes. Ironically, as children are cultured into ‘academic’ achievements, they lose out on opportunities to engage in alternative modes of representation/symbolic systems, which may offer opportunities for cognitive challenge at higher levels. Thus, whilst pushing children to perform ‘academically’ in the early stages of schooling, we underestimate them ‘intellectually’. At elementary school level children’s mark-making is shaped into a ‘catch-all’, narrative/representational style of drawing across all subjects. Children often elect to explore their own personal, culturally specific ways of drawing outside school as ‘home art’. In school their capabilities in using alternative modes of representation as tools for learning wither away.     

The ‘datafication’ of early years pedagogy: ‘if the teaching is good,the data should be good and if there’s bad teaching,there is bad data’

Following the election of the Conservative–Liberal Democrat UK coalition Government in 2010, there has been an urgent intensification and focus upon early years numeracy and literacy and promoting systematic synthetic phonics. This paper argues that the current narrowing of early years assessment, along with increased inspection and surveillance, operates as a policy technology leading to an intensification of ‘school readiness’ pressures upon the earliest stage of education. The paper suggests that this governance has encouraged a functional ‘datafication’ of early years pedagogy so that early years teacher’s work is increasingly constrained by performativity demands to produce ‘appropriate’ data. The article argues that early years high-stakes national assessments act as a ‘meta-policy’, ‘steering’ early years pedagogy ‘from a distance’ and have the power to challenge, disrupt and constrain early years teacher’s deeply held child-centred pedagogical values.     

Predictors of children’s achievement: analysis of the Australian National Numeracy Assessment Program

In this study, we examine children’s National Assessment Program—Literacy and Numeracy (NAPLAN) achievement predictors, which may enable or limit their numeracy performance and assess the relative importance of the predictor variables. Our data source was the NAPLAN numeracy results of Queensland schools from 2014 to 2017. Years 3 and 5 children’s NAPLAN numeracy scores were analysed using a hierarchical multiple regression model. We examined eight variables grouped into four themes to determine their predictive value for children’s numeracy performance in NAPLAN. Findings from this study indicate that parent’s educational level, parent’s occupation and indigenous status variables accounted for 10–11% of the total variance, while geolocation and sector type contributed an additional 0.2–0.4% of the variance. Gender and language background other than English (LBOTE) contributed 0.1–0.4% of the variance. These results were consistent across levels (Years 3 and 5) and test years (2014–2017). When these predictors were controlled, the influence of parent’s post-school education and LBOTE status were less and non-significant. Previous NAPLAN numeracy results for Year 5 children were found to be very large in its predictive value (R²?=?0.50). The implications of these results for teachers, parents and researchers are described.

     

Reporting the ‘education revolution’: MySchool.edu.au in the print media

Launched in January 2010, the MySchool.edu.au website, which ranks and compares schools on the basis of standardised literacy and numeracy tests, has been the subject of intense media coverage. This article examines 34 editorials focused on MySchool, published from October 2009 to August 2010, and identifies three key narratives in operation, those of distrust, choice and performance. It argues that these narratives work together to reinforce and promote neoliberal educational discourses at the heart of what Michael Apple has termed the ‘conservative modernisation’ of education and other social services. Together, the dominant narratives position MySchool and the ensuing newspaper-generated and published league tables as the solution to problems of poor performance, ‘bad’ schools and ‘bad’ teachers in the face of times characterised by self-interested teachers and governments keen to shirk their responsibility in the education arena.     

Steering in complex education systems. Why similar aims can have dramatically different results.

ABSTRACT

In the wake of neo-liberal informed global trends to set performance standards and intensify accountability, the Dutch government aimed for ‘raising standards for basic skills’. While the implementation of literacy standards was hardly noticed, the introduction of numeracy standards caused a major backlash in secondary schools, which ended in a failed introduction of a high stakes test. How can these major differences be explained? Inspired by Foucault’s governmentality concept a theoretical framework is developed to allow for detailed empirical research on steering processes in complex systems in which many actors are involved in educational decision-making. A mixed-methods multiple embedded case-study was conducted comprising nine school boards and fifteen secondary schools. Analyses unveil processes of responsibilisation, normalisation and emerging dividing practices. Literacy standards reinforced responsibilities of Dutch language teachers; for numeracy, school leadership created entirely new roles and responsibilities for teachers. Literacy standards were incorporated in an already used instrument which made implementation both subtle and inevitable. For numeracy, schools distinguished students by risk of not passing the new test affirming the disciplinary nature of schools in the process. While little changed to address teachers main concerns about students’ literacy skills, the failed introduction of the numeracy test usurped most resources.     

The value of literacy practices

The concepts of literacy events and practices have received considerable attention in educational research and policy. In comparison, the question of value, that is, ‘which literacy practices do people most value?’ has been neglected. With the current trend of cross-cultural adult literacy assessment, it is increasingly important to recognise locally valued literacy practices. In this paper we argue that measuring preferences and weighting of literacy practices provides an empirical and democratic basis for decisions in literacy assessment and curriculum development and could inform rapid educational adaptation to changes in the literacy environment. The paper examines the methodological basis for investigating literacy values and its potential to inform cross-cultural literacy assessments. The argument is illustrated with primary data from Mozambique. The correlation between individual values and respondents’ socio-economic and demographic characteristics is explored.