Who pays for standardised testing? A cost-benefit study of mandated testing in three Queensland secondary schools

This paper reports on an Australian study that explored the costs and benefits of the National Assessment Programme, Literacy and Numeracy (NAPLAN) testing, both tangible and intangible, of Year 9 students in three Queensland schools. The study commenced with a review of pertinent studies and other related material about standardised testing in Australia, the USA and UK. Information about NAPLAN testing and reporting, and the pedagogical impacts of standardised testing were identified, however little about administrative costs to schools was found. A social constructivist perspective and a multiple case study approach were used to explore the actions of school managers and teachers in three Brisbane secondary schools. The study found that the costs of NAPLAN testing to schools fell into two categories: preparation of students for the testing; and administration of the tests. Whilst many of the costs could not be quantified, they were substantial and varied according to the education sector in which the school operated. The benefits to schools of NAPLAN testing were found to be limited. The findings have implications for governments, curriculum authorities and schools, leading to the conclusion that, from a school perspective, the benefits of NAPLAN testing do not justify the costs.     

High stakes testing and teacher access to professional opportunities: lessons from Indonesia

Abstract

High-stakes testing regimes, in which schools are judged on their capacity to attain high student results in national tests, are becoming common in both developed and developing nations, including the United States, Britain and Australia. However, while there has been substantial investigation around the impact of high-stakes testing on curriculum and pedagogy, there has been very little research looking at the impact on teachers’ professional opportunities. The current project used a case study approach to examine the impact a high-stakes national testing programme had on teachers’ access to professional learning and their teaching allocations in four Indonesian public schools. It found that better qualified teachers were allocated to classes that would be sitting for the national examinations, and that these teachers were given much more access to professional learning opportunities than those teaching non-examined year levels. This in turn impacted negatively on the staff morale of less qualified teaching staff and potentially on their career trajectories. Findings suggest that school leaders should be wary of targeting better qualified and/or more experienced staff to year levels sitting for high-stakes tests, as this may lead to staff stratification within schools, limiting opportunities for staff to learn from one another and reducing the morale of less qualified and less experienced staff. They also add support to a substantial body of research that suggests policy-makers should be wary of the flow-on effects of using performance in high-stakes tests as the key means of judging school effectiveness.     

A sociological analysis of Australia’s NAPLAN and My School Senate Inquiry submissions: the adultification of childhood?

Growing consensus in popular and academic commentary suggests the lived reality of Western childhood differs considerably from its dominant cultural construction as an innocent period free from adult responsibilities. Sociologically, this disjuncture is conceptualised as adultification. Adopting a critical theoretical lens, we question if Australian high-stakes standardised testing and reporting, National Assessment Program – Literacy and Numeracy (NAPLAN) and My School, evidences adultification of childhood experience in primary and secondary schools. Qualitative critical analysis of 270 submissions to NAPLAN’s 2010 Senate Inquiry demonstrates adultification in Australian schools, with children subjected to developmentally inappropriate expectations, pressure, stress and precocious knowledge in response to NAPLAN testing and reporting. Adultification, we argue, is a side-effect of individualisation, managerialism and neo-liberal government policy played out in Australian schools and exposing children to the harsh realities of political, economic and social life. De-politicalisation and de-marketisation of children is argued as urgently needed to foreground a critically considered ‘best practice’ when promoting or measuring educational progress and performance.     

A preliminary analysis of teacher perceptions of the effects of NAPLAN on pedagogy and curriculum

This paper reports preliminary survey findings of Western Australian and South Australian teacher perceptions of the impact of NAPLAN on curriculum and pedagogy in their classroom and school. The paper examines how teachers perceive the effects of NAPLAN on curriculum and pedagogy and whether these perceptions mediated by the teacher’s gender, the socioeconomics of the school, the State and the school system in which the teacher works. Teachers report that they are either choosing or being instructed to teach to the test, that this results in less time being spent on other curriculum areas and that these effects contribute in a negative way to the class environment and the engagement of students. This largely agrees with a body of international research that suggests that high-stakes literacy and numeracy tests often results in unintended consequences such as a narrow curriculum focus, a return to teacher-centred instruction and a decrease in motivation. Analysis suggests there is a relationship between participant responses to the effect of NAPLAN on curriculum based on the characteristics of which State the teacher taught in, the socioeconomic status of the school and the school system in which they were employed (State, Catholic, and Independent).     

A logic of appropriation: enacting national testing (NAPLAN) in Australia

This paper explores how the strong policy push to improve students’ results on national literacy and numeracy tests – the National Assessment Program, Literacy and Numeracy (NAPLAN) – in the Australian state of Queensland influenced schooling practices, including teachers’ learning. The paper argues the focus upon improved test scores on NAPLAN within schools was the result of sustained policy pressure for increased attention to such foci at national and state levels, and a broader political context in which rapid improvement in test results was considered imperative. However, implementation, (or what this paper describes more accurately as ‘enactment’) of the policy also revealed NAPLAN as providing evidence of students’ learning, as useful for grouping students to help improve their literacy and numeracy capabilities, and as a stimulus for teacher professional development. Drawing upon the sociology of Pierre Bourdieu, the paper argues that even as more political concerns about comparing NAPLAN results with other states were recognised by educators, the field of schooling practices was characterised by a logic of active appropriation of political concerns about improved test scores by teachers, for more educative purposes. In this way, policy enactment in schools is characterised by competing interests, and involving not just interpretation, translation and critique but active appropriation of political concerns by teachers.     

School leaders’ identification of school level and teacher practices that influence school improvement in national numeracy testing outcomes

Since 2008, all Australian students in Years 3, 5, 7 and 9 have been assessed in literacy and numeracy through an annual National Assessment Program—Literacy and Numeracy (NAPLAN) test. In 2015, a team of mathematics education researchers across Australia conducted a nationwide research project to identify school practices and policies that were consistent between schools that showed growth and/or improvement in their NAPLAN numeracy results. This paper reports findings from three case study schools, using a school improvement framework to interpret evidence gathered from the schools’ principals and school leaders. The study has particular implications for policy makers and school leaders who may be seeking ways to improve mathematical practices in their own jurisdictions and schools.     

Investigating the impact of NAPLAN on student,parent and teacher emotional distress in independent schools

Concerns have been raised about the impact Australia’s national standardised testing, the National Assessment Program-Literacy and Numeracy (NAPLAN), has upon the well-being of students, parents and teachers. To date, research evidence is unclear as to the level and extent of emotional distress experienced by stakeholders during testing. Despite an unclear evidence base, the prevailing view is that NAPLAN has a general negative impact upon stakeholder well-being. In a pilot study that surveyed all stakeholder groups across 11 independent schools in Western Australia, we found evidence of a minimal impact from the testing. We also found evidence for a small positive association between student and parent distress during testing, and a moderate positive association between parent and teacher distress during testing and their estimations regarding how NAPLAN impacts other people. Our results are not consistent with the prevailing view that NAPLAN has a broad negative impact on well-being, and highlights the need for further research to inform debates about the usefulness and impact of NAPLAN testing.     

The Potential Impacts of Upcoming High-Stakes Testing on the Teaching of Science in Elementary Classrooms

In 1983, the National Commission on Excellence in Education in the United States issued a report called A Nation at Risk: The Imperative for Educational Reform. This report and other policy initiatives such as the No Child Left Behind Legislation recommended that the individual states institute assessments to hold schools accountable. This research explored the potential impact of impending standardised testing on teaching science in elementary schools in one school district in Florida. We explored the teachers' concerns about the upcoming high-stakes tests in science, possible impact on their curriculum and what changes, if any, will be made in the approach to science teaching and learning in their classrooms. As the teachers look toward the implementation of high-stakes testing in science, they have recognised the need to teach science. This recognition is not borne out of the importance of science learning for elementary school children, but rather out of fear of failure and the effects of tangible rewards or punishments that accompany high-stakes testing. In anticipation, the teachers are preparing to align their teaching to the science standards while aggressively searching for test preparatory materials. Schools are also involved in professional development and structural changes to facilitate teaching of science.     

Voices from the ground: The emotional labour of English teachers' work

This paper examines the complex emotional work of English language teaching in Singapore secondary schools. Findings revealed the emotional burdens, tensions, and challenges associated with the teaching of English, largely attributed to the subject's value-laden content, the stresses of grading student essays, the performance pressures of high-stakes testing, and the need for culturally responsive pedagogies. Further studies of teachers' lived experiences in relation to their disciplinary domains can offer teacher educators and policymakers insights into the ways in which curriculum and policy impact on, and are impacted by, the emotional realities of teachers' work.     

The (hidden) injuries of NAPLAN: two standardised test events and the making of ‘at risk’ student subjects

Standardised testing regimes, including the National Assessment Program Literacy and Numeracy (NAPLAN) in Australia, have impacted on relationships between and within schools, and on teachers’ work and on pedagogies. Previous analyses of the effects of NAPLAN have been generated outside of the test situation: frequently through attitudinal surveys and qualitative interviews. This article takes as its point of departure two intensely affective events associated with the NAPLAN test day itself. These events erupted in two qualitative studies of students’ schooling experiences: a study of students’ experiences of NAPLAN and a study of students’ experiences of student voice at school. We ask, after Deleuze and Guattari, What can a NAPLAN test do? Exploring the entangled corporeal (physical and embodied) and incorporeal (psychic and subjectivating) wounds effected in and through these events, we analyse the dynamic constitution and re-constitutions of ‘at risk’ categorisations. While the NAPLAN test is not claimed to cause physical and psychical injury, we argue that standardised test conditions, in these singular events, are inextricably entwined with the formation of particular students’ schooled subjectivities.     

Student experiences of NAPLAN: sharing insights from two school sites

This paper provides insight into middle school students’ perceptions and reactions to their participation in the Australian National Assessment Program—Literacy and Numeracy (NAPLAN). A case study was conducted over 10 months at two Queensland schools with different approaches to NAPLAN implementation. Student voice was elicited via focus groups and 35 students provided drawings and words describing their experience in four stages: preparing, sitting, completing and receiving their results. Thematic content analysis of the textual data and trait and holistic coding of the visual data revealed five themes and suggests that the approach adopted by the school may impact on students’ NAPLAN experiences. This study privileges student voice and enables access to student experiences as they participate in a testing regime which is now a feature of the Australian school assessment landscape.     

Taking and teaching the test are not the same: a case study of first-year teachers’ experiences in high-stakes contexts

Background: Policymakers’ use of high-stakes exams to improve students’ academic achievement affects teachers and their tenure in the field at all levels of schooling. Novice teachers now being inducted into the field have been educated almost exclusively in these high-stakes learning environments. Yet, how their familiarity with these contexts combined with their experiences in their own classrooms affect novices’ induction into the field of teaching has not been fully examined. Aim: This article presents findings from an investigation into the experiences of two first-year teachers who were educated and trained to be teachers in the same high-stakes education system in which they taught. It examines how these first-year teachers viewed policymakers’ reforms affecting their teaching and tenure in the field. Methods: This qualitative case study centers on the experiences of two first-year teachers working in the same high-stakes standards-based accountability teaching context in which they were educated – the case. This study provides insight into the issue of how novices’ familiarity with high-stakes reform combined with their experiences in their own classrooms impacts their conceptions of their teaching and their tenure in the field. Outcomes: The findings from this case study reveal how policymakers’ high-stakes reforms impacted the development of these novice teachers in significant ways. Not only did they have to learn how to teach as they taught, but they also had to ensure they were teaching all of their students to pass the high-stakes exams. Their varied experiences also demonstrate how these high-stakes exams can ‘test’ beginning teachers out of the classroom. Conclusions: These findings demonstrate that first-year teachers’ familiarity with policymakers’ high-stakes reforms is not enough to prepare them for the expectation that they immediately improve students’ academic achievement on high-stakes exams. Such findings not only challenge what it means to be a educator in these contexts, but they also shed light on how larger political and economic forces impact the teaching and tenure of novices. To support new teachers, teacher educators and mentors should rethink the education and induction processes while helping novices understand as well as prepare for the role context plays in their teaching and development as professionals.     

The Logics of Good Teaching in an Audit Culture: A Deleuzian analysis

This article examines the attempted reform of education within an emerging audit culture in Australia that has led to the implementation of a high-stakes testing regime known as NAPLAN. NAPLAN represents a machine of auditing, which creates and accounts for data that are used to measure, amongst other things, good teaching. In particular, we address the logics of a policy intervention that aims to improve the quality of education through returning ‘good teaching’. Using Deleuze’s concepts of series, events, copies and simulacra, we suggest that an attempt to return past commonsense logics of ‘good teaching’ as a result of NAPLAN is not possible. In an audit culture as exemplified by NAPLAN, ‘good teaching’ is being reconceptualized through those practices and becomes unrecognizable. Whilst policy claims to improved equity and quality are admirable, this article suggests that the simulacral change to logics of good teaching may actualize something very different.     

Preservice Teachers Reconfiguring Teaching Young Children in a High-Stakes Early Education Context Through the Use of iPads:A Case Study

Research Findings: Having practicing or preservice early educators employing iPads and their apps as part of their practices with young children in high-stakes teaching contexts is a challenging process. The case study examined in this article further unpacks this complexity by investigating how incorporating iPads into their high-stakes field placements might have affected a sample of preservice teachers’ figuring of how to instruct and document the learning of young children. Although these preservice teachers seemed to struggle with using iPads to instruct children in their field placements, these teachers did appear to generate improvised responses to documenting student learning. Practice or Policy: Such findings offer teacher educators the chance to consider how to assist teachers in moving beyond the dominant practices found in high-stakes teaching contexts. They also offer teacher educators the chance to aid their teachers in reconfiguring the politics and policy of high-stakes early education contexts.     

A logic of enumeration: the nature and effects of national literacy and numeracy testing in Australia

This paper reveals the array of practices arising from strong policy pressure for improved student results in national literacy and numeracy tests in Australia: the National Assessment Programme in Literacy and Numeracy (NAPLAN). The paper provides an account of a policy context characterised by significant pressure upon teachers and principals to engage in practices to ensure improved outcomes on standardised literacy and numeracy tests, and of teachers and principals’ responses to these policy pressures. Drawing upon Bourdieu’s theory of practice, the article argues that what is described as the ‘field of schooling practices’ has become increasingly dominated by a ‘logic of enumeration’, and that high test results on standardised literacy and numeracy tests are increasingly valued capitals, evident in a strong focus upon teachers meeting, discussing and informing one another about NAPLAN; engaging in curriculum development practices which foreground NAPLAN, and; actively preparing students to sit the test, including, whether intentionally or unintentionally, teaching to the test. Such a focus has important implications for the sorts of practices most valued in schooling settings, as more educative logics are potentially marginalised under such circumstances.     

An ‘at‐risk’ curriculum for ‘at‐risk’ students? Special educational needs and disability in the new Australian Curriculum

The number of students who are ‘at risk’ including those with special education needs and or disabilities is increasing rapidly worldwide in all schools. This has prompted widespread debate regarding the impact of initiatives in Curriculum, Assessment and Reporting for this group of students. Teachers, parents and administrators need to have further information to enable them to contribute to the development of content, assessment and reporting processes in the curriculum that are inclusive, relevant, reliable and valid. This paper explores some of the issues and dilemmas raised by recent policy discussions regarding the inception of a first national Australian Curriculum. It draws purposively on literature relating to developments in England and Wales, where national curriculum provision has existed for over 25 years, as well as the responses of a group of stakeholders (teachers and leaders) from both England/Wales and Australian schools and settings. These data highlight both tension and opportunity in this area of work.     

‘Because then you could never ever get a job!’: children’s constructions of NAPLAN as high-stakes

In the midst of the debate surrounding the question of whether Australia’s National Assessment Program: Literacy and Numeracy (NAPLAN) test is high-stakes, it is evident that children’s own accounts of their experiences remain sparse. This paper describes the findings of a case study which documented the experiences of 105 children across two Catholic primary schools in Queensland serving different socio-economic status (SES) communities. Analysis of the data revealed that these teachers and principals did not experience NAPLAN as high-stakes. However, the data suggested that the children experienced the tests within a confusing context of contradictions and dissonances emanating from multiple sources; receiving little, if any, clear and consistent information regarding the purpose and significance of NAPLAN. While the children’s responses were varied, many reported NAPLAN as a negative experience, with some constructing the test as high-stakes. These constructions ranged from personal judgement or sense of letting their families down, to failure, and less commonly, grade retention and school exclusion. Some Year 3 children had also constructed good results as vital to future prosperity. These constructions bring into question the assumption that because NAPLAN is designed to be a low-stakes test, that children will necessarily experience it in this way.     

Negotiating the constraints of schools: environmental education practices within a school district

The purpose of this study was to explore environmental education (EE) practices within elementary and secondary schools. Using complementary mixed-methods (survey and focus groups), we detail these practices in schools (n?=?58) within one school district. Our findings are categorized according to classroom teaching conditions affecting EE, and whole-school perspectives of the supports and resources for EE in these schools. Our analyses reveal that while typical normative teaching and cultural constraints of schools are still evident (e.g. curriculum standards, school-level organization), there are identifiable practices involving administrators and teachers negotiating these challenges due to their personal commitment to schools and the environment. In particular was a provincial environmental certification program called Ecoschools supporting environmental educators’ initiatives at their respective schools. We conclude with a discussion of recommendations based on an interpretation of our findings in relation to the school reform literature on how to enhance EE in schools and propose future research opportunities.     

A cautionary tale: digital resources in literacy classrooms

ABSTRACT

Supportive digital resources are key to supporting educators’ pedagogic practices in teaching children to be literate. But locating suitable resources can be confusing, with as claims about products being educational, aligned with curriculum outcomes, and even as ‘silver bullets’. In Australia, a lack of specificity in national and state curriculum guidelines about resource selection creates inconsistencies within and across schools. We investigate how teacher-selected digital resources are used in early childhood classrooms to support literacy learning. Drawing on three independent Australian classroom-based studies, we share three examples of children engaging with digital resources. Together, they show that not all digital resources promote active and engaged literacy learning in meaningful and socially interactive contexts. We propose principles for selecting digital resources to promote playful, scaffolded, and exploratory literacy learning.     

Teacher educators mediating curricular reform: anticipating the Australian curriculum

Many education systems are experiencing a re-scaling and consolidation of governance through rolling national agendas of standardisation and centralisation. The present article considers the case of Australia as it moves towards implementing its first national curriculum, to explore how teacher educators plan to retain pedagogical space for debate, diversity and contestation of such systemic curricular reform. The present article reports on an interview study conducted with nine teacher educators across the four curriculum areas included in the first wave of the Australian curriculum: English, science, mathematics and history. The analysis reveals how teacher educators reported professional dilemmas around curricular design, and planned to resolve such dilemmas between the anticipated changes and their preferences for what might have been. While different curricular areas displayed different patterns of professional dilemma, the teacher educators are shown to construe their role as one of active curriculum mediators, who, in recontextualising curricular reforms, will use the opportunity to reinsert both residualised and emergent alternatives in their students’ professional value sets. The study also identifies a new set of dilemmas emerging around the politicisation and standardisation of curriculum, and its impact on the teaching profession and teacher educators.