Assessment for learning in the accountability era: New Zealand

The requirements for valid assessment for learning and assessment of learning are reviewed and then the tensions between these two purposes of assessment are explored, first in general and then within two areas of the New Zealand education system. First, the nature of assessment for learning in primary schools is discussed and how it is, or might be, affected by four accountability pressures associated with assessment of learning. The second area is assessment for qualifications in the final years of secondary education. Here, some of the assessment of learning occurs at local level, within schools, and the remainder occurs at national level. These two assessment pathways create substantially different conditions affecting assessment for learning.     

Assessment for learning in the accountability era: Empirical evidence from Scotland

In many European languages, the words ‘assessment’ and ‘evaluation’ are synonymous, but in English the two terms are used differently. Educational ‘assessment’ is learner-focused and part of professional pedagogy, relating directly to the accountability of practitioners and schools to learners and their families. Educational ‘evaluation’ is understood to be a parallel and linked process, relating to the quality of national policy and of provision and practice in establishments, part of accountability to the wider public. In Scotland, assessment policy has been focused on aligning ‘assessment for learning’ and ‘assessment for accountability’ for nearly a decade and policy guidance has been based on the principle that formative and summative uses of information can apply as well to system evaluation as to school-based assessment. Self-evaluation has been increasingly emphasized, promoting better understanding of the role of continuous review in supporting and improving education. In theory, the two processes of assessment and evaluation should align without difficulty as ‘intelligent accountability’ and together should act as a powerful driver for improved educational outcomes. However, achieving alignment in practice, which requires good professional relationships and mutual trust in different communities of practice, as well as shared understanding and expectations, has proven to be very hard to achieve. This article will show the progress that has been made with alignment; indicate where there have been difficulties and why; and suggest that several important factors need to be acknowledged if alignment is to be achieved.     

The judgement processes involved in the moderation of teacher-assessed projects

Classroom-based assessments have the potential to enhance validity by facilitating the assessment of important skills that are difficult to assess in written examinations. Such assessments tend to be marked by teachers. To ensure consistent marking standards, quality assurance procedures are needed. In the context of continued debate over the robustness of assessment by teachers, this research aimed to provide insights into the cognitive and social processes involved in the moderation of project work in General Certificate of Secondary Education qualifications (taken by many 16 year olds in England). The research involved nine examiners across three subject areas ‘thinking aloud’ whilst moderating the marks given to six students (treated as a mock school). The participants were also interviewed. These methods were chosen to provide an in-depth look at the judgement processes involved. The research provides an improved understanding of moderation judgements and how aspects of this process relate to existing theories of judgement. Improving our understanding of the judgement processes involved when an examiner moderates teacher marking can help to evaluate the appropriateness of this assessment method, may contribute to debate on whether teacher marking can be sufficiently well verified by quality assurance procedures, and may inform moderation practice.     

Curriculum and assessment for the knowledge society: interrogating experiences in the Republic of Ireland and Queensland,Australia

The ‘knowledge society’ has become a central discourse within educational reform. This article posits that the impact of the knowledge society discourse on curriculum and assessment has led to the emergence of what the authors term a new-form/re-form curriculum, and it asks whether what is transacting in contemporary movements in curriculum is less the reform of curriculum and more the emergence of a new-form/re-form curriculum. What is emerging is well beyond the discussions of outcomes and curriculum alignment that characterised much curriculum reform effort in the late 1990s. In this new-form/re-form curriculum ‘content’ is displaced by ‘skills’ and ‘knowledge acquisition’ by ‘learning’. Curriculum coverage is replaced by learner engagement. In this context, assessment also begins to take on new-form/re-form. Assessment now engages and promotes learning as process rather than as product. Two cases – the Republic of Ireland and Queensland, Australia – are analysed and compared to illustrate this shift in the conceptualisation of curriculum and assessment. Consideration is given to the possibility that this new-form/re-form curriculum represents a settlement in the contestation associated with learning outcomes and their perceived technical rationality and market focus. The paper concludes that the new-form/re-form curriculum is emerging in locations as diverse as Ireland and Queensland.     

高考方案：考试方式与计分方式

本文讨论了国际上若干典型的高考方案,从高考方案中校内评定和统一考试所占比重、高考分数是否经过校准两个角度给所述高考方案进行定位。比较和分析这些典型的高考方案,可以为国内的高考方案提供改革思路:改革高考计分方式势在必行,有选考科目的高考方案需要对考试分数进行校准。     

Mind the gap: accountability,observation and special education

There is an absence of observation-based tools designed to evaluate teaching in special education classrooms. Evaluations derived from classroom observations are integral to the accountability process, adding value to understanding teaching and learning by providing a lens into the classroom that test scores cannot capture. The present paper systematically examined existing classroom observation tools, identifying constructs measured and noting elements unique to special education classrooms. Results demonstrate that most extant tools tap into three primary categories of teacher behaviours, but overlook the role paraprofessionals play as well as teacher professional behaviours. Taken together, results reflect the need for a tool designed specifically for special education classrooms. Limitations and implications for practice and policy are discussed.     

Risk, error and accountability: improving the practice of school leaders

This paper seeks to explore the notion of risk as an organisational logic within schools, the impact of contemporary accountability regimes on managing risk and then, in turn, to posit a systems-based process of risk management underpinned by a positive logic of risk. It moves through a number of steps beginning with the development of an understanding of risk, the risk society and the logic of risk derived from the seminal work of Douglas (1992, Risk and blame: essays in cultural theory, London: Sage), Beck (1992, Risk society: towards a new modernity. London: Sage) and Giddens (1990, The consequences of modernity. Cambridge: Polity Press). Second, the paper juxtaposes this understanding of risk with the rise of accountability imperatives and an “audit culture” [Strathern (1997) European Review, 5(3), 305–321] in public institutions, including schools. It then moves to consider how a systems-based approach to risk management, drawing on Reason’s (1990, Human Error. New York: Cambridge University Press) model of human error minimisation, could be usefully developed for schools. Such an approach would be built on a positive risk logic which maintains the flexibility, innovativeness and adaptability so necessary in education and avoids the more deleterious effects of many current forms of accountability and risk management which reflect avoidance, conformity and rigidity.     

Schools which are named, shamed and blamed by the media: school accountability in Norway

Since Norway introduced tests and other types of measurements the press, with a negative bias, has placed the spotlight on those schools which performed badly in attainment measurements. The press reconstructs from public sources “league tables” of aggregated student achievements but at present the official position opposes the public ranking of schools. This article discusses the consequences within schools of such negative media coverage and the responses within badly performing schools that have been named, shamed and blamed in prominent headlines. This media spotlight brings into play a complex emotional process which may spur schools into improvement mechanisms or provoke a hostile reaction, or result in panic measures.

Modelling blended solutions for higher education: teaching,learning, and assessment in the network and mobile technology era

The article addresses the role of network and mobile technologies in enhancing blended solutions with a view to (a) enriching the teaching/learning processes, (b) exploiting the opportunities it offers for their observability, and hence for their monitoring and formative/summative assessment. It will also discuss how such potential can only be captured by solidly integrating the process of instructional design with that of monitoring and assessment. First, the article presents the proposed conception of blended solutions, giving examples. In the second part, the article discusses a possible breakdown of blended solutions into its various components and how these can enrich both the teaching/learning and the assessment processes. Finally, it addresses the question of how to combine and/or use singly the various components of blended solutions. To conclude, implications for the implementation of blended solutions are discussed, also in relation to emerging contexts such as Massive Online Open Courses (MOOCs).     

以"核心能力"为取向——澳大利亚昆士兰州高中考试评价系统述评

澳大利亚昆士兰州的高中考试评价系统是以“核心能力”为取向的教育评价体系,它包括以校为本的评价系统和校外跨课程考试评价系统(QCS测验)。两套评价系统中有很多值得我国教育评价借鉴和思考的地方。     

Assessment as learning: blurring the boundaries of assessment and learning for theory,policy and practice

This paper explores assessment and learning in a way that blurs their boundaries. The notion of assessment as learning (AaL) is offered as an aspect of formative assessment (assessment for learning). It considers how pupils self-regulate their own learning, and in so doing make complex decisions about how they use feedback and engage with the learning priorities of the classroom. Discussion is framed from a sociocultural stance, yet challenges some of the perspectives that have widely become accepted. It offers three new views to help explore the concept of AaL: understanding feedback; understanding the learning gap; and exploring vocabularies of assessment. Pragmatically, the ideas examined suggest that teachers may need to consider less about focused and directive feedback, but more about how learners interpret and understand feedback from their self-regulatory and self-productive identities and how vocabularies for assessment can be more collaboratively shared in learning contexts.     

Assessment for learning in Norway and Portugal: the case of primary school mathematics teaching

In this study, we aim to understand the forces driving assessment for learning (AfL) in primary school teaching. By applying a case study design, including the two cases of Norway and Portugal and using mathematics teaching as an example, available policy documents and research reports are analysed to identify the differences and similarities that might explain the assessment practices previously observed in the two countries. Many similarities are found at the school and national levels. In particular, AfL is introduced as a national policy in both countries. Still, AfL practices are not common in primary mathematics classrooms in either country, although this is true for different reasons in each country. It is suggested that the assessment culture caused by national policies, such as curriculum reforms, national professional development projects and teacher autonomy, explains the similarities in the observed outcomes.     

Promoting assessment for learning through curriculum-based performance standards: teacher responses in the Northern Territory of Australia

Governments in Australia claim that standards-based reforms to schooling will result in greater use of assessment for and as learning. This study analyses the assessment practices that evolved within the planned curricula for senior secondary schooling in the Northern Territory of Australia during standards-based reforms. Case-study methodology was used, with each of the six teachers participating forming one case. The data collected and analysed included the texts created by the six participating teachers from a range of subject areas as they planned to enact the new curriculum. Semi-structured interviews were also conducted with each of the six teachers. The findings indicate that the inclusion of subject-based performance standards in the curriculum for senior schooling did not result in teachers planning a curriculum that included assessment practices for actively engaging students in learning.     

Assessment for learning: sectarian divisions of terminology and concepts

Assessment is critical to support and align learning and teaching within the curriculum. Yet our understanding of the many layers of assessment is still incomplete. This article examines some of the differences between critical elements of assessment terminology across the compulsory and higher education sectors in the anglophone world, more specifically in the United Kingdom. Highlighting these differences is important, so that we are able to make informed pedagogical decisions.

This article signals that there is much to do in the area of assessment to arrive at a clearer understanding of recent developments within each sector. This is necessary if academics' expertise can be used across sector divides. By highlighting these differences, it is possible to address misunderstandings to fulfil the role of assessment adequately in supporting learning and teaching.     

Assessment as learning: Enhancing discourse,understanding, and achievement in innovative science curricula

An assessment‐oriented design‐based research model was applied to existing inquiry‐oriented multimedia programs in astronomy, biology, and ecology. Building on emerging situative theories of assessment, the model extends prevailing views of formative assessment for learning by embedding “discursive” formative assessment more directly into the curriculum. Three twenty‐hour curricula were designed and aligned to content standards, and three levels of assessments were developed and used to assess and enhance learning for each curriculum. These assessments included three or four informal “activity‐oriented” quizzes and discursive formative feedback rubrics supporting collective discourse, a “curriculum‐oriented” examination of individual conceptual understanding, and a “standards‐oriented” test measuring aggregated achievement of targeted standards. After two design‐research cycles, worthwhile scientific argumentation and statistically significant gains were attained for two of the three packages on the exam and test. Achievement gains were comparable to or larger than those of students in comparison classrooms. Many existing innovations could be enhanced and evaluated in this fashion; designing these strategies directly into innovations could have an even greater impact on discourse, understanding, and achievement. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 1240–1270, 2012     

Accounting for mediatization in the era of individualized consequential accountability

ABSTRACT

In this paper, we report on our investigation of news coverage of accountability reform in The New York Times and The Wall Street Journal during the implementation and assessment of New York’s Race to the Top-inspired teacher evaluation system. In systemically analyzing how these prominent media outlets narrated this contentious moment in educational history, this study seeks to identify major narrative features pertinent to the ideological and representational dimensions of teachers in the era of consequential accountability. Specifically, we examine character prevalence, the characterization of prevalent characters, and the valuations ascribed to prevalent characters. This analysis, thus, aims to account for the mediatization of accountability reform. Our findings suggest that both periodicals constructed a one-dimensional conflict between education reformers and resisters of the newly implemented accountability policies while narrating those most affected by the policies as passive bystanders to the ideological conflict being waged by those with more power and influence. This reductionist narrative gives voice to reformers’ audit-based notion of accountability while omitting the relational responsibility of educators – the form of accountability long associated with teachers’ work. In accounting for ideological and representational features of journalists’ narrative construction, we illuminate how prominent media outlets mediatize accountability policy.     

Assessment guiding learning: developing graduate qualities in an experiential learning programme

As industry demands increase for a new type of graduate, there is more pressure than ever before for higher education (HE) to respond by cultivating and developing students who are prepared for these workplace challenges. This paper explores an innovative experiential learning programme built on the principles of work-related learning that develops students to attain graduate qualities for competitiveness in the business sector. The role and importance of assessment as a core influence for learning is recognised and embedded into the programme, as well as the prevalence of meeting the needs of its stakeholders. Issues concerning assessing work-oriented learning are explored as well as what assessment methods might be most appropriate for enhancing and evaluating learning in this context. Feedback from stakeholders on the structure of the programme and its assessment are discussed as well as the question of how to maintain work-related programmes in HE. If such programmes continue to focus assessment and design around student learning, students will not only have the opportunity to apply their knowledge in a practical context, they will also be maximising their personal learning outcomes with the added advantage of being better equipped to compete in an increasingly competitive marketplace.     

Assessment is learning: the preposition vanishes

Scotland, in common with many countries internationally, has been learning how to align ideas from research with policy and practice. This article considers what Scotland learned from large-scale evaluations of its Assessment is for Learning (AifL) programme and the extent to which this evidence was used to inform future learning within the national programme. More recently, the policy focus in Scotland has shifted to the creation of a new curriculum, Curriculum for Excellence, subsuming AifL. Merging curriculum and assessment innovations brought new challenges in the alignment of curriculum, pedagogy and assessment. Drawing on a Scottish Government-funded research project, Assessment at Transition, designed to identify and explore emerging gaps between practice in schools and local authorities and national curriculum and assessment policy aspirations, the article argues that assessment is learning and explores how formative approaches to evaluation at a national level might be used to prevent countries repeating past mistakes.     

我国高中校本学生评价的现状及改进策略研究

随着国外校本管理思想的促进以及教育变革的积极推动与学校办学自主权的不断扩大,评价与考试制度的改革,尤其是校本学生评价得到了广泛的重视。我国校本学生评价在理论与实践层面都有一定的发展,但也存在着偏离评价轨道、教师评价素养缺乏等问题。建议加快校本学生评价的法制化进程,制定并完善学校评价制度,提升教师评价专业素养,建立科学有序的监督机制,构建和谐的校内外评价关系。     

Assessment for learning research in East Asian countries

Educational agencies in East Asia have heeded the advice of research findings and therefore acknowledge the value of assessment for learning (AfL) practices through various policy initiatives. At definitional level, the evolving conceptions and theories of AfL have consistently streamed in from overwhelmingly European and Anglophone-based research. We present a review of mainly peer-reviewed journal articles on selected AfL research in East Asian countries. The findings show that the current implicit and atheoretical approach towards defining and implementing AfL suggests opportunities for further deliberation and theorisation about what constitutes AfL in East Asian countries. It is conceivable that teachers who understand the principles and frequently prepare students for summative assessment in the East Asian classroom are concurrently practising a particular process and practice of AfL. We conclude that the practices of AfL can therefore not just be variable; they will also be very situated and contested.