Assessment for learning in the accountability era: New Zealand

The requirements for valid assessment for learning and assessment of learning are reviewed and then the tensions between these two purposes of assessment are explored, first in general and then within two areas of the New Zealand education system. First, the nature of assessment for learning in primary schools is discussed and how it is, or might be, affected by four accountability pressures associated with assessment of learning. The second area is assessment for qualifications in the final years of secondary education. Here, some of the assessment of learning occurs at local level, within schools, and the remainder occurs at national level. These two assessment pathways create substantially different conditions affecting assessment for learning.     

Assessment for learning research in East Asian countries

Educational agencies in East Asia have heeded the advice of research findings and therefore acknowledge the value of assessment for learning (AfL) practices through various policy initiatives. At definitional level, the evolving conceptions and theories of AfL have consistently streamed in from overwhelmingly European and Anglophone-based research. We present a review of mainly peer-reviewed journal articles on selected AfL research in East Asian countries. The findings show that the current implicit and atheoretical approach towards defining and implementing AfL suggests opportunities for further deliberation and theorisation about what constitutes AfL in East Asian countries. It is conceivable that teachers who understand the principles and frequently prepare students for summative assessment in the East Asian classroom are concurrently practising a particular process and practice of AfL. We conclude that the practices of AfL can therefore not just be variable; they will also be very situated and contested.     

Assessment for equity: learning how to use evidence to scaffold learning and improve teaching

Abstract

This article examines evidence regarding the assessment learning of preservice teachers (PTs) in a new Master of Teaching designed to prepare teachers to address the less than equitable outcomes of certain groups of students in New Zealand. The assessment curriculum was integrated across all of the courses and the in-school experiences as one of six interconnected facets of practice for equity. Evidence about the assessment learning of 27 preservice teachers was collected using a survey, interpretive analysis of three assignments and a focus group interview. The findings demonstrated that preservice teachers combined theory and practice encountered in many contexts to build the assessment understanding and competence needed to address equity issues. We argue that this was facilitated by incorporating the assessment curriculum within each course, intertwining university and school experiences, and the specific focus on addressing equity throughout the programme.     

Assessment for learning in the accountability era: Queensland, Australia

Developments in school education in Australia over the past decade have witnessed the rise of national efforts to reform curriculum, assessment and reporting. Constitutionally the power to decide on curriculum matters still resides with the States. Higher stakes in assessment, brought about by national testing and international comparative analyses of student achievement data, have challenged State efforts to maintain the emphasis on assessment to promote learning while fulfilling accountability demands. In this article lessons from the Queensland experience indicate that it is important to build teachers’ assessment capacity and their assessment literacy for the promotion of student learning. It is argued that teacher assessment can be a source of dependable results through moderation practice. The Queensland Studies Authority has recognised and supported the development of teacher assessment and moderation practice in the context of standards-driven, national reform. Recent research findings explain how the focus on learning can be maintained by avoiding an over-interpretation of test results in terms of innate ability and limitations and by encouraging teachers to adopt more tailored diagnosis of assessment data to address equity through a focus on achievement for all. Such efforts are challenged as political pressures related to the Australian government's implementation of national testing and national partnership funding arrangements tied to the performance of students at or below minimum standards become increasingly apparent.     

Balancing tensions in educational policy reforms: large-scale implementation of Assessment for Learning in Norway

This study investigates how different stakeholders in Norway experienced a government-initiated, large-scale policy implementation programme on Assessment for Learning (AfL). Data were collected through 58 interviews with stakeholders in charge of the policy; Ministers of Education and members of the Directorate of Education and Training in Norway, and the main actors such as municipality leaders, teachers, school leaders and students. Successful implementation of AfL processes was found in municipalities where there were dialogue and trust between the municipality level, school leaders, teachers and students and where the programme was adapted to the local context. Implementation was challenged when the policy was interpreted as a way of controlling the schools. Despite the successful implementation in some municipalities, the programme did not have any effect upon students’ learning outcome, as measured on national tests in reading and mathematics. The results are discussed in relation to how local assessment cultures with particular characteristics influence governing, accountability and trust.     

Assessment for learning in the Hong Kong assessment reform: A case of policy borrowing

This paper describes Hong Kong’s borrowing, primarily from the UK, of the assessment for learning policy, in the context of prolonged use of formal summative public examinations. The narrative review and analysis are guided by a social positivist critique of the assessment for learning policy in the Hong Kong context. This paper concludes that Hong Kong’s attempts to implement assessment for learning are ambitious but somewhat futile because of persistent use of public examinations for important decision-making. Change in Hong Kong may only happen through a gradual implementation of assessment for learning practices that takes into account cultural, societal, and historic norms. Critical issues are identified and recommendations are proposed for further implementation of assessment for learning in Hong Kong.     

Assessment for learning: a catalyst for student self-regulation

The development of students as lifelong, self-regulating learners is a valued outcome of higher education. To this end, the current project investigated how students in an undergraduate course experienced and responded to a teaching–learning environment where they were expected to take responsibility for their learning. The pedagogic environment of this course was grounded in strategies and activities associated with assessment for learning (AfL). As such, students were expected to participate in activities that provided them with opportunities to exercise control over their learning. Data gathering comprised individual semi-structured interviews and the collection of artefacts. Findings indicated goals helped students know where they were going; exemplars provided insights into what was expected and what constituted quality work; course activities elicited evidence of learning; dialogic interactions around these generated feedback about understandings and progress; the evaluation of exemplars developed evaluative knowledge, skill and expertise; peer review and feedback provided an authentic context for evaluation and monitoring of works-in-progress. It was concluded that, while each of the AfL strategies contributed to student self-regulation, the full impact of AfL as a catalyst for self-regulated learning was realised in the cumulative and recursive effect these strategies had on students’ thinking, actions and feelings.     

Professional development of teachers—A prerequisite for AfL to be successfully implemented in the classroom

A prerequisite for AfL to be successfully implemented in the classroom is the teachers’ assessment practice. In many contexts, including the Norwegian, AfL has not been successfully dealt with during initial teacher education, and there is a need for qualified teachers to engage in professional development in AfL.This article first discusses different perspectives of professional development, not all of which lead to change of attitudes and beliefs resulting in changed practice. Difficulties in implementing AfL beyond the individual teacher and reach the full teaching staff is presented through experiences from a Norwegian research and development project. The next project to be briefly discussed focuses on engaging teachers in developing their own criteria for good classroom assessment.Finally the paper proposes that a major obstacle to teachers’ professional development in AfL is the competence of teacher educators in AfL. Do those who are to guide and support professional development in schools hold the essential knowledge and competence themselves?The conclusive argument is that for AfL to be common assessment practice in schools there is a need for development processes at various levels of the education system.     

Assessment terms half a century in the making and unmaking: from conceptual ingenuity to definitional anarchy

As the parameters of the field of educational assessment have extended past testing into learning, assessment concepts have evolved and become ever more nuanced. It is frequently lamented in the English language literature that there is insufficient conformity and clarity in the way they are defined and used. This paper offers a survey of the problem over the past five decades and scrutinises conceptualisations of a number of key assessment terms. Additionally, it argues that some of these may not, or may no longer, be necessary, and recommends the phrase ‘evaluation for learning’ as the most suitable term for embodying the spirit of using testing for improving learning and teaching. It closes by offering suggestions for tackling the problem.     

Turning the tide: creating Professional Learning Communities (PLC) to improve teaching practice and learning in South African public schools

Abstract

Poor learner performance in South African schools raises concerns related to lack of commitment and accountability from school leaders and teachers with no common vision to promote a culture of high learner performance. This paper provides a literature overview of research available on the impact of professional learning communities (PLC) on effective teaching and practices to promote higher levels of learning amongst students; the nature of PLCs; their essential characteristics, developmental stages and challenges; and an assessment of the benefits of PLC in schools and the challenges of PLC from other researchers’ observations. PLCs are necessary to encourage collaborative teamwork on essential outcomes and intervention activities in learning. Finally, I conclude by exploring how South African schools can benefit from the practices of professional learning communities which endeavour to improve teaching practices and poor learner achievement.     

Evaluating a large-scale implementation of Assessment for Learning in Sweden

This study reports on a large-scale implementation of Assessment for Learning (AfL) in a Swedish municipality. The implementation was founded on two principles: (1) teaching should be informed by educational research; (2) to be successful teachers’ professional development needs to be based in everyday classroom practice. From these principles, AfL was chosen as a strand of educational research to inform teaching and ‘Teacher Learning Communities’ were chosen as a vehicle for professional development and for implementing AfL practices. Findings indicate that the project has been successful in bringing about a change in how teachers talk about teaching and learning and in changing teachers’ pedagogical practice towards AfL. Findings also suggest that AfL practices are mostly teacher-centred, which means that the teachers still take most of the responsibility for the assessment. This leads to high workload for the teachers and may also hinder students from taking responsibility for their learning.     

DIALANG:评介与启示

DIALANG-欧洲诊断性语言测验系统是面向大众的诊断性评价的先驱。本文对该测验系统的开发背景、开发依据、测验内容、测验特点以及测验过程进行了较为全面的介绍。在此基础上,为推动我国诊断性评价的开展,文章提出了4点建议:1)关注过程,服务学习;2)开发主观题自动阅卷技术,全面考查各语言技能;3)建立我国自己的语言教学和评价标准;4)建立具有中国特色的、可持续性的诊断性评价体系。     

Feedback in Hong Kong secondary writing classrooms: Assessment for learning or assessment of learning?

While much of L2 teacher feedback research has focused on the effectiveness of feedback and its impact on student revision and writing, little has been done to examine teachers’ feedback in the larger classroom context of teaching and learning to ascertain the functions teacher feedback serves from an assessment-for-learning perspective. Using multiple sources of data from 26 secondary teachers’ written feedback to 174 student texts, interviews with six of the teachers and 18 students, the present study investigates the nature of teacher feedback and the functions it serves in the teaching-learning-assessment process in the writing classroom. The findings show that teacher feedback focuses largely on assessing writing summatively, primarily serving the purpose of assessment of learning, rather than assessment for learning – i.e., using feedback as a pedagogical tool for improving the teaching and learning of writing. The study calls for greater attention to the implementation of assessment for learning in the writing classroom, and specifically the use of feedback for formative purposes.     

Pushing the boundaries of self-directed learning: research findings from a study of u.lab participants in Scotland

ABSTRACT

This article reports on the research findings from a qualitative study of adult learners in Scotland taking part in a u.lab MOOC. As a new phenomenon in adult learning, u.lab has been extremely popular yet, at present, there exists little empirical data about either the process or outcomes of the learning experience. This study aims to provide a starting point for further study of u.lab and other emergent trends in adult learning. Here, the accounts of 12 women and men participating in u.lab were analysed using a grounded theory framework. The inductive nature of this approach allowed us to build up a picture of participant experience. Of significance in the findings were participants’ relationship to course content, experience of learning in community and engagement in shaping the learning experience. We draw on Illeris’ model of the learning field to deepen our understanding of participant experience and to illustrate how the particular constellation of content, incentive and interaction dimensions of learning in u.lab creates a learning space where the possibility for self-direction and self-organisation is extended beyond existing practice.     

Classification of learning outcomes: evidence from the computer games literature

Following up on an earlier issue of The Curriculum Journal (Vol. 16, No. 1), this article focuses on learning outcomes in the context of video games. Learning outcomes are viewed from two theoretical frameworks: Kirkpatrick's levels of evaluation and the CRESST model of learning. These are used to analyse the outcomes claimed in journal articles that report empirical work, indicating the usefulness of the frameworks, and the necessity to consider the role of affective learning. The article ends with some comments on the relationship of instructional design to effective games and learning outcomes.     

Accounting for repetition and dropout in contemporaneous cross-section learning profiles: Evidence from Rwanda

How much do children learn in a year of school? Longitudinal data that tracks children over time is scarce in developing countries, and so recent studies estimate learning profiles by comparing the ability of people with different amounts of schooling, at a single point in time. Such estimates of the effect of schooling on learning may be biased upwards by not controlling for repetition and dropout. In this paper I estimate contemporaneous cross-section learning profiles for Rwanda, using data from a nationally representative survey of 3053 children aged six to eighteen. I show how adjusting this learning profile for the total number of years enrolled in school (accounting for repetition and dropout), using detailed schooling histories, reduces the average amount learnt per year by over 60 percent. The learning profile for Rwanda is not just too flat, but flatter than previous estimates suggest.     

This is the way to teach: insights from academics and students about assessment that supports learning

In this study, assessment and learning is reconceptualised as an integrated and dialogic process. Positioned in a sociocultural framework, the experiences of academics and students at an Australian university were examined to understand how they think about and participate in formative assessment to support learning. Semi-structured interviews and document analysis were used to investigate the lived experience, individual meanings and context of participants. The sociocultural issues that participants emphasised were highlighted through a power, risk and reconceptualisation analytical framework. Findings showed that academics and students give high value to dialogue as a device of trust and power for building learner capacity through assessment, and that academics’ familiarity with students’ individual learning reinforces student trust in the integrity and reliability of assessment. This study contributes to understandings of learning and assessment by offering their reconceptualisation as an integrated and dialogic whole when considered from sociocultural perspectives of the lived experience and context. Importantly, the study proposes that the design of intended learning experiences in assessment can also facilitate development of specific dispositions for thinking and being in students as learners and future citizens.     

高等职业院校学业评价的理论研究与思考

对于一线教师来说,学业评价正成为令人困惑、难以在实践上进行突破的工作,但它的确又是教学的一个重要组成部分。通过分析国内外先进的学业评价理论与实践,发现学业评价不论从评价主体、评价重点、评价方法等方面都呈现出多元化的趋势,同时国内对于高等职业教育的学业评价研究尚未关注其职业性并形成可值得借鉴的体系。     

More than just a group: teacher collaboration and learning in the workplace

Teaching is often characterized as an isolated activity, yet opportunities for teachers to work and learn together in schools are increasing. Underlying this shift is the view that as teachers work on new practices and teaching challenges together, they will express varied perspectives, reveal different teaching styles and experiences, and stimulate reflection and professional growth. Despite strong research interest in teacher learning groups, few studies have looked at the relationship between teachers' conversations and collaboration outside the classroom and their actual classroom teaching. Drawing on data from a larger study of literacy instruction with middle‐school teachers, this article describes how three teachers participated in an ongoing literacy program with a research group. Two were seventh‐ and eighth‐grade language‐arts teachers, the third was a special‐education teacher who taught a substantially separate class of cognitively delayed and learning‐disabled students. Case studies of each teacher draw on meeting observations, classroom observations and interviews to describe how each participated in after‐school meetings, how they used the work of the group in the classroom, and how they brought teaching successes and challenges back to the group. Although each of the teachers participated actively in the teacher learning group and changed their practice, the teachers with the most advanced teaching of literacy practices did not bring that expertise into the teacher group as fully as they might have. The analysis raises questions about how teachers participate and learn and how to structure teacher groups to maximize teacher learning.     

Peer assessment for learning from a social perspective: The influence of interpersonal variables and structural features

This paper reports a systematic literature review examining empirical studies on the effects of peer assessment for learning. Peer assessment is fundamentally a social process whose core activity is feedback given to and received from others, aimed at enhancing the performance of each individual group member and/or the group as a whole. This makes peer assessment an interpersonal and interactional process. Using this social perspective in order to study learning effects, we focus on the impact of the structural arrangement of peer assessment on learning, and the influence of interpersonal variables.The literature search, focusing on empirical studies measuring learning outcomes in a peer assessment setting, resulted in 15 studies conducted since 1990 dealing with effects (performance or perceived learning gains) of peer assessment. Our analysis reveals that, although peer assessment is a social process, interpersonal variables have hardly been studied; more specifically, they were measured in only 4 out of 15 studies. Moreover, they are not used to explain learning gains resulting from peer assessment. Finally, comparing the studies with respect to structural features reveals that, although the differences between the studies are significant, there seems to be no relation with the occurrence of learning benefits. The results of this review seem to indicate that research on peer assessment from a social perspective is still in its infancy and deserves more attention.