Contesting educational assessment policies in Australia

ABSTRACT

Assessment is a major component of education, significant in directing what is identified as valued student learning. This paper is framed within an understanding of imperative and exhortative policy. Two paradigmatically different, and potentially contesting, assessment policy directions in Australian education – educational accountability to monitor school and teacher performance, and teacher assessment practices to improve learning (assessment for learning [AfL] or formative assessment) – are examined for their impact on teacher professionalism. Both approaches have official endorsement in Australian policy. Mandated participation in national tests is indicative of educational accountability assessments under national direction. While also endorsed nationally, AfL implementation is reliant on state and territory direction. Our examination reveals tensions in the alignment of both policies. This is evident in the impact of accountability assessment on AfL implementation, in particular, teachers’ understandings of valued assessment evidence. We conclude that a paradigmatic shift to support student learning in Australian schools is a policy imperative that includes the need for professional development and learning support for teachers.     

The promise and reality of formative assessment practice in a continuous assessment scheme: the case of Trinidad and Tobago

Continuous Assessment (CA) systems are externally directed, curriculum-based assessment schemes used for both summative and formative purposes within classrooms. CA has been implemented as national policy in several postcolonial developing countries and is believed to hold great promise for improving education outcomes. This theory-driven evaluation (TDE) used a mixed methods research design to interrogate the nature of CA practice. The focus was on stakeholders’ understanding and practice of formative assessment in the CA Programme (CAP) of Trinidad and Tobago. The integrated findings suggest that the programme planners’ formative intent was often not fulfilled. Instead, teachers routinely recorded assessment marks without using the data. There is evidence that formative assessment practice was not congruent with teachers’ pedagogical beliefs and practices. Although the design of CA schemes suggests the possibility of synergy between formative and summative purposes, in reality this ideal is rarely achieved in these particular contexts.     

Large-scale implementation of formative assessment practices in an examination-oriented culture

Singapore’s education system has often been characterised as exam-oriented. This paper describes efforts (‘windmills’) made by the Government to constructively respond to the ‘winds of change’ in the education system. A committee called the Primary Education Review and Implementation (PERI) Committee was appointed to study and recommend the priorities, programmes and resources needed to revise primary education in Singapore. The Committee recommended that a balanced school-based assessment system that provides constructive feedback, enabling more meaningful learning in support of both academic and non-academic aspects of a pupil’s development, be carried out under the label of ‘Holistic Assessment’. This paper is an attempt at surfacing the challenges (‘walls’) in implementing ‘Holistic Assessment’ on a large scale, highlighting in particular, the tensions perceived by stakeholders concerning the interaction between formative assessment and accountability systems. It documents how stakeholders, namely teachers and parents, perceive and typify the concept of ‘Holistic Assessment’. The findings provide insights into the consequent realities of a nationwide shift in assessment purpose and discourse on teachers and parents.     

Comparison between conceptions and assessment practices among secondary education teachers: more differences than similarities (Comparación entre concepciones y prácticas de evaluación en profesores de Educación Secundaria: más diferencias que semejanzas)

ABSTRACT

Teachers’ conceptions can affect any teaching practice, including assessment. Compared with the previous learning stages in Spain, the accreditation-based focus increases in secondary education. Therefore, it is necessary to study the conceptions teachers have of assessment during this stage and the role these play in their teaching practices. The study participants comprised 219 secondary education teachers. A mixed methodology including a questionnaire, dilemmas and the analysis of test contents was used. An analysis was implemented of the relationship between the conceptions of assessment and the type of tests used, self-assessment and peer assessment, and characteristics of feedback. The teachers reported having a formative conception, but this was incoherent with their assessment methods characterized by a scarce use of self-assessment and peer assessment and a hardly formative feedback. In conclusion, we highlight the relevance of the teaching-related conceptions in the education system and the need for working jointly with teachers to implement an authentically formative assessment in the classroom, with an emphasis on consistency between conceptions and practices.     

What do we know and where do we go? Formative assessment in developing student teachers’ professional learning of teaching science

In the context of teacher education, it could well be suggested that assessment activities that build on formative interactions between student teachers and teacher educators might offer new windows into better understanding teaching and learning. This paper presents findings from a study into a primary science teacher education initiative that seeks to build the foundations on which 24 primary science student teachers, through the use of formative assessment of their science teaching and learning, can begin developing their pedagogical content knowledge (PCK). In the project, formative assessment consists of activities used by teacher educators to stimulate interactions, self- and peer-assessment in order to provide insights into how student teachers develop their PCK during a semester. Content Representations (CoRes), were used as a tool to unpack the student teachers’ approach to teaching a science topic and the reasons for that approach. The results indicate that the use of CoRes, together with subsequent self-assessment and formative interactions with teacher educators and peers, do have the potential for PCK development for student teachers. The results further highlight the need for developing reliable and valid tools for capturing and assessing student teachers’ PCK in pre-service teacher education.     

‘Formative good,summative bad?’ – A review of the dichotomy in assessment literature

The debate between summative and formative assessment is creating a situation that increasingly calls to mind the famous slogan in George Orwell’s (1945) Animal Farm – ‘Four legs good, two legs bad’. Formative assessment is increasingly being portrayed in the literature as ‘good’ assessment, which tutors should strive towards, whereas summative assessment is ‘bad’ assessment on which tutors should minimise their focus, instead moving towards formative assessment (Taras 2005). By revisiting the origins of formative assessment, this article aims to bring back to light that summative and formative assessment are connected at their inception. It highlights how research in the literature has unintentionally created a harmful dichotomy between summative and formative assessment, and it identifies some attempts in the literature to re-connect formative and summative assessment. This paper challenges the dichotomy in the literature and invites those in higher education to consider the fundamental idea that formative and summative assessment need to work in harmony and should not be seen as contrary to each other.     

Vocational Students Experiences with Assessment in Workplace Learning

Vocational education, as part of the Norwegian upper secondary education, includes both school-based learning and workplace learning. While school-based learning is characterized by formal structures and guided by aims in the curricula, workplace learning is often informal, incidental and directed by the daily work-tasks. Assessment in workplace learning is mainly formative and different stakeholders are involved in the assessment; namely students, teachers and workplace instructors. However, the guidelines for assessment are vague and call for a close cooperation between the stakeholders. This is demanding and has resulted in a variety of assessment practices. The study presented in this article is a qualitative study of students’ experiences with assessment in workplace learning periods in their first year in vocational education. The aim of the study is to give voice to students` experiences with assessment and illuminate how assessment supports their learning processes. Data was collected through focus group interviews with two groups of students in the Programme for Health and Social Care. The main findings indicate different assessment cultures in school and workplaces. This is expressed through the students’ perceptions of assessment, assessment criteria, tools for assessment and vocational knowledge. It is recommended that an open dialogue about the discontinuity in assessment between schools and workplaces is one of several measures necessary to bridge the gap between the stakeholders.     

Formative self-and peer assessment for improved student learning: the crucial factors of design,teacher participation and feedback

Self and peer-assessment are becoming central aspects of student-centred assessment processes in higher education. Despite increasing evidence that both forms of assessment are helpful for developing key capabilities in students, such as taking more responsibility for their own learning, developing a better understanding of the subject matter, assessment criteria and their own values and judgements, and developing critical reflection skills, both forms of assessment are still not the norm at universities. This paper provides the findings of a two-year study of formative self and peer-assessment at an Australian university. The study supports other research showing that students tend to regard formative self and peer-assessment as beneficial for gaining more insights about the assessment process and for improving their own work. We argue that self and peer-assessment requires careful design and implementation for it to be an effective tool for formative assessment processes; and that the development of students’ capacities for giving feedback, and the continuous and timely involvement of the teacher, are central aspects for successful self and peer-assessment. The move to self and peer-assessment is not simple for teachers and students but is worthwhile and necessary for twenty-first century higher education.     

Implementing curriculum-embedded formative assessment in primary school science classrooms

The implementation of formative assessment strategies is challenging for teachers. We evaluated teachers’ implementation fidelity of a curriculum-embedded formative assessment programme for primary school science education, investigating both material-supported, direct application and subsequent transfer. Furthermore, the relationship between implementation fidelity and teacher variables was explored. N = 17 German primary school teachers participated in professional development on formative assessment, N = 11 teachers formed a control group. Teachers’ implementation fidelity was evaluated via classroom observations student ratings and an analysis of students’ workbooks, focusing on the frequency and quality of intended formative assessment elements (assessments, feedback and instructional adaptations). Regarding direct application, treatment group teachers’ implementation fidelity was high, with slight variations in quality. Regarding transfer, implementation fidelity was lower but teachers still implemented more formative assessment elements than the control group. Teachers’ pedagogical content knowledge and their evaluation of the formative assessment intervention were associated with implementation success.     

Aligning formative and summative assessments: A collaborative action research challenging teacher conceptions

Assessment innovations require explicitly challenging teachers’ assessment conceptions. In changing towards outcome-based curricula, aligning formative to new summative assessments is a challenge. This study, conducted in Dutch Agricultural Vocational Education and its new outcome-based summative assessments, aims to provide concrete insights into what teacher conceptions hinder the development of aligned formative assessment practices. In a structured collaborative action research, practitioners, researchers and consultants analyse teachers’ formative practices, identify underlying current conceptions and their misalignment to the new summative assessment system. An iterative process resulted in an overview of current conceptions versus required conceptions, showing required conceptual changes that are prerequisite for teachers to change towards formative assessment practices that are aligned to the new outcome-based summative assessment system.     

What (more) can,and should,assessment do for learning? Observations from ‘successful learning context’ in Singapore

Singapore has earned accolades as one of the leading education systems in the world, based on its record in international assessments, including TIMMS and PISA. This has contributed to the entrenchment of ‘assessment’ becoming an institutional authority of standards, teaching (performativity) and classroom learning. It is against, and amidst such contexts, that this article traces how the notion and discourse of formative assessment and Assessment for Learning (AfL) are widely introduced and used formally across all Singaporean schools, particularly after a recent introduction of new ‘Holistic and Balanced Assessment’ policies. We argue that the very institutional authority of successful high-stake examination results, which served as critical standards of performativity of teaching and learning in the classroom, is being challenged. The changing assessment context of Singaporean schools, therefore serves as an interesting case study site for studying how formative assessment and AfL can be adapted and understood when ‘learning’ is already seen to be successful.     

国外中小学数学教育评价研究述评及其启示

数学是基础教育中最为重要的学科之一,世界各国政府和教育部门对数学教育评价都十分重视。美国国家评价管理委员会、国际教育成就评价协会、国际经济合作与发展组织等近年来分别开发了NAEP、TIMSS以及PISA等多个评价项目,对中小学数学教育质量进行系统测查。相关研究中恰当的目标设置、明确的评价范畴以及科学、严格的研究设计等多个方面对我国的数学教育质量评价研究均具有重要的启示和借鉴意义。     

Exploring tensions in developing assessment for learning

This paper is based on a study of classroom practice of primary school teachers who were engaged in a programme of professional development to implement formative assessment in their classrooms. The programme sought to develop the skills and expertise of teachers to enable formative assessment to be used to support and improve the learning of students. This study examined changes in practice in these teachers’ classrooms, their students’ learning experiences, pedagogical decision‐making, and the challenges experienced by teachers and students in developing assessment for learning. Activity theory was used as an analytical tool and enabled the identification of important contradictions in the changing system that produced tensions and difficulties but also provided driving forces for change. The development of formative assessment practices was of necessity accompanied by a culture change in the complex classroom systems. For teachers change was characterised as a process of expansive learning that was motivated by a contradiction between the teachers’ beliefs about learning and the existing culture in the classroom. The change in classroom practice was enabled by the formative assessment philosophy and a range of mediating artefacts.     

Formative assessment of writing in English as a foreign language

Recognizing the importance of formative assessment, this mixed-methods study investigates how four teachers and 100 students respond to the new emphasis on formative assessment in English as a foreign language (EFL) writing classes in Norway. While previous studies have examined formative assessment in oral classroom interactions and focused on either studying students or teachers, little research has been conducted on formative assessment of writing where both students and teachers are studied. As such, this study provides new insight. The findings mostly indicate that contradictions are prevalent amongst teachers’ and students’ perceptions of formative assessment of writing. The contradictions revolve around feedback, grades, text revision, self-assessment, and student involvement. The identified contradictions suggest the need for developing a mutual understanding of formative assessment in order to make it useful and meaningful.     

The potential formative benefits of portfolio assessment in second and foreign language writing contexts: A review of the literature

This article identifies the potential formative benefits of using portfolio assessment (PA) in second/foreign language classrooms by reviewing the up-to-date research. Three methods were used to search for relevant research: database search, manual search, and citation search. According to the literature, PA has potential benefits due to its process-oriented, authentic, integrated, interactive, and learner-centered characteristics. PA leads to increased motivation, learner autonomy, and improved writing performance. However, not many studies include observation as a method of collecting data. Through observation a researcher can investigate how the benefits of PA are acted upon and negotiated. There is a need for more empirical research in the juxtaposition of PA and formative assessment, particularly in primary and secondary education.     

Developing classroom formative assessment in dutch primary mathematics education

In the last two decades Dutch primary school students scored below expectation in international mathematics tests. An explanation for this may be that teachers fail to adequately assess their students’ understanding of learning goals and provide timely feedback. To improve the teachers’ formative assessment practice, researchers, curriculum experts and teachers worked together to develop a model for classroom formative assessment (CFA). In three pilot studies, six teachers from three different schools implemented the CFA-model and evaluated its feasibility together with the researchers by means of checklists. The CFA-model was primarily changed with regard to the assessment techniques. Teachers indicated that classroom management and preparation time were preconditions for an optimal implementation. Analysis of covariance was used to explore students’ learning outcomes. The results showed that a correct implementation of the CFA-model might result in the enhancement of students’ mathematical performance. The implications of the three pilots for the implementation of the CFA-model on a larger scale are discussed.     

Formative assessment at the crossroads: conformative,deformative and transformative assessment

The theory and practice of formative assessment seems to be at a crossroads, even an impasse. Different theoretical justifications for the development of formative assessment, and different empirical exemplifications, have been apparent for many years. Yet practice, while quite widespread, is often limited in terms of its scope and its utilisation of the full range of possible approaches associated with formative assessment. The paper reviews these issues and explores them in relation to the development of formative assessment in higher education. HE is taken as ‘test case’ of the paradoxical implementation of formative assessment, whereby the aim is, ostensibly, to develop independent and critical learners, while in practice highly conformative assessment procedures are being designed and developed. The paper argues that developers also need to attend to the divergent possibilities inherent in formative assessment, if their aspirations for a more transformative practice are to be realised.     

Promoting learning by leveraging the collaborative nature of formative peer assessment with instructional scaffolds

Over the past two decades, formative peer assessment has become a popular instructional approach. Initially, it was more readily applied in higher education but has since expanded to other educational levels, including primary and secondary education. The popularity is understandable given the increased amount of feedback by multiple peers and enhanced awareness of performance criteria. Although it is increasingly acknowledged by the research community that formative peer assessment is inherently a social endeavour, the collaborative nature is simultaneously the least-explored mechanism. The contributions in this special issue address this gap conceptualising peer assessment and peer feedback as both an individual and a collaborative learning practice. Furthermore, we highlight core learning conditions: learner characteristics, domain and task characteristics, and, finally, instructional scaffolds.     

“双减”政策背景下学生学业评价问题的若干思考

在“双减”政策背景下,中小学既要大力压减考试次数,严格控制作业数量,又要确保教育教学的高质量发展,提供令家长满意的高品质教育,所以必须加大学生学业评价改革的探索力度。一些可行的改革策略主要有:去繁就简,简化评价设计,提高评价效率;改进结果评价,深化命题改革,探索表现性评价;强化过程评价,评学结合,以评促学。有了学业评价改革的配套支撑,轻负高质的教育才有望真正实现。     

‘Straitjacket’ or ‘springboard for sustainable learning’? The implications of formative assessment practices in vocational learning cultures

In contrast to theoretical and empirical insights from research into formative assessment in compulsory schooling, understanding the relationship between formative assessment, motivation and learning in vocational education has been a topic neglected by researchers. The Improving Formative Assessment project (IFA) addresses this gap, using a sociocultural approach to explore the relationship between formative assessment practices and ‘learning cultures’ in vocational education. This article explores the influence of learning cultures in vocational education on the practice of formative assessment and evaluates critically two closely related questions. Why do some learning cultures foster formative assessment that leads to instrumental learning while others develop deeper forms of learning? When is formative assessment a springboard for sustainable learning, and when does it remain an instrumental straitjacket?