Understanding Assessment in the Classroom: phases of the assessment process — the assessment episode

Many studies have shown that assessment in the classroom is a very complex procedure. As the first part of this paper explains, it is developed in four consecutive phases. That is, evidence collection, interpretation of this evidence, the teacher's responses and, finally, the impact of teacher's responses on children. Together these phases form the assessment episode framework. The second part of the paper illustrates the use of this framework in practice by exploring how Greek primary school teachers were carrying out assessments in the classroom, and considers the impact of these practices on children's learning. The paper draws upon evidence gathered by questionnaire and classroom observations of Greek primary school teachers. In order to clarify the complex issues of classroom assessment this article explores them in the light of the four developmental phases of the assessment episode. The quality of teacher comments, the assessment language used, the role of grading, and the relationship between policy and practice are also examined. The findings emphasise the importance of teachers being aware of the potential effects of assessment and the consequent need to use it properly for the benefit of teaching and learning.     

Assessing Key Competences across the Curriculum — and Europe

The development of key competences for lifelong learning has been an important policy imperative for EU Member States. The European Reference Framework of key competences (2006) built on previous developments by the OECD, UNESCO and Member States themselves. It defined key competences as knowledge, skills and attitudes applied appropriately to contexts. Now most Member States have incorporated key competences, or similarly broad learning outcomes, into their school curriculum frameworks. This is a necessary but insufficient step towards implementation; for the effective development of learners' key competences, assessment must also change. This article focuses on the challenge of assessing cross-curricular key competences in primary and secondary education. It is based on a major study for the European Commission (Gordon, et al., 2009), which drew on information gathered and validated with the help of experts in each of the 27 EU Member States. The study's typology of assessment provides a basis for reviewing some recent developments in Member States. Present challenges and innovative responses are addressed, including ‘unpacking’ key competences, ‘mapping’ them to contexts and ‘accessment’ of their full scope and range. Policy developments are considered in the context of the author's work with the European Commission's Thematic Working Group on the assessment of key competences. The article concludes with considerations for policy and practice.     

Children's rights and educational policy in Europe: the implementation of the United Nations Convention on the Rights of the Child

This article aims to shed light on the impact of the United Nations Convention on the Rights of the Child (CRC) on education policy in Europe. The findings are based on a documentary analysis of the published reports of the Committee on the Rights of the Child (the Committee) on the implementation of the education rights in the CRC in every EU state. This included: a review of the state of children's rights to education in Europe as perceived by the Committee; a summary of the Committee's key recommendations for governments; and an assessment of whether the CRC can be considered to have influenced domestic education law and policies. The findings suggest that the CRC is having an impact on domestic education policy and that the child rights framework could be harnessed further by those seeking to influence government. The article concludes by reflecting on the factors which affect the processes of translating the CRC into policy and practice and explores the role that educationalists, both academic and practitioners, might play in its implementation.     

Improving lecturers' assessment practice in higher education: a problem-based approach

This article reports on a project based on the authors' concerns about assessment practice in higher education in the United Kingdom. These concerns stem from their experience as university lecturers, and from knowledge of research evidence and policy issues relating to assessment in higher education. Given the complex nature of higher education, improvement rather than mere change in assessment procedures will require the full participation of people who possess intimate day-to-day contextual knowledge, including an understanding of those aspects of the situation which are not easily measurable or even readily observable. The article details (a) a Popperian problem-based approach to action research designed to facilitate improvements in higher education assessment practice, and (b) how this methodology was adopted, tested and developed at the University of Sunderland. The authors’ aim is to encourage colleagues in other higher education institutions to adopt and further test this methodology in subsequent research.[1]     

Improving assessment of learning and for learning

The focus of this article is recent work by the Assessment Reform Group (ARG) on the role of teachers' judgements in the summative use of assessment. A brief overview of the early work of the ARG is followed by discussion of the desirable properties of assessment for summative uses. The work of the ARG's Assessment Systems for the Future project provided evidence and arguments concerning the validity, reliability, impact and cost of tests and of summative assessment by teachers. Whilst there is ample evidence that the teachers' judgements are more valid than, and equally reliable as, tests, there is a danger of unwanted impact on teaching as long as results are used for ‘high stakes’ evaluation of teachers and schools. Implications for policy include an end to the practice of using the results of pupils' summative assessment, however they are derived, as the sole basis for target setting and school accountability.     

Formative assessment strategies for students' conceptions—The potential of learning analytics

Formative assessment is considered to be helpful in students' learning support and teaching design. Following Aufschnaiter's and Alonzo's framework, formative assessment practices of teachers can be subdivided into three practices: eliciting evidence, interpreting evidence and responding. Since students' conceptions are judged to be important for meaningful learning across disciplines, teachers are required to assess their students' conceptions. The focus of this article lies on the discussion of learning analytics for supporting the assessment of students' conceptions in class. The existing and potential contributions of learning analytics are discussed related to the named formative assessment framework in order to enhance the teachers' options to consider individual students' conceptions. We refer to findings from biology and computer science education on existing assessment tools and identify limitations and potentials with respect to the assessment of students' conceptions.

Practitioner notes

What is already known about this topic

• Students' conceptions are considered to be important for learning processes, but interpreting evidence for learning with respect to students' conceptions is challenging for teachers.
• Assessment tools have been developed in different educational domains for teaching practice.
• Techniques from artificial intelligence and machine learning have been applied for automated assessment of specific aspects of learning.

What does the paper add

• Findings on existing assessment tools from two educational domains are summarised and limitations with respect to assessment of students' conceptions are identified.
• Relevent data that needs to be analysed for insights into students' conceptions is identified from an educational perspective.
• Potential contributions of learning analytics to support the challenging task to elicit students' conceptions are discussed.

Implications for practice and/or policy

• Learning analytics can enhance the eliciting of students' conceptions.
• Based on the analysis of existing works, further exploration and developments of analysis techniques for unstructured text and multimodal data are desirable to support the eliciting of students' conceptions.

     

Same Assessment,Different Practice: Professional consciousness as a determinant of teachers' practice in a school-based assessment scheme

The forms that assessment takes are widely recognised as determinants of educational practice. This paper, however, argues that a teacher's professional consciousness is a more fundamental determinant of teaching practice. To explore the issue, this paper examines data from a larger study which set out to examine the relationship between teachers' practice and their beliefs in the context of a mandatory school-based assessment scheme. Using a theoretical framework that advocates an emancipatory approach to educational changes, it was found that some teachers adopted a passive role regarding policy interpretation and implementation while others adopted a more critical stance in interpreting the policy requirements, demonstrating a more proactive approach in its implementation. The emancipatory approach is conceptualised in terms of three key dimensions: professional confidence, professional interpretation and professional consciousness. The findings of the study carry implications for teacher professional development.     

Directions for research and development: alternative methods of assessing scientific literacy

Educators' current enthusiasm for alternative assessment has roots in political and intellectual concerns. American science students do not do well on international comparisons or on tests of science literacy. Blame for these shortcomings is laid on multiple-choice tests and their focus on isolated facts. But if alternative assessment is to fulfill its promise, research and development need to be done in a coordinated way. This article lays out an agenda for developing assessment tools and researching their effectiveness. A series of design tasks is proposed, followed by related research questions for each task. Needed theoretical research includes studies of the effects of alternative assessment on policy and practice as well as the development of new psychometric techniques. Influences of new assessment forms on learning and motivation theory are also discussed.     

Tasks for Comparative Education in the New Millennium

This article reflects upon the experience of teaching and research in comparative education to reconsider the potential of the field for the new millennium. In doing this, specific attention is given to ways in which comparative perspectives have traditionally been applied, or misapplied, in educational policy debates and the related academic literature. The potential of comparative studies to increase our understanding of the complexities of educational processes is underlined. The uncritical 'borrowing' of educational policy and practice is challenged, and the contemporary need for educational research that recognises the significance of culture, context and difference is highlighted.     

标准参照评估的行动实践 ——以香港中文大学通识教育基础课程为案例

香港特别行政区高校从2015年开始，学生学业评估陆续由常模参照评估转为标准参照评估。本文以香港中文大学通识教育基础课程实施标准参照评估的行动为案例，分析了这项新的学业评估方式在实施中所遇到的问题，讨论了解决方法并提出实施模型。该模型包含评分量表的设计与开发、量表使用、教师意见反馈与量表修改，以及评分之后的集体讨论这一套实施流程。文章最后指出，要保证标准参照评估的有效实施，需建立教师实践共同体。实践共同体的行动包括：教师共同开发评估标准，通过集体讨论对评估标准的含义和使用达成共识，共同审视评估结果，根据评估结果进一步修改和完善评估标准。     

Assessment for learning? Thinking outside the (black) box

This article draws on a survey of 83 teachers, to explore the concepts of ‘assessment for learning’, ‘assessment’ and ‘learning’. ‘Assessment for learning’ is categorized as meaning: monitoring pupils' performance against targets or objectives; using assessment to inform next steps in teaching and learning; teachers giving feedback for improvement; (teachers) learning about children's learning; children taking some control of their own learning and assessment; and turning assessment into a learning event. Conceptions of assessment include assessment‐as‐measurement and assessment‐as‐inquiry. These conceptions are related to two conceptions of learning: learning‐as‐attaining‐objectives and learning‐as‐the‐construction‐of‐knowledge. The conceptions of assessment‐as‐measurement and learning‐as‐attaining‐objectives are dominant in English educational policy today. The article suggests that these conceptions need to be challenged and expanded, since conceptions held by those who have power in education determine what sort of assessment and learning happen in the classroom, and therefore the quality of the student's learning processes and products.     

The impact of the Phonics Screening Check on grouping by ability: A ‘necessary evil’ amid the policy storm

This article examines the impact of a statutory assessment in England, the Phonics Screening Check (PSC), on classroom practices of grouping children by ‘ability’. Bearing in mind the argument that assessment is the rudder that steers the otherwise slow‐moving battleship of educational practice, it is argued that the PSC has altered how teachers organise their classes and curriculum in both the affected year group (Year 1, children aged 5–6) and in earlier and later years. Using data from a nationwide survey of teachers (n = 1,373), focus groups and in‐depth interviews with teachers, the article examines how this relatively new phonics assessment forms part of a ‘policy storm’ of pressures relating to accountability, which encourage teachers to place children in groups on the basis of ability, even when they have doubts about this practice and there is little evidence to suggest grouping improves attainment. Practices include grouping children within classes, across year groups or even across several year groups, by phase of phonics learning, guided by advice from bought‐in private phonics schemes. There is also evidence of ‘educational triage’, where borderline children become the focus, and increased use of interventions which involve withdrawing children. Overall, the article uses the PSC to demonstrate how, in times of multiple policy pressures, assessment can rapidly alter practice, in this case making grouping a ‘necessary evil’, as one teacher respondent argued.     

Learning in a comfort zone: cultural and social capital inside an outcome‐based assessment regime

Despite numerous problems with outcome‐based assessment systems, claims that they enhance learners' motivation and autonomy resonate with research interest in how young people develop cultural and social capital. However, research has not yet explored the ways in which assessment systems affect the forms of capital embedded within them. This paper applies concepts from a growing body of work on social and cultural capital in education to data from a study of assessment policy and practice in the Advanced General National Vocational Qualification (GNVQ) in two further education colleges. It evaluates how norms, practices and dynamics created by the GNVQ assessment regime interacted with other factors in students' lives and the learning programme itself. These interactions shaped cultural and social capital inside a learning ‘comfort zone’ and affected students' motivation and attitudes to learning. The article evaluates the implications of these factors for the types of cultural and social capital that may be on offer in different assessment regimes. In particular, it raises questions about the extent to which social and cultural capital are empowering or constraining, and offers ideas for further research in this area.     

Foucault,Docile Bodies and Post-Compulsory Education in Australia

Australian post-compulsory education policies have been subjected to theoretical critiques which question assumptions behind the articulation of policy. One line of critique derives from Foucault's analysis of power, and makes particular use of the theme of ‘docile bodies’. A limitation of these critiques is the adoption of a ‘top-down’ model of policy which fails to test the model against empirical evidence. This article draws upon recent research evidence ‘at the extremities’ to test the applicability of Foucault's ideas within the Australian context. The research challenges the monolithic image that results from a Hop down’ analysis and counteracts untested assumptions about the inevitability of current policies. While it suggests ways in which Foucault's ideas might enables us to lay bare the disjunctures between policy and its plurality in practice, it also highlights the limitations of Foucault's imagery of power.     

High Stakes Assessment: A Journey Into Unknown Territory

The purpose of this article is to explore efforts to reform physical education programs and to describe why they might not have been successful in the past. The general education and physical education reform literature is examined with attention to the current standards, assessment, and accountability reform movement prevalent in most states. General themes facilitating South Carolina's effort to gain support for policy initiatives and implement a high stakes assessment program are developed with attention to the political activities essential to gain support for change.     

Who or What is School 'Self'-Evaluation for?

Schools' own capacity and responsibility for reflection and evaluation is now at the forefront of UK policy. This article posits an identifiable 'English model' of school self-evaluation, which can be contrasted with the model derived from a recent CIDREE project on school self-evaluation involving 7 other European countries. The 'English model' has various strengths, which can be characterised as instrumentalist, action-oriented, rationalistic and managerial; what seems to be missing from it are what the article calls 'the ethical, affective, non-rational and democratic modes of thinking'. The article argues that, since these are crucial dimensions in the process of education, they should also figure as key aspects or modes of evaluation. What might be the implications of this for current policy and practice?     

Technology-based assessment in science: Issues underlying teacher advocacy of testing policy

The theme of this article is that the development of informed teacher advocacy for new advancements in technology-based assessment is an essential requirement if such advancements are to contribute toward the systemic improvement of the quality of school science instruction. The potential for advocacy involvement by teachers is considered a natural reaction toward the increasing tendency for classroom practices to be affected by local, state, or national assessment policy initiatives. In support of such an advocacy process, this article provides an awareness of the principles of good measurement practices in conjunction with the qualitative characteristics of technology-based assessment that together are sufficient to serve as a foundation for teachers whose concerns may motivate them to raise relevant questions regarding assessment policy. Based upon such implied standards of testing practice, the article suggests key evaluative questions for teachers to ask about any forms of science assessment that would have the effect of amplifying the potential value of new technology-based forms of assessment applications to enhance ongoing classroom processes of science teaching.     

Assessment for learning in the accountability era: Empirical evidence from Scotland

In many European languages, the words ‘assessment’ and ‘evaluation’ are synonymous, but in English the two terms are used differently. Educational ‘assessment’ is learner-focused and part of professional pedagogy, relating directly to the accountability of practitioners and schools to learners and their families. Educational ‘evaluation’ is understood to be a parallel and linked process, relating to the quality of national policy and of provision and practice in establishments, part of accountability to the wider public. In Scotland, assessment policy has been focused on aligning ‘assessment for learning’ and ‘assessment for accountability’ for nearly a decade and policy guidance has been based on the principle that formative and summative uses of information can apply as well to system evaluation as to school-based assessment. Self-evaluation has been increasingly emphasized, promoting better understanding of the role of continuous review in supporting and improving education. In theory, the two processes of assessment and evaluation should align without difficulty as ‘intelligent accountability’ and together should act as a powerful driver for improved educational outcomes. However, achieving alignment in practice, which requires good professional relationships and mutual trust in different communities of practice, as well as shared understanding and expectations, has proven to be very hard to achieve. This article will show the progress that has been made with alignment; indicate where there have been difficulties and why; and suggest that several important factors need to be acknowledged if alignment is to be achieved.     

‘Testing,testing, testing… can you hear me?’

This article draws on material that formed part of a project entitled ‘Sustaining Pupils’ Progress at Year 3'¹. One area that emerged as significant early in the project was the practice and the place of assessment. The project found a high increase in testing and other forms of assessment during Year 3 designed in part to facilitate progress. This article poses the question of whether we can learn from hearing what pupils have to say about their experience of assessment and concludes that, given the language with which to discuss and understand the processes they experience, children's views can indeed be of value as schools focus on ways to sustain learning     

Assessment is learning: the preposition vanishes

Scotland, in common with many countries internationally, has been learning how to align ideas from research with policy and practice. This article considers what Scotland learned from large-scale evaluations of its Assessment is for Learning (AifL) programme and the extent to which this evidence was used to inform future learning within the national programme. More recently, the policy focus in Scotland has shifted to the creation of a new curriculum, Curriculum for Excellence, subsuming AifL. Merging curriculum and assessment innovations brought new challenges in the alignment of curriculum, pedagogy and assessment. Drawing on a Scottish Government-funded research project, Assessment at Transition, designed to identify and explore emerging gaps between practice in schools and local authorities and national curriculum and assessment policy aspirations, the article argues that assessment is learning and explores how formative approaches to evaluation at a national level might be used to prevent countries repeating past mistakes.