Standards-driven reform years 1–10: Moderation an optional extra?

While externally moderated standards-based assessment has been practised in Queensland senior schooling for more than three decades, there has been no such practice in the middle years. With the introduction of standards at state and national levels in these years, teacher judgement as developed in moderation practices is now vital. This paper argues, that in this context of assessment reform, standards intended to inform teacher judgement and to build assessment capacity are necessary but not sufficient for maintaining teacher and public confidence in schooling. Teacher judgement is intrinsic to moderation, and to professional practice, and can no longer remain private. Moderation too is intrinsic to efforts by the profession to realise judgements that are defensible, dependable and open to scrutiny. Moderation can no longer be considered an optional extra and requires system-level support especially if, as intended, the standards are linked to system-wide efforts to improve student learning. In presenting this argument we draw on an Australian Research Council funded study with key industry partners (the Queensland Studies Authority and the National Council for Curriculum and Assessment of the Republic of Ireland). The data analysed included teacher interview data and additional teacher talk during moderation sessions. These were undertaken during the initial phase of policy development. The analysis identified those issues that emerge in moderation meetings that are designed to reach consistent, reliable judgements. Of interest are the different ways in which teachers talked through and interacted with one another to reach agreement about the quality of student work in the application of standards. There is evidence of differences in the way that teachers made compensations and trade-offs in their award of grades, dependent on the subject domain in which they teach. This article concludes with some empirically derived insights into moderation practices aspolicy andsocial events.     

Uncovering ‘unwelcome truths’ through student voice: teacher inquiry into agency and student assessment literacy

Learner agency is often seen unproblematically as an integral aspect of ‘twenty-first century lifelong learning’. Agency and instrumentalist forms of teacher professional development are problematised through this qualitative case study that explores a teacher’s inquiry into assessment for learning practices. This article illustrates how Teaching as Inquiry can be located as either a process that is purely technicist or replete with potential for teachers to engage with ‘unwelcome truths’. Student voice data that reveal ‘unwelcome truths’ can provide a catalyst for teacher reflection on student positioning in learning relationships. Findings focus on practices of assessment for learning, assessment literacy, agency as a neoliberal construction and the need to interrogate power relations in the classroom for student agency to flourish. Issues around student voice and the democratic participation of students in schooling improvement are discussed. Teaching as Inquiry, that explicitly targets wider non-instrumental goals associated with teacher learning, can be a critical process that addresses the growth of assessment literacy and learner agency in classrooms. It can transcend a linear obsession with easily measured quantifiable shifts in student achievement data.     

The tensions of preparing pre-service teachers to be assessment capable and profession-ready

There is both a growing appreciation of teacher assessment capability for the improvement of school student learning and achievement and a commensurate drive for graduates in Australian Initial Teacher Education institutions to demonstrate impact on school student learning as part of a national accreditation process. We argue in this article that if institutions are to prepare assessment capable graduates who are “profession-ready”, attention to practice architectures is warranted. Practice architectures are the features in schools that enable and/or constrain practice. Skills, knowledge and understandings do not just cleanly transfer across Initial Teacher Education institutions and practicum contexts into graduate teacher classrooms. Practitioner identities are produced through “relatings” within specific social-political arrangement, “doings” that constitute activities afforded in material-economic conditions, and “sayings” that are a dominating medium in cultural-discursive frameworks.     

The elusiveness of teacher quality: A comparative analysis of teacher certification and student achievement in Gulf Cooperation Council (GCC) countries

In national education systems worldwide, teacher quality has become synonymous with education reform efforts, but a more elusive goal is empirically measuring teacher quality. One proposed measure of teacher quality, teacher licensing, also known as certification, is an increasingly ubiquitous component of national education systems and pre-service teacher education around the world. Rapidly developing national education systems, like those in the Arabian Gulf states, are actively seeking to measure teacher quality through teacher certification and to estimate teacher quality using scores on student achievement tests. This study synthesizes research literature and contextual data as a foundation for using hierarchical linear models to estimate the impact of teacher certification on student achievement in the Gulf Cooperation Council (GCC) countries. Despite the emphasis on improving teacher quality by establishing teacher certification requirements in GCC national education systems, the researchers found neither a direct nor a consistent association between teacher certification and student achievement in the GCC.     

Is the Physical Being Taken out of Physical Education? On the Possible Effects of High-Stakes Testing on an Embattled Profession’s Curriculum Goals

Building on recent discussions regarding how current national standards for physical education promote cognitive outcomes over physical outcomes, the authors explore how a new era in high-stakes testing is also contributing to an emphasis on the cognitive, over the physical. While high-stakes testing has been linked to reducing the amount of physical education schools offer, less attention has been given to the newest phase of high-stakes testing: the use of student achievement test data to evaluate teachers. To explore how this new high-stakes testing may influence physical education curriculum goals, the authors examine new teacher evaluation policies in New York State. The authors then propose an alternative rational for physical education. By promoting the physical—physical activity, exercise, and structured physical movement through physical education programming—physical education can play a unique and key role in creating the conditions for both student cognitive development and improved public health.     

教育评价变革背景下语文学科核心素养测评框架研究

建构语文学科核心素养的测评框架是落实高中语文课程变革理念的内在要求。课程观念变革之际,核心素养评价发展趋势为:评价目的由评价学习结果转向促进学习过程,强调测评框架的可解释性;评价内容由知识本位走向关注对学科本质的深度理解;评价工具的设计强调测试任务的综合性与实践性。据此,本研究建构以情境为依托,以语言实践活动为载体,以实践活动中表征出的关键认知能力为核心的测评框架。通过对测试数据的分析发现,构建的语文学科核心素养测评框架结构合理并具有可操作性,能够为语文学科核心素养的课程评价提供一定参考。     

Moderation and consistency of teacher judgement: Teachers’ views

Major curriculum and assessment reforms in Australia have generated research interest in issues related to standards, teacher judgement and moderation. This article is based on one related inquiry of a large‐scale Australian Research Council Linkage project conducted in Queensland. This qualitative study analysed interview data to identify teachers’ views on standards and moderation as a means to achieving consistency of teacher judgement. A complementary aspect of the research involved a blind review that was conducted to determine the degree of teacher consistency without the experience of moderation. Empirical evidence was gained that most teachers, of the total interviewed, articulated a positive attitude towards the use of standards in moderation and perceived that this process produces consistency in teachers’ judgements. Context was identified as an important influential factor in teachers’ judgements and it was concluded that teachers’ assessment beliefs, attitudes and practices impact on their perceptions of the value of moderation practice and the extent to which consistency can be achieved.     

The Impact of High School Science Teachers’ Beliefs,Curricular Enactments and Experience on Student Learning During an Inquiry-based Urban Ecology Curriculum

Inquiry-based curricula are an essential tool for reforming science education yet the role of the teacher is often overlooked in terms of the impact of the curriculum on student achievement. Our research focuses on 22 teachers’ use of a year-long high school urban ecology curriculum and how teachers’ self-efficacy, instructional practices, curricular enactments and previous experience impacted student learning. Data sources included teacher belief surveys, teacher enactment surveys, a student multiple-choice assessment focused on defining and identifying science concepts and a student open-ended assessment focused on scientific inquiry. Results from the two hierarchical linear models indicate that there was significant variation between teachers in terms of student achievement. For the multiple-choice assessment, teachers who spent a larger percentage of time on group work and a smaller percentage of time lecturing had greater student learning. For the open-ended assessment, teachers who reported a higher frequency of students engaging in argument and sharing ideas had greater student learning while teachers who adapted the curriculum more had lower student learning. These results suggest the importance of supporting the active role of students in instruction, emphasising argumentation, and considering the types of adaptations teachers make to curriculum.     

Teachers’ innovative change within countrywide reform: a case study in Rwanda

This article presents practical perspectives on mathematics teacher change through results of collaborative research with two mathematics secondary school teachers in order to improve the teaching and learning of mathematics in Rwanda. The 2006 national mathematics curriculum reform stresses pedagogies that enhance problem-solving, critical thinking and argumentation. Teachers need to use new teaching strategies. This article is a case study looking at issues around developing teachers’ use of interactions in mathematics classrooms independently of the national programme. Outputs of the study include teachers’ awareness of the need for change and their increased flexibility to accept learners’ autonomy in shifting from teacher-centred to learner-centred pedagogy. Geometer’s Sketchpad challenged teachers’ practice and then provoked reflection to improve student learning.     

Teachers designing curriculum as professional development: A model for transformational science teaching

We have designed a model for transformational science teaching focused on linking theory and practice through curriculum decision making that has been the framework for professional development sessions for middle-grade science teachers during the past 5 years. Interviews with teachers revealed that their experiences with curriculum development were of significant value in making decisions concerning the design of classroom environments. As teachers reflected on current research about teaching and learning, in collaboration with university scientists and science educators, they were informed by theoretical perspectives which held implications for their practice. Curriculum development became a vehicle for professional development and school reform; however, it was vital that the teachers were in clear communication with their administrators and communities concerning reform issues. Students and teachers from schools implementing the model and from control sites were interviewed to determine the model's influence on instructional practices and student attitude and achievement in science. The five-phase model for transformational science teaching is discussed here, accompanied by teacher comments about tensions experienced at each phase. This discussion is followed by an analysis of teacher and student interview data that reveals teachers' use of instructional strategies and students' attitudes toward science. Results and analysis of student performance on a mandated end-of-grade science test are also included. From this evidence, we recommend a new design for professional development opportunities for teachers that engages them in decision making as they reflect about the connections between theory and practice and the value of continually testing, revising, and reevaluating curriculum and instructional issues. J Res Sci Teach 34: 773–789, 1997.     

语文课程中的发展性学生评价研究

语文课程中的发展性学生评价以促进学生全面发展为根本目的,体现了语文新课程理念。我们应明确语文课程的评价内容,在实施中坚持发展性、全面性和合作性的评价原则。发展性学生评价的方法要灵活多样,采取教师评价、自我评价、同伴评价、家长评价等不同方式。发展性评价对当前语文考试改革具有一定的启示意义。     

Curriculum and assessment for the knowledge society: interrogating experiences in the Republic of Ireland and Queensland,Australia

The ‘knowledge society’ has become a central discourse within educational reform. This article posits that the impact of the knowledge society discourse on curriculum and assessment has led to the emergence of what the authors term a new-form/re-form curriculum, and it asks whether what is transacting in contemporary movements in curriculum is less the reform of curriculum and more the emergence of a new-form/re-form curriculum. What is emerging is well beyond the discussions of outcomes and curriculum alignment that characterised much curriculum reform effort in the late 1990s. In this new-form/re-form curriculum ‘content’ is displaced by ‘skills’ and ‘knowledge acquisition’ by ‘learning’. Curriculum coverage is replaced by learner engagement. In this context, assessment also begins to take on new-form/re-form. Assessment now engages and promotes learning as process rather than as product. Two cases – the Republic of Ireland and Queensland, Australia – are analysed and compared to illustrate this shift in the conceptualisation of curriculum and assessment. Consideration is given to the possibility that this new-form/re-form curriculum represents a settlement in the contestation associated with learning outcomes and their perceived technical rationality and market focus. The paper concludes that the new-form/re-form curriculum is emerging in locations as diverse as Ireland and Queensland.     

Moderating New Zealand’s National Standards: teacher learning and assessment outcomes

Across the globe, standards-based assessment systems are increasingly promoted as a means of improving student outcomes and fulfilling accountability requirements. Within such systems, social moderation is presented as a mechanism for improving the dependability and utility of assessment information. Research emphasises that social moderation processes provide professional learning opportunities; yet this learning tends to be perceived as a by-product rather than a goal of moderation. Situated within the context of New Zealand’s recently implemented National Standards, this article reviews the literature and presents an alternative configuration of the role of social moderation. It foregrounds the professional learning that will be required if these moderation processes are to improve the dependability of National Standards assessment information and contends that reconfiguring teacher professional learning as a goal rather than a by-product of moderation should not only improve dependability and strengthen teacher assessment capability but also assist with lifting student outcomes.     

In support of teachers’ learning: specifying and contextualising teacher inquiry as professional practice

Drawing upon research into a case study of teacher inquiry in one school in Queensland, Australia, recent theorising into professional practice, and relevant literature on teachers’ learning, this article reveals the complexity and particularity of teacher inquiry processes in support of teachers’ learning. Specifically, the research reveals how particular actions, dialogue, and relationships collectively constitute a practice of teacher inquiry which seeks to promote substantive teacher-led learning. The research draws upon a group of Year 5 teachers engaged in collective inquiry into their work in what was described as an “Inquiry Cycle” approach in a school in northern Queensland, during a period of support for substantial curriculum reform. The research reveals the Inquiry Cycle approach as characterised by specific actions, dialogue, and relationships – “doings,” “sayings,” and “relatings” – productive of the development of a learning culture focused on significant curriculum reform; overt support for whole-school “explicit” approaches to teachers’ pedagogies; and active/robust critique of data-focused assessment processes. The research reveals necessary texture and detail in support of teachers’ learning, and the specific circumstances and contextual “arrangements” that help constitute this learning.     

What’s the point of moderation? A discussion of the purposes achieved through contemporary moderation practices

An increasingly regulated higher education sector is renewing its attention to those activities referred to as ‘moderation’ in its efforts to ensure that judgements of student achievement are based on appropriate standards. Moderation practices conducted throughout the assessment process can result in purposes identified as equity, justification, accountability and community building. This paper draws on the limited studies of moderation and wider relevant research on judgement, standards and professional learning to test commonly used moderation practices against these identified purposes. The paper concludes with recommendations for maximising the potential of moderation practices to establish and maintain achievement standards.     

Conceptualising teachers’ assessment literacies in an era of curriculum and assessment reform

Teacher assessment literacy is a phrase that is often used but rarely defined. Yet understanding teacher assessment literacy is important in an international curriculum and assessment reform context that continues to challenge teachers’ assessment practices. In this article situated examples of classroom assessment literacies are analysed using Bernstein’s (Pedagogy, symbolic control and identity: Theory, research and critique, Taylor and Francis, London, 1996; Br J Sociol Educ 20(2):157–173, 1999) theoretical tools of vertical and horizontal discourses, classification and framing. Drawing on a sociocultural view of learning, the authors define teacher assessment literacies as dynamic social practices which are context dependent and which involve teachers in articulating and negotiating classroom and cultural knowledges with one another and with learners, in the initiation, development and practice of assessment to achieve the learning goals of students. This conceptualisation of assessment literacy aims to make explicit some underpinning theoretical constructs of assessment literacy to inform dialogue and decision making for policy and practice to benefit student learning and achievement.     

Statement of Theme

School accountability and student assessment are closely associated in educational jurisdictions’ attempts to monitor student achievement, focus instruction, and improve subsequent student and school performance. The research reported in this article examines the School Effectiveness Framework in Ontario, Canada, exploring the foundations upon which the framework is based and educators’ efforts to use assessment information to monitor the effectiveness of their reform efforts. Through document analysis and interviews, the researchers highlight the challenges and opportunities surrounding the accountability and assessment partnership.     

The influence of the Creative Learning Assessment (CLA) on children's learning and teachers' teaching

This paper describes the development and use of the Creative Learning Assessment (CLA) as a means of evidencing, supporting and promoting children's creative learning in arts‐based contexts. The research team at the Centre for Literacy in Primary Education (CLPE) worked with a group of teachers in inner‐city Lambeth primary schools to develop an assessment system to record the impact of a creative curriculum on children's achievement and to enable schools to justify a broad‐based provision. The Assessing Learning and Communication in Creative Learning Contexts project, funded by CfBT Education Trust (CfBT), aimed to offer teachers a view of creative learning development and a framework for teacher assessment. It set out to provide a close focus on the learner and a valuable source of information for curriculum planning. This article discusses the effect of working with the CLA on children's learning and on teachers' practice through a case study of one project school, and the implications for schools and classrooms from the perspectives of the researcher and the teacher.     

The Impact of Teacher Classroom Practices on Student Achievement during the Implementation of a Reform‐based Chemistry Curriculum

Evidence of a gap in student understanding has been well documented in chemistry: the typical student holds an abundance of misconceptions. The current expectation is that educational reform will foster greater student achievement via inquiry teaching within classrooms. Using assessments involving both conceptual and algorithmic knowledge of gas behaviour, gas laws, and phase changes in chemistry, this study aims to determine the relationship between inquiry teaching and student achievement. The topics were tested in the context of a unit from a reform‐based curriculum that features inquiry, hands‐on activities, and cooperative learning. This curriculum provides step‐by‐step guidance for each lesson in the teacher materials, in order to promote quality inquiry teaching. Two schools were involved in this study, with two high school chemistry teachers from each school. Each teacher participated in professional development and implemented this curriculum with sufficient training and guidance to develop reform methods. Student achievement was found to positively correlate with the use of inquiry teaching about the assessed concepts, regardless of teacher experience or school context.