The impact of formative assessment on student achievement: A study of the effects of changes to classroom practice after a comprehensive professional development programme

A random sample of 22 Year 4 teachers in mathematics from a middle-sized Swedish municipality participated in a teacher professional development programme in formative assessment. The content of the programme was formative assessment conceptualised as a unity of different, integrated strategies. The study examines the effects on student achievement of the changes in the teachers’ formative classroom practice that followed the professional development input. Results show that, after controlling for pretest scores, the classes in the intervention group significantly outperformed the classes in the control group in a posttest administered one school year after the end of the programme (p = 0.036, d = 0.66). The study contributes to the understanding of under-studied areas of the impact of professional development in formative assessment, and the impact of teacher practice based on formative assessment conceptualised as a unity of different formative assessment strategies.     

Assessment and teacher professionalism

ABSTRACT

This paper draws from a multi‐site qualitative case‐study research project entitled From Policy to Practice funded by the University of Exeter. The research sought to identify the impact that the Key Stage 3 tests would have on the working practices of eight heads of English departments and their staff in mixed maintained comprehensive schools in different regions of England.

The paper begins by presenting the way that the national assessment system has undergone change since its inception, highlighting that the function of assessment is to act as the most significant indicator of a school's performance through government policy that promotes and prioritizes the measurement of pupils’ achievements through each key stage.

The English teachers’ responses to the revisions of the English National Curriculum Programmes of Study are described and the paper documents the thoughts and feelings of these teachers as they had to try to make sense of the changes in their classroom working practices. They are articulate in categorizing those aspects of their pedagogical practice that the assessment process has stifled and those that the assessment process has encouraged. The paper then offers an interpretative analysis of the impact that the externally imposed curriculum and assessment changes have had on the teachers’ sense of being professionals.     

What Hath the Coronavirus Brought to Assessment? Unprecedented Challenges in Educational Assessment in 2020 and Years to Come

This paper discusses the unprecedented challenges and possible directions in which the field of educational assessment is going after the outbreak of COVID-19. Though the pandemic leads to a lot of pressure related to instruction, learning, and assessment, it also provides opportunities that are likely to require changes to the current theories and practices as well as the assumptions that are no longer justified. It is hoped that the challenges will motivate our field and the instructional experts to work closely together with the learning and instruction process so that assessment will be better integrated and can provide data-driven insights related to the sequence and content of instruction based on the diagnosis of students' strengths and weaknesses from assessment data. We expect that the integration of assessment in learning and instruction will definitely exert significant positive impact on learning outcomes. We believe the field will become aware of the assessment issues that teaching at a distance presents and will come up with innovative solutions to the many emerging problems when the world of instruction and learning undergoes significant changes from social distancing. This paper provides comments, and predictions about what the challenges and directions in educational assessment will be.     

Does Training in Alternative Assessment Matter? The Case of Prospective and Practicing Mathematics Teachers’ Attitudes Toward Alternative Assessment and Their Beliefs About the Nature of Mathematics

This study explored the training of prospective and practicing mathematics teachers in alternative assessment and its impact on their attitudes toward alternative assessment methods and their beliefs about the nature of mathematics. Data were collected from 51 prospective teachers and 50 practicing teachers who took a course on alternative assessment in mathematics. Findings indicated a significant change in the correlation between the positivist and constructivist dimensions of their beliefs about the nature of mathematics following the course. No significant differences were found between the prospective and practicing teachers’ beliefs either before or after the course nor in their attitudes toward alternative assessment after the course. Before the course, however, the two groups differed significantly in their attitudes toward alternative assessment. Findings also revealed significant changes in attitudes toward alternative assessment and beliefs about the nature of mathematics following participation in the course. These changes in attitudes and beliefs were accompanied by a shift in the nature of the assessment tasks written by the participants. Participants who demonstrated more positive attitudes and constructivist beliefs tended to write more conceptual problems and less procedural exercises. Implications for mathematics teacher training and professional development in alternative assessment are discussed.     

Student assessment and learning for a changing society

This article examines the traditional roles of assessment and the current demands for assessment to ‘gear up’ education systems in response to global economic changes. It argues that in the next millennium, and with the information revolution, it will be important to foster higher order skills and good learning strategies in a high proportion of our students. The article goes on to consider, set against the critical relationship among high-stakes testing, teaching and learning, the nature of high-quality assessment programmes. It will present evidence of impact of the national assessment programme on teaching in England and Wales in the United Kingdom.     

Senior secondary school assessment and standard-setting in Queensland,Australia: social context and paradigmatic change

ABSTRACT

This article draws on three assessment paradigms – psychometrics, outcomes-based and curriculum-based assessment – to discuss paradigmatic changes in senior school assessment and achievement standard-setting in Queensland, Australia, over the last 50 years. These include radical reforms in 1970 from university-controlled examinations to school-based assessments applying normative standard-setting, to subsequent reforms in 1978 introducing competence(curriculum)-based assessment and standards. From 2019, a new reform introduces a combination of school-based and external assessment with procedures for establishing standards still in progress.

Changes to Queensland assessment and standard-setting are discussed in terms of three preconditions for paradigm change – dissatisfaction, an alternative acceptable paradigm, and majority acceptance of change. Influence of paradigmatic origins of reformers is discussed. The amalgam of curriculum-based assessment and psychometric paradigms in the new Queensland system is considered in terms of theoretical compatibility and potential impact on the new standards.     

Intervention in teachers’ differential scoring judgments in assessing L2 writing through communities of assessment practice

In writing assessment, the inconsistency of teachers’ scorings is among the frequently reported concerns regarding the validity and the reliability of assessment. The study aimed to find out to what extent participating in a community of assessment practice (CAP) can impact the discrepancies among raters’ scorings. Adopting one group pretest-posttest design, patterns in the teachers’ scoring judgments were explored based on both quantitative and qualitative data. The results indicate significant increase in the degrees of agreement in the teachers’ differential scorings showing changes in their severity tendencies for structural variety, lexical accuracy, organization and mechanics criteria while their scoring judgements on structural accuracy, task achievement, and lexical variety criteria had low levels of agreement.     

The Impact of a State Performance-Based Assessment and Accountability Program on Mathematics Instruction and Student Learning: Evidence From Survey Data and School Performance

The purpose of this study was to examine the impact of the Maryland School Performance Assessment Program (MSPAP) and the Maryland Learning Outcomes (MLOs) on mathematics classroom instruction and assessment practices, professional development, and student learning. The data sources included questionnaires for principals, mathematics teachers, and students, as well as student performance on MSPAP over a 5-year period. Ninety elementary and middle schools in Maryland participated in the study. The results indicate that principals and teachers tended to support MSPAP as a tool for making changes in instruction, teachers were making some positive changes in mathematics instruction because of MSPAP (based on the questionnaire data), and the schools for which teachers reported that MSPAP had a greater impact on their mathematics instruction had greater MSPAP performance gains in mathematics over the 5 years.     

环境影响评价研究的现状及发展趋势

国内外对环境影响评价的研究是在环境影响经济评价、环境政策评价、战略环境评价和区域环境评价等几个方面展开的，本文在环境影响评价研究综述基础上，指出了目前环境影响评价研究存在的问题，探讨了环境影响评价研究今后的发展方向和趋势。     

高职高专环境影响评价课程教学改革探讨

环境影响评价课程是高职高专环境类专业的主干核心课程之一,教学效果直接影响学生运用环境影响评价知识的能力。本文结合笔者多年的环境影响评价课程理论和实践教学的经验积累,主要从课程标准制订、教材选用、教学内容、教学方法、实践和考核方面出发,分析探讨了高职高专环境影响评价课程的教学改革。     

Assessment literacy and student learning: the case for explicitly developing students ‘assessment literacy’

In this paper, we report on a study to quantify the impact on student learning and on student assessment literacy of a brief assessment literacy intervention. We first define ‘assessment literacy’ then report on the development and validation of an assessment literacy measurement instrument. Using a pseudo-experimental design, we quantified the impact of an assessment literacy-building intervention on students’ assessment literacy levels and on their subsequent performance on an assessment task. The intervention involved students in the experimental condition analysing, discussing and applying an assessment rubric to actual examples of student work that exemplified extremes of standards of performance on the task (e.g. poor, excellent). Results showed that such a procedure could be expected to impact positively on assessment literacy levels and on student performance (on a similar or related task). Regression analyses indicated that the greatest predictor of enhanced student marks (on the assessment task that was the subject of the experiment), was the development of their ability to judge standards of performance on student work created in response to a similar task. The intervention took just 50 minutes indicating a good educational return on the pedagogical investment.     

Quality assessment of undergraduate education in China: impact on different universities

This research analyzes the scheme proposed to assess the quality of higher education institutions in China, namely, the Quality Assessment of Undergraduate Education (QAUE) scheme. This article aims to determine the impact of the QAUE on universities and explore the reasons that intended effects have or have not been generated in the evaluated universities by conducting case studies of three Chinese universities with different statuses. The empirical studies show the effects on the various dimensions of quality provisions at different universities were not the same. It was found that the impact of the QAUE was not a linear consequence of policy implementation, but the result of an interaction between the external quality assessment scheme and the evaluated universities. Quality assessment is regarded to be an external force to cause universities to change. This empirical study of the QAUE shows that changes will only take place when the external force is integrated with the evaluated universities’ internal motivation and capacity.     

高校会计专业教学的现状及问题探析

我国经济体制以及国际环境的深刻变革影响着传统的会计教学模式.要适应经济信息的瞬息万变,提高会计专业毕业生的知识水平和综合素质,应从更新教育理念、完善教学环境、优化课程结构设置以及改革课程考核方式等方面开展高校会计专业教学改革     

Parents' views on nursery education: Perceptions in context

The analysis describes the broad consensus which is currently emerging about the nature of the educational changes which are necessary for the creation of a 'learning society' and contrasts this vision with the contemporary reality of an education system which is every day more constrained by formal assessment. The implications of these tightening bonds for the development of universities in the third millennium are explored in terms of research evidence which documents the impact of conventional forms of assessment on student learning. The argument is made that this emphasis on 'categoric' assessment if fundamentally incompatible with aspirations towards the creation of a 'learning society'. This is partly because institutions must necessarily give their attention to obtaining high scores and cannot risk the substantial changes in the reorganisation of teaching and learning that an 'empowering' educational environment would arguably require and partly because of the power of the prevailing assessment discourse to define priorities. The article uses Lyotard's concept of 'performativity' to examine these contemporary tensions in higher education, their origins and potential significance for the creation of a 'learning society'.     

Portfolios for learning,assessment and professional development in higher education

This article focuses on the use of portfolios for learning and professional development in Higher Education (HE). Recent research findings related to learning and assessment help to contextualize the study. The use of portfolios for summative assessment and development of teaching and reflective practice dominates the literature. What is lacking is research that provides insights into how a portfolio for learning can be used in HE to develop understanding into one’s own learning, assessment and professional practices. The action research findings related to portfolio use for learning purposes identified in the three case studies include: the importance of establishing the purpose of the portfolio; the impact of portfolio use on the approach to learning, to teaching and to professional development; the changes to professional practice brought about as a result of the learning; and the need to consider issues related to ethics and confidentiality.     

Fair and equitable assessment practices for all students

This paper focuses on promoting fairness and equity in student assessment practices. The researchers used questionnaires and interviews and the study encompassed a total of 3312 individuals representing a range of stakeholders. The paper is presented in two parts: fairness and discrimination, and challenging policy and practice. Five key principles emerged. Educators must strive to address the personal impact of assessment practices on individual students and their families. Assessment must be differentiated to accommodate the ability, social, cultural and linguistic background of students. All members of school communities must challenge the complacency associated with accepting indefensible assessment practices. The frequency, intensity and intrusiveness of assessments must not be overwhelming for students and their families. Finally, assessment must not be used to counter inappropriate student behaviour or reward desired behaviour. Implications for practice are presented. Additionally, the authors describe changes to policy and practice that occurred as a result of the study.     

Assessment innovation and student experience: a new assessment challenge and call for a multi-perspective approach to assessment research

The impact of innovative assessment on student experience in higher education is a neglected research topic. This represents an important gap in the literature-given debate around the marketisation of higher education, international focus on student satisfaction measurement tools and political calls to put students at the heart of higher education in the UK. This paper reports on qualitative findings from a research project examining the impact of assessment preferences and familiarity on student attainment and experience. It argues that innovation is defined by the student, shaped by diverse assessment experiences and preferences, and therefore its impact is difficult to predict. It proposes that future innovations must explore assessment choice mechanisms which allow students to shape their own assessments. Cultural change and staff development will be required to achieve this. To be accepted, assessment for student experience must be viewed as a complementary layer within a complex multi-perspective model of assessment, which also embraces assessment of learning, assessment for learning and assessment for lifelong learning. Further research is required to build a meta-theory of assessment to enhance the synergies between these alternative approaches and minimise the tensions between them.     

Evaluating risk assessment implementation in child protection: issues for consideration.

The use of systematic risk assessment models by Child Protective Services is a rapidly growing phenomenon. Despite their popularity, we know little about the effect of implementation on casework practice. This article examines some issues that agencies might consider when evaluating the impact of risk assessment implementation on service delivery. The authors recommend an approach that includes the use of qualitative and quantitative measures in a process and an outcome evaluation to determine the degree to which the model has been implemented as intended and the impact of implementation on the case work process. Though this approach is likely to provide agencies with detailed information of the impact of risk assessment implementation, caution is recommended when interpreting the results from an evaluation of a risk assessment model in a field setting.     

基于同侪互评的在线学习评价研究综述

在线同侪互评是一种形成性评价策略。它通过学习者之间相互给予评分或反馈来改善学习成果,对学习者的学习成绩、态度及高阶思维能力等方面能够产生重要的影响。首先回顾了近10年来国际在线同侪互评的主要文献．从概念与内涵、程序与方法、系统与工具,以及效果与影响等四个方面综述了现有研究成果。而后,展望未来研究可能聚焦于：同侪互评与其他网络教学策略整合、同侪互评与教师评价结合运用、同侪评语分析等主题。     

环境影响评价中环境经济损益分析方法浅析

为了介绍建设项目环境影响评价中环境经济损益分析的方法和步骤,对影响因子的类型及其量化方法、经济损益计算方法及经济损益评价方法进行了深入的探讨,在环境经济方面为建设项目审批及实施提供更加完善的依据;采用逐一列举的方法,说明环境影响经济评价在环评中所占的重要地位,指出对建设项目进行环境影响经济评价是今后环境影响评价发展的方向．