Student peer review: enhancing formative feedback with a rebuttal

This study examines the use of peer review in an undergraduate ecology programme, in which students write a research proposal as a grant application, prior to carrying out the research project. Using a theoretical feedback model, we compared teacher and student peer reviews in a double blind exercise, and show how students responded to feedback given by each group. In addition, students wrote a rebuttal for every feedback point before re-drafting and submission. Despite students claiming they could tell if the reviewer was a teacher or student, this was not always the case, and both student and teacher feedback was accepted on merit. Analysis of feedback types and rebuttal actions showed similar patterns between students and teachers. Where teachers differed slightly was in the use of questions and giving direction. Interviews with students showed the rebuttal was a novel experience, because it required a consideration of each comment and justification as to why it was accepted, partially accepted or rejected. Being a reviewer helped students to learn about their own work, and it changed the way they understood the scientific literature. In addition, some students transferred their new peer review skills to help others outside of the ecology programme.     

Designing and implementing peer formative feedback within online learning environments

With increasing need to achieve appropriate balance between learning support and self-regulation within the context of online learning, formative feedback has been identified as a viable means to achieve meaningful engagement. Specifically, this study sought to establish how peer–peer formative feedback was facilitated in an online course and to what extent this engaged students in meaningful learning experiences. This case study entailed an in-depth investigation into the design and implementation of an online course in a New Zealand university. The studied course was part of a postgraduate programme in continuing (in-service) teacher education. The study adopted a case study methodology with a bias on qualitative techniques. Online observations, analysis of the archived course discourse and interviews were utilised as sources of data. The data from multiple sources were subsequently triangulated to corroborate the evidence. The findings indicate that peer formative feedback promoted active learners’ participation and meaningful engagement. The findings further showed that opportunities for dialogic peer formative feedback promoted learning support and self-regulation.     

Testing the effectiveness of classroom formative assessment in Dutch primary mathematics education

Classroom formative assessment (CFA) is considered to be a fundamental part of effective teaching, as it is presumed to enhance student performance. However, there is only limited empirical evidence to support this notion. In this effect study, a quasi-experiment was conducted to compare 2 conditions. In the treatment condition, 17 teachers implemented a CFA model containing both daily and weekly goal-directed instruction, assessment, and immediate instructional feedback for students who needed additional support. In the control condition, 17 teachers implemented a modification to their usual practice. They assessed their students’ mastery of learning goals on the basis of half-yearly mathematics tests, and prepared weekly pre-teaching sessions for groups of low-achieving students. The posttests showed no significant differences in student performance between the 2 conditions after controlling for student and teacher characteristics. The degree of implementation of the CFA model, however, appeared to be positively related to the 5th-grade students’ performance.     

A case study of using peer feedback in face-to-face and distance learning classes among pre-service teachers

This study investigated a feedback exchange activity for engaging pre-service teachers and the nature of such feedback in two undergraduate classes, a distance learning (DL) and a face-to-face (F2F) class. The research question asked if the nature of peer feedback was different between F2F and DL class formats. Students’ work samples were collected during class time to examine feedback function ratings. Participants also completed an online questionnaire to examine the nature of expectations of the feedback given. For both the nature of expectations and feedback function ratings, results for chi-square analyses demonstrated no statistically significant difference between the two modes of instruction (F2F versus DL), and the peer feedback categories. However, provision of feedback was significantly favoured in the F2F class over the DL class. Implications for course curriculum and future research are discussed.     

Investigating the dynamics of formative assessment: relationships between teacher knowledge,assessment practice and learning

This exploratory study of elementary school science examines questions central to policy, practice and research on formative assessment: What is the quality of teachers’ content-pedagogical and assessment knowledge? What is the relationship between teacher knowledge and assessment practice? What is the relationship between teacher knowledge, assessment practice and student learning? Drawing on multiple measures, hierarchical linear modelling and path analysis, results suggest that despite weaknesses in teachers’ content-pedagogical and assessment knowledge, teachers’ formative assessment practices are positively related to student learning. Relationships between teachers’ knowledge and assessment practices are mixed. Findings underscore both the potential and challenge of bringing effective formative practice to fruition as well as the need for continued research.     

The missing disciplinary substance of formative assessment

We raise concerns about the current state of research and development in formative assessment, specifically to argue that in its concentration on strategies for the teacher, the literature overlooks the disciplinary substance of what teachers and students assess. Our argument requires analysis of specific instances in the literature, and so we have selected four prominent publications for consideration as examples. These, we show, pay little attention to the student reasoning they depict, presume traditional notions of “content” as correct information, and treat assessment as distinct from other activities of learning and teaching, even when they claim the contrary. We then offer an alternative image of formative assessment centered on attention to disciplinary substance, which we illustrate with an example from a high school biology class. Assessment, we contend, should be understood and presented as genuine engagement with ideas, continuous with the disciplinary practices science teaching should be working to cultivate. © 2011 Wiley Periodicals, Inc. J Res Sci Teach 48: 1109–1136, 2011     

Effective formative e-assessment of student learning: a study on a statistics course

The process of formative assessment in universities has the potential to engage students in reflection and to take greater ownership of their learning. We report on a study involving 104 students taking a statistics course in a degree programme in rehabilitation science in Hong Kong. The assessment strategy was redesigned to include a weekly online formative assessment activity for 10 weeks. In this case, it was observed that there was a high participation rate across weeks. An end-of-course online survey was conducted to explore the learning experiences during formative assessment of the cohort, and students reported high satisfaction with the process, particularly how this contributed to a change in their learning approach. Students not only showed regular commitment of time on tasks but also took active steps to find answers for themselves and with their peers.     

开放教育课程形成性考核现存问题与对策

形成性考核是现代远程开放教育教学质量保证体系的重要组成部分,是强化素质教育,加强教学过程管理,改进课程考试方式方法的重要措施。本文针对形成性考核实施过程中存在的诸如思想认识、考核设计和组织管理等方面的问题提出了相应对策,以利于更科学、有效地推进此项工作。     

The quality of peer assessment in a wiki-based online context: a qualitative study

Peer assessment (PA) provides opportunities for authentic assessment, autonomy and collaboration. Several authors advocate that students can benefit from PA and put forward the effects of PA on the students’ learning outcomes. Questions concerning the validity and reliability of PA and PA competences are also addressed by different researchers. This qualitative study is part of a wider project that seeks to develop and test evaluation and assessment strategies in online contexts. In a doctoral module, PA was used for summative and formative purposes. Formative PA aimed to give feedback about the ongoing group work, but also to increase online interaction between the different groups of students. The main module task was to write a literature review, about a selected topic, using a wiki. Criteria and indicators to assess the literature review were negotiated with the students. Different criteria were used to assess the quality of PA, such as, the use of the negotiated criteria, the adequacy of the chosen vocabulary or the provision of constructive feedback. The results show that overall the quality of PA can be improved. Groups did not provide sufficient criticism, questions and suggestions for improvement.     

Using formative assessment to promote argumentation in a university bilingual science course

Formative assessment, bilingualism, and argumentation when combined can enrich bilingual scientific literacy. However, argumentation receives little attention in the practice of bilingual science education. This article describes the effect of a formative assessment-based pedagogical strategy in promoting university students’ argumentation. It examines the written and oral arguments produced by 54 undergraduates (28 females and 26 males, 16–21 years old) in Colombia during a university bilingual (Spanish-English) science course. The data used in this analysis was derived from students’ written responses, and audio and video recordings. The first goal of this study was to determine how this teaching strategy could help students increase the use of English as a means of communication in argumentation in science. The second goal was to establish the potential of the strategy to engage students in argumentative classroom interactions as an essential part of formative assessment. The findings show that the strategy provided participants with opportunities to write their argumentation in Spanish, in English and in a hybrid version using code-switching. Educational implications for higher education are discussed.     

The relationship between formative assessment and reading achievement: A multilevel analysis of students in 19 countries/regions

Despite the general consensus on the positive impact of formative assessment on student learning, researchers have not shown the underlying mechanisms between specific formative assessment strategies and academic performance on an international sample. This study examines the link between student and teacher reports of teachers’ formative assessment strategies (i.e. clarifying goals and monitoring progress, providing feedback, and instructional adjustments) and students’ reading achievement, based on data from 151,969 fifteen-year-olds in 5,225 schools in 19 countries/regions in PISA 2018 via multilevel analysis of plausible values. The results show that clarifying goals and monitoring progress, and instruction adjustments are positively linked to reading achievement, but providing feedback alone has no significant impact. These findings highlight the complexity of formative assessment as a multifaceted concept and the different impacts of formative assessment strategies on student learning. Implications for researchers and practitioners are discussed.     

Aiming for autonomy: formative peer assessment in a final-year undergraduate course

This article takes a dual focus on the theme of student formative peer assessment. On the one hand it offers a thorough literature review in this field, while on the other it unpacks a case study of curriculum design where peer assessment has been adopted. The practical example draws on recent changes made to a third- and final-year undergraduate research dissertation course in a UK architectural school. Although peer assessment worked quite well in this small setting, similar findings might be uncovered when scaled up to larger cohorts, as well as other disciplines and year groups. The research findings are certainly relevant for other contexts. Qualitative research from a focus group with six students on the course informs the empirical body of the paper. Through engaging with students’ reflections, as well as the relevant literature, and reflexively looking at the curriculum changes, this paper discusses some of the benefits and drawbacks that can arise from peer assessment in this context. Peer assessment is not without its challenges and hiccups, but, despite these, the benefit to autonomous critical thinking cannot be understated. And arguably peer assessment is especially germane for final-year undergraduates as they embark on employment or more advanced studies.     

Student perspectives on formative feedback as part of writing portfolios

Despite the crucial role that students play in formative assessment practices, student perspectives on such practices are relatively under-researched. Through a qualitative analysis of 128 reflection notes written by student teachers of English, this article investigates the students’ perceptions of formative feedback as part of portfolio assessment at two teacher education institutions in Norway. As such, it contributes to bridging the gap between research and practice. Students received peer and teacher feedback on assignments and wrote reflection notes during the semester. Findings show that students are positive towards teacher feedback and highlight the significance of teacher praise. Main objections raised against peer feedback concern the lack of constructive criticism. However, positive attitudes towards peer discussion groups suggest that they may be a more effective way of implementing peer assessment than formalised written peer commentary. Student reflections suggest that a failure to understand the task and the feedback is a possible hindrance to successfully revising assignments. Overall, students’ positive attitudes towards the portfolio process, which includes multiple drafting, suggest that students in higher education would benefit from more opportunities to revise and resubmit their work, yet they need adequate practice in providing peer feedback, and interpreting and implementing feedback in general.     

Small group discussion as a key component in online assessment training for enhanced student learning in web-based peer assessment

The purpose of this study is to examine the effect of online assessment training, with synchronous group discussion as a key component, on subsequent web-based peer assessment results. Participants included 81 college students, mostly women, taking a business writing class. After initial submission of a draft counter-offer letter, they completed online assessment training by engaging in a consensus-seeking, synchronous group discussion of the rubric-based ratings they gave to sample counter-offer letters. They then engaged in web-based assessment of randomly assigned peer counter-offer letters and upon receiving peer feedback, submitted revision of their own counter-offer letter. The discussion groups were randomly assigned to either anonymous (using a pseudo name) or identified conditions (using real name). Findings indicate that the quality of student counter-offer letters improved after online assessment training, and improved even more after web-based peer assessment. There were no significant differences between anonymous discussion groups and identified groups.     

The supportive character of teacher education triadic conferences: detailing the formative feedback conveyed

This study explored feedback conveyed in nine triadic conferences in teacher education practicum. The supportive character of formative feedback was explored in detail by employing a framework that combines two conceptualisations of feedback.The study depicted feedback directed backwards, upwards or forward and focusing performance, strategies, self-regulation or personal characteristics inside a framework of self-regulated learning. Findings show the teacher student to be more active in feed up, feed back and feed forward than previous studies have shown. Furthermore the conversations were found to be characterised by joint problem-solving in which all three parties focused on the student’s professional teacher-becoming. In conclusion, the findings indicate a feedback practice characterised by ‘sustainable’ feedback that scaffolds students’ self-assessing competence while fostering student self-reflexivity and self-regulation.     

Linking a learning progression for natural selection to teachers' enactment of formative assessment

Learning progressions, or representations of how student ideas develop in a domain, hold promise as tools to support teachers' formative assessment practices. The ideas represented in a learning progression might help teachers to identify and make inferences about evidence collected of student thinking, necessary precursors to modifying instruction to help students advance in their learning. The study reported in this article took the novel approach of using a learning progression for natural selection to support teachers' enactment of formative assessment. Sources of data include interviews and videotapes of six high school biology teachers leading assessment conversations around the same formative assessment questions. Results indicate that while teachers picked out and made inferences about student ideas related to the learning progression during assessment conversations, they did not use all parts of the learning progression in the same way. Furthermore, several of the teachers seemed to use the learning progressions simply as catalogs of misconceptions to be “squashed” rather than drawing upon the developmental affordances offered by a learning progression. Results are framed in terms of the utility of learning progressions as supports for classroom practice. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 1181–1210, 2012     

STEM‐focused high schools as a strategy for enhancing readiness for postsecondary STEM programs

The logic underlying inclusive STEM high schools (ISHSs) posits that requiring all students to take advanced college preparatory STEM courses while providing student‐centered, reform‐oriented instruction, ample student supports, and real‐world STEM experiences and role models will prepare and inspire students admitted on the basis of STEM interest rather than prior achievement for postsecondary STEM. This study tests that logic model by comparing the high school experiences and achievement of students in ISHSs and comparison schools in North Carolina. After identifying ISHS and non‐STEM comparison high schools serving students who were similar in terms of socioeconomic status and academic achievement prior to high school entry, we employed propensity‐score weighting and HLM modeling to estimate the impact of attending an ISHS on a set of outcome measures obtained from student surveys and from the state's longitudinal student data system. Analyses of student survey data found that attending an ISHS raises the likelihood that a student will complete pre‐calculus or calculus and chemistry in high school, leads to increased involvement in STEM extracurricular and out‐of‐class activities, and enhances interest in science careers and aspirations to earn a master's or higher degree. Analyses of student outcome data from state administrative records revealed a positive impact of inclusive STEM high school attendance on grade point average (GPA) but not on ACT scores. © 2016 The Authors. Journal of Research in Science Teaching Published by Wiley Periodicals, Inc. J Res Sci Teach 53: 709–736, 2016

     

The assessment cycle: a model for learning through peer assessment

This paper advances a model describing how peer assessment supports self-assessment. Although prior research demonstrates that peer assessment promotes self-assessment, the connection between these two activities is underspecified. This model, the assessment cycle, draws from theories of self-assessment to elaborate how learning takes place through peer assessment. The model is applied to three activity structures described in the literature to analyse their potential to support learning by promoting self-assessment. Broadly speaking, the model can be used to understand learning that takes place in a variety of peer assessment activities: marking/grading, analysis, feedback, conferencing and revision. This approach contrasts most studies on peer assessment, which have focused on calibration of instructor and peer grades, rather than learning opportunities.     

形成性评价在英文报刊阅读教学中的实践探讨

英文报刊阅读课程主要针对学生的阅读、翻译和语言综合运用能力进行培养.形成性评价运用于英文报刊阅读课程中,可以通过跟踪学习过程有效整合语言知识技能目标、文化目标和人文素养目标三者的达成度评价,这样不仅能够弥补以书面考试为主的终结性评价方式的不足,而且也有利于充分激发和维持学生的英语学习热情,培养学生的自我评价能力,发挥学生学习的主观能动性,培养学生的思辨能力、自主学习能力、自我管理能力和自我约束能力,在获得成就感的同时增强学习英语的自信心.教学实践证明,在英文报刊阅读教学中采用教师观察、自评互评、学习档案、访谈等形成性评价手段,能够充分尊重学生个体差异和学习优势,提升学习效果.与此同时授课教师可以及时发现英文报刊阅读教学中存在的问题,及时改进教学,提升教学效果.