Prompting secondary students’ use of criteria,feedback specificity and feedback levels during an investigative task

This study investigates the effects of prompting on secondary students’ written peer feedback in chemistry investigation reports. In particular, we examined students’ feedback features in relation to the use of criteria, feedback specificity, and feedback levels. A quasi-experimental pre-test post-test design was adopted. Reviewers in the prompted condition were provided with question prompts that asked them to pose written feedback to their peers on what they did or did not do well and suggestions for improvement, while reviewers in the unprompted condition gave written peer feedback without prompts. The findings showed that prompted peer feedback has a significant effect on the number of comments related to Knowledge of errors, Suggestions for improvement and Process level feedback. This study supports the view that prompting peer feedback in the use of criteria, feedback specificity and feedback levels opens up opportunity for reviewers to engage more meaningfully with peer feedback in report writing tasks.     

Using feedback requests to actively involve assessees in peer assessment: effects on the assessor’s feedback content and assessee’s agreement with feedback

Criticizing the common approach of supporting peer assessment through providing assessors with an explication of assessment criteria, recent insights on peer assessment call for support focusing on assessees, who often assume a passive role of receivers of feedback. Feedback requests, which require assessees to formulate their specific needs for feedback, have therefore been put forward as an alternative to supporting peer assessment, even though there is little known about their exact impact on feedback. Operationalizing effective feedback as feedback that (1) elaborates on the evaluation and (2) to which the receiver is agreeable, the present study examines how these two variables are affected by feedback requests, compared to an explanation of assessment criteria in the form of a content checklist. Situated against the backdrop of a writing task for 125 first-year students in an educational studies program at university, the study uses a 2 × 2 factorial design that resulted in four conditions: a control, feedback request, content checklist, and combination condition. The results underline the importance of taking message length into account when studying the effects of support for peer assessment. Although feedback requests did not have an impact on the raw number of elaborations, the proportion of informative elaborations within feedback messages was significantly higher in conditions that used a feedback request. In other words, it appears that the feedback request stimulated students to write more focused messages. In comparison with feedback content, the use of a feedback request did, however, not have a significant effect on agreement with feedback.     

Investigating the impact of automated feedback on students’ scientific argumentation

ABSTRACT

This study investigates the role of automated scoring and feedback in supporting students’ construction of written scientific arguments while learning about factors that affect climate change in the classroom. The automated scoring and feedback technology was integrated into an online module. Students’ written scientific argumentation occurred when they responded to structured argumentation prompts. After submitting the open-ended responses, students received scores generated by a scoring engine and written feedback associated with the scores in real-time. Using the log data that recorded argumentation scores as well as argument submission and revisions activities, we answer three research questions. First, how students behaved after receiving the feedback; second, whether and how students’ revisions improved their argumentation scores; and third, did item difficulties shift with the availability of the automated feedback. Results showed that the majority of students (77%) made revisions after receiving the feedback, and students with higher initial scores were more likely to revise their responses. Students who revised had significantly higher final scores than those who did not, and each revision was associated with an average increase of 0.55 on the final scores. Analysis on item difficulty shifts showed that written scientific argumentation became easier after students used the automated feedback.     

Assessment training effects on student assessment skills and task performance in a technology-facilitated peer assessment

This study examines the impact of an assessment training module on student assessment skills and task performance in a technology-facilitated peer assessment. Seventy-eight undergraduate students participated in the study. The participants completed an assessment training exercise, prior to engaging in peer-assessment activities. During the training, students reviewed learning concepts, discussed marking criteria, graded example projects and compared their evaluations with the instructor’s evaluation. Data were collected in the form of initial and final versions of students’ projects, students’ scoring of example projects before and after the assessment training, and written feedback that students provided on peer projects. Results of data analysis indicate that the assessment training led to a significant decrease in the discrepancy between student ratings and instructor rating of example projects. In addition, the degree of student vs. instructor discrepancy was highly predictive of the quality of feedback that students provided to their peers and the effectiveness of revisions that they made to their own projects upon receiving peer feedback. Smaller discrepancies in ratings were associated with provision of higher quality peer feedback during peer assessment, as well as better revision of initial projects after peer assessment.     

Fostering oral presentation performance: does the quality of feedback differ when provided by the teacher,peers or peers guided by tutor?

Previous research revealed significant differences in the effectiveness of various feedback sources for encouraging students’ oral presentation performance. While former studies emphasised the superiority of teacher feedback, it remains unclear whether the quality of feedback actually differs between commonly used sources in higher education. Therefore, this study examines feedback processes conducted directly after 95 undergraduate students’ presentations in the following conditions: teacher feedback, peer feedback and peer feedback guided by tutor. All processes were videotaped and analysed using a coding scheme that included seven feedback quality criteria deduced from the literature. Results demonstrate that teacher feedback corresponds to the highest extent with the majority of the seven identified feedback quality criteria. For four criteria, peer feedback guided by tutor scores higher than peer feedback. Skills courses should incorporate strategies focused on discussing perceptions of feedback and practising providing feedback to increase the effectiveness of peer feedback.     

EFL写作中教师作文书面反馈研究——学生评估,教师自我评估,教师实际书面反馈与教师教学理念

鉴于目前国内关于EFL写作教师反馈的研究中,很少涉及教师对其反馈的自我评估的情况,系统研究了英语作为外语时,教师对作文反馈自我评估的内容、意义和作用。主要研究了以下内容:(1)教师的书面反馈中就整体和局部的反馈各占多少。(2)教师的自我评估和学生对教师书面反馈的评估的吻合程度。(3)教师对书面反馈的自我评估和教师的实际书面反馈的吻合程度。研究结果表明:教师书面反馈的重点仍然是文章的局部问题。教师的自我评估和学生对教师书面反馈的评估的吻合程度低,教师倾向高估所给出的反馈的量,反映出学生希望获得更多的教师书面反馈。而教师的自我评估和教师的实际书面反馈的吻合程度为66%,教师能比较准确地评估就作文局部所给出反馈的量,却倾向高估就作文整体所给出反馈的量。     

A case study of peer learning in higher aeronautical education

In order to improve student learning in an advanced course in aeronautics, lectures are replaced with more student-centred sessions based on peer learning. The course is organised in student teams, with the main task of delivering lecture requests for full class discussions. For the same reason, the written theory exam is replaced by a peer review of student reports. The new approach is found to result in a substantial increase of student–student and student–teacher interaction, leading to observable improvements in the course results. Finally, some feedback from the students is presented, being in great favour of the peer learning approach.     

Formative peer assessment in primary school: the effects of involving pupils in setting assessment criteria on their appraisal and feedback style

This experimental study is aimed at examining the effect of involving pupils in primary education in setting assessment criteria and standards on their appraisal of a peer’s work and their peer feedback style. It is expected that our intervention will lead to (1) a criteria-referenced appraisal and (2) more final vocabulary, which is associated with a more authoritative style. In total, 95 sixth grade pupils from The Netherlands were randomly assigned to one of two conditions. In the experimental group, the pupils first received an exemplar, which was followed by a group discussion about appropriate assessment criteria and standards. In the control group, the pupils provided peer feedback without this discussion. Their peer appraisal was measured with a questionnaire and feedback style was determined by analysing the written feedback using a person-oriented approach (cluster analysis). Results showed that the chance that pupils in the experimental group had an authoritative style was three times higher than in the control group. Theoretical and practical implications of the study are discussed.     

Dialogue within peer feedback processes: clarification and negotiation of meaning

Peer feedback carries a number of potential benefits to students, yet how they learn in the process remains under-researched. Building on ideas of feedback as dialogue, this study aims to unpack the respective perceptions of the provider and the receiver of peer feedback in relation to the benefits and challenges of dialogue about academic writing. Data were collected through classroom observations, interviews and journals at a university in southern China. Two key inter-related benefits emerge from the qualitative analysis of students’ perceptions of verbal interaction about written peer feedback. The provider of written comments obtains feedback on their feedback and the receiver has the opportunity to clarify or negotiate meaning with the feedback provider. Contextual challenges include students wanting more guidance about peer feedback and desiring more teacher input to the process. The study adds to the knowledge about the significance of peer dialogue in mutual clarification and negotiation between the provider and the recipient while emphasising ongoing teacher guidance in the process.     

Student perspectives on formative feedback as part of writing portfolios

Despite the crucial role that students play in formative assessment practices, student perspectives on such practices are relatively under-researched. Through a qualitative analysis of 128 reflection notes written by student teachers of English, this article investigates the students’ perceptions of formative feedback as part of portfolio assessment at two teacher education institutions in Norway. As such, it contributes to bridging the gap between research and practice. Students received peer and teacher feedback on assignments and wrote reflection notes during the semester. Findings show that students are positive towards teacher feedback and highlight the significance of teacher praise. Main objections raised against peer feedback concern the lack of constructive criticism. However, positive attitudes towards peer discussion groups suggest that they may be a more effective way of implementing peer assessment than formalised written peer commentary. Student reflections suggest that a failure to understand the task and the feedback is a possible hindrance to successfully revising assignments. Overall, students’ positive attitudes towards the portfolio process, which includes multiple drafting, suggest that students in higher education would benefit from more opportunities to revise and resubmit their work, yet they need adequate practice in providing peer feedback, and interpreting and implementing feedback in general.     

引导性问题如何影响高校项目化学习中的同伴反馈

同伴反馈作为形成性评价的重要形式,对高校学生的学习有着积极的影响,但在课堂教学实践中面临着种种挑战。引导性问题作为同伴反馈的支架,在支持并提升同伴反馈质量和学生课程学习上效果显著。本研究主要采用准实验法,以Z大学一门课程的46名本科生为研究对象,通过内容分析、对应分析、回归分析等方法,对不同方式、不同阶段撰写的引导性问题对同伴反馈的影响进行研究。研究发现学生更倾向于撰写评论型引导性问题,小组合作方式与期末阶段会产生更为丰富的引导性问题类型。不同类型的引导性问题能够对应引发不同类型的同伴反馈,且对同伴反馈质量与有效性产生显著影响。其中,分享型、头脑风暴型、改进型引导性问题能够引发更高质量且更有效的同伴反馈。     

Rubric‐referenced self‐assessment and middle school students’ writing

This study investigated the relationship between middle school students’ scores for a written assignment (N = 162) and a process that involved students in generating criteria and self‐assessing with a rubric. Gender, time spent writing, grade level, prior rubric use, and previous achievement in English were also examined. The treatment involved using a model essay to scaffold the process of generating a list of criteria for an effective essay, reviewing a written rubric, and using the rubric to self‐assess first drafts. The comparison condition involved generating a list of criteria and reviewing first drafts. Findings include a main effect of treatment, gender, grade level, writing time, and previous achievement on total essay scores, as well as main effects on scores for every criterion on the scoring rubric. The results suggested that reading a model, generating criteria, and using a rubric to self‐assess can help middle school students produce more effective writing.     

Peer assessment in university teaching: evaluating seven course designs

Peer assessment is understood to be an arrangement with students assessing the quality of their fellow students’ writings and giving feedback to each other. This multiple‐case study of seven designs of peer assessment focuses on the contribution of peer assessment to the acquisition of undergraduates’ writing skills. Its aim is to arrive at an optimal design of peer assessment. Factors included in this study are: the quality of peer assessment activities, the interaction between students in oral peer feedback, students’ learning outcomes, and their evaluation of peer assessment. Most students took assessing the work of their fellow students seriously, and included the peer feedback in the revision of their work. In most conversations, students provided feedback in an evaluative manner. In others, the interaction was more exploratory. For peer assessment, we recommend a combination of written and oral peer feedback.     

Peer review in the classroom: student perceptions,peer feedback quality and the role of assessment

Abstract

Peer review in the classroom can enhance numerous employability skills such as critical appraisal, writing skills, reflection practices and collaborative experiences. This study takes place over two years and discusses the implementation of a repeating blind peer review cycle across a single semester for final year chemistry students enrolled on a compulsory employability module. The feedback cycle promotes personal reflection through the use of mini-reflective questionnaires. The process was assessed by academic tutors at the resubmission stage and/or the peer feedback stage where the quality of peer feedback was directly assessed. The research investigates the quality of peer feedback, the importance of assessment and student perceptions of what is most useful. Methods include directed content analysis of feedback produced, student opinions and a focus group. Students were capable of offering useable feedback across a range of assessment criteria but tend to focus on the important criteria best aligned to the particular assignment. A range of motivational factors and tactics were noticed but students tended to find reviewing the most beneficial.     

Designing student peer assessment in higher education: analysis of written and oral peer feedback

The nature of written and oral peer feedback will be described as it occurred in seven writing courses, each with a different design of peer assessment. In all courses, peer feedback was focused on evaluation, which is one of the four feedback functions. Feedback on structure was hardly provided. Relating feedback to design features, we suggest that feedback is adequate when (1) peer assessment has a summative (on the basis of a writing product) as well as a formative character (during the writing process); (2) the assessment is performed in small feedback groups; (3) the written feedback is orally explained and discussed with the receiver.     

句酷批改网英语作文评分的信度和效度研究

作文批改与反馈是英语写作教学的一个重要环节,对提高学生的写作能力有着不可低估的作用,句酷批改网以其优势而深受广大师生的喜爱。句酷批改网的作文评分有很高的信度,但评分显著地高于教师的评分,尚不能反映学生英语作文的真实水平。从效度上看,以句子为单位,在词汇和语法等方面进行详细的评价,但在篇章结构、文体修辞、内容逻辑性和连贯性方面不能给学生充分的反馈。在运用批改网的同时,我们还要同其他的评估方式结合起来。     

Peer Assessment Training in Teacher Education: Effects on performance and perceptions

The implementation of peer assessment receives much attention in teacher education. This paper reports the effects of peer assessment training on the performance of student teachers. Ninety-three student teachers were randomly assigned to control groups and experimental groups. The experimental groups were trained in defining performance criteria, giving feedback and writing assessment reports. This was done through peer assessment tasks that were embedded in a redesigned course. Analyses of data derived from peer assessment reports written by the students showed that the experimental groups surpassed the control groups in the quality of the assessment skill. As a result of the training, students from the experimental groups also scored significantly higher grades for the end products of the course than students from the control groups. The results of the questionnaire showed that all students were significantly more satisfied with the redesigned course.     

Gifted children with written output difficulties: Paradox or paradigm

Abstract

This study was designed to ascertain the prevalence of written output deficits in young gifted children, to delineate the relationship between written output performance and reading performance, and to identify possible mechanisms for specific written output deficits in such children. Data from a sample of children scoring >120 on at least one IQ or achievement subscale indicated: (1) that there was a significant incidence of discrepancies between written spelling scores and reading (decoding) scores, as compared to the population; (2) that performance on spelling tasks was more subject to a maturational timetable than decoding was; (3) that performance on spelling tasks is less amenable than performance on decoding tasks to compensatory enhancement by higher level processing, and involves a sequential processing module that is shared with calculation but not with decoding; and (4) that strengths in visual‐spatial tasks may interact with relative weaknesses in both decoding and calculation tasks to predict even poorer performance on written spelling tasks.