Designing and implementing peer formative feedback within online learning environments

With increasing need to achieve appropriate balance between learning support and self-regulation within the context of online learning, formative feedback has been identified as a viable means to achieve meaningful engagement. Specifically, this study sought to establish how peer–peer formative feedback was facilitated in an online course and to what extent this engaged students in meaningful learning experiences. This case study entailed an in-depth investigation into the design and implementation of an online course in a New Zealand university. The studied course was part of a postgraduate programme in continuing (in-service) teacher education. The study adopted a case study methodology with a bias on qualitative techniques. Online observations, analysis of the archived course discourse and interviews were utilised as sources of data. The data from multiple sources were subsequently triangulated to corroborate the evidence. The findings indicate that peer formative feedback promoted active learners’ participation and meaningful engagement. The findings further showed that opportunities for dialogic peer formative feedback promoted learning support and self-regulation.     

Assisting learning in e-assessment: a closer look at educational supports

This study analyses the educational support offered through information and communication technology during formative assessment in two different cases in higher education. We analysed one blended and one virtual case from two different universities. The study aimed at identifying specific patterns of educational support intended to foster two interaction processes: (1) the promotion of greater autonomy in the students and (2) the construction of more appropriate meanings by them. The analysis showed that these two processes were achieved with different attainment levels in each of the two study cases. Specific patterns of support mediated by technology were found underlying these different results. This led us to identify ‘suitable’ and ‘undesirable’ patterns of support in e-assessment practices.     

Feedback as dialogue: exploring the links between formative assessment and social software in distance learning

The paper explores the relationship between formative assessment and social software. Formative assessment practices though beneficial for student learning become marginalised and constrained in open and distance learning environments in higher education. Feedback is a key factor in formative assessment and learners can benefit from the deployment of emerging technologies and the opportunities for participation and dialogue afforded by social software. This paper explores and proposes a conceptual framework for this relationship. The claim is that the social dimensions of emerging technologies – specifically, blogs and wikis – allow for formative assessment practices to be re‐invented or at the very least facilitated by essentially participative and student‐focussed interventions. A comparison of these technologies against formative assessment mechanisms identifies the types of processes that these new tools might best support to encourage effective feedback approaches that both empower the learner and enhance their learning experience.     

Using formative assessment to promote argumentation in a university bilingual science course

Formative assessment, bilingualism, and argumentation when combined can enrich bilingual scientific literacy. However, argumentation receives little attention in the practice of bilingual science education. This article describes the effect of a formative assessment-based pedagogical strategy in promoting university students’ argumentation. It examines the written and oral arguments produced by 54 undergraduates (28 females and 26 males, 16–21 years old) in Colombia during a university bilingual (Spanish-English) science course. The data used in this analysis was derived from students’ written responses, and audio and video recordings. The first goal of this study was to determine how this teaching strategy could help students increase the use of English as a means of communication in argumentation in science. The second goal was to establish the potential of the strategy to engage students in argumentative classroom interactions as an essential part of formative assessment. The findings show that the strategy provided participants with opportunities to write their argumentation in Spanish, in English and in a hybrid version using code-switching. Educational implications for higher education are discussed.     

Comparing student learning experiences of in-text commentary and rubric-articulated feedback: strategies for formative assessment

This study compares students’ experiences of two types of criteria-based assessment: in-text commentary and rubric-articulated feedback, in an assessment design combining the two feedback channels. The main aim is to use students’ responses to shed light on how feedback strategies for formative assessment can be optimised. Following action research methodology, the study discusses key categories of student responses from three sources: reflective texts, a questionnaire, and interviews. Results show that different functions were attributed to the two feedback channels: in-text commentary to lower-order concerns related to language proficiency, and rubric-articulated feedback to higher-order concerns related to an overview of writing achievement. We argue that the different functions have the potential of creating a sufficiently balanced assessment design with the possibility of serving both short-term and continuous learning goals. On the other hand, some students found it difficult to navigate between the two feedback channels. The article therefore ends with a ‘lessons learned’ section where we list possible ways in which the current assessment design can be improved for optimal use of the synergy effects emanating from a combination of in-text commentary and rubric-articulated feedback for formative purposes.     

Assisting transition to university: using assessment as a formative learning tool

This study explores the effectiveness of an intervention involving formative assessment in a first‐year core business subject. Students were invited to receive feedback on a draft of their first written assessment during the early weeks of the semester. Consideration is given to the economic and ethical issues raised by the intervention. A multi‐method approach of qualitative and quantitative data collection and analysis is used. The research finds that the intervention facilitates significantly higher marks in assessments and grades, while assisting student learning overall. Findings are reinforced by comparison with a subject where the intervention was not offered.     

The impact of an alternative professional development model on teacher practices in formative assessment and student learning

Among contemporary means of enhancing student learning, formative assessment is perhaps one of the most important and effective. While formative assessment ideas and practices have been shown to have a proven record enhancing student learning, these practices are slow to be fully integrated into teachers’ day-to-day classroom practices. This study describes a collaborative effort among university faculty and public school partners to train teachers in the skills and practices of formative assessment. Regarding teachers’ involvement in the formative assessment professional development, findings highlight that 1) teachers’ participation in the professional development efforts did strengthen their understanding of both general knowledge of formative assessment and the use of formative assessment practices, 2) teachers’ plans to use the strategies in the future were related to their understanding of these strategies, and 3) in-depth and comprehensive understanding of formative assessment practices were critical to concrete applications of such practices in their classrooms. With respect to the impact on student learning, an overall effect size of .41 was found for teachers who utilized a formative assessment strategy compared with district averages for similar learning objectives when the practices were not used.     

The quality of peer assessment in a wiki-based online context: a qualitative study

Peer assessment (PA) provides opportunities for authentic assessment, autonomy and collaboration. Several authors advocate that students can benefit from PA and put forward the effects of PA on the students’ learning outcomes. Questions concerning the validity and reliability of PA and PA competences are also addressed by different researchers. This qualitative study is part of a wider project that seeks to develop and test evaluation and assessment strategies in online contexts. In a doctoral module, PA was used for summative and formative purposes. Formative PA aimed to give feedback about the ongoing group work, but also to increase online interaction between the different groups of students. The main module task was to write a literature review, about a selected topic, using a wiki. Criteria and indicators to assess the literature review were negotiated with the students. Different criteria were used to assess the quality of PA, such as, the use of the negotiated criteria, the adequacy of the chosen vocabulary or the provision of constructive feedback. The results show that overall the quality of PA can be improved. Groups did not provide sufficient criticism, questions and suggestions for improvement.     

The missing disciplinary substance of formative assessment

We raise concerns about the current state of research and development in formative assessment, specifically to argue that in its concentration on strategies for the teacher, the literature overlooks the disciplinary substance of what teachers and students assess. Our argument requires analysis of specific instances in the literature, and so we have selected four prominent publications for consideration as examples. These, we show, pay little attention to the student reasoning they depict, presume traditional notions of “content” as correct information, and treat assessment as distinct from other activities of learning and teaching, even when they claim the contrary. We then offer an alternative image of formative assessment centered on attention to disciplinary substance, which we illustrate with an example from a high school biology class. Assessment, we contend, should be understood and presented as genuine engagement with ideas, continuous with the disciplinary practices science teaching should be working to cultivate. © 2011 Wiley Periodicals, Inc. J Res Sci Teach 48: 1109–1136, 2011     

Linking a learning progression for natural selection to teachers' enactment of formative assessment

Learning progressions, or representations of how student ideas develop in a domain, hold promise as tools to support teachers' formative assessment practices. The ideas represented in a learning progression might help teachers to identify and make inferences about evidence collected of student thinking, necessary precursors to modifying instruction to help students advance in their learning. The study reported in this article took the novel approach of using a learning progression for natural selection to support teachers' enactment of formative assessment. Sources of data include interviews and videotapes of six high school biology teachers leading assessment conversations around the same formative assessment questions. Results indicate that while teachers picked out and made inferences about student ideas related to the learning progression during assessment conversations, they did not use all parts of the learning progression in the same way. Furthermore, several of the teachers seemed to use the learning progressions simply as catalogs of misconceptions to be “squashed” rather than drawing upon the developmental affordances offered by a learning progression. Results are framed in terms of the utility of learning progressions as supports for classroom practice. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 1181–1210, 2012     

加强形成性评价 提高英语学习成效——探索提高英语B级测试成绩的途径

形成性评价是以学生为中心、注重能力培养的一种教学方式。在高职英语教学中,通过实施对学生课堂学习行为、课堂活动参与及作业的评价,建立学生学习档案,实行以评价学习过程为主的评价标准,能有效地提高学生英语B级测试成绩,极大地调动学生学习的积极性。     

Peer assessment as a learning tool for enhancing student teachers' preparation

This study investigates how peer assessment contributes to enhancing student teachers' preparation during field experience. A semi-structured interview was conducted with 72 student teachers. The findings showed that the student teachers have positive beliefs about peer assessment. They think that it can be beneficial if some changes are made in the way it is employed in teacher education programs. In light of the study findings, the researchers put forth a number of suggestions and recommendations for employing peer assessment in teacher education programs in Jordan.     

Incorporating formative assessment in Iranian EFL writing: a case study

Undergraduate students' experience of assessment in universities is usually of summative assessment which provides only limited information to help students improve their performance. By contrast, formative assessment is informative and forward-looking, possessing the leverage to inform students of their day-to-day progress and inform teachers of how to better tailor their instruction to students' immediate learning needs. Despite these potentials, studies carried out on the use of formative assessment in English as a foreign language (EFL) contexts are somehow rare. The current study reports on incorporating formative assessment in an L2 writing course in Iran. The analysis of data from pre- and post-study writing tasks, pre- and post-study questionnaires, and semi-structured interviews revealed that first-year undergraduate students were offered opportunities to improve various aspects of their writing and to develop positive attitudes toward writing as well as formative assessment. However, the students reported several challenges that could have implications for the further implementation of formative assessment in similar contexts.     

Student perspectives on formative feedback as part of writing portfolios

Despite the crucial role that students play in formative assessment practices, student perspectives on such practices are relatively under-researched. Through a qualitative analysis of 128 reflection notes written by student teachers of English, this article investigates the students’ perceptions of formative feedback as part of portfolio assessment at two teacher education institutions in Norway. As such, it contributes to bridging the gap between research and practice. Students received peer and teacher feedback on assignments and wrote reflection notes during the semester. Findings show that students are positive towards teacher feedback and highlight the significance of teacher praise. Main objections raised against peer feedback concern the lack of constructive criticism. However, positive attitudes towards peer discussion groups suggest that they may be a more effective way of implementing peer assessment than formalised written peer commentary. Student reflections suggest that a failure to understand the task and the feedback is a possible hindrance to successfully revising assignments. Overall, students’ positive attitudes towards the portfolio process, which includes multiple drafting, suggest that students in higher education would benefit from more opportunities to revise and resubmit their work, yet they need adequate practice in providing peer feedback, and interpreting and implementing feedback in general.     

Investigating the dynamics of formative assessment: relationships between teacher knowledge,assessment practice and learning

This exploratory study of elementary school science examines questions central to policy, practice and research on formative assessment: What is the quality of teachers’ content-pedagogical and assessment knowledge? What is the relationship between teacher knowledge and assessment practice? What is the relationship between teacher knowledge, assessment practice and student learning? Drawing on multiple measures, hierarchical linear modelling and path analysis, results suggest that despite weaknesses in teachers’ content-pedagogical and assessment knowledge, teachers’ formative assessment practices are positively related to student learning. Relationships between teachers’ knowledge and assessment practices are mixed. Findings underscore both the potential and challenge of bringing effective formative practice to fruition as well as the need for continued research.     

Developing classroom formative assessment in dutch primary mathematics education

In the last two decades Dutch primary school students scored below expectation in international mathematics tests. An explanation for this may be that teachers fail to adequately assess their students’ understanding of learning goals and provide timely feedback. To improve the teachers’ formative assessment practice, researchers, curriculum experts and teachers worked together to develop a model for classroom formative assessment (CFA). In three pilot studies, six teachers from three different schools implemented the CFA-model and evaluated its feasibility together with the researchers by means of checklists. The CFA-model was primarily changed with regard to the assessment techniques. Teachers indicated that classroom management and preparation time were preconditions for an optimal implementation. Analysis of covariance was used to explore students’ learning outcomes. The results showed that a correct implementation of the CFA-model might result in the enhancement of students’ mathematical performance. The implications of the three pilots for the implementation of the CFA-model on a larger scale are discussed.     

开放教育课程形成性考核现存问题与对策

形成性考核是现代远程开放教育教学质量保证体系的重要组成部分,是强化素质教育,加强教学过程管理,改进课程考试方式方法的重要措施。本文针对形成性考核实施过程中存在的诸如思想认识、考核设计和组织管理等方面的问题提出了相应对策,以利于更科学、有效地推进此项工作。     

A case study of using peer feedback in face-to-face and distance learning classes among pre-service teachers

This study investigated a feedback exchange activity for engaging pre-service teachers and the nature of such feedback in two undergraduate classes, a distance learning (DL) and a face-to-face (F2F) class. The research question asked if the nature of peer feedback was different between F2F and DL class formats. Students’ work samples were collected during class time to examine feedback function ratings. Participants also completed an online questionnaire to examine the nature of expectations of the feedback given. For both the nature of expectations and feedback function ratings, results for chi-square analyses demonstrated no statistically significant difference between the two modes of instruction (F2F versus DL), and the peer feedback categories. However, provision of feedback was significantly favoured in the F2F class over the DL class. Implications for course curriculum and future research are discussed.     

Classroom action research on formative assessment in a context-based chemistry course

Context-based science courses stimulate students to reconstruct the information presented by connecting to their prior knowledge and experiences. However, students need support. Formative assessments inform both teacher and students about students’ knowledge deficiencies and misconceptions and how students can be supported. Research on formative assessments suggests a positive impact on students’ science achievement, although its success depends on how the formative assessment is implemented in class. The aim of this study was to provide insights into the effects of formative assessments on achievement during a context-based chemistry course on lactic acid. In a classroom action research setting, a pre-test/post-test control group design with switching replications was applied. Student achievement was measured in two pre-tests, two post-tests and a retention test. Participants were Grade 9 students from one secondary school in the Netherlands. Repeated-measures analysis showed a significant effect of formative assessments on students’ achievement. During the implementation of the formative assessments, intriguing discussions emerged between students, between students and teacher, and between teachers. Adding formative assessments to context-based approaches reinforces their strength to meet with the current challenges of chemistry education. Formative assessments affect students’ achievement positively and stimulate feedback between students and teacher(s).     

Informal formative assessment: The role of instructional dialogues in assessing students’ learning

This paper focuses on an unceremonious type of formative assessment - informal formative assessment - in which much of what teachers and students do in the classroom can be described as potential assessments that can provide evidence about the students’ level of understanding. More specifically, the paper focuses on assessment conversations, or dialogic interactions or exchanges, which continuously happen in the classroom and that are at the center of informal formative assessment. It is argued that assessment conversations make students’ thinking explicit in an unobtrusive manner, and when students’ thinking is explicit, it can be examined, questioned, and shaped as an active object of constructive learning. The paper conceptualizes informal formative assessment at the center of effective instructional activities with the use of instructional dialogues as assessment conversations, a typical informal formative assessment practice. The paper then presents a discussion about the evidence on the effect of assessment conversations on student learning.