Exploring formative assessment as a tool for learning: students’ experiences of different methods of formative assessment

This study aims to provide a greater insight into how formative assessments are experienced and understood by students. Two different formative assessment methods, an individual, written assessment and an oral group assessment, were components of a pathology course within a medical curriculum. In a cohort of 70 students, written accounts were collected from 17 students and group interviews were carried out to explore the students’ experiences of these two forms of assessment. All students were engaged in both assessment methods, which were conducted a few weeks apart, and data were collected soon after each assessment. Our findings suggest that formative assessments motivate students to study, make them aware of what they have learned and where they need to study more. Thus, formative assessment can act as a tool for learning, contributing to the process and outcomes of learning. A closer look at students’ experiences of each form of assessment reveals interesting differences.     

Is peer review an appropriate form of assessment in a MOOC? Student participation and performance in formative peer review

Many aspects of higher education must be reconceptualised for massive open online courses (MOOCs). Formative and summative assessment of qualitative work in particular requires novel approaches to cope with the numbers involved. Peer review has been proposed as one solution, and has been widely adopted by major MOOC providers, but there is currently little evidence about whether it is appropriate or under what conditions. Here, we examine student participation, performance and opinions of a peer review task in a biomedical science MOOC. We evaluate data from approximately 200 student topic summaries and 300 qualitative peer reviews of those summaries, and compare these to student demographic data (gender, age, employment status, education, national language) and to performance in multiple choice tests. We show that higher performance in the written topic summary correlated with both higher participation in the peer review task and with writing higher quality peer reviews. Qualitative analysis of student comments revealed that student opinion on the usefulness of the peer review task was mixed: some strongly believed it benefitted their learning, while others did not find it useful or did not participate. We suggest instructional design strategies to improve student participation and increase learning gain from peer review in the MOOC context.     

First-year students’ appraisal of assessment tasks: implications for efficacy,engagement and performance

This study investigated students’ appraisals of assessment tasks and the impact of this on both their task-related efficacy and engagement and subsequent task performance. Two hundred and fifty-seven first-year students rated their experience of an assessment task (essay, oral presentation, laboratory report or exam) that they had previously completed. First-year students evaluated these assessment tasks in terms of two general factors: the motivational value of the task and its manageability. Students’ evaluations were consistent across a range of characteristics and level of academic achievement. Students’ evaluations of motivational value generally predict their engagement and their evaluations of task manageability generally predict their sense of task efficacy. Engagement was a significant predictor of task performance (viz. actual mark) for exam and laboratory report tasks but not for essay-based tasks. Findings are discussed in terms of the implications for assessment design and management.     

The validity and students’ experiences of peer assessment in a large introductory class of gene technology

Although studies have examined the validity of peer assessment, research including students’ own experiences of peer assessment is scarce. The present study aims to improve assessment practices in a context with a highly traditional assessment culture. The aim is first to examine the validity of peer assessment by analysing the compatibility of student and teacher evaluation and explore the differences between minor and major students’ evaluations. Second, the study examines students’ experiences of peer assessment. Peer assessment was implemented in a large bioscience course with 79 student participants. After the peer assessment, the students provided feedback. The results indicate that student subject understanding can be supported through a proper assessment practice. Peer assessment was successful in an introductory class with minor and major students, and most students experienced it as supportive of their learning.     

Reciprocal peer coaching and its use as a formative assessment strategy for first‐year students

Co‐operative learning is underused as a teaching and learning strategy in higher education and yet is ideal for courses that require students to learn skills that require manual dexterity, knowledge and clinical reasoning – key elements of professional and clinical competence. Reciprocal peer coaching (RPC) is a form of co‐operative or peer‐assisted learning that encourages individual students in small groups to coach each other in turn so that the outcome of the process is a more rounded understanding and a more skilful execution of the task in hand than if the student was learning in isolation. Used as a formative assessment strategy, RPC has the capacity to increase motivation in students due to the nature of the shared interdependent goal, and to provide immediate feedback to students on completion of the assessment. The purpose of this research was to interview a group of first‐year students to elicit their perceptions of the RPC process. The data were analysed from a phenomenological perspective and revealed three themes: motivating learning, learning in groups and the context of learning. The findings were subsequently explored in relation to the concept of self‐regulation of learning and the benefits which RPC as a formative assessment strategy has in promoting students’ self‐regulation.     

The impact of formative peer feedback on higher education students’ academic writing: a Meta-Analysis

Peer feedback is frequently implemented with academic writing tasks in higher education. However, a quantitative synthesis is still lacking for the impact that peer feedback has on students’ writing performance. The current study conveyed two types of observations. First, regarding the impact of peer feedback on writing performance, this study synthesized the results of 24 quantitative studies reporting on higher education students’ academic writing performance after peer feedback. Engagement in peer feedback resulted in larger writing improvements compared to (no-feedback) controls (g?=?0.91 [0.41, 1.42]) and compared to self-assessment (g?=?0.33 [0.01, 0.64]). Peer feedback and teacher feedback resulted in similar writing improvements (g?=?0.46 [-0.44, 1.36]). The nature of the peer feedback significantly moderated the impact that peer feedback had on students’ writing improvement, whereas only a theoretically plausible, though non-significant moderating pattern was found for the number of peers that students engaged with. Second, this study shows that the number of well-controlled studies into the effects of peer feedback on writing is still low, indicating the need for more quantitative, methodologically sound research in this field. Findings and implications are discussed both for higher education teaching practice and future research approaches and directions.     

Teachers’ practices in science learning environments and their use of formative and summative assessment tasks

This study was aimed at detecting the most frequently-used teaching and assessment activities in secondary school science classes, identifying links between these variables, and revealing possible challenges in these processes. To this end, data were gathered from 155 secondary school science teachers in 56 Israeli public schools and 380 grade eight and nine students from 22 of these using the What Is Happening In this Class? Teachers were also asked to indicate their perceptions of the extent to which they used formative assessment tasks provided by the curriculum and to specify, in their own words, the reason for insufficient usage of these tasks. Task orientation was highly used in science classes, whereas investigation was the least employed activity, according to both teachers’ and students’ perceptions. The most-frequently used tasks to evaluate students were final tests and quizzes. Path model analysis revealed that teachers who tended to use teacher-based approaches also employed traditional assessment tools, whereas teachers who allowed students to cooperate rather than compete with one another tended to use formative assessment tools. Implications limitations, and directions for future research are discussed.     

Global learning partnerships in the Café: peer feedback as a formative assessment tool for animation students

This paper reports on a global learning partnership using the Café: the collaborative application for education as an e-learning environment within the Facebook framework, for first-year animation students at the University of South Australia (USA) in Australia and Nanyang Technological University in Singapore. “The Café” has been designed based on five principles of user interface design – visibility, usability, relevance, accessibility, and interactivity – and aims to provide institutions with an established, structured, and dedicated e-learning environment that meets the needs of modern-day tertiary students and teaching staff. From July to November in 2013, 71 students participated within the e-learning environment. Students submitted work-in-progress imagery related to major assignments, and provided feedback and critiques to their local and global peers. A post-semester survey provided students with the opportunity to critically reflect on the learning experience. The results are discussed in light of the use of peer feedback as a formative assessment tool.     

The impact of criteria-referenced formative assessment on fifth-grade students’ theater arts achievement

The purpose of this study was to examine the effects of criteria-referenced formative assessment (CRFA) on students’ achievement in theater arts. The role of type of task in differentiating the treatment-achievement relationship was explored. The analytical sample included 520 fifth-grade students from 13 schools in New York City. Schools were randomly assigned to the treatment or control group. Selection bias in treatment assignment at student level was adjusted with propensity score analysis. CRFA had a positive effect on students’ achievement on performance tasks (d = 0.25), but no significant effect on students’ performance on the analytical constructed response tasks or the theater vocabulary multiple-choice items.     

The role of self-, peer and teacher assessment in promoting Iranian EFL learners’ writing performance

In the last decade, with the increased attention to learner-centred curricula, the topic of self-assessment and peer assessment has become of particular interest in testing and evaluation. The present study explores the role of self-assessment, and peer assessment in promoting writing performance of language learners. To do this, 157 intermediate TEFL (Teaching English as Foreign Language) students were assigned to five different treatments in five groups: four experimental groups and one control group. The first experimental group did journal writing as a self-assessment technique, the second group self-assessed their own writings, the third group employed peer assessment, and the fourth group had both self- and peer assessment. Moreover, there was teacher assessment in all experimental groups, except the fourth group, i.e., the self- and peer assessment group. In the control group, there was only teacher assessment. Also, at the beginning and end of the semester, all participants took a writing test. The design of the study was quasi-experimental, non-randomised control group, pre-test–post-test design. The results revealed that in the second and third groups, in which the students employed self-assessment and peer assessment, together with teacher assessment, we observed the maximum improvement in writing.     

Predicting pre-service teachers’ intention of implementing peer assessment for low-achieving students

Despite the benefits of peer assessment, many teachers are not willing to implement it, particularly for low-achieving students. This study used the theory of planned behaviour to predict pre-service teachers’ intention to use peer assessment for low-achieving students. A total of 229 pre-service teachers in Singapore participated in the survey which consists of eight factors about peer assessment in writing: belief of knowledge source, belief of ability, belief of constructivist assessment, attitude, subjective norm, perceived behaviour control, behavioural intention, and intention for low-achieving students. Structural equation modelling was used to test hypothesized relationships of the eight factors. This study found that pre-service teachers’ beliefs about knowledge source and constructivist assessment significantly influenced their attitude towards peer assessment of writing. In addition, the attitude and perceived behaviour control were significant factors in shaping the intention of peer assessment. Lastly, pre-service teachers’ intention of implementing peer assessment for low-achieving students was influenced by both the intention of peer assessment and the belief of ability.     

A case study of a formative assessment practice and the effects on students’ self-regulated learning

The study investigates one mathematics teacher’s implementation of formative assessment and its effects on students’ self-regulated learning (SRL). A questionnaire administered before and after the eight-month long intervention shows a significant effect, compared to two control classes, on students’ motivational beliefs involved in SRL. Qualitative data shows a notable enhancement of the students’ SRL behavior in the classroom. Analysis of the teacher’s implemented formative assessment shows a practice integrating several aspects of formative assessment, and provides empirical evidence of what formative assessment with large effects on students’ SRL may look like and how it fits with models of SRL development.     

Preservice teachers’ implementation of formative assessment in English writing class: Mentoring matters

This multiple-case study investigated the experience of three preservice teachers who attempted formative assessment (FA) strategies in their English as a second language writing class during their teaching practicum in a secondary school in Hong Kong. Based on data from 17 lesson observations and 24 interviews, the study examined the three teachers’ implementation of FA strategies during cycles of pre-, while- and post-writing stages. Also analyzed are the teachers’ reflections on and their mentors’ and students’ evaluation of their FA implementation. The study found the teachers could translate their understanding of FA principles into teaching and assessment strategies appropriately, but the school’s accountability culture worked against their innovation. School mentors’ open-mindedness and support to their FA attempts were found to be crucial. The findings are discussed centering on key issues in the relational, developmental and contextual dimensions of the teaching practicum and their impact on preservice teachers’ practice and attitude.     

Does students’ heritage matter in their performance on and perceptions of historical reasoning tasks?

This mixed methods study explores how high school students (N = 35) enrolled in a US charter school with a high Latino/a population perform on and perceive (in terms of interest and relevance) document-based type historical reasoning tasks: one about the Dust Bowl in the 1930s and the other about the experiences of Mexicans and Mexican Americans in the 1920s. Students wrote essay responses and completed perception inventories about the tasks. We also interviewed 10 focal students to delve more deeply into students’ thinking regarding the tasks and their interest levels in the two topics. We scored students’ responses along the criteria of historical claims, substantiation of claims, use of evidence from documents, sourcing of documents and contextualization. Our hypotheses were that students would perform better on, and be more interested in, tasks that were culturally relevant to them. We found that although students did not perform differently on the two tasks overall, students’ perceptions of the tasks differed, with a significantly greater interest in the task about Mexicans and Mexican Americans. We address the complexity of these findings and discuss implications for curriculum and practise.     

Exploring students’ emotional responses and participation in an online peer assessment activity: a case study

The STACI^N Project is a development, implementation, and research effort that examines the impact of systems thinking, simulation, and modeling in precollege curricula on student learning, classroom processes, and organizational change. Nearly 100 teachers have been trained to use systems thinking in their secondary school curricula. This article examines how systems thinking affects teachers and classroom processes. A two‐dimensional matrix is presented to characterize the modes of adaptation employed by the teachers as they use modeling and simulation in their courses. The dimensions include teacher proficiency with technology and the specific systems applications observed in classes. A discussion of issues related to the use of systems in precollege instruction also is included.     

Anonymity as an instructional scaffold in peer assessment: its effects on peer feedback quality and evolution in students’ perceptions about peer assessment skills

Although previous research has indicated that providing anonymity is an effective way to create a safe peer assessment setting, continuously ensuring anonymity prevents students from experiencing genuine two-way interactive feedback dialogues. The present study investigated how installing a transitional approach from an anonymous to a non-anonymous peer assessment setting can overcome this problem. A total of 46 bachelor’s degree students in Educational Studies participated in multiple peer assessment cycles in which groups of students assessed each other’s work. Both students’ evolution in peer feedback quality as well as their perceptions were measured. The content analysis of the peer feedback messages revealed that the quality of peer feedback increased in the anonymous phase, and that over time, the feedback in the consecutive non-anonymous sessions was of similar quality. The results also indicate that the transitional approach does not hinder the perceived growth in peer feedback skills, nor does it have a negative impact on their general conceptions towards peer assessment. Furthermore, students clearly differentiated between their attributed importance of anonymity and their view on the usefulness of a transitional approach. The findings suggest that anonymity can be a valuable scaffold to ease students’ importance level towards anonymity and their associated need for practice.     

The development of a content analysis model for assessing students’ cognitive learning in asynchronous online discussions

The purpose of this study was to develop and validate a content analysis model for assessing students’ cognitive learning in asynchronous online discussions. It adopted a fully mixed methods design, in which qualitative and quantitative methods were employed sequentially for data analysis and interpretation. Specifically, the design was a “sequential exploratory” (QUAL → quan) design with priority given to qualitative data and methods. Qualitative data were 800 online postings collected in two online courses. Quantitative data were 803 online postings from the same two courses but from different discussion topics and different weeks. During the qualitative process, a grounded theory approach was adopted to construct a content analysis model based on qualitative data. During the quantitative process, χ² tests and confirmative factor analysis (CFA) which used online postings as cases or observations and was the first of its kind were performed to test if the new model fit the quantitative data.     

A Study in Self‐assessment: tutor and students’ perceptions of performance criteria

This paper reports a study which implemented and evaluated a method of student self‐assessment. The theme of the importance of marking criteria (Orsmond et al., 1996) is developed. Pairs of first‐year undergraduate biology students were asked to complete a poster assignment on a specific aspect of nerve physiology. The study was designed to allow the evaluation of (1) student self and tutor marking for individual marking criteria; and (2) student vs student marking of their poster work for individual marking criteria. A comparison between the tutor and the student self‐assessed mark reveals how important it is to consider the individual marking criteria rather than the overall mark. These results support our findings on peer assessment reported earlier (Orsmond et al., 1996). The results also illustrate the potential pitfalls that exist when making assumptions about the degree of student/student interaction and students’ marking ability. This study supports previous work which showed that self‐assessment is extremely useful in helping students reach their learning goals, i.e. it is a strong formative educational tool and can be used in order to bring about behavioural changes in students with regard to their own learning processes.