Exploring formative assessment as a tool for learning: students’ experiences of different methods of formative assessment

This study aims to provide a greater insight into how formative assessments are experienced and understood by students. Two different formative assessment methods, an individual, written assessment and an oral group assessment, were components of a pathology course within a medical curriculum. In a cohort of 70 students, written accounts were collected from 17 students and group interviews were carried out to explore the students’ experiences of these two forms of assessment. All students were engaged in both assessment methods, which were conducted a few weeks apart, and data were collected soon after each assessment. Our findings suggest that formative assessments motivate students to study, make them aware of what they have learned and where they need to study more. Thus, formative assessment can act as a tool for learning, contributing to the process and outcomes of learning. A closer look at students’ experiences of each form of assessment reveals interesting differences.     

The role of social-academic goals in Chinese students’ self-regulated learning

European Journal of Psychology of Education - The role of mastery and performance goals in self-regulated learning (SRL) has received much attention. However, in collectivist and Confucian-heritage...     

The effects of self-regulated learning training on community college students’ metacognition and achievement in developmental math courses

The effects of training in self-regulation on metacognition and math achievement were investigated. The participants were 116 community college students enrolled in developmental math courses. Students enrolled in 16 classrooms were randomly assigned to the treatment and control groups. Participants in the treatment group completed four self-regulated learning (SRL) exercises based on Zimmerman’s (2002) cyclical model. The exercises were completed weekly and repeated for a total of 3 weeks. During the last week of class, participants completed a final exam to measure math achievement as well as the metacognitive self-regulation and time/study environment management scales on the Motivated Strategies for Learning Questionnaire ([MSLQ], Pintrich, Smith, Garcia, & McKeachie, 1991). There were significant differences between the two groups, indicating that training in SRL improved math achievement and metacognitive skills assessed on both MSLQ scales. The findings suggested that training in SRL improves math achievement, metacognitive self-regulation and time/study environmental management skills of students enrolled in developmental math courses.     

Process mining techniques for analysing patterns and strategies in students’ self-regulated learning

Referring to current research on self-regulated learning, we analyse individual regulation in terms of a set of specific sequences of regulatory activities. Successful students perform regulatory activities such as analysing, planning, monitoring and evaluating cognitive and motivational aspects during learning not only with a higher frequency than less successful learners, but also in a different order—or so we hypothesize. Whereas most research has concentrated on frequency analysis, so far, little is known about how students’ regulatory activities unfold over time. Thus, the aim of our approach is to also analyse the temporal order of spontaneous individual regulation activities. In this paper, we demonstrate how various methods developed in process mining research can be applied to identify process patterns in self-regulated learning events as captured in verbal protocols. We also show how theoretical SRL process models can be tested with process mining methods. Thinking aloud data from a study with 38 participants learning in a self-regulated manner from a hypermedia are used to illustrate the methodological points.     

What can moment-by-moment learning curves tell about students’ self-regulated learning?

Many students in primary education learn arithmetic using adaptive learning technologies (ALTs) on tablets every day. Driven by developments in the emerging field of learning analytics, these technologies adjust problems based on learners' performance. Yet, until now it is largely unclear how students regulate their learning with ALTs. Hence, we explored how learners regulate their effort, accuracy and learning with an ALT using moment-by-moment learning curves. The results indicated that moment-by-moment learning curves did reflect students’ accuracy and learning, but no associations with effort were found. Immediate drops were associated with high prior knowledge and suboptimal learning. Immediate peaks were associated with robust learning and pointed to effective student regulation. Close multiple spikes showed moderate learning and lower initial levels of accuracy but, with system support, these students seemed able to regulate their learning. Separated multiple spikes indicated reduced learning and accuracy and potentially signal the inability of students to regulate their learning. In this light, moment-by-moment learning curves seem to be valuable indicators of accuracy regulation during learning with ALTs and could potentially be used in interventions to support SRL with personalized visualizations.     

Are assessment environments gendered? An analysis of the learning responses of male and female students to different assessment environments

There is considerable variation between male and female Bachelor degree performance at Oxford and Cambridge (Oxbridge) where male students attain more First and Third Class degrees and female students attain more Second Class degrees. Various hypotheses have been put forward to explain this phenomenon including the possibility that the distinctive Oxbridge assessment environment, very different from those at both pre‐ and post‐92 universities, might account for the difference. Data from the Assessment Experience Questionnaire (AEQ; Oxbridge, pre‐ and post‐92 universities, one science, one humanities and one applied social science subject from each) were analysed to determine gendered perceptions of the assessment environment. Significant gender differences were found on five AEQ scales (Quantity of effort, Coverage of syllabus, Quantity and quality of feedback, Use of feedback and Appropriate assessment) but there was no significant interaction between gender and university. Consequently, there were few clues in students' responses to confirm that the Oxbridge assessment environment explains gendered differences in degree performance.     

The role of students’ interests in self-regulated learning: The relationship between students’ interests, learning strategies and causal attributions

The purpose of this research was to examine the relationship between students’ interests, their use of certain specific learning strategies and causal attributions which they made for their academic achievement. In this manner, we attempted to explore the relationships between some important variables from three different, but connected phases of self-regulated learning: the forethought phase (interests), the performance control phase (learning strategies) and the self-reflective phase (causal attributions). Results confirmed the presumption that learning strategies could be a potential mediator in the relationship between students’ interests and their academic achievement. Also, results indicate that the causal dimension of controllability could have a partial mediating role between students’ academic achievement and their interests. Generally, our findings indicate a dynamic and cyclical nature of learning process — interest is an integral part of this process and it could be conceptualized as both a consequence and an antecedent of cognitive aspects of learning.     

A case study of a formative assessment practice and the effects on students’ self-regulated learning

The study investigates one mathematics teacher’s implementation of formative assessment and its effects on students’ self-regulated learning (SRL). A questionnaire administered before and after the eight-month long intervention shows a significant effect, compared to two control classes, on students’ motivational beliefs involved in SRL. Qualitative data shows a notable enhancement of the students’ SRL behavior in the classroom. Analysis of the teacher’s implemented formative assessment shows a practice integrating several aspects of formative assessment, and provides empirical evidence of what formative assessment with large effects on students’ SRL may look like and how it fits with models of SRL development.     

Does using e-portfolios for reflective writing enhance high school students’ self-regulated learning?

The study aims to examine whether reflective writing using e-portfolios enhances high school students’ self-regulated learning. Participants included two classes of eighth-graders majoring in Information Processing and taking a course called ‘Website Design’ at a vocational high school in Taiwan. There were 41 students, with 18 males and 23 females. The experiment lasted 10 weeks, and students used e-portfolios to reflect on their learning. The results showed that students after using e-portfolios to reflect on their learning had significantly better self-regulated learning than before. This indicates that using e-portfolios for reflection enhanced self-regulated learning. It also shows that high-reflection students had significantly better self-regulated learning than moderate-reflection and low-reflection students, which implies that reflective performance had a significantly positive effect on self-regulated learning.     

A collaborative assessment of students’ placement learning

The research informing this paper set out to investigate the qualitative experiences of students, supervisors and tutors involved in a summative collaborative assessment of placement learning on an undergraduate professional qualifying programme in the UK. Analysis of data gathered through semi-structured interviews provides valuable insights into its use. In particular, engagement in a collaborative assessment brings a degree of exposure for all concerned. Participants need to feel ‘able’ to participate, and ability to participate is linked to notions of agency and autonomy. Collaborative assessment design needs to acknowledge power relations and include strategies to reduce imbalances. The importance of recognising and working with the complexities of assessment should not be underestimated. Criterion referencing offers a guide to support consistency but can also falsely present assessment as mechanistic and instrumental. The research shows that it is in the ‘doing’ of assessment that a ‘shared language’ is developed. It demonstrates the value of active student engagement in assessment in relation to the construction and use of theory, developing reflective practice and assessment literacy. The collaborative assessment provides students with the opportunity to experience a ‘performance of understanding’ in a community of practice that, whilst pressured, reflects ‘real’ professional life.     

Effects of different evaluative feedback on students’ self-efficacy in learning

Two studies examined the effects of four types of teachers’ evaluative feedback on Chinese students’ self-efficacy in English vocabulary acquisition. In Study 1, a random sample of Grade 8 students (N = 79) learned prefixes and received either formative or summative feedback after failure in test. The results showed that students who received summative feedback showed a larger decrease in their self-efficacy than those who received formative feedback. In Study 2, a random sample of Grade 7 students (N = 77) went through similar procedures as in Study 1 except that students received either self-referenced or norm-referenced feedback. The results showed that self-referenced feedback was more beneficial to students’ self-efficacy than norm-referenced feedback. The influences of teachers’ evaluation and feedback on students’ self-efficacy are discussed.     

What is assessment for learning?

The idea that assessment is intrinsic to effective instruction is traced from early experiments in the individualization of learning through the work of Benjamin Bloom to reviews of the impact of feedback on learners in classrooms. While many of these reviews detailed the adverse impact of assessment on learning, they also indicated that under certain conditions assessment had considerable potential to enhance learning. It is shown that understanding the impact that assessment has on learning requires a broader focus than the feedback intervention itself, particularly the learner's responses to the feedback, and the learning milieu in which the feedback operates. Different definitions of the terms “formative assessment” and “assessment for learning” are discussed, and subsumed within a broad definition that focuses on the extent to which instructional decisions are supported by evidence. The paper concludes by exploring some of the consequences of this definition for classroom practice.     

Should mobile learning be compulsory for preparing students for learning in the workplace?

From the contexts of current social, educational and health policy, there appears to be an increasingly inevitable “mobilisation” of resources in medicine and health as the use mobile technology devices and applications becomes widespread and culturally “normed” in workplaces. Over the past 8 years, students from the University of Leeds Medical School have been loaned mobile devices and smartphones and been given access to mobile‐based resources to assist them with learning and assessments as part of clinical activity in placement settings. Our experiences lead us to suggest that educators should be focusing less on whether mobile learning should be implemented and more on developing mobile learning in curricula that is comprehensive, sustainable, meaningful and compulsory, in order to prepare students for accessing and using such resources in their working lives.     

Finnish students’ reasons for their achievement in classroom activities: focus on features that support self-regulated learning

The aim of this study was to investigate how finnish students explain factors that contribute to their achievement in classroom learning activities and whether these factors are related to support of self-regulated learning (SRL) in classroom. Over seven weeks, 24 primary school students were videotaped during their typical classroom activities in 28 lessons to capture moments when they succeeded in learning tasks. From the video observations, 62 episodes were edited and used in stimulated recall interviews in which students were asked to report the reasons they related to their achievement in learning situations. Data-driven content analysis was used to analyse the open-ended interview data. The video observation data were analysed and sorted into theory-driven categories in order to find out how SRL was supported in classrooms. The results showed that students describe achievement through the actions that they took in the learning situations, such as being able accomplish the task. The reasons given for their achievement dealt with ability to accomplish the tasks or doing academic activities in order to achieve in the task. Furthermore, the students recognised classroom activities that support SRL, acknowledging their contribution to their achievement, mostly through the support that they received from their teachers and peers.     

Effects of the implementation of state-wide exit exams on students’ self-regulated learning

Whereas several studies investigated the effects of implementation of state-wide exit exams on student achievement, there is still little known about the impacts of the exams on students’ self-regulated learning. This paper examines the question as to whether the implementation of state-wide high school exit exams is associated with a change in the self-regulated learning of students in mathematics or English. We conducted a standardized questionnaire survey of students in two German states for a period of 3 years. In mathematics no significant effects of the immediate introduction of state-wide exit exams were identified. In English the results show significant positive and negative effects. The results are discussed and implications for further research are given.     

The impact of different teaching methods on students’ arithmetic and self‐regulated learning skills

The present study examines the effect of three different structured methods, traditional, independent and problem‐solving, of teaching children arithmetic in the beginning of 7th grade in Sweden, age 13 years. The progress made by these students is presented by measures of their arithmetic ability, calculation and quantitative concept, as well as their self‐regulated learning skills in mathematics, characterised as internal and instrumental motivation, self‐concept and anxiety. The results will be discussed with reference to a socio‐cultural perspective. This study has a split‐plot factorial design with time as within‐subject and type of intervention as a between‐subject factor. The results show that there are no significant differences between teaching methods when assessing arithmetic in total and calculation. Students’ progress in quantitative concepts is significantly better if teachers teach traditionally or with a problem‐based curriculum. In order to develop aspects of self‐regulating learning skills, the results show that pupils would benefit in a traditional or problem‐solving curriculum. Problem‐solving seems to be more effective than traditional and independent work for students’ internal motivation. Traditional work and problem‐solving are more effective than independent work for students’ self‐concept.     

Avoidance-oriented students’ development in motivation for maths,self-regulated learning behaviour and achievement: a person-centred study in the lowest level of secondary education

Performance-avoidance orientation has been found to undermine students’ academic motivation and achievement. Recognising groups of students with different levels and developments of performance-avoidance orientation makes it possible to try to intervene early in their school careers. In this study, 1168 12–13?year-old students attending the first and second year of the lowest level of secondary education, participated. Questionnaires on goal orientations, self-efficacy, investment in maths and well-being at school were administered four times. Report marks were collected at school. Using growth mixture modelling, four groups of students were distinguished: group 1 had an intermediate and a slightly increasing performance-avoidance orientation; group 2 a low and clearly increasing performance-avoidance orientation; group 3 an intermediate and clearly decreasing performance-avoidance orientation; and group 4 a low and slightly decreasing performance-avoidance orientation. We found that groups1 and 2 had less favourable development in their well-being at school, self-efficacy and performance-approach orientation.     

Achievements and attitudes of tenth‐grade students learning by individual learning methods

Learning achievements and attitudes towards individualized learning in biology of tenth‐grade students in Israel were studied. For this purpose the subject concerned with the blood system was developed in terms of eleven self‐learning subject modules for individualized learning. Of the 557 students who participated in the study, 340 students used the individualized method whilst 214 students learned the same subject by the standard traditional method. The results indicate better achievement by students learning individually, especially average and fast students, and also girls. In the light of the results it is recommended that the individualized method be used especially in heterogeneous classes where the teacher would be free to help the slow students while average and fast students could learn without teacher assistance.     

Motivation matters? The relationship among different types of learning motivation,engagement behaviors and learning outcomes of undergraduate students in Taiwan

The purpose of this study is to understand predictors of different learning outcomes among various student background characteristics, types of learning motivation and engagement behaviors. 178 junior students were surveyed at a 4-year research university in Taiwan. The scales of motivation, engagement and perceived learning outcomes were adapted from the Motivated Strategies for Learning Questionnaire and the National Survey of Student Engagement College Student Report. Multiple hierarchical regression analysis was used in data analysis. Findings confirm that different student background characteristics and learning motivation can predict different learning outcomes. However, student engagement behaviors cannot significantly predict different types of learning outcomes when student background and learning motivation variables are included. This study also finds that student’s majors play an important role in explaining learning outcomes. Overall, the findings highlight the importance of learning motivation and suggest that instructors can provide students with more successful learning experiences to ensure more confidence in their learning abilities.