Training self-assessment and task-selection skills: A cognitive approach to improving self-regulated learning

For self-regulated learning to be effective, students need to be able to accurately assess their own performance on a learning task and use this assessment for the selection of a new learning task. Evidence suggests, however, that students have difficulties with accurate self-assessment and task selection, which may explain the poor learning outcomes often found with self-regulated learning. In experiment 1, the hypothesis was investigated and confirmed that observing a human model engaging in self-assessment, task selection, or both could be effective for secondary education students’ (N = 80) acquisition of self-assessment and task-selection skills. Experiment 2 investigated and confirmed the hypothesis that secondary education students’ (N = 90) acquisition of self-assessment and task-selection skills, either through examples or through practice, would enhance the effectiveness of self-regulated learning. It can be concluded that self-assessment and task-selection skills indeed play an important role in self-regulated learning and that training these skills can significantly increase the amount of knowledge students can gain from self-regulated learning in which they choose their own learning tasks.     

Designing for impact: a conceptual framework for learning analytics as self-assessment tools

Abstract

Although it is frequently claimed that learning analytics can improve self-evaluation and self-regulated learning by students, most learning analytics tools appear to have been developed as a response to existing data rather than with a clear pedagogical model. As a result there is little evidence of impact on learning. Even fewer learning analytics tools seem to be informed by an understanding of the social context and social practices within which they would be used. As a result, there is very little evidence that learning analytics tools are actually impacting on practice. This paper draws on research in self-regulated learning and in the social practices of learning and assessment to clarify a series of design issues which should be considered by those seeking to develop learning analytics tools which are intended to improve student self-evaluation and self-regulation. It presents a case study of how these design issues influenced the development of a particular tool: the Learning Companion.     

Effects of self-assessment on self-regulated learning and self-efficacy: Four meta-analyses

This meta-analytic review explores the effects of self-assessment on students' self-regulated learning (SRL) and self-efficacy. A total of 19 studies were included in the four different meta-analyses conducted with a total sample of 2305 students. The effects sizes from the three meta-analyses addressing effects on different measures of SRL were 0.23, 0.65, and 0.43. The effect size from the meta-analysis on self-efficacy was 0.73. In addition, it was found that gender (with girls benefiting more) and certain self-assessment components (such as self-monitoring) were significant moderators of the effects on self-efficacy. These results point to the importance of self-assessment interventions to promote students’ use of learning strategies and its effects on motivational variables such as self-efficacy.     

Teacher self-assessment: A mechanism for facilitating professional growth

Self-assessment is a powerful technique for improving achievement. In this article we outline a theory of teacher change that links self-assessment by teachers to their professional growth. This theory provides avenues for peers and change agents to influence teacher practice. We apply the theory to change in mathematics teaching and report an explanatory case study in which use of the self-assessment tool, in combination with other elements, contributed to change in the instructional practice of a grade 8 mathematics teacher. Provision of a self-assessment tool contributed to teacher growth by: (1) influencing the teacher's definition of excellence in teaching and increasing his ability to recognize mastery experiences; (2) helping the teacher select improvement goals by providing him with clear standards of teaching, opportunities to find gaps between desired and actual practices, and a menu of options for action; (3) facilitating communication with the teacher's peer; and (4) increasing the influence of external change agents on teacher practice. The study argues that providing a self-assessment tool is a constructive strategy for improving the effectiveness of in-service provided it is bundled with other professional growth strategies: peer coaching, observation by external change agents, and focused input on teaching strategies     

Enhancing learning in clinical placements: reflective practice,self-assessment,rubrics and scaffolding

Professional preparatory health programmes generally involve clinical placements with a focus on integration of theory into real life practice. Reflective writing is often included in the assessment requirements for clinical placement courses. However enabling students to engage in deeper levels of reflective writing in action, on action and for action requires careful scaffolding and assessment task design within university clinical placement handbooks. The purpose of this case study was to explore iterative refinement of assessment exercises within clinical placement handbook activities. Specifically, the study examined students’ responses to counselling experiences in authentic pharmacy practice, with comparative analysis undertaken for the various versions of the assessment task. Results showed that provision of iteratively developed guidelines, provided to three different groups of students, to support students in the assessment task, increased the marks achieved for individual components of the assessment. The results provide insight into how the design of these types of assessment exercises can be improved.     

Using contrasting cases to improve self-assessment in physics learning

Self-assessment is essential to scientific literacy as stated by the National Research Council Committee on Conceptual Framework for the New K-12 Science Education Standards and has since been incorporated into the Next Generation Science Standards. However, little empirical evidence documents which instructional tools are beneficial in improving students’ self-assessment in science learning. As such, we conducted a classroom-based quasi-experiment to test whether contrasting case-based instructional supports improved 390 introductory high school physics students’ accuracy in self-assessment and academic performance when solving physics problems. We compared the effects of providing students with content knowledge and contrasting cases (contrasting good and poor solution) on students’ physics problem solving and their ability to self-assess, with the effects of either presenting them with content knowledge and good solutions or teaching only content knowledge. We found contrasting examples improved the accuracy of students’ self-assessments, promoted content learning, and enhanced the development of self-assessment strategies.     

A cyclical self-assessment process: towards a model of how students engage in self-assessment

While significant progress has been made on understanding the effects of student self-assessment, the processes by which these effects occur are much less studied. The present research identified the actions involved in a cyclical self-assessment process. In this qualitative study, 17 undergraduate students from a teacher education institute took part in in-depth interviews focusing on the common actions students normally undertake to self-assess. The findings identified the following three actions that are commonly undertaken in the self-assessment process: (1) determining the performance criteria, (2) self-directed feedback seeking and (3) self-reflection. The paper discusses the implications of the findings and concludes with suggestions for promoting student self-assessment.     

Career counsellors, support and lifelong learning: A case for clinical supervision

While much has been written about clinical supervisionin other fields of counselling, little has beenwritten in the area of career counselling. However ascareer counsellors are confronted with the challengesof a constantly changing world of work, their supportand learning needs are increasing. This articlediscusses the role of clinical supervision as amechanism for facilitating the support and lifelonglearning of career counsellors moving into thelearning culture of the 21st Century.     

Feeding a growing team: action learning as fertiliser

Here I describe an action learning programme I ran for a youth offending team, with 15 of the 19 team members, over a six month period. The programme emerged from running a development session for the team, which highlighted a need for more ownership of the work of the team by workers and for them to be involved in setting the direction of the team's work. Most members felt they had benefited from the programme, in pushing them into new roles and taking on more responsibility in the team. I believe that action learning acts as a powerful fertiliser on seeds of growth, providing a rich, multi-faceted and powerful ingredient for cultivation.     

Initiating self-assessment strategies in novice physiotherapy students: a method case study

Student self- and peer-assessment strategies ideally are instigated early in programmes for health professionals. This study presents an innovative method of stimulating critical evaluation of clinical skills learned in the practical class setting for first year physiotherapy students. Twice in the semester (beginning and end) students assessed mock clinical demonstrations using examples of two widely discrepant approaches to evaluation of clinical skills: (1) a detailed analytical rubric of listed criteria and (2) a broad holistic, competency-based proforma. Anonymously, 67 students rated the usefulness of the activity to learning. They provided estimates of individual self-efficacy to make fair and reliable judgements in grading the demonstrations using the rubric and proforma and contemporaneous levels of personal stress with the perceived stress scale_10. Students reported that the activities aided their learning of course work on both occasions. By the end of semester the change in students’ self-efficacy to grade the demonstrations with the proforma was significantly greater than that for the rubric. The changes flag a deep understanding of the analytic and holistic methods used by class examiners and future clinical educators. Practical experience with assessing clinical performances enhanced student familiarity with the practical assessment and was associated with a reduction in pre-examination personal stress levels.     

Boosting vocabulary learning through self-assessment in an English language teaching context

This study explores the influence of self-assessment of vocabulary competence on a group of students’ oral fluency. Twenty-four young adult learners participated in a learning process that promoted their oral skills and vocabulary development. Self-assessment was mainly examined through the analysis of students’ learning logs, field notes and artefacts in the form of audio recordings. By contrasting and analysing data sources, and the results obtained from pre- and post-speaking tasks, through a mixed method design approach, it was found that when students self-assess, they are able to acknowledge their learning strengths and drawbacks. This practice enabled students to set learning commitments, use learning strategies that also allow them to raise awareness and take further actions, while self-monitoring them. Consequently, initial improvements in students’ oral fluency development were evinced through the implementation of a systematic cycle that applies self-assessment as a formative assessment source. Thus, the students entered a process in which they gradually become more able to self-monitor, judge and react towards their own gains in language and learning. Findings highlighted the value of goal setting as an essential component in self-assessment. Further longitudinal studies may well support the long-lasting effects of this strategy in similar educational contexts.     

A situative metaphor for teacher learning: the case of university tutors learning to grade student coursework

In the continuing concern about academic standards in the higher education sector a great deal of emphasis has been placed on quality assurance procedures rather than on considering how university tutors learn to grade the quality of work produced by students. As part of a larger research project focused on how tutors grade student coursework, this paper offers a new metaphor for such tutor learning, based on a sociocultural perspective. The research project used think‐aloud protocols recorded as university tutors graded student coursework, and this was followed by semi‐structured interviews. The voluntary participants consisted of 25 lecturers in four contrasting domains—humanities, art and design, medicine and teacher education—in three universities, two teaching‐led and one research intensive. We developed a metaphorical framework that helps to understand the work and learning of the lecturers and tested it by applying it to analysis of the tutor interview data. Grading, writing feedback, second marking and moderation are important situated professional learning opportunities for tutors to debate and reach agreement on the academic standard demonstrated by student coursework. The metaphor considers professional learning as interplay between the vertical domain of public knowledge and the horizontal domain of teachers' practical wisdom. The metaphor presented in this paper is proposed for critical consideration and wider use by academics, teachers, academic developers and teacher educators as an aid to better understanding of teacher's professional learning.     

Mathematics learning and assessment using MathE platform: A case study

Education and Information Technologies - Universities are encouraging the implementation of innovative methodologies and teaching strategies to develop an interactive and appealing educational...     

Accuracy in student self-assessment: directions and cautions for research

Student self-assessment is a central component of current conceptions of formative and classroom assessment. The research on self-assessment has focused on its efficacy in promoting both academic achievement and self-regulated learning, with little concern for issues of validity. Because reliability of testing is considered a sine qua non for the validity of assessment interpretations, and research into the human ability to self-evaluate work raises concerns about the quality of students’ judgements, it is sensible to investigate the accuracy of students’ self-assessments. This article reviews relevant literature from educational psychology and psychometrics to define the need for a better understanding of accuracy in self-assessment as well as to identify possible pitfalls in measuring accuracy that could undermine its effectiveness by, for example, trading the focus on formative feedback for summative scoring or rating. The article concludes with recommendations for the design of research on accuracy in self-assessment.     

A case study: Problem-based learning for civil engineering students in transportation courses

This paper describes two case studies where problem-based learning (PBL) has been introduced to undergraduate civil engineering students in University College Dublin. PBL has recently been put in place in the penultimate and final year transport engineering classes in the civil engineering degree in University College Dublin. In this case study, the paper describes how PBL was introduced, the impacts of its introduction and the feedback received by students regarding PBL. PBL was introduced in these years to help students to become deep and active learners and to help them in the transition from passive note taker to researcher and lifelong learner.