Staff student partnership in assessment: enhancing assessment literacy through democratic practices

In recent years, research and practice focused on staff and students working in partnership to co-design learning and teaching in higher education has increased. However, within staff–student partnerships a focus on assessment is relatively uncommon, with fewer examples evident in the literature. In this paper, we take the stance that all assessment can be oriented for learning, and that students’ learning is enhanced by improving their level of assessment literacy. A small study in a Scottish university was undertaken that involved a range of different adaptations to assessment and feedback, in which students were invited to become partners in assessment. We argue that a partnership approach, designed to democratise the assessment process, not only offered students greater agency in their own and their peers’ learning, but also helped students to enhance their assessment literacy. Although staff and students reported experiencing a sense of risk, there was immense compensation through increased motivation, and a sense of being part of an engaged learning community. Implications for partnership in assessment are discussed and explored further. We assert that adopting staff–student partnership in assessment and more democratic classroom practices can have a wide range of positive benefits.     

Easing the transition from school to HE: scaffolding the development of self-regulated learning through a dialogic approach to feedback

High quality feedback is known to be essential for learning, yet in higher education it has been highlighted as a problem area in the UK by both the Quality Assurance Agency (QAA) and National Student Surveys. Furthermore, a recent study has shown that there is a fault-line between the highly structured guidance system that exists in schools/colleges and the culture of ‘independent’ learning that is promoted in higher education and suggests that this is a significant barrier to a successful transition. This article reports research to improve the transition for first-year undergraduates by providing a structured set of guidance activities (scaffolding) as a means of an extended induction into the assessment processes in higher education. The activities are based on the dialogic feedback cycle, which encompasses principles of feedback as dialogue, emphasising guidance at the start of and during an assignment rather than summative written feedback. The intervention was evaluated by means of a questionnaire and supported by focus groups. The questionnaire was administered to a control group and an intervention group. Results showed statistically significant improvements (p < 0.05) in students’ perceptions of their understanding of assessment tasks and criteria and increased confidence in terms of completing assessment tasks and self-regulated learning.     

Calibrating assessment literacy through benchmarking tasks

Abstract

In calibration tasks students assess exemplar texts using criteria against which their own work will be assessed. Typically, these tasks are used in the context of training for peer assessment. Little research has been conducted on the benefits of calibration tasks, such as benchmarking, as learning opportunities in their own right. This paper examines a dataset from a long-running benchmarking task (～500 students per semester, for four semesters). We investigate the relationship of benchmarking performance to other student outcomes, including ability to self-assess accurately. We show that students who complete the benchmarking perform better, that there is a relationship between benchmarking performance and self-assessment performance, and that students appreciate the support for learning that benchmarking tasks provide. We discuss implications for teaching and learning flagging the potential of calibration tasks as an under-explored tool.     

Teacher learning through participation in a negotiated assessment procedure

This article focuses on the impact of a specific formative assessment procedure, negotiated assessment, on teacher professional learning. Negotiations between the assessor and the teacher as assessee seem to be especially promising for this teacher learning. However, there is no empirical evidence yet that has confirmed this. We explored teachers’ opinions about the usefulness of the different elements in a negotiated assessment procedure for their professional learning and the learning benefits they reported as a result of being engaged in this procedure. Our findings show that teachers found the negotiated assessment procedure useful for their learning and reported different types of learning benefits in terms of change: change in their knowledge, beliefs and attitudes, change in their teaching practice and change in their students’ learning outcomes.     

A written,reflective and dialogic strategy for assessment feedback that can enhance student/teacher relationships

In response to the shortcomings of current assessment feedback practice, this paper presents the results of a study designed to examine students’ and teachers’ experience of engaging in a written, reflective and dialogic feedback (WRDF) strategy. The strategy was designed to enhance the learning experience of students undertaking a large first-year core course at a regional Australian university in semester 2, 2012. The evaluation consisted of three components: student surveys pre- and post-WRDF; a student focus group post-WRDF; and a teacher survey post-WRDF. Participating students’ and teachers’ perceptions of the WRDF assessment feedback suggested that students value feedback highly, and show a preference for feedback combining written, reflective and dialogic processes. The research findings suggest that the WRDF framework can be utilised to address the immediate, practical problem of students’ and teachers’ dissatisfaction with the practice of assessment feedback. Thus, WRDF may be used to nurture teacher/student relationships and enhance the learning process. Although a relatively intensive process, the WRDF strategy can serve an integral role in enhancing feedback practices and supporting students.     

The influence of student gender on the assessment of undergraduate student work

The aim of this study was to investigate the influence of perceived student gender on the feedback given to undergraduate student work. Participants (n = 12) were lecturers in higher education and were required to mark two undergraduate student essays. The first student essay that all participants marked was the control essay. Participants were informed that the control essay was written by Samuel Jones (a male student). Participants then marked the target essay. Although participants marked the same essay, half of the participants (n = 6) were informed that the student essay was written by Natasha Brown (a female student), while the remaining participants were informed that it was written by James Smith (a male student). In-text and end-of-text feedback were qualitatively analysed on six dimensions: academic style of writing; criticality; structure, fluency and cohesion; sources used; understanding/knowledge of the subject; and other. Analysis of feedback for both the control and target essay revealed no discernible differences in the number of comments (strengths of the essay, areas for improvement) made and the content and presentation of these comments between the two groups. Pedagogical implications pertaining to the potential impact of anonymous marking on feedback processes are discussed.     

Improving assessment of learning and for learning

The focus of this article is recent work by the Assessment Reform Group (ARG) on the role of teachers' judgements in the summative use of assessment. A brief overview of the early work of the ARG is followed by discussion of the desirable properties of assessment for summative uses. The work of the ARG's Assessment Systems for the Future project provided evidence and arguments concerning the validity, reliability, impact and cost of tests and of summative assessment by teachers. Whilst there is ample evidence that the teachers' judgements are more valid than, and equally reliable as, tests, there is a danger of unwanted impact on teaching as long as results are used for ‘high stakes’ evaluation of teachers and schools. Implications for policy include an end to the practice of using the results of pupils' summative assessment, however they are derived, as the sole basis for target setting and school accountability.     

Leading assessment for enhanced student outcomes

This paper reports the leadership findings that emerged from the Alberta Student Assessment Study, a large-scale study employing a mixed-method design. Findings included the importance of assessment leadership, credibility of leaders, capacity to make hard decisions and ability to lead professional learning. An optimal assessment leadership profile emerged which includes values and assessment knowledge, mediated by personal qualities and accompanied by an interplay between procedural knowledge and professional skills. This informs leadership vision and actions leading to increased assessment literacy, more effective monitoring and reporting practice, enhanced instructional practice, enriched partnerships with parents and community members and positive student outcomes.     

Comparing student learning experiences of in-text commentary and rubric-articulated feedback: strategies for formative assessment

This study compares students’ experiences of two types of criteria-based assessment: in-text commentary and rubric-articulated feedback, in an assessment design combining the two feedback channels. The main aim is to use students’ responses to shed light on how feedback strategies for formative assessment can be optimised. Following action research methodology, the study discusses key categories of student responses from three sources: reflective texts, a questionnaire, and interviews. Results show that different functions were attributed to the two feedback channels: in-text commentary to lower-order concerns related to language proficiency, and rubric-articulated feedback to higher-order concerns related to an overview of writing achievement. We argue that the different functions have the potential of creating a sufficiently balanced assessment design with the possibility of serving both short-term and continuous learning goals. On the other hand, some students found it difficult to navigate between the two feedback channels. The article therefore ends with a ‘lessons learned’ section where we list possible ways in which the current assessment design can be improved for optimal use of the synergy effects emanating from a combination of in-text commentary and rubric-articulated feedback for formative purposes.     

Improving teaching and learning in engineering education through a continuous assessment process

This paper presents the effects of a continuous assessment process on mechanical engineering education at Kuwait University. This process has been in place for the last five academic years and is producing results. Efforts to educate faculty and students about the process are beginning to produce accurate and consistent measurements of student learning. Although another assessment cycle is needed to make a better judgement, there is evidence that assessment is effective in improving teaching and learning in the programme. There is also an increased constituent awareness of the utility of assessment, which helps in instilling an institutional culture and therefore assuring a sustainable process.     

Supporting the less-adaptive student: the role of learning analytics,formative assessment and blended learning

Abstract

How can we best facilitate students most in need of learning support, entering a challenging quantitative methods module at the start of their bachelor programme? In this empirical study into blended learning and the role of assessment for and as learning, we investigate learning processes of students with different learning profiles. Specifically, we contrast learning episodes of two cluster analysis-based profiles, one profile more directed to deep learning and self-regulation, the other profile more directed toward stepwise learning and external regulation. In a programme based on problem-based learning, where students are supposedly being primarily self-directed, this first profile is regarded as being of an adaptive type, with the second profile less adaptive. Making use of a broad spectrum of learning and learner data, collected in the framework of a dispositional learning analytics application, we compare these profiles on learning dispositions, such as learning emotions, motivation and engagement, learning performance and trace variables collected from the digital learning environments. Outcomes suggest that the blended design of the module with the digital environments offering many opportunities for assessment of learning, for learning and as learning together with actionable learning feedback, is used more intensively by students of the less adaptive profile.     

In practice: Enriching the student learning experience through community service learning

Cecil D. Bradfield and R. Ann Myers are professors of sociology and social work at James Madison University in Harrisonburg, Virginia, where they cofounded the JMU Center for Service-Learning. The Center is noteworthy in its dedication to (and success in) serving equally the academic learning needs of students and the needs of the community. Here Bradfield and Myers describe the Center and at the same time examine what makes service learning different from community service.     

Team dynamics feedback for post-secondary student learning teams

In the current research, we introduce the team CARE model for supporting team development during post-secondary education. Team CARE is part of a larger suite of assessments at itpmetrics.com. Team CARE is a free, online, survey-based assessment that allows team members to rate their team’s health and functioning in four key categories (communicate, adapt, relate and educate), as well as provide written feedback about the team’s functioning to add nuance and supplemental context to the numeric scores. Team members completing the assessment receive a report documenting their team’s scores on the variables measured. We report on data from student learning teams suggesting that the variables in the team CARE model are reliable, and that they are correlated with team performance outcomes. Students’ perceptions of the tool were also examined, and the findings suggest that team CARE is perceived to be valuable, useful and easy to use. Recommendations for practice are detailed, including sample assessment schedules for teams with differing life spans. Implications for future research and implementation are discussed.     

Feeding forward from summative assessment: the Essay Feedback Checklist as a learning tool

Owing to the increasing diversity of assessments in higher education, feedback should be provided to students in a format that can assist future and alternative work. This study aimed to assess the effectiveness of the Essay Feedback Checklist on future alternative assessments. Participants were assigned to one of two groups, one of which completed the checklist prior to assessment 1 (essay) and received feedback using this method. Attainment on assessment 1 and assessment 2 (examination) were taken as pre- and post-test scores. Results revealed increased assessment scores for the checklist group, compared to those who received conventional feedback. Focus group data indicated that students particularly liked elements of the checklist as a feedback method, but potential drawbacks were also highlighted. Implications and future use of the checklist is then discussed.     

Improving the effectiveness of feedback by use of assessed reflections and withholding of grades

We wished to improve levels of student engagement with feedback within the context of our postgraduate masters-level programme, and therefore evaluated the use of two interventions: assessed reflections on feedback and grade-withholding. In questionnaires students reported more engagement with feedback after the interventions, with 77% in favour of using reflections, though only 57% favoured grade-withholding, with feelings of frustration and anxiety about the grade cited as factors. Overall class grades improved over the two years in which reflections were used, with the greatest gains made by students generating the most insightful reflections. Additional gains in the second year of intervention may have been attributable to improved implementation or the introduction of grade-withholding, or a combination of both. Overall we demonstrated clear improvement in feedback utilisation and achievement associated with our interventions.     

Disaggregating assessment to close the loop and improve student learning

This study examined student learning outcomes for accelerated degree students as compared to conventional undergraduate students, disaggregated by class levels, to develop strategies for then closing the loop with assessment. Using the National Survey of Student Engagement, critical thinking and oral and written communication outcomes were examined. Within- and between-group learning outcome differences with freshmen and seniors in both instructional formats were tested to determine if instructional goals were met and student learning transpired. A quantitative, single case analysis method was used to determine significance with the items relating to these outcomes. Results indicated that seniors in both instructional formats typically reported greater engagement scores than freshmen, and that accelerated students tended to report more engagement than their conventional counterparts. These findings were most robust for the critical thinking outcome. Ramifications for student learning and relevant instructional formats are then explored, so as to close the loop with assessment.     

The assessment cycle: a model for learning through peer assessment

This paper advances a model describing how peer assessment supports self-assessment. Although prior research demonstrates that peer assessment promotes self-assessment, the connection between these two activities is underspecified. This model, the assessment cycle, draws from theories of self-assessment to elaborate how learning takes place through peer assessment. The model is applied to three activity structures described in the literature to analyse their potential to support learning by promoting self-assessment. Broadly speaking, the model can be used to understand learning that takes place in a variety of peer assessment activities: marking/grading, analysis, feedback, conferencing and revision. This approach contrasts most studies on peer assessment, which have focused on calibration of instructor and peer grades, rather than learning opportunities.     

The development of student feedback literacy: the influences of teacher feedback on peer feedback

Abstract

Although the concept of student feedback literacy has drawn increasing attention in higher education, empirical research on this matter is still in its infancy. In the area of peer feedback, little research has investigated the role of teacher follow-up feedback on peer feedback in the development of student feedback literacy. To address the research gap, a multiple-case study of three Chinese master’s students enrolled in an academic writing course was conducted, drawing on the students’ drafts with peer feedback, teacher written feedback on that peer feedback, semi-structured interviews, retrospective verbal reports, observation field notes and class documents. Three students’ epistemological and practical knowledge about, attitudes towards, and self-efficacy beliefs in peer feedback were found to improve at different paces and to different degrees. However, considerable individual variations were observed with two high-achieving, highly motivated participants becoming more feedback-literate than their under-achieving, minimally motivated peer. Teacher feedback on peer feedback was found to have distinct impacts on individual students, depending on learner factors including language ability, beliefs and motivation. These findings suggest that teacher feedback on peer feedback, if consistently provided and compatible with learner factors, can scaffold both cognitive and social-affective aspects of student feedback literacy.     

Innovative assessment paradigm to enhance student learning in engineering education

Incorporation of student self-assessment (SSA) in engineering education offers opportunities to support and encourage learner-led-learning. This paper presents an innovative assessment paradigm that integrates formative, summative, and SSA to enhance student learning. The assessment innovation was implemented in a senior-level civil engineering design course. Direct evidence of the impact of employing this innovation on student learning and achievement was derived by monitoring student academic performance in direct assessment tasks throughout the semester. Students’ feedback demonstrated the effectiveness of this innovation to improve their understanding of course topics build their autonomy, independent judgement, and self-regulated learning skills.     

Incorporation of continuous student assessment into lectures in engineering education

A continuous student assessment system was incorporated into an advanced microelectronic course. This study investigated the relationship between the continuous assessment system based on home exams and individual student achievement. The perspective was based on the learning frameworks of the social constructivist theory. Six fourth-year engineering students participated in the study, which covered 13 lectures and 5 home exams. Feedback sessions concerning the particular exam were held after every exam. Correlations between the exams, the feedback, and individual student achievement were computed. The results indicated a positive correlation between continuous assessment and student achievement. Rather than being improved a lot, student achievement stabilised statistically at a higher level. Additionally, student's absence was very low (5%) despite the voluntary participation in the course. Continuous assessment realised with home exams induced two-way discussions between the teacher and the students. Unprompted, the students learned additional material and discussed it in the exam essays, confirming the principles of social constructivist theory.