Teachers developing assessment for learning: impact on student achievement

While it is generally acknowledged that increased use of formative assessment (or assessment for learning) leads to higher quality learning, it is often claimed that the pressure in schools to improve the results achieved by students in externally‐set tests and examinations precludes its use. This paper reports on the achievement of secondary school students who worked in classrooms where teachers made time to develop formative assessment strategies. A total of 24 teachers (2 science and 2 mathematics teachers, in each of six schools in two LEAs) were supported over a six‐month period in exploring and planning their approach to formative assessment, and then, beginning in September 1999, the teachers put these plans into action with selected classes. In order to compute effect sizes, a measure of prior attainment and at least one comparison group was established for each class (typically either an equivalent class taught in the previous year by the same teacher, or a parallel class taught by another teacher). The mean effect size in favour of the intervention was 0.32.     

Improving the student learning experience through dialogic feed-forward assessment

Abstract

Assessment feedback from teachers gains consistently low satisfaction scores in national surveys of student satisfaction, with concern surrounding its timeliness, quality and effectiveness. Equally, there has been heightened interest in the responsibility of learners in engaging with feedback and how student assessment literacy might be increased. We present results from a five-year longitudinal mixed methods enquiry, thematically analysing semi-structured interviews and focus groups with undergraduate students who have experienced dialogic feed-forward on a course in a British university. We use inferential statistics to compare performance pre and post-assessment intervention. The assessment consisted of submitting a draft coursework essay, which was discussed and evaluated face-to-face with the course teacher before a self-reflective piece was written about the assessment process and a final essay was submitted for summative grading. We evidence that this process asserted a positive influence on the student learning experience in a number of inter-related cognitive and affective ways, impacting positively upon learning behaviour, supporting student achievement and raising student satisfaction with feedback. We advocate a cyclic and iterative approach to dialogic feed-forward, which facilitates learners’ longitudinal development. Programme teams should offer systematic opportunities across curricula for students to understand the rationale for and develop feedback literacy.     

Supporting the less-adaptive student: the role of learning analytics,formative assessment and blended learning

Abstract

How can we best facilitate students most in need of learning support, entering a challenging quantitative methods module at the start of their bachelor programme? In this empirical study into blended learning and the role of assessment for and as learning, we investigate learning processes of students with different learning profiles. Specifically, we contrast learning episodes of two cluster analysis-based profiles, one profile more directed to deep learning and self-regulation, the other profile more directed toward stepwise learning and external regulation. In a programme based on problem-based learning, where students are supposedly being primarily self-directed, this first profile is regarded as being of an adaptive type, with the second profile less adaptive. Making use of a broad spectrum of learning and learner data, collected in the framework of a dispositional learning analytics application, we compare these profiles on learning dispositions, such as learning emotions, motivation and engagement, learning performance and trace variables collected from the digital learning environments. Outcomes suggest that the blended design of the module with the digital environments offering many opportunities for assessment of learning, for learning and as learning together with actionable learning feedback, is used more intensively by students of the less adaptive profile.     

Disaggregating assessment to close the loop and improve student learning

This study examined student learning outcomes for accelerated degree students as compared to conventional undergraduate students, disaggregated by class levels, to develop strategies for then closing the loop with assessment. Using the National Survey of Student Engagement, critical thinking and oral and written communication outcomes were examined. Within- and between-group learning outcome differences with freshmen and seniors in both instructional formats were tested to determine if instructional goals were met and student learning transpired. A quantitative, single case analysis method was used to determine significance with the items relating to these outcomes. Results indicated that seniors in both instructional formats typically reported greater engagement scores than freshmen, and that accelerated students tended to report more engagement than their conventional counterparts. These findings were most robust for the critical thinking outcome. Ramifications for student learning and relevant instructional formats are then explored, so as to close the loop with assessment.     

The performative turn in the assessment of student learning: a rights perspective

Active learning and group-based processes in higher education are central to student engagement strategies. Forms of assessment regarded as evidencing student engagement, including attendance, class participation grading and group-based projects, have become commonplace in the university curriculum on an international basis. Whilst the literature has focused on evaluating such forms of assessment in terms of learning gain, analysis of their impact from a student rights perspective has been largely overlooked. This paper will analyse student perspectives of three forms of assessment entailing the measurement of observable student attitudes and behaviour: attendance, class participation and group work grading. The evidence from a survey of undergraduates based in a Hong Kong university suggests that the majority of students are concerned about whether such practices are appropriate and fair, potentially undermining their freedom of choice to learn as adults.     

Supporting student learning: the use of computer–based formative assessment modules

This paper describes the development of a variety of computer–based assessment opportunities, both formative and summative, that are available to a large first year biology class at The University of Sydney. These materials include: weekly quizzes; a mock exam; quiz sections in tutorials; and special self–assessment modules (SAMs). The weekly quiz is password protected and secure but the remaining materials are available on–line from a Virtual Learning Environment (http://FYBio.bio.usyd.edu.au/VLE/L1/). Evaluations over a number of years of the use and usefulness of the formative assessment materials indicate that the student population is making significant use of materials and that these materials are helping students in their learning     

Does peer assessment promote student learning? A meta-analysis

Abstract

In recent years, there has been an increasing use of peer assessment in classrooms and other learning settings. Despite the prevailing view that peer assessment has a positive effect on learning across empirical studies, the results reported are mixed. In this meta-analysis, we synthesised findings based on 134 effect sizes from 58 studies. Compared to students who do not participate in peer assessment, those who participate in peer assessment show a .291 standard deviation unit increase in their performance. Further, we performed a meta-regression analysis to examine the factors that are likely to influence the peer assessment effect. The most critical factor is rater training. When students receive rater training, the effect size of peer assessment is substantially larger than when students do not receive such training. Computer-mediated peer assessment is also associated with greater learning gains than the paper-based peer assessment. A few other variables (such as rating format, rating criteria and frequency of peer assessment) also show noticeable, although not statistically significant, effects. The results of the meta-analysis can be considered by researchers and teachers as a basis for determining how to make effective use of peer assessment as a learning tool.     

Improving the quality of student learning: the influence of learning context and student approaches to learning on learning outcomes

Previous studies of the relationship between perceptions and/or evaluations of the learning environment and approaches to study have either not included measures of students' learning outcomes, or have included quantitative differences and not qualitative differences in learning outcomes. The studies reported in this paper focus on the relationship between qualitative differences in learning outcomes, perceptions/evaluations of the learning environment and approaches to study. The results support previous research in identifying relationships between perceptions/evaluations of the learning environment and approach to study and between approach to study and the quality of the learning outcomes. The second of the two studies reported also identifies a relationship between perceptions, approaches and the quality of the outcomes. The results suggest that perceived environments which encourage deep approaches are more likely to facilitate higher quality learning than environments designed to discourage surface approaches.     

Innovative assessment paradigm to enhance student learning in engineering education

Incorporation of student self-assessment (SSA) in engineering education offers opportunities to support and encourage learner-led-learning. This paper presents an innovative assessment paradigm that integrates formative, summative, and SSA to enhance student learning. The assessment innovation was implemented in a senior-level civil engineering design course. Direct evidence of the impact of employing this innovation on student learning and achievement was derived by monitoring student academic performance in direct assessment tasks throughout the semester. Students’ feedback demonstrated the effectiveness of this innovation to improve their understanding of course topics build their autonomy, independent judgement, and self-regulated learning skills.     

The paradigm shifts: Examining quality of teaching through assessment of student learning

Student learning is the strongest criterion for evaluating effective teaching. This article looks at three practices which partner students, teachers, and faculty peers in understanding the quality of teaching and learning through student course portfolios and teacher course portfolios, majors portfolios and teaching portfolios, and collaborative classroom assessment. Two outcomes of using a learning paradigm are building community and representing successes in higher education through documentation of effective teaching and learning.Barbara L. Cambridge, Professor of English and Associate Dean of the Faculties at Indiana University-Purdue University Indianapolis, serves on the IUPUI Program Review and Assessment Committee and recently chaired the Task Force on Accountability and Assessment for Indiana University's Strategic Directions Longrange Planning. She has made presentations and written on portfolio assessment, assessment and evaluation of faculty work, and issues in undergraduate education. Editor of theJournal of Teaching Writing, she is past President of the National Council of Writing Program Administrators.     

The assessment of learning skills in nursing student selection: A scoping review

Abstract

Higher education student selection has significant societal, institutional and individual impacts. Thousands of applicants apply only for nursing, one of the major higher education disciplines. As the nursing profession is characterised by cognitive requirements, higher education institutions assess the learning skills of nursing applicants. However, there has been no comprehensive analysis of learning skills assessment for nursing student selection. The purpose of this scoping review was to describe the assessment of learning skills in undergraduate nursing student selection. Five databases were systematically searched, and 24 studies published between 2006 and 2016 were included. Learning skills were most commonly assessed using standardised tests in the areas of language and communication, reasoning, mathematics and natural sciences. Overall scores of onsite selection methods were found to best predict future academic performance. The results indicate that higher education institutions may benefit from comprehensive assessment of learning skills in their selection processes. This assessment should focus on a wider range of cognitive aptitudes, including reasoning skills. This review focussed on nursing education, but the results may benefit other higher education disciplines due to the generic nature of learning skills and similar cognitive requirements of higher education studies. The results support the development of more comprehensive and valid methods for assessing learning skills.     

Teacher beliefs about feedback within an assessment for learning environment: Endorsement of improved learning over student well-being

Teachers’ understandings of feedback probably influence the type and quality of feedback that they provide. The beliefs of 518 New Zealand practicing teachers about feedback were evaluated with the Teachers’ Conceptions of Feedback (TCoF) inventory and related to practices these teachers considered to be feedback. Nine feedback factors and four practices factors were found and models were statistically invariant between primary and secondary teachers. New Zealand teachers’ understandings of feedback were strongly focused on improving learning instead of enhancing student well-being. Similar factors are expected in other contexts, though agreement rates should reflect local policy priorities and cultural values.