Assisting transition to university: using assessment as a formative learning tool

This study explores the effectiveness of an intervention involving formative assessment in a first‐year core business subject. Students were invited to receive feedback on a draft of their first written assessment during the early weeks of the semester. Consideration is given to the economic and ethical issues raised by the intervention. A multi‐method approach of qualitative and quantitative data collection and analysis is used. The research finds that the intervention facilitates significantly higher marks in assessments and grades, while assisting student learning overall. Findings are reinforced by comparison with a subject where the intervention was not offered.     

Implementing summative assessment with a formative flavour: a case study in a large class

Teaching a large class can present real challenges in design, management and standardisation of assessment practices. One of the main dilemmas for university teachers is how to implement effective formative assessment practices with accompanying high-quality feedback consistently over time with large classroom groups. This article reports on how elements of formative practices can be implemented as part of summative assessment in very large undergraduate cohorts (n = 1500 in one semester), studying in different modes (on- and off-campus), with multiple markers, and under common cost and time constraints. Design features implemented include the use of exemplars, rubrics and audio feedback. The article draws on the reflections of the leading teacher, and argues that, for summative assessment to benefit learners, it should contain formative assessment elements. The teaching practices utilised in the case study provide some means to resolve the tensions between formative assessment and summative assessment that may be more generally applicable.     

Professional controversies between teachers about their summative assessment practices: a tool for building assessment capacity

Abstract

This article describes two collaborative research projects whose common goal was to explore the potential role of professional controversies in building teachers’ summative assessment capacity. In the first project, upper primary teachers were encouraged to compare their practices through a form of social moderation, without prior instructor input or theoretical preparation. In the second project, lower secondary school teachers were encouraged to compare their summative assessment practices with reference to a theoretical model of curriculum alignment, under the guidance of an instructor. The findings support the potentially constructive role of professional controversies in supporting teachers’ professional development for summative assessment. They highlight the status of references called upon in discussion of controversies, and their contribution to the construction of the subjects under discussion.     

Formative and summative assessment in Hong Kong primary schools: students’ attitudes matter

ABSTRACT

This study investigates the relationship between students’ attitudes towards formative assessment and summative assessment and aims to enrich the understanding of formative and summative assessment from the students’ perspective. A total of 3,019 Hong Kong primary school students responded to a newly developed instrument. Overall, students reported positive instrumental yet negative affective attitudes towards formative and summative assessment. Girls had less negative affective attitudes towards formative assessment, but more positive instrumental attitudes towards formative and summative assessment than boys. Grade 4 students consistently scored higher than Grade 5 and Grade 6 students in assessment attitudes. The gender and grade differences were statistically significant, but had small effect size. Moreover, it was found that students’ affective and instrumental attitudes to formative assessment positively predicted students’ affective and instrumental attitudes to summative assessment.     

Instructor perspectives of multiple-choice questions in summative assessment for novice programmers

Learning to program is known to be difficult for novices. High attrition and high failure rates in foundation-level programming courses undertaken at tertiary level in Computer Science programs, are commonly reported. A common approach to evaluating novice programming ability is through a combination of formative and summative assessments, with the latter typically represented by a final examination. Preparation of such assessment is driven by instructor perceptions of student learning of programming concepts. This in turn may yield instructor perspectives of summative assessment that do not necessarily correlate with student expectations or abilities. In this article, we present results of our study around instructor perspectives of summative assessment for novice programmers. Both quantitative and qualitative data have been obtained via survey responses from programming instructors with varying teaching experience, and from novice student responses to targeted examination questions. Our findings highlight that most of the instructors believed that summative assessment is, and is meant to be, a valid measure of a student's ability to program. Most instructors further believed that Multiple-choice Questions (MCQs) provide a means of testing a low level of understanding, and a few added qualitative comments to suggest that MCQs are easy questions, and others refused to use them at all. There was no agreement around the proposition that if a question was designed to test a low level of skill, or a low level in a hierarchy of a body of knowledge, that such a question should or would be found to be easy by the student. To aid our analysis of assessment questions, we introduced four measures: Syntax Knowledge; Semantic Knowledge; Problem Solving Skill and the Level of Difficulty of the Problem. We applied these measures to selected examination questions, and have identified gaps between the instructor perspectives of what is considered to be an easy question and also in what is required to be assessed to determine whether students have achieved the goals of their course.     

Improving assessment of learning and for learning

The focus of this article is recent work by the Assessment Reform Group (ARG) on the role of teachers' judgements in the summative use of assessment. A brief overview of the early work of the ARG is followed by discussion of the desirable properties of assessment for summative uses. The work of the ARG's Assessment Systems for the Future project provided evidence and arguments concerning the validity, reliability, impact and cost of tests and of summative assessment by teachers. Whilst there is ample evidence that the teachers' judgements are more valid than, and equally reliable as, tests, there is a danger of unwanted impact on teaching as long as results are used for ‘high stakes’ evaluation of teachers and schools. Implications for policy include an end to the practice of using the results of pupils' summative assessment, however they are derived, as the sole basis for target setting and school accountability.     

Using digital representations of practical production work for summative assessment

This paper presents the findings of the first phase of a three-year study investigating the efficacy of the digitisation of creative practical work as digital portfolios for the purposes of high-stakes summative assessment. At the same time the paired comparisons method of scoring was tried as an alternative to analytical rubric-based marking because we believed that it was likely that a more holistic approach to scoring would be more appropriate. Researchers created digital representations of the practical submissions of 75 Visual Arts and 82 Design students graduating from secondary school in Western Australia. These digital portfolios were scored using the two methods, with the scores compared to those officially awarded to the physical forms. It was concluded that the digital representations of the Visual Arts submissions had adequate fidelity for the purpose of awarding high-stakes scores particularly using the paired comparisons method. However, the Visual Arts teachers and students were opposed to digitisation. For the Design portfolios teachers and students were supportive of digital submission, but the structure of the portfolios reduced the reliability and validity of scores, particularly from analytical marking.     

From course assessment to redesign: a hybrid-vehicle course as a case illustration

Assessment has become a central aspect of engineering education for evaluating student learning, attaining accreditation, and ensuring accountability. However, the final step of the assessment process, which requires assessment results be used to redesign courses and programmes, is appreciably underdeveloped in the literature. As such, this work suggests a process, based on the engineering problem-solving method, to analyse and act on problems and successes identified in the assessment results. The process is illustrated through an application to Colorado State University's new programme for Hybrid-Electric Vehicle Engineering, for which the redesign process was originally created. Readers will benefit by simplifying and systematising the essential aspect of the assessment process – application to course redesign – for use in both research and practice applications.     

Triangulation of language assessment modes: learning benefits and socio-cognitive prospects

An experimental design was adopted in the present study to cross-compare the effect of two formative assessments, namely peer assessment (PA) and teacher assessment (TA), with summative assessment (SA) on the improvement of language learners’ writing skill and self-efficacy. Writing excellence was operationalized by structural (grammar), lexical (word choice), and discoursal (cohesion and coherence) well-formedness. Furthermore, focused group interview was run to elicit the learners' attitudes and preferences toward type of assessment. Three cohorts of proficiency-matched language learners sat for a semester-long experimentation (20 sessions × 90 min = 30 h) and three testing sessions. The results revealed that PA group significantly improved in the writing skill, but TA and SA groups did not. Self-efficacy was not enhanced in any of the assessment groups under study. The interviews and follow-up member checkings indicated that the pupils did not have positive attitudes toward PA and preferred TA. Among the sources of this disfavor, they referred to misunderstanding, lack of knowledge or attention, tiredness, poor handwriting of the assesse, shyness, friendship bias, and even feeling not qualified enough to judge their peers’ tasks. Overall, then, the study reported a mismatch between the students’ actual performance and attitudinal beliefs under different assessment conditions, implying that (a) Iranian students are more inclined toward teacher-dominated pedagogies and (b) triangulation of assessment modes provides more reliable optimal results.     

形成性评价与终结性评价并重高职英语测评体系构建

高职英语作为专业课程的辅助课程,主要体现出其应用能力,沿用原有的终结式考试已经不能体现出学生对本门课技能掌握情况。鉴于此教师对考核方式进行改革,加强考核引导和过程控制,注重学生英语应用能力培养及提高,建立基于过程控制的高职英语课程形成性考核与终结性考核并重的考核体系,深化高职英语课程改革,促进高职学生英语应用能力的提高。     

Peer assessment as a learning tool for enhancing student teachers' preparation

This study investigates how peer assessment contributes to enhancing student teachers' preparation during field experience. A semi-structured interview was conducted with 72 student teachers. The findings showed that the student teachers have positive beliefs about peer assessment. They think that it can be beneficial if some changes are made in the way it is employed in teacher education programs. In light of the study findings, the researchers put forth a number of suggestions and recommendations for employing peer assessment in teacher education programs in Jordan.     

Using self- and peer-assessments for summative purposes: analysing the relative validity of the AASL (Authentic Assessment for Sustainable Learning) model

The purpose of this paper is to provide a proof of concept of a collaborative peer-, self- and lecturer assessment processes. The research presented here is part of an ongoing study on self- and peer assessments in higher education. The authentic assessment for sustainable learning (AASL) model is evaluated in terms of the correlations between sets of marks. The article provides an explanation of the assessment process, and analyses sets of marks as a means of justifying the validity of the process. The results suggest that students, even those with no prior experience in peer- or self-evaluation, in their first year of tertiary study, under the right conditions, are able to accurately judge their own work and make reasonably accurate judgements of the work of their peers. While previous studies have expounded the benefits of self- and peer assessments in tertiary study, undertaking a prescribed process, such as AASL, has a further implication in allowing others to replicate the process with reasonable assuredness of the validity of the process across various fields of study.     

Innovative assessment paradigm to enhance student learning in engineering education

Incorporation of student self-assessment (SSA) in engineering education offers opportunities to support and encourage learner-led-learning. This paper presents an innovative assessment paradigm that integrates formative, summative, and SSA to enhance student learning. The assessment innovation was implemented in a senior-level civil engineering design course. Direct evidence of the impact of employing this innovation on student learning and achievement was derived by monitoring student academic performance in direct assessment tasks throughout the semester. Students’ feedback demonstrated the effectiveness of this innovation to improve their understanding of course topics build their autonomy, independent judgement, and self-regulated learning skills.     

Feedback as dialogue: exploring the links between formative assessment and social software in distance learning

The paper explores the relationship between formative assessment and social software. Formative assessment practices though beneficial for student learning become marginalised and constrained in open and distance learning environments in higher education. Feedback is a key factor in formative assessment and learners can benefit from the deployment of emerging technologies and the opportunities for participation and dialogue afforded by social software. This paper explores and proposes a conceptual framework for this relationship. The claim is that the social dimensions of emerging technologies – specifically, blogs and wikis – allow for formative assessment practices to be re‐invented or at the very least facilitated by essentially participative and student‐focussed interventions. A comparison of these technologies against formative assessment mechanisms identifies the types of processes that these new tools might best support to encourage effective feedback approaches that both empower the learner and enhance their learning experience.     

Teacher learning through participation in a negotiated assessment procedure

This article focuses on the impact of a specific formative assessment procedure, negotiated assessment, on teacher professional learning. Negotiations between the assessor and the teacher as assessee seem to be especially promising for this teacher learning. However, there is no empirical evidence yet that has confirmed this. We explored teachers’ opinions about the usefulness of the different elements in a negotiated assessment procedure for their professional learning and the learning benefits they reported as a result of being engaged in this procedure. Our findings show that teachers found the negotiated assessment procedure useful for their learning and reported different types of learning benefits in terms of change: change in their knowledge, beliefs and attitudes, change in their teaching practice and change in their students’ learning outcomes.     

Feedback as a relational concept in the classroom

Abstract

This paper constructs a theoretical argument to frame feedback as a relational concept. It addresses contemporary concern that formative assessment, of which feedback is a part, is under theorised. The arguments presented link to existing theoretical and research evidence. The paper also challenges the dominant policy discourse in high stakes assessment contexts in which feedback is typically seen in technised ways to serve the need to raise measured pupil outcomes. Vygotsky’s notion of the zone of proximal development is explored as a relational space in which both teachers and learners understand differences between learning ‘now’ and learning ‘next’. Extending Vygotsky’s perspective, a socio-cultural perspective is offered, by considering the role of ‘others’, ‘language’, ‘activity’ and ‘identity’, as part of the process of sharing and understanding feedback in classrooms. The work of Holland et al. (1998), Bakhtin (1986) are central to the developing argument. The paper reveals feedback as a complex situated process, requiring mediated dynamic interaction, where feedback is appropriated as a cultural artefact by its participants. The implications of such an articulation demands a greater sense of understanding pupils’ roles in feedback and the importance of teachers enabling pupils to see themselves in new ways as future learners.     

Feedback effects of teaching quality assessment: macro and micro evidence

This study investigates the feedback effects of teaching quality assessment. Previous literature looked separately at the evolution of individual and aggregate scores to understand whether instructors and university performance depends on its past evaluation. I propose a new quantitative-based methodology, combining statistical distributions and transition probabilities matrices, to take into account the dynamics of teaching quality over time both at the macro and the micro level. Using a three-year longitudinal panel from an Italian university, it is shown that evaluation exercises do not impact future teaching performance at either the university level or the individual level.     

Peer assessment among first year medical students in anatomy

Peer assessment has been shown to be an effective tool to promote professionalism in medical students. Peer assessment may be particularly useful in anatomy dissection laboratory as the required close collaboration and long hours of anatomy laboratory provide students insights into their peers' work habits and interpersonal skills. The objective of this study was to quantitatively and qualitatively analyze the use of a validated peer assessment tool in Gross Anatomy. Students in a first year medical school class evaluated three members of their dissection group using an online survey tool. The mid‐course and end‐of‐course evaluation included open‐ended comments, as well as a five‐point scale that measured three work habits, two interpersonal attributes and one overall score. All 267 students completed the assignment. The overall score and four of the five other assessed categories showed significant improvement from the mid‐ to end‐of‐course evaluations. Quantitative and qualitative data also revealed significant improvement among the students who received the lowest mid‐course assessments. Seventy‐six percent of the class agreed with the statement: “Based on the feedback I received, I made a change in how I worked with or taught my peers.” The use of this peer assessment tool used by students in anatomy was associated with improvements in work habits and interpersonal attributes, particularly by the cohort of students who received the lowest mid‐course feedback. Peer assessment offers students an opportunity to improve their interpersonal skills and work habits. Anat Sci Educ 7: 144–152. © 2013 American Association of Anatomists.     

Multimodal composition and assessment: a sociocultural perspective

In this article, we examine how assessment is enacted and negotiated in a school project that involves multimodal composition. The case is a project on advertisement in which lower secondary students collaboratively composed multimodal commercials about various products and topics. The theoretical framework is based on sociocultural perspectives on learning and assessment, and video data of classroom interaction are subjected to detailed analysis. The findings document the consequences of decoupling production and assessment practices. The analysis show that written texts and multimodal texts have different statuses in the project because of how they are assessed and that this has consequences for students’ participation as learners. In addition, the analysis shows how students position themselves differently towards resources that are intended to help them in summative assessment situations. We discuss issues that teachers may reflect upon when planning and executing multimodal composition in schools.