Students’ learning outcomes and peer rating accuracy in compulsory and voluntary online peer assessment

Peer assessment can be conducted online with rapid development of online learning technology. The current study was conducted empirically to investigate peer rating accuracy and student learning outcomes in online peer assessments, comparing compulsory and voluntary peer assessment. Section 1 (N?=?93) was assigned to the voluntary group and Section 2 (N?=?31) was assigned to the compulsory group. The results showed the voluntary group scored significantly higher than the compulsory group in the final task of the course, while there was no significant difference on the final task score increase. Students who participated in the voluntary group provided more accurate scores (i.e. peer rater accuracy) than those who participated in the compulsory group. The peer score leniency/severity rating, comparing peer assigned scores with the teacher assigned scores, were generally consistent with the peer rater accuracy results. The current study offers insights for researchers who are interested in studying the effect of online peer assessment activities. The results are also of interest for instructors who may want to conduct peer assessments in online courses and are choosing between compulsory and voluntary formats.     

Students’ conceptions of assessment purposes in a low stakes secondary-school context: A mixed methodology approach

Though assessment in its early history was conceived as a measurement device, alternative approaches to assessment of student achievement have appeared the past few decades. In this context, studies have been conducted to investigate students’ conceptions of assessment approaches and purposes, as there is evidence that these will affect their learning and ultimately their achievement. This study uses a sequential mixed methods design to investigate students’ conceptions about the purposes of assessment and their definitions of assessment. A questionnaire was administered to 599 lower secondary school students in Cyprus, followed by group interviews with 15 students to explain and build upon initial quantitative findings. Results show that students’ perceptions are in alignment with the current shift in assessment to be used primarily for enhancing teaching and learning. Students seem to agree with the legitimate purposes of assessment and realize that it is an ongoing procedure linked with teaching and learning.     

Students’ choices and achievement in large undergraduate classes using a novel flexible assessment approach

A flexible approach to assessment may promote students’ engagement and academic achievement by allowing them to personalise their learning experience, even in the context of large undergraduate classes. However, studies reporting flexible assessment strategies and their impact are limited. In this paper, I present a feasible and effective approach to flexible assessment, describe choices made by 2016 students in 12 sections of two different courses using this approach, and explore associations between students’ choices and academic achievement. Students decided at the beginning of the term whether they would use the assessment scheme proposed by the instructor or modify it by selecting (from within ranges provided) which assessments they would complete and the value of each in calculating their final grade. Most students (62%) made some change, but many (38%) opted to use the suggested values. Students did not choose to minimise their workload by selecting the fewest assessments possible. Opting out of a large assignment was the most common change, but the majority (69%) completed the assignment and almost all (95%) included quizzes based on readings. Different choices were not associated with notable differences in achievement: midterm score was the most important predictor of performance on a cumulative final examination.     

Students’ collaboration in technology-enhanced reciprocal peer tutoring as an approach towards learning mathematics

Education and Information Technologies - Technology-enhanced Reciprocal Peer Tutoring (RPT) was carried out with Finnish, nine to ten year-old primary school students (N=40). The RPT as a method of...     

Anonymity as an instructional scaffold in peer assessment: its effects on peer feedback quality and evolution in students’ perceptions about peer assessment skills

Although previous research has indicated that providing anonymity is an effective way to create a safe peer assessment setting, continuously ensuring anonymity prevents students from experiencing genuine two-way interactive feedback dialogues. The present study investigated how installing a transitional approach from an anonymous to a non-anonymous peer assessment setting can overcome this problem. A total of 46 bachelor’s degree students in Educational Studies participated in multiple peer assessment cycles in which groups of students assessed each other’s work. Both students’ evolution in peer feedback quality as well as their perceptions were measured. The content analysis of the peer feedback messages revealed that the quality of peer feedback increased in the anonymous phase, and that over time, the feedback in the consecutive non-anonymous sessions was of similar quality. The results also indicate that the transitional approach does not hinder the perceived growth in peer feedback skills, nor does it have a negative impact on their general conceptions towards peer assessment. Furthermore, students clearly differentiated between their attributed importance of anonymity and their view on the usefulness of a transitional approach. The findings suggest that anonymity can be a valuable scaffold to ease students’ importance level towards anonymity and their associated need for practice.     

Students’ perceptions about peer assessment for writing: their origin and impact on revision work

We investigate students’ negative perceptions about an online peer assessment system for undergraduate writing across the disciplines. Specifically, we consider the nature of students’ resistance to peer assessment; what factors influence that resistance; and how students’ perceptions impact their revision work. We do this work by first examining findings from an end-of-course survey administered to 250 students in ten courses across six universities using an online peer assessment system called SWoRD for their writing assignments. Those findings indicate that students have the most positive perceptions of SWoRD in those courses where an instructor graded their work in addition to peers (as opposed to peer-only grading). We then move to an in-depth examination of perceptions and revision work among 84 students using SWoRD and no instructor grading for assessment of writing in one university class. Findings from that study indicate that students sometimes regard peer assessment as unfair and often believe that peers are unqualified to review and assess students’ work. Furthermore, students’ perceptions about the fairness of peer assessment drop significantly following students’ experience in doing peer assessment. Students’ fairness perceptions—and drops in those perceptions—are most significantly associated with their perceptions about the extent to which peers’ feedback is useful and positive. However, students’ perceptions appear to be unrelated to the extent of their revision work. This research fills a considerable gap in the literature regarding the origin of students’ negative perceptions about peer assessment, as well as how perceptions influence performance.     

Students’ views of assessment in project-led engineering education: findings from a case study in Portugal

According to the demands of the Bologna process, new educational methods and strategies are needed in order to enhance student-centred learning. Project work is one of those approaches. This paper aims to evaluate the impact of project-led education (PLE) on students’ learning processes and outcomes, within the context of a first-year engineering programme. It explores students’ perceptions about assessment procedures and processes. Data collection was based on individual surveys at the end and the beginning of each PLE edition and through focus groups, after a period of six months. Findings are presented according to emerging themes from the data analysis, focusing mainly on students’ perspectives of learning and assessment, the role of formative and summative assessments in PLE and their impact on learning. Implications for improving assessment practices are discussed.     

Students’ reception of peer assessment of group-work contributions: problematics in terms of race and gender emerging from a South African case study

Participatory assessment is increasingly employed in higher education worldwide as a formative mechanism to support students’ active learning. But do students in an increasingly relationally diverse environment perceive that peer assessment of individuals’ contributions to group-work tasks enhances their learning? Recognising the impact of students’ conceptions on the quality of their learning, this study considers students’ perspectives of peer assessment of group-work contributions at a South African university. Questionnaires elicited students’ perspectives of and general attitudes towards assessment of and by their peers. A growing measure of discontent with the process of assessing peer contributions to group tasks emerged, including actual and perceived racial and gender stereotyping, and related rejection-sensitivity. These initial findings were checked against the students’ experiences in a report-and-respond process that enabled probing discussions of the interpretations. This paper examines and explores the implications of such identifications and receptions for learning engagement and group-work curriculum development in the context of a rapidly transforming higher education sector.     

Exploring students’ emotional responses and participation in an online peer assessment activity: a case study

The STACI^N Project is a development, implementation, and research effort that examines the impact of systems thinking, simulation, and modeling in precollege curricula on student learning, classroom processes, and organizational change. Nearly 100 teachers have been trained to use systems thinking in their secondary school curricula. This article examines how systems thinking affects teachers and classroom processes. A two‐dimensional matrix is presented to characterize the modes of adaptation employed by the teachers as they use modeling and simulation in their courses. The dimensions include teacher proficiency with technology and the specific systems applications observed in classes. A discussion of issues related to the use of systems in precollege instruction also is included.     

Students’ approaches to learning and assessment preferences in a portfolio-based learning environment

This study focused on the relationships between experiences with portfolio assessment, students’ approaches to learning and their assessment preferences by means of a pre- and post-test design in an authentic class setting. The participants were 138 first-year professional bachelor’s degree students in office management. They were assessed by means of portfolio assessment in a course that combined constructivist design principles and lectures. Approaches to learning and assessment preferences were measured by means of the Revised Two-Factor Study Process Questionnaire and the Assessment Preferences Inventory. Results showed that students’ preferences for student participation in examination and for permanent evaluation decreased significantly. Moreover, deep approaches were not enhanced. On the contrary, surface learning increased significantly. Notwithstanding, the surface approach proved to be a significant negative predictor of the portfolio assessment score.     

Students’ views of oral performance assessment in mathematics: straddling the ‘assessment of’ and ‘assessment for’ learning divide

This paper explores the views of a group of students who took an oral performance assessment in a first-year mathematics module. Such assessments are unusual for most subjects in the UK, but particularly within the generally homogenous assessment diet of undergraduate mathematics. The evidence presented here resonates with some, but not all, of the existing literature on oral assessment and suggests that, despite concerns about anxiety and fairness, students see oral assessments as encouraging a focus on understanding, being relatively authentic and reactive to their needs. We argue that, suitably implemented, oral assessment may be a viable assessment method for straddling the ‘assessment for’ and ‘assessment of’ learning divide in higher education.     

Students’ conceptions about a fair assessment of their learning

The objective of this study is to know the conceptions of primary and secondary school students about what constitutes a fair assessment. To achieve this aim, a phenomenographic study was carried out with 32 students. In a broad sense, the results showed that there were two types of conceptions. On one hand, a conception of fair assessment related to equality, transparency, objectivity, and evaluation of class content; that is, an egalitarian conception of fair assessment. On the other hand, a conception associated with ideas such as adaptation, diversification of tests, and qualitative assessment, even taking into account students' effort and attitudes, which define a conception of fair assessment linked to equity. These conceptions are associated with the concepts of legal justice and social justice, respectively and they contrast with the nature of external evaluations currently carried out.     

Students’ perceptions of assessment: a comparative analysis between Portugal and Sweden

This paper aims at investigating students’ perceptions about assessment, especially the ways in which it is put into practice. Data were collected through questionnaires in different programmes in Portugal and Sweden. In total, 173 students from Portugal and 72 from Sweden participated in the study. Findings showed that students had similar ideas about assessment, such as verification of knowledge and learning, tests and grades. Their experiences of assessment methods used varied in the two countries, which can partly be explained by differences in national education systems. A learner-oriented perspective is prominent in the use of assessment methods, but at the same time student influence on assessment is perceived as low in both countries. Implications of the findings are analysed, namely issues regarding a learner-oriented perspective and the effectiveness, influence, trust, times and methods of assessment.     

Students’ experience of team assessment with immediate feedback in a large accounting class

Team assessment has been suggested as a competency-based collaborative learning technique. Critical to the success of an assessment for learning, in competency-based education, is the use of formative feedback. This study reports on the development of, and the students’ experience of, a Team Assessment with Immediate Feedback (TAIF), in which immediate formative feedback is provided to the students by their peers and the assessment instrument (the IF-AT^® form). Results of the quantitative and qualitative data, collected in a survey, suggest that the majority of the students experienced the TAIF positively. Many students highlighted that they had constructed new knowledge and understanding of the content and practiced numerous skills during the team assessment. The learning benefits of the immediate feedback component of the team assessment were widely acknowledged by the students. The study also provided some initial evidence that team assessment in a culturally diverse student cohort may enhance intercultural collaboration. Team assessment may also contribute towards re-establishing the link between professional accounting education and practice.     

Students’ conceptions of assessment: Links to outcomes

Students conceive of assessment in at least four major ways (i.e., assessment makes students accountable; assessment is irrelevant because it is bad or unfair; assessment improves the quality of learning; and assessment is enjoyable). A study in New Zealand of 3469 secondary school students’ conceptions of assessment used a self‐report inventory and scores from a standardised curriculum‐based assessment of reading comprehension. Four inter‐correlated conceptions based on 11 items were found with good psychometric properties. A path‐model linking the four correlated conceptions with student achievement in reading, while taking into account student ethnicity, student sex, and student year, had good psychometric properties. The conception that assessment makes students accountable loaded positively on achievement while the three other conceptions (i.e., assessment makes schools accountable, assessment is enjoyable, and assessment is ignored) had negative loadings on achievement. These findings are consistent with self‐regulation and formative assessment theories, such that students who conceive of assessment as a means of taking responsibility for their learning (i.e., assessment makes me accountable) will demonstrate increased educational outcomes.     

External peer review of assessment: an effective approach to verifying standards?

There is growing international concern to regulate and assure standards in higher education. External peer review of assessment, often called external examining, is a well-established approach to assuring standards. Australian higher education is one of several systems without a history of external examining for undergraduate programmes that is currently considering the approach. What can entrants to external examining at that level learn from the UK higher education system's long history of external examining? To that end, this paper reports on a mixed methods research project designed to investigate current practices in how academic standards are conceived, constructed and applied by external examiners and debates the implications of the findings for the development of external examining in other countries. The findings suggest that the potential of experienced peers in a subject discipline to provide the assurance of standards is limited. It concludes by presenting various possible enhancements that might be considered.     

Factors associated with students’ attitude change in online peer assessment – a mixed methods study in a graduate-level course

Abstract

Positive student attitude towards peer assessment can be demonstrated through high-quality peer assessment activities. Research findings on students’ attitudes before and after such activities were mixed. This study was conducted using a mixed-methods approach to investigate the underlying factors influencing students’ attitude change. Participants were students enrolled in an online graduate-level assessment course in the college of education in a university in the southeast United States in the fall of 2017 (N?=?31). Surveys and interviews were used to collect quantitative and qualitative data separately, both of which indicated that perceived accurate and specific feedback tended to help students shift to more positive attitudes towards online peer assessment. In addition, final task score improvement after the activity was correlated with positive attitude change. Qualitative results also identified other factors, such as communication with the peers’ work and logistic concerns. The current study offers insights for researchers and instructors to promote positive attitude changes in online peer assessment activities.     

Students’ perceptions of teaching behaviour in Turkish secondary education: a Mokken Scaling of My Teacher Questionnaire

Learning Environments Research - Teacher behaviour has significant impact on student learning and outcomes and determines the teaching quality in learning environments. The My Teacher Questionnaire...     

Engaging MSW Students in Faculty Research: Students’ Perspectives of Involvement in a Program Evaluation

Engaging social work students in research is challenging, in part, because of the way research is taught in the classroom and the need for learners to effectively develop connections between the “abstract world” of research concepts with the “real world” of professional experiences. This article describes the experiences of graduate social work students involved in a process and outcome evaluation of a community-based program. Analysis of student learning outcomes and the team-based model used to engage students in the evaluation are provided to put forth a paradigm of teaching social work research through direct, supervised, and collaborative engagement.