Peer assessment of class participation: applying peer nomination to overcome rating inflation

Having students actively engaged with each other in discussions has become an increasingly important and common aspect of the classroom environment. This increased emphasis has also meant that instructors need to find ways to effectively and efficiently evaluate class participation. In this paper, we describe the most common method used for these assessments and highlight some of its inherent challenges. We then propose an alternative method based on peer nominations. Two case studies illustrate the advantages of this method; we find that it is both easy for students to complete and provide instructors with valuable diagnostic information with which to provide feedback and assign grades.     

A robust approach for mapping group marks to individual marks using peer assessment

Group work can form a substantial component of degree programme assessments. To satisfy institutional and student expectations, students must often be assigned individual marks for their contributions to the group project, typically by mapping a single holistic group mark to individual marks using peer assessment scores. Since the early 1990s, various mapping methods that use self- and peer ratings have been developed. They are based on (normalised) individual weighting factors, partial scaling of the group mark, inter-rater agreement corrections or parabolic functions. We show that no single existing method can be successfully applied to most practical peer assessment scenarios such as different marking scale interpretations, intra-group ranking errors, biased free-riders and marks exceeding 100%. We present a combined analytical mapping method that incorporates the benefits of existing mechanisms, but alleviates their weaknesses with minimum computational effort and tutor input. The robustness of the method is illustrated through problematic assessment examples and empirically evaluated in multiple group work environments involving a total of 243 students and five different disciplines.     

Assessing postgraduate student perceptions and measures of learning in a peer review feedback process

Peer review feedback, developed to assist students with increasing the quality of group reports and developing peer review skills, was added to a master’s level Climate Change Policy and Planning unit. A pre- and post-survey was conducted to determine whether students found the process a valuable learning opportunity: 87% of students responding to the post-review survey indicated they saw benefit in both developing and receiving peer review feedback. Peer review design minimising the potential for plagiarism resulted in low levels of student concern surrounding plagiarism. Marks allocated by students were valid (consistent with the lecturer) and were generally reliable; however, distribution of marks had a higher variance where group report quality was low. Training on completing the peer review template could result in more reliable feedback. Consistent with the literature, the feedback developed during the peer review process focused on style and presentation preferentially to content. Seven out of eight group reports improved between report submissions, with all groups responding to peer review feedback. Peer review feedback and changes made to group reports indicated students had limited capacity to judge the quality of referencing and critical analysis.     

How to achieve accurate peer assessment for high value written assignments in a senior undergraduate course

The psychometric measures of accuracy, reliability and validity of peer assessment are critical qualities for its use as a supplement to instructor grading. In this study, we seek to determine which factors related to peer review are the most influential on these psychometric measures, with a primary focus on the accuracy of peer assessment or how closely peer-given grades match those of an instructor. We examine and rank the correlations of accuracy, reliability and validity with 17 quantitative and qualitative variables for three senior undergraduate courses that used peer assessment on high value written assignments. Based on these analyses, we altered the single most significant variable of one of the courses. We demonstrate that the number of reviews completed per reviewer has the greatest influence on the accuracy of peer assessment out of all the factors analysed. Our calculations suggest that six reviews must be completed per reviewer to achieve peer assessment that is no different from the grading of an instructor. Effective training, previous experience and strong academic abilities in the reviewers may reduce this number.     

Small group discussion as a key component in online assessment training for enhanced student learning in web-based peer assessment

The purpose of this study is to examine the effect of online assessment training, with synchronous group discussion as a key component, on subsequent web-based peer assessment results. Participants included 81 college students, mostly women, taking a business writing class. After initial submission of a draft counter-offer letter, they completed online assessment training by engaging in a consensus-seeking, synchronous group discussion of the rubric-based ratings they gave to sample counter-offer letters. They then engaged in web-based assessment of randomly assigned peer counter-offer letters and upon receiving peer feedback, submitted revision of their own counter-offer letter. The discussion groups were randomly assigned to either anonymous (using a pseudo name) or identified conditions (using real name). Findings indicate that the quality of student counter-offer letters improved after online assessment training, and improved even more after web-based peer assessment. There were no significant differences between anonymous discussion groups and identified groups.     

A blended learning curriculum for training peer researchers to conduct community-based participatory research

Peer researchers (PRs) are research team members who share traits (e.g. gender, age, sexual orientation, diagnosis, income, housing situation, etc.) with study participants. Participatory methods and some fields (e.g. HIV/AIDS) expect PRs to be equitably involved in a project. Moreover, in Canada, there is a current impetus to include ‘the patient’ in health research. PRs often join a project without any formal research training, yet they are frequently tasked with suggesting appropriate language, recruiting participants, conducting interviews, administering surveys, analyzing data, and presenting findings. While there is literature on PR hiring, ethical considerations of PR engagement, and PR experiences, the methods of training PRs remain underreported. A blended learning curriculum (i.e. combination of webinars, didactic in-person presentation, filmed simulation, etc.), informed by the principles of action learning and the concept of reciprocity, has shown preliminary effectiveness in training PRs across two studies. This paper will present the curriculum, alongside exploratory evaluation results (n?=?7), with details on how the curriculum changed from one study to the next and how reciprocity between academic and peer researchers led to stronger collaborations.     

Peer development as an alternative to peer observation: a tool to enhance professional development

Many higher education institutions worldwide require that all academic staff undergo a peer observation of teaching each academic year. Within one department in a university in the South of England, questions have arisen about the value and purpose of the traditional ‘peer observation’ process, and as a result a new voluntary system of ‘peer development’ has been introduced. This paper explains the rationale underpinning the new peer development process, and explores its worth and value to those who have participated in it as a mechanism for professional development. Reflections on the process are considered, along with what can be done to improve the new system.     

Active learning: A small group histology laboratory exercise in a whole class setting utilizing virtual slides and peer education

Histology laboratory instruction is moving away from the sole use of the traditional combination of light microscopes and glass slides in favor of virtual microscopy and virtual slides. At the same time, medical curricula are changing so as to reduce scheduled time for basic science instruction as well as focusing on student‐centered learning approaches such as small group active learning and peer‐instruction. It is important that medical schools resist the temptation to respond to this conjunction of events by turning histology into a self‐study activity. This article describes a lymphoid histology laboratory exercise, occurring in a specially equipped Learning Studio housing an entire medical class that utilizes virtual slides in the context of small group active learning and peer instruction. Anat Sci Educ © 2012 American Association of Anatomists.     

The role of questioning in writing tutorials: a critical approach to student-centered learning in peer tutorials in higher education

ABSTRACT

Peer tutoring in higher education aims to enhance student learning, and confidence. In writing centres, peer writing tutors use critical questioning to make the tutorial sessions student-focused and productive. The nature of questions influences the outcomes of the tutorials, yet research has not devoted sufficient time to unpacking what form this questioning takes, and the potential value for students and tutors. This paper explores the kinds of questions asked, the challenges posed to students and tutors, and implications for the learning process. Tutors’ experiences during tutorials and their reflections in written reports are used to unpack and explore questioning in tutorials. The paper highlights questioning as relevant in writing centre spaces due to its central role in shaping student learning about writing. The findings have relevance for peer tutoring in higher education generally, and indicate the importance of peer tutors learning to use questions to engage effectively with students.     

Talking about death: Implementing peer discussion as a coping mechanism to overcome fears about dissection,death, and dying

Many studies have reported on the perceptions of medical students toward dissection. It is important to understand the feelings and symptoms experienced during dissection so that they can be adequately handled. Prior to dissection, first year students are given lectures on aspects of dissection, death and dying, and death rituals in various cultures. Two separate questionnaires, one given during the first week of dissection and another given one month into the program were then completed anonymously by dissection groups. The questions were designed to be open‐ended, thereby encouraging group discussion amongst students. The questionnaires were used to determine the perception of students to dissection and to discover if these perceptions change during the dissection program. The first questionnaire revealed that students do experience fears and anxiety prior to and at the beginning of dissection; however, most of these fears dissipated by the time of the second questionnaire. One month into dissection students cited talking to peers as their main coping mechanism and fewer students mentioned emotional detachment from their cadaver as a coping mechanism, as was the case in the first questionnaire. Dissection was perceived as a positive experience by our student cohort and most students cited the main advantage of dissection as the ability to visualize organs in three dimensions. The comprehensive answers received from the students indicated that thorough discussion of feelings amongst peers occurred, introducing students to an important coping mechanism at an early stage of their learning. Anat Sci Educ. © 2013 American Association of Anatomists.     

The pedagogy of multiliteracies as a code breaker: A suggestion for a transversal approach to computing education in basic education

While computing has been (re)introduced into the basic education curricula in various countries, its actual implementation appears to be inconsistent. There are schools in which computing education is commonplace, while the implementation seems to be lagging behind in others. There is emerging evidence that some teachers do not consider computing education relevant, meaningful and important and, thus, intentionally neglect its provision. This is problematic as understanding the principles of code and computing is crucial for agentic citizenship in the post-digital era. This paper argues that one main reason for these teachers' reluctance is the economy-driven discursive framing of computing education, which is in contrast with the socialization-oriented manner in which teachers approach their work. To contribute to resolving this issue, the present paper introduces a transversal approach to computing education. It conceptualizes code as a sociomaterial text with social and societal histories and consequences. Theoretically and conceptually, the approach draws on the pedagogy of multiliteracies. The leading idea is that digital technologies are examined with students from functional and critical dimensions and through micro and macro perspectives. The use of wearable sports technologies, such as activity wristbands, are used as practical examples to put the theoretical ideas into context.

Practitioner notes

What is already known about this topic

• Computing has been (re)introduced in the curricula of basic education in various countries.
• Some teachers are found to be reluctant to teach computing in basic education.

What this paper adds

• This paper introduces a transversal multiliteracies-based approach for computing education.

Implications for practice and policy

• Computing should be included in curricula and classrooms in a holistic manner that includes both functional and critical approaches to computing.

     

Developing an interactive augmented reality system as a complement to plant education and comparing its effectiveness with video learning

The learning of plants has garnered considerable attention in recent years, but students often lack the motivation to learn about the process of plant growth. Also, students are not able to apply what they have learned in class in the form of observation, since plant growth takes a long time. In this study, we use augmented reality (AR) technology to develop the ARFlora system, which can assist students in observing the changes in plant growth while in the classroom. More specifically, students are able to use AR markers to manipulate various virtual objects (e.g. sunlight) and observe the changes they have on plant growth. Meanwhile, a quasi-experimental evaluation is in place to substantiate the effectiveness of ARFlora in the learning of plants and to compare it with digital video learning. In the quasi-experimental design, 55 elementary-school students participated in the study. The participants are divided into two groups, an “experimental group” and a “control group.” The experimental group was taught using the ARFlora system, while the control group was taught by employing the digital video. Results show that (1) ARFlora and digital video have the same effectiveness on student's learning outcomes; (2) ARFlora is more effective in helping students retain learned knowledge; and (3) ARFlora is comparatively more useful in motivating students to learn about plants.     

A pedagogy of larger concerns used as a lens to reflect on the design of student learning experiences

ABSTRACT

Although engineering educational endeavours are often described with regard to how well they prepare students to meet national or global engineering concerns, the purpose of this paper is to show how those efforts can also serve the larger educational goals of the educators themselves as they develop learning experiences for their students. This paper describes the reflections of four engineering educators who used a research-based ‘Pedagogy of Larger Concerns’ (PLC) as a conceptual lens for examining important aspects of their courses. A PLC is a set of teaching conceptions that was identified in a study exploring the thinking of outstanding professors in order to improve our understanding of the basis of their effectiveness.     

Teleology as a tacit dimension of teaching and learning evolution: A sociological approach to classroom interaction in science education

Teleology has been described as an intuitive cognitive bias and as a major type of student conception. There is controversy regarding whether teleological explanations are a central obstacle to, are legitimate in, or are even supportive of science learning. However, interaction in science classrooms has not yet been investigated with regard to teleology. Consequently, this study addresses the question of how teleological explanations emerge in science classroom interactions about evolution and how teachers and students address emerging teleology. In this article, we introduce a theoretical and methodological framework drawing from the sociology of knowledge and systems theory, suggesting that this framework may enrich the understanding of knowledge construction and of social practices in the science classroom because it enables distinguishing between explicit and tacit knowledge. We investigated seven secondary school units about evolution and present data from four grade-12 classes in Germany, a country with very few creationists, to contrast two ways in which teleology is addressed. In the first type, the teachers combine intentional and need-based teleological explanations with aspects of scientific theories in an ambiguous way. Contrastingly, in the second type, the teachers construct a duality between correct mechanistic and incorrect teleological explanations by discrediting preceding scientific theories. In the discussion, we argue that the presented sociological approach can also be valuable in other science education contexts, such as creationism, the nature of science and socio-scientific issues, because classroom interaction involves tacit communication, such as a tacit epistemology, which are essential grounds for the students' knowledge construction.     

Using a Hero as a Model in Video Instruction to Improve the Daily Living Skills of an Elementary-aged Student with Autism Spectrum Disorder: A Pilot Study

The present pilot study investigated the impact of video hero modelling (VHM) on the daily living skills of an elementary-aged student with autism spectrum disorder. The VHM, in which a character much admired by the student exhibited a correct response, was shown to the participant immediately before the situation where he needed to exhibit the target behaviours. Results of a multiple-probe design across three behaviours showed that each of the three target behaviours improved only when the VHM was introduced. In addition, the participant and his teachers demonstrated positive attitudes toward the use of VHM. However, the teachers hesitated to develop the VHM by themselves due to the perceived complexity of the development process and time constraints.     

Learning how to be a woman in the Canadian Forces/unlearning it through feminism: an autoethnography of my learning journey A preliminary version of this paper was presented as part of a panel discussion at the Atlantic Regional Canadian Association for Studies in Adult Education (CASAE) 2002 conference.

Gender plays a significant role in the experiences of workers within organizations. This is particularly true for women in non-traditional roles as they constantly struggle with gender barriers that are so ensconced in certain organizations and in society as to be accepted without question. Using an autoethnographical account, I explore the implications of my experience as a woman in the non-traditional role of a military member. First, I will discuss the importance of speaking from a first-hand, subjective position, and will briefly explore how we learn to be men and women through socialization processes in current western society. Then I will focus on how I learned to be a military member in a male organization and will examine how women's bodies and emotions separate women from men. I conclude with a discussion of how learning about feminist theories provoked me to begin to make connections between my experience and larger societal issues that had previously been invisible to me.