The architecture of peer assessment: do academically successful students make good teammates in design assignments?

This paper considers the relationship between architecture and construction management students’ overall academic abilities (as measured by Weighted Average Marks [WAMs]), their peer ratings for contributions to team design assignments (as measured by an online Self-and-Peer-Assessment [SAPA] tool), and their specific abilities as building designers (as measured by grades in individual design assignments). The research was conducted to determine whether a student’s prior academic achievements might indicate how well they will work in teams. The research demonstrates a statistically significant relationship between WAMs and SAPA ratings indicating that academically successful students more often than not make good teammates. However, the study also highlights that when peers are assessing contributions to teamwork they are assessing skills and qualities in their teammates other than overall academic ability or the ability to design well. Whilst this study is largely located within the field of design, the findings are relevant to any group work where teachers aim to design assessment that unravels group and individual contribution.     

Extracting Latent Moral Information from Text Narratives: Relevance,Challenges, and Solutions

ABSTRACT

Moral Foundations Theory (MFT) and the Model of Intuitive Morality and Exemplars (MIME) contend that moral judgments are built on a universal set of basic moral intuitions. A large body of research has supported many of MFT’s and the MIME’s central hypotheses. Yet, an important prerequisite of this research—the ability to extract latent moral content represented in media stimuli with a reliable procedure—has not been systematically studied. In this article, we subject different extraction procedures to rigorous tests, underscore challenges by identifying a range of reliabilities, develop new reliability test and coding procedures employing computational methods, and provide solutions that maximize the reliability and validity of moral intuition extraction. In six content analytical studies, including a large crowd-based study, we demonstrate that: (1) traditional content analytical approaches lead to rather low reliabilities; (2) variation in coding reliabilities can be predicted by both text features and characteristics of the human coders; and (3) reliability is largely unaffected by the detail of coder training. We show that a coding task with simplified training and a coding technique that treats moral foundations as fast, spontaneous intuitions leads to acceptable inter-rater agreement, and potentially to more valid moral intuition extractions. While this study was motivated by issues related to MFT and MIME research, the methods and findings in this study have implications for extracting latent content from text narratives that go beyond moral information. Accordingly, we provide a tool for researchers interested in applying this new approach in their own work.     

Relationship of the AAHPER Youth Fitness Test to Total Dynamic Strength

Abstract

One hundred high school girls (N = 20 per group) were initially given 10 trials on the Bachman ladder-climb task; each group was given a different length of lay-off (10 min., or 1 day, or 1 week, or 4 weeks, or 13 weeks) before being retested with another 10 trials. Correlations between individual differences across the lay-off decreased as the length of the lay-off period increased (from r = .89 to r = .69). Correlations between adjacent trials remained relatively constant at r =.90 as practice progressed. As remoteness increased, the relation decreased regularly, from r =.92 to r =.68. Individuals became increasingly different from each other as a result of motor learning; intraindividual variance did not change appreciably.