An inventory of peer assessment diversity

Since Topping published his literature review on peer assessment in 1998 Topping, K. 1998. Peer assessment between students in colleges and universities. Review of Educational Research, 68: 249–76. [Crossref], [Web of Science ®] [Google Scholar], the number of studies on this subject has doubled, if not tripled. However, along with this expansion, the diversity of peer assessment applications increased equally fast. Based on recent literature, this contribution focuses specifically on the diversity that has come to exist in order to update Topping's typology, adding eight variables, extending eight others with extra sub‐dimensions, and including the implementation factors. Five original variables were absorbed into larger entities, leaving 20 variables which were finally grouped into five clusters. For teachers or advisors, this inventory may be of interest as a source of inspiration or as a checklist of important decisions to make when working with peer evaluation. For researchers, it may be a guide towards covering the full scope of particularities when introducing their peer assessment design. Moreover, the framework developed in this paper might relieve the possible confusion originating from the use of a single term to cover a multitude of sometimes incompatible practices.     

Validation of the SenseWear Armband in different ambient temperatures

This study examines the validity of the SenseWear Armband in different temperatures using the old (SenseWear v2.2) and newest version of the algorithm (SenseWear v5.2) against indirect calorimetry (IC). Thirty-nine male and female students (21.1 ± 1.41 years) completed an exercise trial in 19°C, 26°C and 33°C consisting of 5 min standing followed by alternating walking/running at 35% and 65% of their maximal oxygen uptake. The accuracy of the algorithms was evaluated by comparing estimated energy expenditure (EE) to IC using a mixed-model design. No difference was reported in EE between the different temperatures for IC. Both algorithms estimated EE significantly higher when exercising at high intensity in 33°C compared to 19°C. Compared to IC, SenseWear v2.2 accurately estimated EE during standing and light intensity exercise but underestimated EE when exercising in a hot environment and at high intensity. SenseWear v5.2 showed a difference when exercising at high intensity in thermoneutral and warm conditions. The new algorithm improved EE estimation in hot environments and at high intensity compared to the old version. However, given the inherent inaccuracy of the EE estimates of SenseWear, greater weight should be given to direct monitor outputs rather than the ability of a monitor to estimate EE precisely.     

Identifying configurations of perceived teacher autonomy support and structure: Associations with self-regulated learning,motivation and problem behavior

Grounded in self-determination theory, the aim of this study was (a) to examine naturally occurring configurations of perceived teacher autonomy support and clear expectations (i.e., a central aspect of teacher structure), and (b) to investigate associations with academic motivation, self-regulated learning, and problem behavior. Based on person-centered analyses in a sample of high school students (N = 1036), four different perceived teaching configurations emerged: high autonomy support – clear expectations, low autonomy support – vague expectations, high autonomy support, and clear expectations. The teaching configuration characterized by perceived autonomy support and clear expectations was related to the most positive pattern of outcomes, whereas the opposing teaching configuration related to the most negative pattern of outcomes. The two remaining groups fell in between. The discussion focuses on the compatibility of teacher autonomy support and teacher structure.     

Die Körperzusammensetzung von Hobbygamern im Vergleich zu deutschlandweit erhobenen Referenzdaten

About two thirds of adults in Germany are overweight or obese. While an increase in the consumption of high-calorie food is considered the main cause, the influence of various forms of sedentary activities is still controversially discussed. The aim of the present study is to compare the body composition of hobby gamers with reference data collected throughout Germany and to examine the effects of intensive use of computer games (gaming) on body composition. A total of 68 male participants of a computer game event aged 18–46 years (27.9 years; 180.1?cm; 83.5?kg; BMI 25.7) were examined for fat mass, body cell mass, extracellular mass, body water and phase angle using bioelectrical impedance analysis (BIA, Nutriguard MS type, data input). Ten test persons were retested by means of segmental 8?electrode BIA after a 24?h interval during their visit to the event. As a reference sample, data from 278 male adults of the same age (27.9 years, 179.4?cm; 78.8?kg; BMI 24.5) were collected in 168 locations throughout Germany. The hobby gamers reported on average 37.1?h screen media usage per week. Compared to the reference sample, they showed a slightly higher body cell mass index (p?<?0.01, T?=?4.07), but no differences in fat mass index (p?=?0.96, T?=?0.05) and phase angle (p?=?0.90, T?=?0.12). A significant increase in body water (T₀: 48.2?l, T₀₊₂₄?_h: 49.3?l; p?=?0.04, T?=?2.39) and decrease in the phase angle of the lower extremities (T₀:?7.40, T₀₊₂₄?_h: ?6.85; p?<?0.01, T?=?5.40) was observed in the 24?h retest. Compared to the reference data collected throughout Germany, hobby gamers show no differences in health-relevant parameters of body composition. Nevertheless, after intensive gaming, a short-term increase in the amount of extracellular water in the lower extremities was found. Due to these disturbances in the water balance, the consequent execution of movement breaks during gaming is important.     

Students’ experiences with contrasting learning environments: The added value of students’ perceptions

This study investigated the effects of two contrasting learning environments on students’ course experiences: a lecture-based setting to a student-activating teaching environment. In addition, the evaluative treatment involved five research conditions that went together with one of four assessment modes, namely, portfolio, case-based, peer assessment, and multiple-choice testing. Data (N = 608) were collected using the Course Experience Questionnaire. Results showed that the instructional intervention (i.e. lectures versus student-activating treatment) influenced students’ course experiences, but in the opposite direction to that expected. In declining order, the following scales (5 out of 7) revealed statistically significant differences: Clear Goals and Standards; the General scale; Appropriate Workload; Good Teaching; and Independence. Moreover, when the assessment mode was considered, also the Appropriate Assessment scale demonstrated significant differences between the five research conditions. Moreover, the same teaching/learning environments led to diverse students’ perceptions. While the perceptions of lecture-taught students were focused and concordantly positive, students’ course experiences with student-activating methods were widely varied and both extremely positive and negative opinions were present. Students’ arguments in favour of the activating setting were the variety of teaching methods, the challenging and active nature of the assignments and the joys of collaborative work in teams, whereas students expressed dissatisfaction with the perceived lack of learning gains, the associated time pressure and workloads, and the (exclusive) use of collaborative assignments and related group difficulties.     

Quality standards for new modes modes of assessment. An exploratory study of the consequential validity of the OverAll Test

During the past decade, due to societal developments, methods of instruction as well as the assessment of students’ performances have changed to an important considerable extent. Two of the elements of this change are the accents on cognitive competencies such as problem solving and on learning in an authentic context. In conjunction with the development of such learning methods, new modes of assessment were implemented. It was expected that this change would have positive feedback effects on learning and teaching. These feedback effects are the central issue of this article. They are discussed in terms of the experiences of the Maastricht School of Economics and Business Administration. This school places the analysis of authentic problems at the core of the curriculum, including the learning process as well as the assessment system. The OverAll Test, a case-based assessment instrument aiming to assess problem solving skills, was implemented as part of this. Different quality issues related to the OverAll Test have been evaluated. This article presents the results of one of the four validity studies conducted; an exploratory study of the consequential validity of the OverAll Test. It starts with the an outline of the main features of the new modes of assessment and the OverAll test as an example. There is then a discussed discussion of effectively the OverAll test fits these features as well as the goals and characteristics of problem-based learning. The study of the consequential validity of the OverAll Test is then described in depth. The results of the survey, as well as the results of the semi-structured interviews with staff and students, indicate a friction between the intended characteristics of the learning and assessment environment and the practice of instruction and assessment.     

Student-centred learning environments: an investigation into student teachers’ instructional preferences and approaches to learning

The use of student-centred learning environments in education has increased. This study investigated student teachers’ instructional preferences for these learning environments and how these preferences are related to their approaches to learning. Participants were professional Bachelor students in teacher education. Instructional preferences and approaches to learning were measured by means of questionnaires. Results showed that most students preferred teacher direction, cooperative learning and knowledge construction, and adopted a deep approach. Moreover, significant correlations were found between approaches to learning and instructional preferences. Students adopting a deep approach preferred knowledge construction and cooperative learning, while students adopting a surface approach had a preference for teacher direction and passive learning.     

New Learning Environments and Constructivism: The Students’ Perspective

Research into students’ perceptions of their learning environments reveals the impact of these perceptions on the way students cope with these learning environments. Consequently, students’ perceptions affect the results of their learning. This study aims to investigate whether students in a new learning environment (NLE) perceive it to be more constructivist when compared with the perceptions students have of a conventional lecture-based environment. Using a questionnaire consisting of seven key factors of constructivist learning environments, the results show that students in the NLE perceive it to be more constructivist when compared to the perceptions of students in a conventional lecture-based environment. The difference was statistically significant for four of the seven factors. According to the effect size, as measured by the d-index, the difference in perception between the two groups was greatest for the factor ‘conceptual conflicts and dilemmas’. in final form: 31 May 2005     

Students’ assessment preferences, perceptions of assessment and their relationships to study results

The purposes of this study are to gain more insight into students’ actual preferences and perceptions of assessment, into the effects of these on their performances when different assessment formats are used, and into the different cognitive process levels assessed. Data were obtained from two sources. The first was the scores on the assessment of learning outcomes, consisting of open ended and multiple choice questions measuring the students’ abilities to recall information, to understand concepts and principles, and to apply knowledge in new situations. The second was the adapted Assessment Preferences Inventory (API) which measured students’ preferences as a pre-test and perceptions as a post-test. Results show that, when participating in a New Learning Environment (NLE), students prefer traditional written assessment and questions which are as closed as possible, assessing a mix of cognitive processes. Some relationships, but not all the expected ones, were found between students’ preferences and their assessment scores. No relationships were found between students’ perceptions of assessment and their assessment scores. Additionally, only forty percent of the students had perceptions of the levels of the cognitive processes assessed that matched those measured by the assessments. Several explanations are discussed.     

Students’ approaches to learning and assessment preferences in a portfolio-based learning environment

This study focused on the relationships between experiences with portfolio assessment, students’ approaches to learning and their assessment preferences by means of a pre- and post-test design in an authentic class setting. The participants were 138 first-year professional bachelor’s degree students in office management. They were assessed by means of portfolio assessment in a course that combined constructivist design principles and lectures. Approaches to learning and assessment preferences were measured by means of the Revised Two-Factor Study Process Questionnaire and the Assessment Preferences Inventory. Results showed that students’ preferences for student participation in examination and for permanent evaluation decreased significantly. Moreover, deep approaches were not enhanced. On the contrary, surface learning increased significantly. Notwithstanding, the surface approach proved to be a significant negative predictor of the portfolio assessment score.