Group peer assessment for summative evaluation in a graduate-level statistics course for ecologists

Peer assessment is often used for formative learning, but few studies have examined the validity of group-based peer assessment for the summative evaluation of course assignments. The present study contributes to the literature by using online technology (the course management system Moodle^?) to implement structured, summative peer review based on an anchored rubric in an ecological statistics course taught to graduate students. We found that grade discrepancies between students and the instructor were fairly common (60% of assignments), relatively low in value (mean = 3.3 ± 2.5% on assignments that had discrepancies) and proportionally higher for criteria related to interpretation of statistical results and code quality and organisation than for criteria related to the successful completion of analysis or instructional tasks (e.g. fitting particular statistical methods, de-identification of one’s submission). Students reported that the peer assessment process increased their exposure to alternative ways of approaching statistical and computational problem-solving, but there were concerns raised about the fairness of the process and the effectiveness of the group component. We conclude with some recommendations for implementing peer assessment to maximise student learning and satisfaction.     

Network Applications for Group-Based Learning: Is More Better?

Group-based learning is being introduced into many settings in higher education. Is this a sustainable development with respect to the resources required? Under what conditions can group-based learning be applied successfully in distance education and in increasingly flexible campus-based learning? Can networked support facilitate and enrich courses where group-based learning is applied? These questions formed the basis of the motivation for the research project whose main results are presented here. The goals set for the research were the identification of problems associated with the planning, operationalisation, and monitoring of group tasks in group-based learning in higher education, and the identification of networked support options which, in combination with appropriate instructional decisions, have the potential to remedy these problems. The solutions identified were tested in the context of three case studies.     

The performative turn in the assessment of student learning: a rights perspective

Active learning and group-based processes in higher education are central to student engagement strategies. Forms of assessment regarded as evidencing student engagement, including attendance, class participation grading and group-based projects, have become commonplace in the university curriculum on an international basis. Whilst the literature has focused on evaluating such forms of assessment in terms of learning gain, analysis of their impact from a student rights perspective has been largely overlooked. This paper will analyse student perspectives of three forms of assessment entailing the measurement of observable student attitudes and behaviour: attendance, class participation and group work grading. The evidence from a survey of undergraduates based in a Hong Kong university suggests that the majority of students are concerned about whether such practices are appropriate and fair, potentially undermining their freedom of choice to learn as adults.     

A faculty team works to create content linkages among various courses to increase meaningful learning of targeted concepts of microbiology

As research faculty with expertise in the area of host–pathogen interactions (HPI), we used a research group model to effect our professional development as scientific educators. We have established a working hypothesis: The implementation of a curriculum that forms bridges between our seven HPI courses allows our students to achieve deep and meaningful learning of HPI concepts. Working collaboratively, we identified common learning goals, and we chose two microorganisms to serve as anchors for student learning. We instituted variations of published active-learning methods to engage students in research-oriented learning. In parallel, we are developing an assessment tool. The value of this work is in the development of a teaching model that successfully allowed faculty who already work collaboratively in the research area of HPI to apply a “research group approach” to further scientific teaching initiatives at a research university. We achieved results that could not be accomplished by even the most dedicated instructor working in isolation.     

Assessment for equity: learning how to use evidence to scaffold learning and improve teaching

Abstract

This article examines evidence regarding the assessment learning of preservice teachers (PTs) in a new Master of Teaching designed to prepare teachers to address the less than equitable outcomes of certain groups of students in New Zealand. The assessment curriculum was integrated across all of the courses and the in-school experiences as one of six interconnected facets of practice for equity. Evidence about the assessment learning of 27 preservice teachers was collected using a survey, interpretive analysis of three assignments and a focus group interview. The findings demonstrated that preservice teachers combined theory and practice encountered in many contexts to build the assessment understanding and competence needed to address equity issues. We argue that this was facilitated by incorporating the assessment curriculum within each course, intertwining university and school experiences, and the specific focus on addressing equity throughout the programme.     

Evaluating the impact of online discussion boards on student engagement with group work

The purpose of this study is to examine the impact of the use of an online discussion board as an assessment item on students learning performance in relation to group work based on Social Learning Theory. The study uses survey questionnaires at the beginning and end of semester together with student grade information. The data analysis consists of (1) a regression analysis to explore the relationship between student interaction and performance and (2) a repeated measures ANOVA to explore changes in attitude and perceived encouragement. Student's perceptions at the outset were found to be important as was the use of the online discussion board as a learning tool even when it is not assessed. Further, students' attitude to the online discussion board improved through the semester however the online assessment task did not encourage domestic students to be more engaged in group-based activities. In contrast, international students were more encouraged to participate in group-based activities at the end of the semester. The study has implications for online group activities in education.     

Promoting Inquiry-Based Teaching in Laboratory Courses: Are We Meeting the Grade?

Over the past decade, repeated calls have been made to incorporate more active teaching and learning in undergraduate biology courses. The emphasis on inquiry-based teaching is especially important in laboratory courses, as these are the courses in which students are applying the process of science. To determine the current state of research on inquiry-based teaching in undergraduate biology laboratory courses, we reviewed the recent published literature on inquiry-based exercises. The majority of studies in our data set were in the subdisciplines of biochemistry, cell biology, developmental biology, genetics, and molecular biology. In addition, most exercises were guided inquiry, rather than open ended or research based. Almost 75% of the studies included assessment data, with two-thirds of these studies including multiple types of assessment data. However, few exercises were assessed in multiple courses or at multiple institutions. Furthermore, assessments were rarely based on published instruments. Although the results of the studies in our data set show a positive effect of inquiry-based teaching in biology laboratory courses on student learning gains, research that uses the same instrument across a range of courses and institutions is needed to determine whether these results can be generalized.     

Exploring Online and Blended Course Delivery in Social Group Work

Agency group work has increased, but opportunities for social work group practice in educational settings have not kept pace. One option in response is technology-based learning, and students appear to have positive perceptions of online group project work. Online courses appear to have outcomes comparable to those that occur with in-person groups but require careful monitoring of group processes and group-based technologies. The authors discuss the factors involved in developing and implementing online and blended course delivery in teaching group work.     

What are the perceptions of lecturers towards using cooperative learning in civil engineering?

The objective of the current paper is to examine how group learning and cooperative learning are used in civil engineering courses. The paper defines group learning and cooperative learning in the first section. It is hypothesized that group learning is used in civil engineering courses to build teamwork skills and communication skills among civil engineers but that its effectiveness is not maximized owing to a lack of awareness of how it can be structured. The paper suggests that using cooperative learning is more effective. The paper describes a study of the attitudes and perceptions of lecturers in civil engineering departments in several universities. The paper finds that many lecturers use group learning in order to teach civil engineers ‘soft skills’ but are uncomfortable with the assessment of such work. There is a lack of awareness regarding how group work can be structured and regarding research into the use of cooperative learning.     

Group Learning and Group Assessment on Undergraduate Computing Courses in Higher Education in the UK: results of a survey

A survey was undertaken of all universities in the UK to establish the extent and nature of group learning and group assessment on undergraduate computing courses. Quantitative and qualitative data were collected about the amount and control of group learning and assessment, methods of marking group assessments and tutors’ attitudes to group learning and assessment. The results are presented, analysed and discussed. The survey shows that group learning and group assessment have established themselves to varying extents in the vast majority of computing courses for which responses were received and points to the need for more research into methods of group assessment which can demonstrate reliability.     

Assessing a Remedial Intervention Programme in Developing the Planning Skills of Grade 4 and 5 Learners

The search for assessment procedures that are more fair and useful have led to the investigation of alternatives to traditional forms of intellectual assessment. This study explored an alternative which combined a dynamic assessment approach with the Planning, Attention, Simultaneous and Successive Processing (PASS) model of cognitive processing. The aim was to investigate the effectiveness of a planning intervention programme based on Feuerstein’s criteria for Mediated Learning Experience (MLE) with a group of Grade 4 and 5 remedial school learners who presented with a range of barriers to learning. Twenty six learners were assigned to the experimental group and 25 to the control group. The results showed that there was a significant improvement in the experimental group’s Planning Scale score on the Cognitive Assessment System, following the intervention. These results imply that children often have far greater potential than is realised and that intentional mediation can help to enhance cognitive functioning and assist in further developing children’s learning potential.     

在线协作讨论中成员表现的综合评价研究

目前随着网络技术的发展和教学观念的变革,网络环境下的协作学习越来越受到重视,相应地其评价问题也日益突出。协作学习过程评价是协作学习评价的重点。本文提出由“互动”、“争辩”和“建构”作为评价准则、十三类交互言行作为评价指标的评价模型,并引入基于AHP的综合评价方法,对小组成员个人贡献进行量化分析。实验结果表明,该评价模型为辅助评价小组成员提供了更有价值的参考依据。     

Assessment worlds colliding? Negotiating between discourses of assessment on an online open course

Abstract

Using the badged open course, Taking your first steps into Higher Education, this case study examines how assessment on online open courses draws on concepts of assessment used within formal and informal learning. Our experience was that assessment used within open courses, such as massive open online courses, is primarily determined by the requirements of quality assurance processes to award a digital badge or statement of participation as well as what is technologically possible. However, this disregards much recent work in universities that use assessment in support of learning. We suggest that designers of online open courses should pay greater attention to the relationship of assessment and learning to improve participant course completion.     

Equivalent but not the Same: Teaching and Learning in Full Semester and Condensed Summer Courses

Research on teaching and learning in condensed-course formats is varied and difficult to generalize. We analyze this research and identify factors that may account for the varied findings. Additionally, we present a mixed methodology study of 20 matched-pair courses (i.e., full and condensed formats) from 11 disciplines which examines student learning and student and faculty perception data. We find that faculty and students perceive condensed courses as more effective, but that student learning varies depending upon the measures used to assess it. We conclude by considering the implications of our study for teaching and assessment practices.     

Assessors’ approaches to portfolio assessment in Assessment of Prior Learning procedures

In an effort to gain better understanding of the assessment of prior informal and non‐formal learning, this article explores assessors’ approaches to portfolio assessment. Through this portfolio assessment, candidates had requested exemptions from specific courses within an educational programme or admission to the programme based on their prior learning. The assessors judged the portfolios according to set rating criteria, and subsequently discussed their approaches. Their decision‐making processes, perception of portfolio use in the Assessment of Prior Learning (APL), deciding factors in portfolio assessment and use of the rating criteria were key elements in this discussion. The results show that they do use the rating criteria as an indicator in decision‐making, but have mixed perceptions regarding the fairness of APL portfolio assessment. They perceive the portfolio evidence in combination with sound argumentation as the deciding elements in portfolio assessment.     

Examining the Predictive Validity of an Instrument: Technology Attitudes and Learning

This article reports the results of a study examining the predictive validity of a computer attitude instrument. The researchers attempted to determine the extent to which this instrument predicts student learning. Data from two universities were collected using this instrument over a nine-year period and were sorted into three sets with a random n of 400 in each. Three procedures were performed. First, one set of data was used to develop a base model of prediction. Second, this model was used to calculate the predicted learning achievement scores for the other two sets of data. Finally, in those two sets of data, the means of the predicted and observed learning achievement scores were compared using inferential statistics. The predictive validity of the instrument was confirmed, as no significant differences were found between the mean predicted and observed learning outcome scores.     

Lifelong learning from natural disasters: transformative group-based learning at Philippine universities

This study explores reflective experience during transformative, group-based learning among university leaders following a natural disaster such as a typhoon in two Philippine universities. Natural disasters are recurrent phenomena in many parts of the world, but the literature largely ignores their impact on lifelong human learning, for instance regarding preparing the university setting for future natural disasters. The study used interviews and document analysis, drawing on a body of interrelated works in transformative learning theory, critical educational theory and conceptions about group processes and reflective practice to understand university leaders’ lifelong learning from natural disasters as experiential, transformative, reflective and group oriented. The findings document that university leaders’ reflective, transformative learning depends on individuals’ experience of natural disasters as disorienting dilemmas, and that reflection is facilitated by decisive group dynamics rather than only personal reflection. Facilitating a learning space for transformative, reflective learning in university settings might assist university leaders to enhance disaster risk preparedness, for instance through local policy change.     

Does regular online testing enhance student learning in the numerical sciences? Robust evidence from a large data set

While a number of studies have been conducted on the impact of online assessment and teaching methods on student learning, the field does not seem settled around the promised benefits of such approaches. It is argued that the reason for this state of affairs is that few studies have been able to control for a number of confounding factors in student performance. We report on the introduction of a regular (every 3 weeks) low-mark online assessment tool in a large, first-year business mathematics course at the University of New South Wales, a major Australian university. Using a retrospective regression methodology together with a very large and rich data set, we test the proposition that exposure to the online assessment instrument enhances student learning. Significantly, we are able to control for prior student aptitude, in-course mastery, gender and even effort via a voluntary class attendance proxy. Furthermore, the study incorporates two large, and statistically diverse cohorts as well as manipulations in the model tested to robustly examine the outcomes. Our central result is that higher exposure to the online instrument robustly leads to higher student learning, all else being equal. Various implications for online assessment design, implementation and targeting are also discussed.     

A Consideration of the Relationship Between Creativity and Approaches to Learning in Art and Design

Creative intelligence is relevant to all aspects of the school curriculum, yet it is through art and design that pupils may come to experience the significance of creativity as a means of exploring innovative and original ideas which offer credence to the individual and affect approaches to learning. This article analyses creativity and the creative process and addresses the links between creativity and intelligence by examining the implications such factors may hold for the teacher when developing approaches to learning in art and design. It focuses in particular on the use of sketchbooks within the context of a number of Art and Design GCSE courses and explores how students have been provided with opportunities to develop creative responses to set tasks. In addition, it sets out to challenge the notion that the requirements of GCSE assessment criteria inevitably restrict creativity and lead to non‐creative formulaic practice.     

Group tagging: Using video tagging to facilitate reflection on small group activities

Collaborative learning in class-based teaching presents a challenge for a tutor to ensure every group and individual student has the best learning experience. We present Group Tagging, a web application that supports reflection on collaborative, group-based classroom activities. Group Tagging provides students with an opportunity to record important moments within the class-based group work and enables reflection on and promotion of professional skills such as communication, collaboration and critical thinking. After class, students use the tagged clips to create short videos showcasing their group work activities, which can later be reviewed by the teacher. We report on a deployment of Group Tagging in an undergraduate Computing Science class with 48 students over a semester. Through our analysis of interviews and log data, we show that Group Tagging helped the students remain attentive and on-task during group work, and encouraged them to participate more during group activities.