Assessing teamwork in undergraduate education: a measurement tool to evaluate individual teamwork skills

Effective teamwork skills are essential for success in an increasingly team-based workplace. However, research suggests that there is often confusion concerning how teamwork is measured and assessed, making it difficult to develop these skills in undergraduate curricula. The goal of the present study was to develop a sustainable tool for assessing individual teamwork skills, with the intention of refining and measuring these skills over time. The TeamUp rubric was selected as the preliminary standardised measure of teamwork and tested in a second year undergraduate course (Phase One). Although the tool displayed acceptable psychometric properties, there was concern that it was too lengthy, compromising student completion. This prompted refinement and modification leading to the development of the Team-Q, which was again tested in the same undergraduate course (Phase Two). The new tool had high internal consistency, as well as conceptual similarity to other measures of teamwork. Estimates of inter-rater reliability were within a satisfactory range, although it was determined that logistical issues limited the feasibility of external evaluations. Preliminary evidence suggests that teamwork skills improve over time when taught and assessed, providing support for the continued application of the Team-Q as a tool for developing teamwork skills in undergraduate education.     

Autism and multidisciplinary teamwork through the SCERTS Model

This research investigates multidisciplinary teamwork in an English special school located in the West Midlands region of the UK. The research was carried out by Paola Molteni, a PhD student at Università Cattolica del Sacro Cuore, Milan, Karen Guldberg of the Autism Centre for Education and Research Director at the University of Birmingham School of Education, and Nick Logan, head of the Psychology and Therapists Department at Sunfield Children's Home, Clent. The school uses the innovative SCERTS (Social Communication, Emotional Regulation, Transactional Support) model. The methodology was a collaborative and participatory case study focused on the point of view of professionals and on understanding the teamwork process through analysis of three teams working together to implement SCERTS. Methods included focus groups, semi‐structured interviews, direct observations and questionnaires; the data were analysed using the Interpretative Phenomenological Analysis method. The research provides an example of good practice and enables practitioners to reflect on the issues involved in implementing a multidisciplinary process using the SCERTS approach. The findings show that the SCERTS Model can support the educational team in promoting and exchanging good daily practice and planning educational work together. The article draws out implications for further studies that aim to analyse teamwork in other settings and over a longer period.     

体育教学中学生团队精神的培养

通过体育教学活动,不仅可以培养学生的团队精神,同时,还可以培养学生优良的思想品质,这是新世纪人才所必须具备的素养和品质,所以在体育教学中,必须正确认识对学生施以团队精神培养的教育特点,需要理顺几方面的关系和正确掌握有效方法,才能实现培养学生团队精神的教育目标.     

A democratic and student-centred approach to facilitating teamwork learning among first-year engineering students: a learning and teaching case study

This work examines an innovative and evolving approach to facilitating teamwork learning in a generic first-year mechanical engineering course. Principles of inclusive, student-active and democratic pedagogy were utilised to engage students on both the social and personal planes. Learner opportunities to facilitate, direct and lead the learning direction were emphasised. This emphasis encouraged a rich learning process and motivated students dismissive of the need to examine their communication skills and those who initially perceived the topic as a personal intrusion. Through a sharing of curriculum decisions, a climate of trust, ownership and shared value arose. Students chose from a range of tools across personality-type indicators, learning style indicators and hierarchies of human needs, to assist their capacity to express and discuss engineering designs and concepts. Peer teaching and collaborative exercises were incorporated to provide an authentic learning context and to further the student's sense of ownership.     

Rethinking feedback practices in higher education: a peer review perspective

Peer review is a reciprocal process whereby students produce feedback reviews on the work of peers and receive feedback reviews from peers on their own work. Prior research has primarily examined the learning benefits that result from the receipt of feedback reviews, with few studies specifically exploring the merits of producing feedback reviews or the learning mechanisms that this activates. Using accounts of their experiences of peer review, this study illuminates students’ perceptions of the different learning benefits resulting from feedback receipt and feedback production, and, importantly, it provides insight into the cognitive processes that are activated when students construct feedback reviews. The findings show that producing feedback reviews engages students in multiple acts of evaluative judgement, both about the work of peers, and, through a reflective process, about their own work; that it involves them in both invoking and applying criteria to explain those judgements; and that it shifts control of feedback processes into students’ hands, a shift that can reduce their need for external feedback. The theoretical and practical implications of these findings are discussed. It is argued that the capacity to produce quality feedback is a fundamental graduate skill, and, as such, it should receive much greater attention in higher education curricula.     

The effects of peer judgements on teamwork and self-assessment ability in collaborative group work

A crucial determinant of the success or failure of collaborative group work is the effect of peer feedback interventions on learning. Research exploring such effects on developing soft skills is sparse. This study seeks to address whether peer feedback leads to enhanced teamwork behaviour and self-assessment ability, two skills highly sought after by employers. Specifically, this study examines the direct effect of formative performance rating and the mediating effect of praise and criticism in peer feedback messages on achievement in teamwork and self-assessment skills. The sample consists of quantitative and qualitative data from 98 students enrolled in business programmes using a particular form of collaborative group work. The paper finds a direct positive relationship between formative performance rating and summative self-assessment ability. It also finds that praise negatively mediates the relationship between formative performance rating and summative teamwork. Further analyses suggest that a significant proportion of comments provided is past rather than future-oriented. Potential strategies to overcome the limitations of current practices are discussed.     

The quality of peer assessment in a wiki-based online context: a qualitative study

Peer assessment (PA) provides opportunities for authentic assessment, autonomy and collaboration. Several authors advocate that students can benefit from PA and put forward the effects of PA on the students’ learning outcomes. Questions concerning the validity and reliability of PA and PA competences are also addressed by different researchers. This qualitative study is part of a wider project that seeks to develop and test evaluation and assessment strategies in online contexts. In a doctoral module, PA was used for summative and formative purposes. Formative PA aimed to give feedback about the ongoing group work, but also to increase online interaction between the different groups of students. The main module task was to write a literature review, about a selected topic, using a wiki. Criteria and indicators to assess the literature review were negotiated with the students. Different criteria were used to assess the quality of PA, such as, the use of the negotiated criteria, the adequacy of the chosen vocabulary or the provision of constructive feedback. The results show that overall the quality of PA can be improved. Groups did not provide sufficient criticism, questions and suggestions for improvement.     

Student perceptions of teamwork within assessment tasks in undergraduate science degrees

Teamwork assessment creates a more comprehensive educational experience by broadening the diversity of skills that students develop. Developing teamwork skills is particularly important due to a recognised skills gap among science graduates. This study investigated student perceptions of developing teamwork skills during their undergraduate science degrees. A mixed methods approach was used, which included the analysis of both quantitative and qualitative online survey data. The key findings showed that, although students understood the importance of developing teamwork skills for their future, a substantial proportion did not feel sufficiently prepared with these skills by their science degree. To develop teamwork skills, more students valued working in teams during laboratory sessions, team sports and informal study groups than non-laboratory based formal teamwork assessment. In support of previous teamwork studies across disciplines, the most cited factors contributing to poor teamwork experiences were difficulties scheduling meetings and unequal contribution among team members. This study indicates pedagogical improvements that may enhance the teamwork experience of students during assessments.     

Outcomes of synergetic peer assessment: first-year experience

Active participation in learning activities and reviewing assessment activity can facilitate learners engaged in these processes. This case study reports student experiences of the process of peer assessment with teacher guidance in a group project for a first-year nursing course with 153 students. Twenty groups of students were assigned roles in exploring one of the two scenarios: one involved analysing diabetes mellitus and the other considered colorectal carcinoma, in each case covering provision of acute nursing care in hospitals and preparing health promotion strategies in a community. Each group also provided comments to the group that worked on the other scenario, based on prearranged assessment criteria. After receiving comments from their peer group, each group was then allowed to revise their drafts prior to final submission. The teacher’s input would be offered, if the peer feedback was inaccurate or insufficient. A survey was conducted to explore the learning experiences, and three semi-structured focus group interviews were conducted to triangulate findings with the survey. The first-year students expressed the need for both peer feedback and the lecturer’s direct guidance.     

Learning mechanisms in multidisciplinary teamwork with real customers and open-ended problems

Recently, there has been a trend towards adding a multidisciplinary or multicultural element to traditional monodisciplinary project courses in computing and engineering. In this article, we examine the implications of multidisciplinarity for students' learning experiences during a one-semester project course for real customers. We use a qualitative research approach and base our analysis on students' learning reports on three instances of a project course titled Multidisciplinary working life project. The main contribution of this article is the unified theoretical picture of the learning mechanisms stemming from multidisciplinarity. Our main conclusions are that (1) students generally have a positive view of multidisciplinarity; (2) multidisciplinary teams enable students to better identify their own expertise, which leads to increased occupational identity; and (3) learning experiences are not fixed, as team spirit and student attitude play an important role in how students react to challenging situations arising from introduction of the multidisciplinarity.     

Using activity theory to evaluate a professional learning and development initiative in the use of narrative assessment

Analysis of the impact of professional learning and development (PLD) programmes for educators is complex. This article presents an analysis of a PLD initiative in which classroom teachers learned to use narrative assessment for students with ‘high’ and ‘very high’ learning needs. Using Cultural Historical Activity Theory (CHAT), the analysis showed how various tensions arose across the activity system of participants during the initiative. Tensions were associated with the roles of those involved, the narrative assessment approach, and the rules of the initiative. While the new narrative assessment approach resulted in benefits for the students and their parents, role conflict emerged in relation to established assessment approaches already used by the educators. It is argued that CHAT enables a more nuanced understanding of the complex ways in which teachers actually engage with official curriculum, pedagogy or assessment PLD initiatives, than do theories that position teachers as simply resistant to change.     

Design for assessment of dissection in anatomy laboratory based on group identification of structures and peer evaluation

Dissection is a unique multisensory educational experience and is essential to learning the anatomical construction of the human and animal bodies. This study aims to introduce a specialized design for the assessment of dissection and to discuss the assessment's attributes. The design was a product of the “assessment drives learning” concept and was developed to motivate students to dissect. Students were awarded “dissection points” based on prior group dissection and identification of structures. Students' perception of the design was examined, and content analysis was performed. The assessment consisted of two parts: the first assigning each student group structures to “pin” on their previously dissected cadavers; the second was a group peer evaluation. The most critical factor for the assessment's success was careful selection of structures assigned to students to pin. The assessment was fit for the purpose, valid, reliable, and had a significant educational impact. Eighty-three percent of students (n = 116) recommended maintaining the assessment design, as they felt it promoted a deep approach to learning as well as teamwork while reducing stress to a minimum. A strong correlation (Spearman's rho = 0.46, P < 0.0001) was present between the high rating of the design and the number of structures learned, as well as, high rating and lower stress level (Spearman's rho = 0.40, P < 0.0001). There was no apparent influence of grades on student perception of the effectiveness of the assessment. This specific design of evaluation could be used as part of anatomy education in veterinary and medical schools.     

The construction of a questionnaire to evaluate the science orientedness of students' identities as learners from a cognitive perspective

Forming a science-oriented identity is considered a process underlying both interest and achievement in science education. A questionnaire is developed for describing “identities as learners” and evaluating their science orientedness. The instrument (k = 65) focuses on cognitive aspects. An internal coherence of .88 was found. Five subscales were defined that proved interrelated yet distinguishable. A pilot amongst 40 students from Dutch general secondary education showed that preferring science over non-science subjects and relatively high grades for sciences subjects were strongly correlated to science orientedness of the learner identity (r_s  = .65; p < .001). The results support the reliability and validity of the questionnaire but also point to the importance of identity as a central concept in studying science education. It is concluded that we made a promising step in constructing an instrument for monitoring the development of cognitive aspects of science-oriented identities during (innovative) science education.     

从文化维度透视高校学生团队合作问题的成因

团队教育是高校素质教育中的重要组成。大学生在团队实践时遇到的合作问题并非由学生自身造成,而和中国文化有很大关系。学生在进行团队合作训练时实际上体验着一种和中国文化不同的价值观(主要是西方文化的价值观),团队合作中表现出消极、不适、失落等情绪本质上是文化休克的表现,因此教师需要借鉴跨文化训练的一些方法对学生进行团队精神和合作能力的培养。     

Introducing a scalable peer feedback system for learning teams

In the current research, we report on a peer feedback system for supporting student teamwork skill development during post-secondary education. The peer feedback system is part of a larger suite of assessments at ITPmetrics.com. This is a free assessment-based system that allows team members to provide round-robin ratings of each member’s effectiveness in the team on five dimensions (communication; commitment; foundation of knowledge, skills and abilities; emphasising high standards; and focus), as well as provide anonymous written feedback to supplement the numeric scores. Team members have access to a dashboard where they can complete the assessment and store assessment reports generated from their peers’ ratings. We summarise data from student learning teams suggesting that peer ratings are reliable (internally consistent, unidimensional and inter-rater correlated; n?>?85,000). Recommendations for implementation are provided with respect to pre-briefing, debriefing, and assessment schedules.     

Peer and self-assessment applied to oral presentations from a multidisciplinary perspective

This article analyses the use of peer and self-assessment in oral presentations as complementary tools to assessment by the professor. The analysis is based on a study conducted at the University of Girona (Spain) in seven different degree subjects and fields of knowledge. We designed and implemented two instruments to measure students’ peer and self-assessment, and a rubric to guide the assessment process. Results were compared with the marks awarded by the professor. In contrast with studies by other authors, which show a high correlation between these different assessment systems, our study revealed significant deviations. Applying peer and self-assessment to oral presentation activities also demonstrates their formative value above and beyond their summative usefulness.     

Using scaffolded rubrics to improve peer assessment in a MOOC writing course

This study explored the value of using a guided rubric to enable students participating in a massive open online course in writing to produce more reliable assessments of their fellow students’ writing. To test the assumption that training students to assess will improve their ability to provide quality feedback, a multivariate factorial analysis was used to determine differences in assessments made by students who received guidance on using a rating rubric and those who did not. Although results were mixed, on average students who were provided no guidance in scoring writing samples were less likely to successfully differentiate between novice, intermediate, and advanced writing samples than students who received rubric guidance. Rubric guidance was most beneficial for items that were subjective, technically complex, and likely to be unfamiliar to the student. Items addressing relatively simple and objective constructs were less likely to be improved by rubric guidance.     

Enacting feedback utilization from a task-specific perspective

Feedback is central to successful teaching and learning. Despite extensive research on the relationship between feedback, pedagogy and learning, there remain no conclusive answers as to how feedback can be effectively utilized by learners. Recently, there is emerging research exploring how feedback is conceptualized as dialogic processes to facilitate provision and uptake of feedback; and how feedback utilization is best supported by learner active involvement in the iterative feedback process for future learning. Drawn from this knowledge base, this article aims to review four aspects of feedback scholarship including nature, paradigms, issues and trends which serve as a theoretical basis, together with instructors’ interviews, to inform how five common assessment tasks in one social sciences faculty could be strategically revamped to promote feedback utilization. The article concludes with pedagogical insights to suggest three conditions wherein feedback could be made sustainable to support learning through a redesigning of conventional assessment tasks in the higher education contexts.     

Learning to lead: a practitioner perspective

This reflective essay presents a personal account of experiences and models that have shaped the development of the author as a leader in tertiary education. It is presented from the perspective of a practitioner whose career has led her through academic and administrative roles in Australian and UK institutions into her current position as academic registrar of a large, global university. The author concludes that, in learning to lead, the ideas that have been influential and which she has integrated into her practice are those that resonate with her own understanding of leadership and which are consistent with her values.     

第三部门视野中的高等教育

在国外 ,教育被纳入第三部门研究范畴中 ,但具体论述不多。从第三部门的视角研究高等教育属性具有特殊的意义。近年来各种高等教育思潮风起云涌 ,高等教育改革处于激烈争论之中 ,根本的原因在于这些改革在某种程度上缺乏足够的理论合法性。将第三部门的相关理论引入高等教育理论范畴 ,既有助于加深对目前高等教育改革困境的理解 ,又可丰富现有的高等教育理论 ,提高理论的前瞻性