Three in-course assessment reforms to improve higher education learning outcomes

A current international concern is that, for too large a proportion of graduates, their higher order cognitive and practical capabilities are below acceptable levels. The constituent courses of academic programmes are the most logical sites for developing these capabilities. Contributing to patchy attainment are deficiencies in three particular aspects of assessment practice: the design and specifications of many assessment tasks; the minimum requirements for awarding a passing grade in a course and granting credit towards the degree; and the accumulation of points derived from quizzes, assessments or activities completed during the teaching period. Rethinking and reforming these would lead to improvements for significant sub-populations of students. Pursuing such a goal would also have significant positive implications for academic teachers, but be contingent on favourable contextual settings including departmental and institutional priorities.     

Identifying the trends and impact of graduate attributes on employability: a literature review

Graduate employability has become an issue since there are broad mismatches between the acquired graduate skills from university and the required skills by employers. While previous researches have outlined the salient skills that need to be embedded in graduate education, to date no studies have attempted to methodically identify and synthesize the literature on graduate attributes. In this paper a total of 39 relevant studies on graduate skills and attributes in the subject areas of business and management, accounting, and computer science were extracted from Scopus^® (database). This revealed a total of 53 graduate attributes, with some being highly used, such as communication, teamwork, problem solving, technological skills, creativity, interpersonal skills, leadership skills, self-management and flexibility/adaptability. The majority of studies used a quantitative survey method to collect and rank graduate attributes, and Australia emerged as the most active country in researching the domain.     

Exploring the role and value of creativity in education for sustainability

Creativity, innovation and divergent thinking are routinely expected to help people envision and implement alternative practices to the status quo. However, these do not feature strongly in the literature on education for sustainability in higher education (HE), and especially graduate competencies or capabilities for sustainability. The paper makes the case for the importance of creativity in education for sustainability (EfS), and argues that innovation is at the heart of moving societies towards more sustainable paths. In other words, creativity is an essential part of learning for sustainability. A critical perspective is offered, by highlighting the effects of the theoretical roots of sustainability and environmental education in the ecological sciences, the traditional and still dominant construction of learning and teaching in HE and EfS, and the challenges and rewards that supporting creativity presents for learners and teachers in this field.     

The place of content and pedagogy in shaping sustainability learning outcomes in higher education

This research investigates the ways in which undergraduate courses dealing with the environment address sustainable development (SD), and contribute to the development of sustainability learning outcomes (SLO). The participants in the study were 13 instructors, and 360 students who were enrolled in 13 courses that addressed the environment in a technical university. Mixed methods were used for data collection and analysis. We found that courses that address the environment are varied in the way that they address sustainable development, and in the pedagogy they use. We also found links between teaching methods and the pattern of reported SLOs: skills development was promoted mainly in courses with a high degree of participatory learning; changes in awareness and attitudes were reported mainly in courses that addressed sustainable development, and motivation to promote sustainable development was reported mainly in courses that addressed sustainable development and also provided opportunities for active and participatory learning. The implications of our research are discussed.     

A case study of assessment of graduate learning outcomes at the programme,course and task level

A shift in emphasis from educational inputs to academic outcomes as the basis for judgements of educational quality in many parts of the world has intensified efforts to develop assessment practices that provide convincing evidence that students have achieved or made progress towards the graduate learning outcomes specified for a programme of study. Examples of sound and feasible practice are still relatively rare in this area, so when assessment practices observed during the initial stages of an evaluation of a curriculum innovation in an archaeology programme conveyed an impression of unusually high quality, the original evaluation plan was expanded in order to allow further investigation. The resulting case study describes the features that contributed to assessment quality at the programme, course and task level. As the general principles and guidelines for effective practice are comprehensively addressed in current assessment literature, this case has a particular focus on the ‘technical’ such as task analysis and task relationship patterns. Though contextualised in the archaeology discipline, the study seeks to illuminate aspects of practice in terms that enable academics outside this field to identify implications for practice in their own disciplinary or institutional contexts.     

An assessment of the effectiveness of a classroom activity designed to teach the value of lifelong learning

Many agree that educational systems should instill in students the value of lifelong learning (LLL), but few have suggested how to accomplish that or how to measure the effectiveness of those curricular initiatives. We developed a technique intended to strengthen students' beliefs about the value of LLL and piloted use of a recently developed scale to assess changes in commitment to LLL. Using a quasi-experimental procedure, we presented students with faculty members’ career biographies describing their personal career paths, including how they learned from their experiences and how they had to adapt and adjust to changing circumstances. To assess beliefs about LLL, students completed Bath and Smith's Propensity for Lifelong Learning (PLLL) scale. We found that students who listened to career biographies had significantly stronger beliefs regarding the value of LLL than the students who were not exposed to the career biographies. We concluded that listening to career biographies strengthened commitment to LLL and that the PLLL scale is a useful outcome measure of this commitment. We discussed limitations and future directions of our method and measurement instrument.     

‘Think about what our industry stands for….’: exploring the impact of external factors on line manager perceptions of graduate employability

ABSTRACT

Increasing emphasis is being placed upon employer expectations in research on graduate employability, in response to the widely claimed gap between employer expectations and graduates’ understanding of these expectations. For graduates, being uncertain of their employer’s expectations may threaten the ease of their transition into the workplace and their job satisfaction, even leading to issues around graduate retention for employers. External influences on the graduate labour market such as differences in industry/sector level expectations and economic/political factors, can pose further complications. This paper presents a cross-industry analysis of employer expectations of graduates, drawing from four selected case study vignettes aimed at uncovering insights into these variances. Findings offer implications for policy makers and higher education providers around the design and delivery of a curriculum that appropriately prepares students for the graduate labour market, whilst also catering for industry-level expectations particularly in light of the UK’s forthcoming departure from the EU.     

Taking stock of sustainability in higher education: a review of the policy literature

Abstract

This paper provides a review of the current literature that examines the uptake of sustainability policies in higher education. Articles were retrieved from both ERIC and Scopus databases and then manually reviewed to ensure that they focused on each of: higher education; sustainability; and policy. A total of 91 articles were analysed using a multi-stage process that involved sorting data according to typologies (i.e. temporal, terminology, methodology, geography), coding the text of the articles based on topical content, and an indexing method used to label data for further analysis and the development of broader code categories. Results suggest that drivers and barriers associated with the integration of sustainability policy in higher education are well known; yet increased research is needed to understand best practices and processes by which sustainability can be furthered through higher education policy. In addition, findings demonstrate the need for future research to focus on various aspects of the policy process, including policy development and enactment, and on implications of policy for practice. While there have been some reviews of sustainability policy in higher education research to date, this review contributes to this literature by highlighting research primarily focused on sustainability policy within higher education.     

学习效果评估:美国高等教育评估发展的趋向

随着利益相关者的介入,政府外在问责与高校内在质量改进的要求,促使美国高等教育评估发生了转变,更注重以学生学习效果作为重要维度。高等教育认证机构、质量评估机构纷纷推动学习效果评估的实施,建构了评估框架与标准体系,从而提升高等教育质量。在实施过程中,体现出学生全面发展的理念,政府加强介入,评估活动更加专业化,注重在全国范围内实施的特点。     

Rethinking models of feedback for learning: the challenge of design

Student feedback is a contentious and confusing issue throughout higher education institutions. This paper develops and analyses two models of feedback: the first is based on the origins of the term in the disciplines of engineering and biology. It positions teachers as the drivers of feedback. The second draws on ideas of sustainable assessment. This positions learners as having a key role in driving learning, and thus generating and soliciting their own feedback. It suggests that the second model equips students beyond the immediate task and does not lead to false expectations that courses cannot deliver. It identifies the importance of curriculum design in creating opportunities for students to develop the capabilities to operate as judges of their own learning.     

Learning about agriculture within the framework of education for sustainability

The last two decades have seen increased threats to agricultural landscapes in Israel. Key factors include population growth, strong pressure from construction entrepreneurs and possible profit to land owners who benefit from a legal conversion of farmland into lands allocated for construction. While each Israeli elementary school student used to participate in agriculture classes, most students no longer experience this and their overall exposure to farming in schools is limited. The main objective of this study was to explore the ways farming is presented and addressed in the national curriculum and in learning materials. Additionally, it examines the actual status of teaching about agriculture and explores how farming is addressed in teachers' pre‐service programmes. The main finding is that very little teaching about agriculture and land management is carried out at most school levels. Only one college prepares agriculture teachers and science education programmes rarely address agriculture as a course topic. The paper also outlines an education for sustainability framework for integrating science, agriculture and environmental education.     

Conceptualising strategic alignment between curriculum and pedagogy through a learning design framework

Abstract

Improved clarity concerning the relationship between curriculum and pedagogy in higher education is needed to address issues concerning learning and teaching quality. This paper explores the relationship between curriculum and pedagogy and argues for a stronger and more explicit link between the two. On that basis, the paper proposes a conceptual learning design framework that has the potential to act as a clarifying tool for academic developers and academics as they conceptualise and develop contemporary learning environments for effective learning. Reflections on the implication of the framework for practice are discussed.     

Effect of continuous assessment on learning outcomes on two chemical engineering courses: case study

In this paper, the effect of continuous assessment on the learning outcomes of two chemical engineering courses is studied over a several-year period. Average grades and passing percentages of courses after the final examination are reported and also student feedback on the courses is collected. The results indicate significantly better learning results after the adoption of continuous assessment in the courses. Also student feedback suggests higher quality in teaching after the adoption of more activating teaching methods which compel students to study effectively throughout the course.     

学习产出视角下高等职业教育学生学习评估探析

高职学生学习产出是指学生经过学习后,其职业知识、职业技能、职业行为及职业道德等方面发生的变化。高职学生学习产出具有职业性、实践性和应用性等特点。以学习产出视角反思当前我国高职学生学习评估现状,需要树立系统化的学习评估理念;学校需要从被评者转变为评估主体和主导者;行业企业和学生需要共同参与以学习产出为核心的学习评估标准制定;学习信息的复杂性和多样性需要采用多元收集方法。     

Formative assessment of teachers in the context of an online learning environment

This case study looked at how an assessment strategy designed for an online learning environment can support teachers’ professional development. More specifically, we intended to evaluate how a particular online assessment design can help the participating in-service teachers to recognize the added value of formative assessment, and promote their own use of formative assessment in their professional classroom practices. The presented assessment design consists of a combination of different, non-standard assessment methods in an online environment. We analysed data from 494 questionnaires, the participants’ critical reflections about their learning and the participants’ produced artefacts. The findings illustrate the participants’ recognition of the formative character of the proposed assessment design, reflected not only by the high scores reported in seven of the eight themes explored, but also from the qualitative analysis of the participants’ reflections and artefacts. Suggestions are offered for the improvement of the proposed assessment design, so as to better promote the formative character of assessment. In particular, implications for the development of formative assessment in online professional development are discussed taking into account its potential to promote the participants’ self-regulatory learning processes.     

Formative self-and peer assessment for improved student learning: the crucial factors of design,teacher participation and feedback

Self and peer-assessment are becoming central aspects of student-centred assessment processes in higher education. Despite increasing evidence that both forms of assessment are helpful for developing key capabilities in students, such as taking more responsibility for their own learning, developing a better understanding of the subject matter, assessment criteria and their own values and judgements, and developing critical reflection skills, both forms of assessment are still not the norm at universities. This paper provides the findings of a two-year study of formative self and peer-assessment at an Australian university. The study supports other research showing that students tend to regard formative self and peer-assessment as beneficial for gaining more insights about the assessment process and for improving their own work. We argue that self and peer-assessment requires careful design and implementation for it to be an effective tool for formative assessment processes; and that the development of students’ capacities for giving feedback, and the continuous and timely involvement of the teacher, are central aspects for successful self and peer-assessment. The move to self and peer-assessment is not simple for teachers and students but is worthwhile and necessary for twenty-first century higher education.     

Quality of assessment of prior learning (APL) in university programmes: perceptions of candidates,tutors and assessors

Formal diplomas and certificates have been accepted as proof that students may receive exemption for parts of their educational programme. Nowadays, though, it is socially desirable that informal and non-formal learning experiences are also recognised. Assessment of prior learning (APL) addresses this issue. In APL, the candidate's knowledge, skills or competences required in informal and non-formal learning are measured against a standard to determine whether they match the learning objectives. Although APL is frequently used in workplaces and vocational education, it is practised less in universities, and research is lacking in this context. This study aims to evaluate the first APL procedure in an academic computer science programme, and an adjusted APL procedure in an educational science masters programme. This is done from the perspective of the APL candidates, tutors and assessors, using the theoretical framework by Baartman et al. (2006). The computer science participants comprised 23 candidates from a police software company, four tutors and four assessors. From educational science, nine candidates, two tutors and two assessors participated. The results show that the APL procedure in educational science is viewed significantly more positively than that in computer science; further, the computer science assessors differ considerably from the other participants in their perceptions relating to the quality criterion ‘cognitive complexity’. Explanations for the difference between the two programmes are discussed in this article and assessor and tutor training highly recommended.