Evaluating student perceptions of learning processes and intended learning outcomes under inquiry approaches

Inquiry-based learning (IBL) is promoted as a teaching approach that can enhance student learning outcomes. IBL can be categorised according to scale (e.g. tasks, course/module/paper, degree), mode (structured, guided, open) and framing (information or discovery-oriented). Our research used a survey instrument to determine how student perceptions of learning processes and intended learning outcomes (ILOs) varied in response to courses with different modes and framing of IBL. The survey was completed by 940 students in 15 IBL courses across a range of disciplines and levels. All types of IBL courses were well rated by students for encouraging learning processes and ILOs congruent with a well-designed inquiry experience. Regarding modes of IBL, there was a clear hierarchy from open (most highly rated) to guided and then structured inquiry. For the framing of IBL, courses using discovery-oriented IBL were more highly rated than information-oriented IBL. Overall, the most highly rated course design was open, discovery-oriented IBL, but other types of IBL remained important in terms of developing research and inquiry skills. To determine whether all types of IBL courses are promoting enhanced ILOs compared to more traditionally taught courses, a comparative study should be undertaken.     

Hunting and gathering: new imperatives in mapping and collecting student learning data to assure quality outcomes

Assurance of learning (AOL) is a quality enhancement and quality assurance process used in higher education. It involves a process of determining programme learning outcomes and standards, and systematically gathering evidence to measure students' performance on these. The systematic assessment of whole-of-programme outcomes provides a basis for curriculum development and management, continuous improvement, and accreditation. To better understand how AOL processes operate, a national study of university practices across one discipline area, business and management, was undertaken. To solicit data on AOL practice, interviews were undertaken with a sample of business school representatives (n?=?25). Two key processes emerged: (1) mapping of graduate attributes and (2) collection of assurance data. External drivers such as professional accreditation and government legislation were the primary reasons for undertaking AOL outcomes but intrinsic motivators in relation to continuous improvement were also evident. The facilitation of academic commitment was achieved through an embedded approach to AOL by the majority of universities in the study. A sustainable and inclusive process of AOL was seen to support wider stakeholder engagement in the development of higher education learning outcomes.     

Measuring learning outcomes

The growing interest for measurement of learning outcomes relates to long lines of development in higher education, the request for accountability, intensified through international reforms and movements such as the development and implementation of qualifications frameworks. In this article, we discuss relevant literature on different approaches to measurement and how learning outcomes are measured, what kinds of learning outcomes are measured, and why learning outcomes are measured. Three dimensions are used to structure the literature: Whether the approaches emphasise generic or disciplinary skills and competence, self‐assessment or more objective test based measures (including grades), and how the issue of the contribution from the education program or institution (the value‐added) are discussed. It is pointed out that large scales initiatives that compare institutions and even nations seem to fall short because of the implicit and explicit differences in context, whilst small‐scale approaches suffer from a lack of relevance outside local contexts. In addition, competence (actual level of performance) is often confused with learning (gain and development) in many approaches, laying the ground for false assumptions about institutional process‐quality in higher education.     

Grasping the TLRP nettle: preliminary analysis and some enduring issues surrounding the improvement of learning outcomes

The ESRC Teaching and Learning Research Programme is the largest ever programme of educational research in the UK. This article reports the purposes, processes, outcomes and issues arising from cross-programme thematic work on the conceptualization of, and research into, ‘enhancing learning outcomes’ which is a key aim of the programme. Early documentation from thirty projects is analysed, especially in relation to a classification of learning outcomes, dominant metaphors of learning, sector differences and evidence of outcomes. Discussion focuses upon persistent issues concerning the assessment of the broad range of outcomes, what leads to them, and how knowledge of these links might be established.     

New Faculty Roles in Learning Outcomes Education: The Experiences of Four Models and Institutions

Innovative models that focus on learning outcomes engage faculty in new ways of facilitating and assessing learning, while their institutions seek to support and reward their participation. Innovators from four different institutions provide an overview of their approaches to implementing principles of outcomes-based education, compare their models, and explore the changes that are precipitated in the roles, rewards, resources, structures, and models. While the four institutions and models differ on several significant variables, the innovators identify common key elements and issues that the academy must address in order to transform the educational experience and culture to a more learning-centered enterprise.     

Quality of learning outcomes in an online video-based learning community: potential and challenges for student teachers

This study investigates the learning outcomes of 25 student teachers in an online video-based learning community (VBLC). Data were drawn from the student teachers' written comments and feedback recorded in the VBLC and the post-course interviews. Based on Biggs and Collis's Structure of Observed Learning Outcomes (SOLO) taxonomy, the majority of comments and feedback were classified as uni-structural, but more sophisticated responses could also be found. The interviews revealed that the student teachers benefited from the opportunities of peer interaction and self-reflection. The study thus makes suggestions for further improvement of the operation of the VBLC.     

培养学生的积极情感,提高学习效果

课堂教学是学生日常获得知识的主要方式,教师在教学活动中关注学生的心理活动,在教学活动的各个环节培养学生学习的积极情感,就会为教育的成功提供强大动力和有效保障。通过激发学生的求知欲,变学生被动接受知识的教学模式为学生主动探究知识的教学模式,即从"要我学"变为"我要学",以达到良好的学习效果。     

Transforming evaluation thinking and behaviour: programmes develop,teachers learn and student learning outcomes improve

This article examines evaluation intervention influence on programme performance through surveys, qualitative evaluation, questionnaires, interviews and test scores. The study uses quantitative (SPANOVA and MANOVA) and qualitative (the constant comparative method) data analysis, together with examining practical significance through effect size and power analysis. Major findings show positive contributions of evaluation intervention to quality management, teacher pedagogical skills and student learning outcomes (SLOs). Quantitative and qualitative findings, however, diverge regarding evaluation impact on programme research. A positive transfer of evaluation ownership discourse from decision-maker to implementer stakeholders has been observed. The study recommends evaluation intervention for programme, institutional and individual development alongside quality improvement.     

The outcomes and impacts of everyday learning

This article examines the effects of synthesising existing theoretical approaches to understanding the effects of adult learning. The paper focuses on aspects of the findings of a small Australian research project that explored the significance of everyday learning in people’s lives. One key part of the research involved examining and synthesising two key approaches for understanding the effects of adult learning with another, different approach and then applying this to the collected snapshots of six people’s everyday lives. In the paper it is argued that this application of a synthesised framework to the participant’s stories was able to reveal more of the complex and interconnected nature of the effects of the participant’s everyday learning than either of the two original approaches on their own. This research is significant for two key reasons. Firstly, the findings of the research suggest that the effects of adult everyday learning are more complex and further reaching beyond the individual than previously established. Secondly, the work can be seen as a demonstration of the benefits of a synthesised approach to adult learning that seeks inclusivity, breadth and depth in understanding, thus contributing to the growing body of work, and understandings of adult learning.     

Student activity and learning outcomes in a virtual learning environment

The aim of the study was to explore the relationship between degree of participation and learning outcomes in an e-learning course on medical informatics. Overall activity in using course materials and degree of participation in the discussion forums of an online course were studied among 39 medical students. Students were able to utilise the course material in discussion groups focusing on the lectures, quizzes and students’ own notes. Each student’s data recording of activities and individual participation in discussion in the online course was analysed in order to assess which activities predicted learning outcome. Higher course grades were associated with studying the course material frequently and also with regular participation in reading postings and replying to them. There were no connections between learning outcome and the students’ original contributions to the discussion forums. There were no statistically significant differences between male and female students in how they utilised the various components of the learning material.     

Alternative perspectives on learning outcomes: challenges for assessment

In discussing the relationship between curriculum and assessment it is commonly argued that assessment should be aligned to curriculum or, alternatively, that they should be congruent with each other. This article explores that relationship in five educational contexts in the UK and in Europe, ranging across school education, workplace learning, vocational education and higher education. Four main themes are highlighted: construct definition, progression, assessment procedures, and system-level accountability. What emerges from the five case studies under review is a multi-layered process of knowledge being constructed in diverse ways at different levels in each context. The article concludes that, rather than thinking in terms of either alignment or congruence, these relationships are better understood in terms of non-linear systems embracing curriculum, pedagogy and assessment.     

The place of content and pedagogy in shaping sustainability learning outcomes in higher education

This research investigates the ways in which undergraduate courses dealing with the environment address sustainable development (SD), and contribute to the development of sustainability learning outcomes (SLO). The participants in the study were 13 instructors, and 360 students who were enrolled in 13 courses that addressed the environment in a technical university. Mixed methods were used for data collection and analysis. We found that courses that address the environment are varied in the way that they address sustainable development, and in the pedagogy they use. We also found links between teaching methods and the pattern of reported SLOs: skills development was promoted mainly in courses with a high degree of participatory learning; changes in awareness and attitudes were reported mainly in courses that addressed sustainable development, and motivation to promote sustainable development was reported mainly in courses that addressed sustainable development and also provided opportunities for active and participatory learning. The implications of our research are discussed.     

Perspectives of lifelong education in Portuguese higher education: a critical analysis of learning outcomes

ABSTRACT

Nurturing students’ continuous learning is a current trend in the higher education agenda. Curricula and academic contents should enable students to take part in stimulating learning experiences, as well as promoting both developing and training opportunities in the course of their lives and careers. Despite the relevance given to lifelong learning in the educational system, there are still some open questions: how this concept is understood and put into practice by higher education institutions? The paper aims to analyse the conceptions of lifelong learning as reflected on the learning outcomes proposed in a sample of study programs. A qualitative methodology and a data-driven approach are adopted to explore the content of the learning outcomes proposed in 10% of total study programs submitted to quality accreditation, since 2009. Generally, results reveal that higher education institutions are committed to the lifelong learning paradigm, particularly in master and PhD degrees. Students are expected to ‘invest in personal and professional development through life’, to ‘develop learning competences through life’, as well as to ‘foster lifelong learning’. This study provides a better understanding of the range of perspectives and the relevance given to lifelong learning as a valuable learning outcome.     

Behind the acquisition metaphor: conceptions of learning and learning outcomes in TLRP school-based projects

Using Sfard's distinction between acquisition and participation metaphors as an organizing principle, the twelve school-based projects within the TLRP programme were overwhelmingly judged by the Learning Outcomes Thematic Group as belonging to the acquisition metaphor. In essence, this article advances the initial analyses in two directions: (1) it reconsiders the projects from the point of view of conceptions of learning rather than metaphor and (2) it analyses outcomes from the point of view of a distinction that is particularly pertinent to notions of acquisition and participation—knowing that v. knowing how. The reason is simple—to keep the spotlight on the widest range of learning and learning outcomes that is being researched in the programme and to avoid blurring differences that might be important for curriculum planners, for teachers and for assessment. In the final section, some general implications for assessment in classrooms are briefly discussed.     

Civic learning outcomes: a step towards an inclusive higher education

An inclusive education goes beyond the acquisition of discipline knowledge or skills. Inclusion is concerned with the participation and integration of all students (regardless of their intrinsic characteristics), helping them to develop civic competences. Civic and democratic values, equality and social justice became critical dimensions in this broader concept of education. This paper argues that the incorporation of civic dimensions, such as civic knowledge, civic skills or civic values in academic curricula could be an effective step towards more inclusive education. Specifically, this work intends to explore what civic dimensions are emphasised as a learning outcome in Portuguese higher education programmes. Adopting a qualitative methodology, typologies and incidence of civic learning outcomes were analysed and compared across three academic levels (first, second and third study cycles). The results provide a better understanding of what civic dimensions are stressed by institutions. All types of civic learning outcomes have been reinforced, defining civic values, civic skills and civic knowledge as expectable learning results. Both civic values and skills are well represented while civic knowledge is the less mentioned category. The enforcement of such civic dimensions is a valuable approach to enhancing education as a collective societal endeavour and as a common good.     

Graduate learning outcomes in science: variation in perceptions of single- and dual-degree students

The development of transferrable skillsets, articulated in statements of graduate learning outcomes, is emphasised in undergraduate science degree programmes. Science students enrolled in dual (double) degrees comprise a significant minority of Australian science undergraduates. Research comparing perceptions of single and dual degree students on their science learning outcomes has rarely been explored. The Science Students Skills Inventory was used to compare the perceptions of single (n = 640) and dual (n = 266) degree undergraduate science students. The instrument explored science graduate learning outcomes across six indicators: importance; the extent to which outcomes were included; the extent to which they were assessed; improvement; confidence; and likely future use. Analysis of findings, employing the planned–enacted–experienced curricula framework, offers insight into potential avenues towards coherence of the experienced curriculum by arguing the need for shared perceptions of graduate learning outcomes for single and dual degree science students. The key contribution of this study is a shift towards progressive curriculum development that draws on both single and dual degree student perspectives to achieve graduate learning outcomes. Recommendations include: whole-of-programmes curricular pathways premised on progressive development of learning outcomes that are inclusive of dual degree students, explicit interdisciplinary learning opportunities, and adoption of dual/single status as a demographic variable reported in future research.     

Growing confidence in educational research: Threats and opportunities

We live in difficult times—socially, economically and politically—and it is right that learned societies, such as the British Educational Research Association, reflect on their purpose and direction. We cannot take for granted the social contract that supports the funding of social science and educational research. This paper reflects on enduring themes and new pressures and argues for special attention to: collaboration within and beyond the community of university‐based educational researchers; support for, and recognition of, the importance of reviews of research; the development of accessible forms of communication of findings and their implications, to guide sound decision making; more direct engagement with practitioners, policy makers and the public. It argues that it is time for communities of educational researchers to have confidence to become outward looking and strengthen alliances with other groups of researchers at home and abroad, across disciplines, with different types of research institutions and also with practitioners and policy makers. What drives this should be our principal aim to pursue educational research and its application for the improvement of education and the public benefit.     

Assessment of learning outcomes in Finnish vocational education and training

This article provides an outline and critical review of assessment, an evaluation of learning outcomes, in vocational education and training (VET) in Finland. Assessment of VET is formative, development-orientated and criteria-based. There are no national tests and information from vocational skills demonstrations is used instead. Assessment targets are individual and communal learning focusing on processes instead of reports. Interactive, multifaceted assessments and qualitative methods promote learning and are based on trust – not control. The developmental assessment of learning outcomes started as an experiment in 2002 and as a permanent system in 2007. The whole process has been included and still includes also many challenges of methods, which this article tries to open.