Does continuous assessment in higher education support student learning?

A distinction is often made in the literature about “assessment of learning” and “assessment for learning” attributing a formative function to the latter while the former takes a summative function. While there may be disagreements among researchers and educators about such categorical distinctions there is consensus that both types of assessment are often used concurrently in higher education institutions. A question that often arises when formative and summative assessment practices are used in continuous assessment is the extent to which student learning can be facilitated through feedback. The views and perceptions of students and academics from a discipline in the Humanities across seven higher education institutions were sought to examine the above question. A postal survey was completed by academics, along with a survey administered to a sample of undergraduate students and a semi-structured interview was conducted with key academics in each of the seven institutions. This comparative study highlights issues that concern both groups about the extent to which continuous assessment practices facilitate student learning and the challenges faced. The findings illustrate the need to consider more effective and efficient ways in which feedback can be better used to facilitate student learning.     

Stopping to thinks school‐based and higher education‐based primary student teachers' reflections on their learning

This paper examines trainees' perceptions of the impact, on secondary mathematics trainees, of collaborative school‐based work involving small groups of trainees, a university tutor and a class teacher. The findings suggest that trainees' become better able to plan and deliver a coherent yet diverse sequence of lessons, that their awareness of children's learning styles and misconceptions was raised and that preconceived notions about teaching and learning were challenged and mediated. A few trainees found the experience unhelpful and threatening. The role of the tutor was found to influence trainees' responses to the program and, to an extent, moderate the effects of variations in teacher involvement. Some implications are discussed.     

Development and evaluation of computer‐assisted assessment in higher education in relation to BS7988

A university‐wide project team of academic and administrative staff worked together to prepare, deliver and evaluate a number of diagnostic, formative and summative computer‐based assessments. The team also attempted to assess the University of Southampton's readiness to deliver computer‐assisted assessment (CAA) within the Code of practice for the use of information technology in the delivery of assessments (British Standards Institution, 2002 British Standards Institution (BSI). 2002. BS7988: 200—code of practice for the use of information technology in the delivery of assessments, London: British Standards Institution.  [Google Scholar]). Evaluation data was used formatively to improve procedures during the project and summatively in preparing the project's final report, this publication and future support for CAA at Southampton. Some of the problems encountered during this pilot programme were anticipated, both by the project team and by BS7988; but they were not necessarily or entirely avoidable given the nature of control and management in an academic environment. Our approach was to encourage institutional learning via extensive dissemination and discussion of the results. To contribute to the public debate on the adoption of BS7988, we highlight difficulties in allocating responsibility for various aspects of the assessment process and make a number of recommendations about this and other practical issues.     

E‐learning and the transformation of social interaction in higher education

This article examines the way in which e‐learning is transforming the nature of social interaction in higher education. In this new educational environment, radical societal transitions and the opportunities afforded by modern communication technologies together produce formidable challenges. Significant as these challenges may be, concentration upon problems of a practical kind draws attention away from the more theoretical concerns in understanding e‐learning. By drawing together developments in social, educational and communicational theory and Gilly Salmon’s hands‐on approach to teaching and learning online, this article reveals some unintended consequences: e‐moderation and the use of e‐tivities may perpetuate the very conditions that limit our chances of dealing successfully with the challenges posed by e‐learning. While theory may muddle what might otherwise be communicated meaningfully to those in search of practical answers, theoretical developments provide concepts and frameworks that can be placed in the service of a critical understanding of e‐learning and the transformation of social interaction in higher education.     

A computer‐based learning environment in the field of Newtonian mechanics

This paper describes a Computer‐based Learning Environment (CBLE) whose objective is to stimulate and support learning in the field of Newtonian mechanics through exploratory activities in various microworlds. The structure of the microworld TABLE is described in detail. A pilot study is presented: it concerns the modelling process of the learner knowledge in the topic involved and the evaluation of the impact of the exploratory activity on student learning. Some suggestions drawn from the results are discussed.     

Identifying and promoting self‐regulated learning in higher education: roles and responsibilities of student tutors

This article reports on a case study of learning and academic achievement in engineering education. Two sets of oral exams were used as a source of information in relation to students’ learning and needs in the learning situation. Through ensuing interviews, patterns of learning strategies were discerned. Academically successful students utilised self‐monitoring skills, such as self‐evaluation and comprehension monitoring, while these skills were used only to a minor extent by those less successful. Promoting self‐regulated learning could be one way to improve student learning. The research literature, however, suggests that merely teaching self‐monitoring skills does not necessarily make a difference. This study therefore focuses on roles of tutors in identifying and promoting self‐regulated learning.     

Evaluating computer‐based assessment in a risk‐based model

There are three purposes for evaluation: evaluation for action to aid the decision making process, evaluation for understanding to further enhance enlightenment and evaluation for control to ensure compliance to standards. This article argues that the primary function of evaluation in the ‘Catherine Wheel’ computer‐based assessment (CBA) cyclic model is evaluation for action and secondary functions are evaluation for understanding and control. By studying segment and cyclic dependencies, conducting a risk analysis and identifying key stakeholders it is possible to identify where action evaluation has the most effect, what is required to be evaluated, who will perform the action and how it will be controlled. Each segment and cycle in the CBA model must therefore be monitored and the observations made must have meaning for the elimination or reduction of pedagogic, operational, technical non web‐based, web‐based and financial risks. It is important to consider stakeholders because they have differing views on what is most important in the evaluation process and inevitably will be involved in the evaluation process itself. CBA system stakeholders include management, academic, support and administrative staff together with external verifiers and students. The information gained from these stakeholders provides quality enhancement and assurance and forms the basis for change.     

The role of visualization in learning from computer‐based images

Among the sciences, the practice of geology is especially visual. To assess the role of spatial ability in learning geology, we designed an experiment using: (1) web‐based versions of spatial visualization tests, (2) a geospatial test, and (3) multimedia instructional modules built around QuickTime Virtual Reality movies. Students in control and experimental sections were administered measures of spatial orientation and visualization, as well as a content‐based geospatial examination. All subjects improved significantly in their scores on spatial visualization and the geospatial examination. There was no change in their scores on spatial orientation. A three‐way analysis of variance, with the geospatial examination as the dependent variable, revealed significant main effects favoring the experimental group and a significant interaction between treatment and gender. These results demonstrate that spatial ability can be improved through instruction, that learning of geological content will improve as a result, and that differences in performance between the genders can be eliminated.     

Vets and videos: student learning from context‐based assessment in a pre‐clinical science course

To increase the perceived relevance of pre‐clinical science courses to undergraduates, a context‐based assessment item was introduced to a genetics course that occurs early within a five‐year veterinary science programme. The aim was to make a direct link between genetic concepts and the future clinical profession of the students. In the assessment task, students used problem‐solving skills to deduce relationships between genetic variants and nose and coat colour in dogs and to determine breeding strategies to obtain a specified colour combination. The assignment was contextualised by students presenting their results as a role‐play video of a veterinarian/client consultation. The students responded enthusiastically, finding relevance and enjoyment in the task. Together with the higher cognitive skills required, contextualisation is likely to be responsible for the deeper style of learning that was adopted by the majority of students. Hence, making explicit links between pre‐clinical content and its use in a workplace setting can lead to improved learning outcomes     

Investigating the curriculum through assessment practice in higher education: the value of a ‘learning cultures’ approach

It is widely acknowledged that the curriculum and knowledge in higher education (HE) are especially visible through (and often constructed by) assessment practices. If this is the case, it matters greatly what perspectives and theoretical tools are brought to bear on the task of understanding these practices. Having briefly set out three perspectives on assessment in HE (the technical, humanist and interactionist), this paper introduces a ‘learning cultures’ perspective, drawing upon the work of Bourdieu, developed as part of a recent research project on English Further Education. The application of this perspective in HE is introduced through a vignette outlining a recent assessment episode and notes on how it may be explored. The paper argues that whilst some contemporary work on HE assessment incorporates elements of a cultural perspective, there are potential practical benefits to a more thoroughgoing adoption of a ‘learning cultures’ approach.     

Going with the flow: First‐cycle higher education in a lifelong learning context

Abstract

Higher education is in flux as governments around the world seek to use it as an instrument to enhance national economies, and the half‐life of knowledge steadily decreases. Lifelong learning is presented as critically important to the development of human capital, but its implications for first‐cycle higher education have yet to be fully appreciated. It is argued that first‐cycle higher education is evolving in the light of changes in the relationship between the academy and employers. Students’ part‐time work is a significant component of their experience in higher education, yet its potential for learning is generally under‐exploited. The argument is made that part‐time work can be drawn into the formal curriculum without prejudice to traditional academic concerns, particularly if a lifelong learning perspective is taken.     

The contribution of non-formal learning in higher education to student teachers’ professional competence

This article reports a mixed methods study on the contribution of various aspects of pre-service student teachers’ learning in initial teacher education (ITE) to their professional competence in a Five-year Bachelor of Education Programme in Hong Kong. Special attention is given to how student teachers’ non-formal learning in higher education contributes to their professional competence, an under-researched area in teacher education. A total of 282 student teachers participated in the quantitative survey, 18 of whom were interviewed. Although  Undergraduate Learning Experience: Formal Learning and Non-formal Learning was not the most highly rated factor, multiple regression indicated that it was the only ITE professional learning factor that significantly predicted all dimensions of professional competence. This supports the hypothesis that non-formal learning as a part of learning in higher education makes a significant contribution to student teachers’ professional competence. The qualitative findings showed that non-formal learning provided opportunities for service learning, co-curricular activities, and student exchange programmes with different objects of engagement. Student teachers constructed pedagogical content knowledge, general pedagogical knowledge, and knowledge of context through hands-on experiences, professional dialogue with practitioners, and observations of others’ practice. Such knowledge contributed to their competence in classroom teaching and to work in schools. Implications for ITE are discussed.     

Student‐teachers' evaluation on the use of different modes of problem‐based learning in teacher education

Problem‐based learning (PBL) has been widely adopted in many university programmes. Evaluations of PBL in medicine, dentistry, nursing and social work reveal positive outcomes from both tutors and learners. However, few evaluations have been published about using PBL in teacher education programmes. This paper reports how the 13 student‐teachers in the Integrated Humanities Major Method course evaluated the use of three different modes of PBL delivery, namely: the classical PBL; an alternate pattern of PBL and teacher‐led deductive workshops; and a modified PBL using problem‐based scenario inductive inquiry workshops. The learning experiences of the student‐teachers were captured via an open‐ended questionnaire to discuss the feasibility and receptivity of endorsing full or partial use of PBL in the teacher education programme. The outcome shows strong preference for the use of the modified PBL approach while the majority agreed the classical PBL style is the most challenging among the three modes.     

Staff–student collaboration: student learning from working together to enhance educational practice in higher education

The association of research and teaching, and the roles and responsibilities of students and academic staff and the nature of their interrelationship are important issues in higher education. This article presents six undergraduate student researchers’ reports of their learning from collaborating with academic staff to design, undertake and evaluate enquiries into aspects of learning and teaching at a UK University. The students’ reflections suggest that they identified learning in relation to employability skills and graduate attributes and more importantly in relation to their perceptions of themselves as learners and their role in their own learning and that of others. This article draws attention to the potential of staff–student collaborative, collective settings for developing pedagogic practice and the opportunities they can provide for individual student's learning on their journey through higher education.     

Teaching at the border of despair and hope: supporting the education of non‐traditional working class student teachers

This study focuses on a group of working class adult students' experiences and reactions to their encounters during a foundational series of university courses required of all preprofessional education students. It finds that sharing stressful events and personal information during analytical discussions led to the development of a collegial learning community and added to participants' respect for difference and diversity. The study also finds that these non‐traditional undergraduates viewed their own academic learning experience, as well as their role as college students, through a standpoint of struggle and distress. However, their future professional goal, being a teacher, was defined from an opposite point of view. Education and learning as a profession was viewed as a liberating experience, a way out of poverty and other stressful conditions. The dissonance between these two perspectives is explored from a variety of theoretical perspectives and the discussion ends with a call for more inclusive and flexible university programs that support working class and non‐traditional students' perspectives and needs.     

A meta‐analysis of the effectiveness of telecourses in distance education

Abstract

This study used meta‐analytic procedures to examine experimental research literature about the use of telecourses in adult and higher education. Weighted effect size analysis procedures were used. The study included experiments that used video and either one‐way or two‐way audio. The purpose of this study was to review evidence concerning the effectiveness of telecourses. The instructional features that impacted learner achievement were type of interaction during the broadcast, type of course, and type of remote site. Two‐way interaction was found to be the best method of interaction between learners and the instructor. Most of the studies failed to provide information about their learner attrition rate, thereby casting a shadow on the results.     

Inside the ‘body box’: exploring feedback in higher education

In recent years, educational research has paid special attention to teachers’ practical-operative experience. The growing interest in the concept of practice within workplace settings has become a turning point in sociological, anthropological and educational studies. The present study aims to explore lecturers’ perceptions and conceptions of feedback and their daily professional practice, with a focus on the use of body movement while providing feedback during the class. Even though educational research has paid a lot of attention to the concepts of practice and performance, there are very few studies that consider the main actor included in the definition of those concepts: the body. Methodologically this exploratory case study uses a mixed methods approach. Results identified two types of issues: the first one concerns the relation between lecturer and students during the feedback practice; the second one concerns the internal coherence of lecturers between the kind of verbal feedback they provide during the lesson and how at the same time they act bodily.     

Variation in the development of teachers’ understandings of assessment and their assessment practices in higher education

This paper reports a study into the development of staff understanding of assessment and assessment practice. Eight teachers from two universities constructed an initial concept map about assessment that was discussed in a one-to-one semi-structured interview. A year later, a new map was created and the interview focused on change in thinking and practice. Multiple models of assessment were evident in the participants’ understandings at the same time and change was characterised by subtle evolution in thinking. Development in practice was more significant and often associated with the foregrounding of assessment for learning. Vignettes are used to illustrate the variation in nature and scale of development. Interplay between this development of practice and understanding was multidirectional and external context played an important role. The approach offers detailed insight into the relationship between assessment thinking and practice and demonstrates that both research and academic development need to go beyond conventional approaches to conceptualising the development of academics and take account of the finer grained complexities of assessment thinking and practices.