The Return to Final Paper Examining in English National Curriculum Assessment and School Examinations: Issues of Validity,Accountability and Politics

There are sound educational and examining reasons for the use of coursework assessment and practical assessment of student work by teachers in schools for purposes of reporting examination grades. Coursework and practical work test a range of different curriculum goals to final papers and increase the validity and reliability of the result. However, the use of coursework and practical work in tests and examinations has been a matter of constant political as well as educational debate in England over the last 30 years. The paper reviews these debates and developments and argues that as accountability pressures increase, the evidence base for published results is becoming narrower and less valid as the system moves back to wholly end-of-course testing.     

Impressions of ICOTS II

The following short contributions are from people who attended the Second International Conference on Teaching Statistics held in Victoria, August 1986     

FROM A DOMESTIC TO AN INTERNATIONAL ORGANIZATION: THE OPEN UNIVERSITY,THE UNITED KINGDOM,AND EUROPE

This article describes the change of the Open University of the United Kingdom during the 1990‐1993 period from being a domestic to an international organization, with the expansion of its provision throughout the whole of the European Union and a range of other European countries, including Austria, Bulgaria, Romania, Russia, Slovakia, Slovenia, and Switzerland. As a case study, it raises issues about the development of universities from the unique organizations which they have been in European society to international organizations which understand their roles in business terms, and suggests that distance teaching universities, because of their industrialized nature and volume of activity, may become leading examples of this trend.     

The Scholarship of Teaching and Learning: Theory–Practice Integration in a Faculty Certificate Program

There is growing recognition of the complexity of academic work and the need for university and college faculty members to develop scholarly approaches to teaching and learning. While structured programs of study have been initiated for faculty to address these issues in various higher education contexts, very little research has investigated the theory–practice relationship of the scholarship of teaching and learning within a faculty certificate program context. This article presents a program development and evaluation framework to enhance the theory–practice integration of the scholarship of teaching and learning in such a program. Data suggest that a broad range of institutional and programmatic strategies can enhance the scholarship of teaching and learning in a faculty certificate program. A scholarly approach to teaching and learning is viewed as both an individual and social contextual process.Dr Harry Hubball and Dr Helen Burt are faculty members at the University of British Columbia, BC, Canada. Harry Hubball's research focuses on curriculum and pedagogy in university settings. He coordinates the UBC Faculty Certificate Program on Teaching and Learning in Higher Education. Helen Burt is the Associate Dean of the Faculty of Pharmaceutical Sciences. Her research interests include the development of novel polymer-based drug delivery systems.     

Validating human and automated scoring of essays against “True” scores

ABSTRACT

In the current study, two pools of 250 essays, all written as a response to the same prompt, were rated by two groups of raters (14 or 15 raters per group), thereby providing an approximation to the essay’s true score. An automated essay scoring (AES) system was trained on the datasets and then scored the essays using a cross-validation scheme. By eliminating one, two, or three raters at a time, and by calculating an estimate of the true scores using the remaining raters, an independent criterion against which to judge the validity of the human raters and that of the AES system, as well as the interrater reliability was produced. The results of the study indicated that the automated scores correlate with human scores to the same degree as human raters correlate with each other. However, the findings regarding the validity of the ratings support a claim that the reliability and validity of AES diverge: although the AES scoring is, naturally, more consistent than the human ratings, it is less valid.     

Developing formative assessments for postgraduate students in engineering

This paper outlines an approach taken to produce computer-based formative assessments for two modules in a one-year taught MSc programme in Road Management and Engineering. It presents the aims of the assessments, the taxonomy adopted to ensure that the formulation of the questions addressed learning outcomes related to the development of higher order skills and the choice of software used. Further, the students’ qualitative perception of the assessments is presented together with a discussion on key elements that affected the implementation procedure. This included an understanding of the higher order skills assessed, knowledge of the facilities offered by the software to be used, and the commitment needed to designing, delivering and improving flexible learning materials.     

Governance and decision-making in higher education

Concluding Observations From the presentations of the survey outcomes is has become clear that substantial differences exist between both types of institutions as well as between countries. To a large extent, the results for the universities in particular still reflect the dominant notion of professional expertise, especially where the primary processes of teaching and research are concerned. At the same time, it also has become clear that the role of the central institutional administration is a non-negligible factor in higher education, especially for what we can call the ‘non-primary processes’ issues. With respect to differences between countries, the study shows substantial variation between the countries. This alone appears to provide sufficient basis to question the general assumption of the continental model. On the European continent clearly different institutional governance systems exist, and it would appear logical to relate these to the different ways in which national governments in these systems have changed their policies and policy priorities over the years. However, to shed further light on these differences, a more detailed analysis of the data will have to be performed, for example relating the survey out-comes to differences in governmental steering paradigms.