A macro-analysis of quality assessment in higher education

In most West European countries a quality control system for higher education is in a process of development. This article examines some general characteristics of the emerging structures, how quality is defined and what impact this definition has on internal evaluation.On the basis of a more substantive conceptualization of the term quality, the current trend of a quality control system in which quality is predominantly defined from one central power centre is questioned. Important methodological and substantive weaknesses inherent in this centralist model will be discussed.In the final section a shift towards a quality control system is advocated in which other interests and perspectives are taken into account.     

高等教育服务质量模糊综合评价法初探

模糊综合评价是一种新的高等教育服务质量评价方法,具有多元性、差异性、全面性、发展性、模糊性等特征。它将定性和定量评价、过程评价和结果评价结合起来,体现了现代高等教育质量评价的时代需要,是对已有的高等教育质量评价的一种超越,对提高高等教育质量具有重要的现实意义。     

International comparisons of themes in higher education research

ABSTRACT

The themes in higher education research in different countries vary to some extent. This research takes 15 SSCI journals of higher education as examples. A scientometric method was used to classify the themes in higher education research, and a vector space model was employed to calculate the similarities in different countries active in the research hot spots in the cognate area. The results show that the top five ranked keywords of higher education research are assessment, university, sustainability, feedback, and diversity. Higher education research was classified into 20 areas, and different countries were focused on different areas. The number of publications was mainly led by the USA, the UK, and Australia. The most similar countries in the higher education research field were Australia and the UK. European countries had a higher similarity in higher education research with each other, but the similarity between Asian countries was very low. The similarity between different countries exhibited different characteristics, which has important significance for the development of higher education research.     

Factors influencing assessment quality in higher vocational education

The development of assessments that are fit to assess professional competence in higher vocational education requires a reconsideration of assessment methods, quality criteria and (self)evaluation. This article examines the self-evaluations of nine courses of a large higher vocational education institute. Per course, 4–11 teachers and 3–10 students participated. The purpose of this article is to critically examine the quality of assessment in higher vocational education, to identify critical factors influencing assessment quality and to study whether self-evaluation leads to concrete points for improvement. Results show that strong points are fitness for purpose, comparability and fairness. Weak points are reproducibility of decisions and development of self-regulated learning. Critical factors are the translation of competences into assessment criteria to be used in daily lessons and the involvement of the work field. The self-evaluations generated many points for improvement, but not all were translated into actions. Altogether, this article provides a rich picture of assessment quality in higher education and identifies quality aspects that need improvement, (partly) confirming other research on current assessment methods.     

Shifting themes in OECD country reviews of higher education

There have been changes in the political economy since the 1980s, and the Organization for Economic Cooperation and Development (OECD) has changed as well. Scholars have noted shifts in OECD discourse in some policy fields since that time: shifts away from what might be called classic neoliberal perspectives. This paper reflects on the changes in the political economy and in OECD and explores how they might be related to changes in OECD discourse in higher education. Specifically, it examines country reviews of higher education systems conducted by OECD in the mid-1990s and the late-2000s for evidence of shifts in its higher education discourse. Instead of a softening of neoliberal perspectives, it finds a further entrenchment of assumptions associated with neoliberalization. It also describes what appears to be a deepening contradiction in the discourse concerning the private and public benefits of higher education. Finally, it reflects on how the contexts of the political economy as framed by OECDs discourse, affects its proposed goals and strategies for higher education.     

西方大学评价的权力模式

本文把西方各国大学评价过程中表现出来的权力分配模式（大学自治与责任的相互作用模式）分为：英国，荷兰，美国三种模式，荷兰模式备受国际高等教育界推崇，这种模式在外部责任要求与大学自治之间达到了较为理想的平衡，这有可能使大学发展起组织学习文化。     

Towards a general model of quality assessment in higher education

In this article a number of elements of a general model of quality assessment in higher education are presented. On the one hand these elements are put in a historical context of quality assessment in Medieval universities and, on the other hand, deduced from the recent experiences with quality assessment in both North-American and Western European countries. With respect to the historical context a distinction is made between the intrinsic and the extrinsic values of higher education. Two types of quality assessment related to these values are also distinguished. Concerning the recent experiences with quality assessment systems, the practices in the U.S.A., Canada, France, the Netherlands and the United Kingdom are explored. In the final section the general mode of quality assessment is discussed in the context of the distinction between the intrinsic and the extrinsic values of higher education.     

Culturally responsive student assessment and quality work in higher education

Educational Assessment, Evaluation and Accountability -     

Regional themes and global means in supra-national higher education policy

The supra-national level has become increasingly important in educational policy formulation. This paper describes and compares two settings in which growth in these supra-national policies is evident—in Europe and in Africa. Key themes arising in policy documents in each context are examined. A distinction is drawn in analysis between themes classified as ‘global means’, such as qualification frameworks and quality assurance mechanisms, which are becoming international norms and which show close similarity across contexts, and regional goals or ‘themes’ in supra-national policy. The paper argues that although there are apparent similarities between the policy goals espoused in ‘regional themes’, context plays an important part in understanding the meanings of these policy goals. In closer analysis, there are differences both in the underlying problems which the policy goals are intended to address, and in the prioritisation given to these goals. This finding is examined in the light of debates regarding policy convergence, specifically drawing on Vaira’s (2004) framework for institutional analysis.     

Credits, curriculum, and control in higher education: Cross-national perspectives

Through an examination of the higher education systems in threecountries (Indonesia, Nicaragua, and Vietnam), the authors explore howthe use of academic credits for monitoring student progress has been andcontinues to be linked to policies and institutions associated withcapitalist, market-driven economic systems. The recent histories ofthese countries and their current social and political contexts areanalyzed in relation to three interrelated themes that have emerged fromthe analysis of the three cases. These themes are: (1) Linkages topolitical and economic systems: higher education as vocationaltraining, (2) Standardization, efficiency, andtechnocracy, and (3) Who controls the curriculum? Inconclusion, the authors suggest that the academic credit system,embedded within a network of other educational practices, hastransformed the university into an institution focused on relativelynarrow, utilitarian aims rather than a more universal pursuit ofknowledge.     

Electronic assessment in higher education

Assessment is an important cornerstone of education. A world trend in staying abreast of the latest developments in the field of information and communication technology (ICT) has led to an increased demand for electronic assessment in education circles. The critical need and responsibility for higher education to stay on par with the latest techniques regarding assessment subsequently led the University of Johannesburg (UJ) to implement electronic assessment in some departments in 2004. Several challenges led to this exploration into the use of one e‐assessment tool within the University.     

Measuring higher education quality

Conclusion The panelists indicated that considerable progress is being made by such organizations as ACT and NCHEMS in identifying the domains of quality to be measured and particularly in devising unidimensional indicators of student progress. Few were able to cite comparable advancements in the development of multivariate techniques to assess the relation of student growth to other variables. Notable progress in achieving consensus on appropriate standards for measuring quality institutions or curricular programs within comparable institutions remains as a future task.Panelists were: William Toombs, Pennsylvania State University; Patrick Terenzini, State University of New York at Albany; Lois Torrence, University of Connecticut. Joan Stark, University of Michigan, was moderator.     

Reflections on quality education in African higher education

Abstract

Worldwide the diverse ills in society are often seen as a manifestation of the weaknesses and poor quality of the education systems practiced, especially those founded on traditional approaches – highly disciplined patriotic regimens, with a great deal of memorisation and not much room for reflecting and questioning, in contrast to the contemporary education mission which seeks to produce free citizens, citizens who are free not because of wealth or birth, but because they can call their minds their own (Nussbaum, 1998). This paper critically explores both the basics of traditional education regimens, and the contemporary education mission as espoused by some renowned intellectuals, and concludes that a sound education system ought to cultivate humanity – a citizenry that can think critically, solve problems and apply new skills and techniques in diverse contexts, a citizenry that is knowledgeable about the care and wise use of the environment.     

Culture and quality in higher education

The growth in quality assurance worldwide raises questions about what higher education should want from its quality programmes. The paper constructs a typology of quality assurance systems (drawing a distinction between the source of the judgement and the purpose of the process) and evaluates the alternatives. It argues that Total Quality strategies are the best suited to the higher education purpose but demonstrates that there are deep, often conflicting, cultural processes that can frustrate its introduction.     

Student assessment of teaching in higher education

Plans to introduce campus-wide assessments of college or university teaching which are largely dependent on student ratings are seen as a threat to academic freedom in those institutions with little or no experience of this form of evaluation. While regular student evaluations of teaching are very common in North America, their introduction is only now being considered in colleges and universities in a number of other countries. Research on the reliability and validity of student ratings indicate that they are capable of providing valuable information about the quality of teaching. Depending on the survey used, this type of evaluation may be used to provide evidence of teaching ability to staffing committees or to suggest ways of improving teaching. The paper concludes with a set of recommendations for higher education institutions which are considering the regular assessment of all teachers by their students.     

Embedding quality culture in higher education in Ghana: quality control and assessment in emerging private universities

High quality provision has been one of the key aims of the current reforms in higher educational institutions across the globe since the beginning of the century and the millennium. Consequently this has led to the increasing demand for quality assurance (QA). This report identifies those institutional processes and structures that support the development of an internal quality culture in the emerging private universities in Ghana. The study bases its understanding of “quality culture” on the definition which sees it as referring to an organizational culture characterized by a cultural/psychological element on the one hand, and a structural/managerial element on the other hand. If we take our educational activity as a process, then the process (the activity) requires inputs (information, materials), resources (people, equipment, space) and control (QMS) to produce outputs (products and/or services). QA then is a culture—a way of continuously aiming to improve and do better—and the private universities in Ghana are responding to this.     

The assessment of quality in higher education: A critical review of the literature and research

The article discusses the elusive concept of quality and the problems involved in attempting to assess it. The article provides a comprehensive yet critical review of the literature and empirical research studies undertaken on the subject matter. Three types of studies are identified and are reviewed relative to their major findings, strengths, and weaknesses. Issues that remain to be resolved are also identified and discussed.     

基于能力本位的高职教育考核评价方法刍议

目前高职生的考核评价方法已成为制约高职教育培养高素质技能人才的瓶颈之一。针对当前高职教育考核评价方法存在的问题,应树立以能力测试为中心的现代考试观,并从评价内容、评价方式、考试方法和考试结果诊断反馈机制等方面进行改革,以促进高职教育人才培养质量的提高。     

The assessment of off-campus higher education

After acknowledging the general ignorance concerning the changes which occur in American undergraduates who study off-campus, either domestically or internationally, the authors describe various studies which have attempted to assess off-campus educational experiences. These research efforts may be categorized in two types: (1) those which used existing, standardized instruments; and (2) those which used locally designed instruments. Yet both kinds of studies are found wanting. A new instrument, currently being tested, “The Individual Opinion Inventory”, is designed to locate affective levels of perceptual change in those American undergraduates studying off-campus, either in the US or abroad.