The reflective institution: Assuring and enhancing the quality of teaching and learning

Three definitions of ``quality' have entered the qualityassurance (QA) debate: quality as value for money, quality as fitfor the purpose of the institution, quality as transforming. The firstis pivotal for retrospective QA, which sees QA in terms ofaccountability, and conforming to externally imposed standards. The lasttwo are pivotal for prospective QA, which sees QA asmaintaining and enhancing the quality of teaching and learning in theinstitution. In this paper, the reflective practitioner is taken as themodel for prospective QA. Three stages are involved in institutionalreflective practice: articulating an espoused theory of teaching, thequality model (QM); continually improving on current practicethrough quality enhancement (QE), in which staff development should playan important role; and making quality feasible (QF), by removingimpediments to good teaching, which often arise through distortedpriorities in institutional policy and procedures. These three stages,QM, QE, and QF, are essential ingredients in prospective QA.     

Quality assurance for public higher education: context,strategies and challenges in Kenya

Quality assurance (QA) mechanisms used to be highly dependent on national administrative traditions but nowadays there is a convergence of mechanisms. Compared to more developed higher education (HE) systems in the world, QA systems in Africa are still at an infant stage and thus confronted by many challenges. The purpose of this article is to present some of the findings derived from a study analysing the crucial issues and unique challenges facing Kenya's public HE as it struggles to develop QA mechanisms. Using purposive sampling, the researcher chose two public universities who indicated their willingness to participate and a national QA Agency (QAA). The study was done through in-depth interviews and a review of historical materials and records. Overall, respondents strongly emphasised the need for Kenyan universities to have compulsory and effective external and internal QA mechanisms. They indicated that the trends facing HE make it necessary for HE in Kenya to review their traditional QA structures and to create new systems of external QA. The numerous comments in this research indicate deficiency not only in the QAA focus and work but also in the internal QA frameworks within public universities.     

远程教育的质量文化

质量保证是远程教育摆脱边缘地位的关键,因此,构建远程教育的质量文化意义重大。本文介绍了英联邦学习共同体2006年出版的《远程教育新视角:构建质量文化》一书收录的12个案例研究中所凸现出来的7个质量文化主题:政府政策的导向,领导和机构的质量意识,权力下放、包容式民主和参与式管理,能力建设,以学生为中心,内外结合的质量保证机制,以及引进与创新,并对电大的质量文化建设提出几点反思。     

University administrators’ conceptions of quality and approaches to quality assurance

As the quality of university education garners increasingly more interest in both the public and in the literature, and as quality assurance (QA) processes are developed and implemented within universities around the world, it is important to carefully consider what is meant by the term quality. This study attempts to add to the literature empirical data from interviews conducted with senior administrators within Canada’s province of Ontario. A quality assurance framework was developed by the Ontario Council of Academic Vice-Presidents in response to international trends in QA and implemented by all 21 Ontario universities in 2011. This phenomenographic study explored the conceptions of quality held by senior university administrators and their strategies for implementing QA processes. Results revealed a range of QA approaches that are employed within Ontario’s universities. Rather than the two categories of retrospective QA and prospective QA that Biggs (High Educ 41:221–238, 2001) postulated, results indicate a more complex spectrum that involves three main approaches to QA: an approach aimed at defending quality, an approach aimed at demonstrating quality, and an approach aimed at enhancing quality. These approaches are considered in relation to Biggs’s (High Educ 41:221–238, 2001) ideas about quality enhancement and a revision to his model is proposed.     

Peer review improves the quality of MCQ examinations

The aim of this study was to assess the effect of the introduction of peer review processes on the quality of multiple-choice examinations in the first three years of an Australian medical course. The impact of the peer review process and overall quality assurance (QA) processes were evaluated by comparing the examination data generated in earlier years (2008) with those held under the new QA regime (2009 and 2010) from the same blueprint. Statistical analysis and comparisons of overall examination performance were made by year. Regarding multiple-choice questions (MCQs), item analysis was used to compare the proportion of difficult and discriminating items and functional distractors on summative examinations in 2008 (pre-implementation of peer review) and 2009 and 2010 (post-implementation). The impact of peer review processes resulted in a decrease in the number of items with negative discrimination; increases in reliability, appropriate item difficulty, and numbers of items with significant discrimination. There was an associated improvement in the effectiveness of distractors for the MCQ items. The trend of overall improvement in the quality of MCQ items continued in 2009 and 2010. The introduction of QA processes, specifically peer review of MCQ items has resulted in a sustained improvement in the quality of MCQ items within our examinations.     

Embedding quality culture in higher education in Ghana: quality control and assessment in emerging private universities

High quality provision has been one of the key aims of the current reforms in higher educational institutions across the globe since the beginning of the century and the millennium. Consequently this has led to the increasing demand for quality assurance (QA). This report identifies those institutional processes and structures that support the development of an internal quality culture in the emerging private universities in Ghana. The study bases its understanding of “quality culture” on the definition which sees it as referring to an organizational culture characterized by a cultural/psychological element on the one hand, and a structural/managerial element on the other hand. If we take our educational activity as a process, then the process (the activity) requires inputs (information, materials), resources (people, equipment, space) and control (QMS) to produce outputs (products and/or services). QA then is a culture—a way of continuously aiming to improve and do better—and the private universities in Ghana are responding to this.     

英国开放大学学习支持服务的经验研究与启示

英国开放大学是世界远程教育领域的旗帜和楷模,其学习支持服务是教学质量保证的重要环节,也是原创性最强且特色最鲜明的一种理念与实践,对国际远程教育领域学习支持服务的理论发展和实践探索起到了很强的引领和示范作用。它的学习支持服务特色体现在学习者优先理念、学习支持全面优质、完备的教学师资团队、智慧高效的信息技术和健全的质量评估保证五个方面。我国开放大学要建设具有新时代中国特色的一流开放大学,需引入先进的服务理念、提供完善的支持服务、加强学习支持服务团队建设、发挥信息技术的作用并建立全面的质量保证机制。     

Quality assurance of joint degree programs from the perspective of quality assurance agencies: experience in East Asia

Joint degree programs have gained popularity in East Asia, due to the growth of transnational higher education in the region since 2000. However, the external quality assurance (QA) and accreditation of joint degree programs is a challenge for QA agencies, as it normally involves the engagement of several institutions and multiple national accreditation procedures. The purpose of this study is to explore current QA approaches to joint degree programs in Europe and East Asia from the perspectives of QA agencies. There are four major findings from the study. First, East Asian countries tend to stipulate national regulations for a joint degree program. Second, an external QA mechanism for joint degree programs has not yet been developed in East Asian nations. Third, the adoption of international accreditation as the popular approach for joint degree programs in business fields in Asia raises the serious issue of national jurisdiction over higher education. Fourth, the European Consortium for Education's (ECA) single accreditation mode is highly recommended by QA agencies.     

The Australian higher education quality assurance framework

The Australian government initiated a review of higher education in 2008. One of the outcomes of the review was the formation of a national regulator, the Tertiary Education Quality and Standards Agency (TEQSA), with responsibilities to: register all higher education providers, accredit the courses of the non self-accrediting providers, assure quality against externally set standards and reduce risk by monitoring institutional performance on various measures. One of the key changes in Australian higher education quality assurance is the shift from a ‘fitness-for-purpose’ approach to quality assurance to a compliance-driven approach using an externally developed set of standards monitored by the national regulator, which has legislated powers to place sanctions on universities and other providers for non-compliance. This article outlines the new framework introduced by the government and analyses its limitations in assuring and improving quality in core and support areas. It cautions universities against being dominated by TEQSA's compliance agenda. Rather, it encourages the development and maintenance of shared governance principles and strong internal quality improvement processes along with the establishment of an outcomes focus, which will stand the test of external compliance auditing while allowing the institution to pursue its own educational objectives. The article is based on the authors’ experience and reflection on external, improvement-led quality audits in Australia over the past decade compared with the present compliance-oriented audits now required for institutional registration and ongoing accreditation.     

基于辍学研究的电大课程教学反思——以“变化中的英语”课程为例

本文基于电大辍学归因研究中的学习负荷问题展开讨论。调查显示,学习负荷过高造成了许多电大学生在学习道路上的无功而返,而学习的高负荷是由课程难度与学生学术水平之间的落差所造成的。本研究旨在通过对电大课程教学过程的审视,探究其学术支持服务手段的有效性。本研究以2011年3-6月上海电大A分校2010春英语专业本科层次"变化中的英语"课程教学为个案,通过面授课堂观察、课程形成性考核记录、网上教学记录、课程期末考试成绩聚焦课程教学效果。研究结果显示,电大的课程教学支持服务手段仍停留于传统教学模式,而作为重要学习辅助手段的网上学习,其形式意义占据和弥漫于抽样所在班级师生的观念中,导致学习支持的可获得性受到制约;同时,由于任课教师在电大体制下被层层嵌于一个庞大的系统之中,教师的能动性在改善课程教学效果时会受到一定程度上的限制;第三,在多方原因的共同作用下,现行教学模式下学生的课业表现与预期课程教学目标之间存有潜在的些微差距,会在一定程度上影响任课教师对自身课程教学的判断和调整。改变这种状况,电大教学组织制度的变革和对教师支持服务力度的加强势在必行。     

Collecting feedback on the quality of distance education: a follow‐up survey of China Central Radio and TV University graduates and their employers

Timely collection of feedback on the quality of teaching from graduates and their employers is of great significance in distance education, and can help enhance the quality of teaching and improve management and all‐round learner support. However, since the graduates left university some years ago, are now widely dispersed and consequently may have changed jobs various times, it becomes more difficult to collect feedback effectively at low cost, and it is even more challenging to establish a regular mechanism for collecting this feedback. This research was based on a follow‐up survey of 280,000 graduates, who graduated from China Central Radio and TV University (CCRTVU) between 2002 and 2004, and a sample of 3–5% of them who were participants for research through questionnaires and interviews. Their employers were also invited as participants. The research data covered the feedback collected on the open learning programmes offered by the CCRTVU, in terms of curriculum design, learning resources, learner support and the delivery and effectiveness of teaching. This in turn provided the basis for improving teaching and learner support. The successful conduct of the follow‐up survey and the effective use of its results have shown that the establishment of such a mechanism is significant in improving the quality of distance education. This article focuses on the establishment of a mechanism for large‐scale feedback and provides some insights into the development of the questionnaire, which will be discussed in more detail elsewhere.     

Academics’ participation in quality assurance: does it reflect ownership?

Academics’ support for quality assurance (QA) depends on several factors, including their sense of ownership, which seems to be influenced by academics’ participation in QA’s implementation. This paper aims to understand whether this participation is indeed contributing to academics’ ownership of QA. Findings from a survey of Portuguese academics’ on their participation in study programmes accreditation suggests that this may not be the case. Academics present a partial withdrawal towards effective participation in study programmes’ accreditation, especially regarding external assessment. Furthermore, they do not seem willing to enhance this participation nor are they very critical about it. Since academics’ sense of ownership is essential for the successful implementation of QA, these results may represent a challenge for both institutions and QA agencies.     

Limited legitimacy among academics of centrally driven approaches to internal quality assurance in Vietnam

For more than 15 years, Vietnam has worked to develop a quality assurance (QA) system as part of its effort to reform higher education. The government’s effort seeks to respond to widespread criticism over the quality of training in higher education. The appropriation of western QA mechanisms and the effectiveness of the QA system as it has been implemented, however, is still viewed with scepticism. This paper reports on a study of academics and QA practitioners’ perceptions of quality assurance. Documentation and in-depth interviews were used in the study. The findings show that QA remains a new concept in the country, which appears to have promoted a compliance-driven approach to mandated policies rather than a system that promotes academics’ engagement in continuous improvement. Moreover, the appropriated mechanism may be seen as contradictory to the values respected by academics and rooted in a Confucian society.     

开放教育学习支援的实证研究——以兴安盟电大分校为例

＂质量＂是开放教育的生命线和办学的归宿,学习者是教学质量的承担者,教学质量只有依附于学习者才能体现,而学习支援是保证开放教育质量的必要手段。开放教育的成人和远程特点决定了其教学质量管理的艰巨性和长久性。因此,为学习者提供良好的、全面的学习支援是保证开放教育教学质量的基本要件。     

Measuring the perceived quality of an AR-based learning application: a multidimensional model

Augmented reality (AR) technologies could enhance learning in several ways. The quality of an AR-based educational platform is a combination of key features that manifests in usability, usefulness, and enjoyment for the learner. In this paper, we present a multidimensional model to measure the quality of an AR-based application as perceived by students. The model is specified by a second-order factor (perceived quality) and three dimensions: ergonomic quality, learning quality, and hedonic quality. The purpose of this model is to embody previous research into a coherent framework for the evaluation of AR-based educational platforms and to provide guidance for researchers and practitioners. The model was empirically validated on a Chemistry learning scenario and the results confirm the importance of both the learning and hedonic quality.     

开放实验室对高等学校教师职业素质的要求

在实验室全开放和学生自主学习的教学环境下,实验教学效果获得了大幅度提高。实验教师应该如何适应开放实验室的教学模式是一个必须解决的关键问题。探讨了开放实验室对教师职业素质的要求,以提高高校实验室建设水平。     

Internal quality assurance: A new culture or added bureaucracy?

This paper analyses teaching and non-teaching staff perceptions on the implementation of internal quality assurance (QA) practices at their higher education institutions. The aim is to understand how far different perspectives on quality – as culture, as compliance or as consistency – are reflected in the views of these two groups on such practices. Data from a survey sent to all Portuguese institutions show that, to some extent, the perspectives of quality as culture and quality as compliance seem to permeate both groups’ views. This is evident in regard to the factors identified as supporting the development of internal QA, the main features underlying the implementation of such practices and their main effects. As the study allows for a better understanding on how these practices are perceived by teaching and non-teaching staff, it can contribute to promoting the critical reflection of institutions about QA and the way it can be both more effective and aligned with academia’s needs and expectations, contributing to influencing institutional practices.     

Ten years of external quality audit in Australia: evaluating its effectiveness and success

External quality audits are now being used in universities across the world to improve quality assurance, accountability for quality education and transparency of public funding of higher education. Some countries such as Australia, New Zealand, United Kingdom, Sweden and Denmark have had external quality audits for more than a decade but there has been limited research as to their impact. This study analyses the extent to which external audits in Australia have improved quality assurance in universities over the past 10 years. The analysis is based on discussions with 40 participants in a workshop on the effectiveness of audits and the review of 60 external quality audit reports between 2001 and December 2010. The research found that while external audits have led to an improvement in systems and processes in Australian universities, they have not necessarily improved the student experience. This lack of impact on the student experience in Australia is similar to other countries, according to the literature review. This study is timely in its analysis on the effectiveness of the current improvement-led audits, as government in Australia is in the process of renewing quality assurance arrangements of higher education institutions with a focus on standards and outcomes.     

Challenges to successful quality management implementation in higher education institutions

This article discusses the key challenges to successful quality management implementation in higher education institutions identified by 160 colleges and universities at various stages of quality management practices. Survey findings suggest that there are five key challenges that affect the successful implementation of quality management practices in colleges and universities: organizational culture, senior leadership commitment, faculty support, implementation time, and training.Julie E. Horine, Ph.D. (The Florida State University) is Assistant Professor of Organizational Behavior in the Department of Educational Leadership at the University of Mississippi. Her areas of professional expertise include quality management and the use of the Baldrige criteria as a diagnostic tool for organizational improvement. Julie is a two-year Malcolm Baldrige National Quality Award Examiner and an evaluator of the Baldrige Education Pilot Criteria. William A. Hailey, DBA (University of Kentucky), is Professor of Operations Management and Information Systems and holder of the H.E McCarty Chair in the Else School of Management at Millsaps College in Jackson, Mississippi. He is recognized as a Fellow, Certified Quality Engineer, and Certified Quality Auditor by the American Society for Quality Control. His areas of professional expertise include strategic quality planning, quality management training, and designing information systems for implementing continuous improvement principles.     

The association of classroom interactions,year group and social class

We investigate differences in the teacher‐learner interactions in Reception, Year 2 and Year 4 science and literacy classrooms through three measures: (i) the proportion of open questions asked by the teacher, (ii) the rate of successful responses, and (iii) wait‐times. A regression analysis of data from 20 schools and 102 lessons suggests that classrooms in socio‐economically disadvantaged areas offer distinctive patterns of interaction, i.e., typically associated with those approximately two years younger in the more affluent school districts. We then closely examine the quality of two contrasting dialogues from reception science classes of schools in poor and affluent areas. We see how teachers’ questions can work or fail to work to achieve the expected quality in scientific dialogue, and thus how effective use of open questioning might be indicative of quality. In conclusion, we discuss quality of talk as an explanation of class differences in learning outcomes of schooling.