Competitive comparison and PISA bragging rights: sub-national uses of the OECD's PISA in Canada and the USA

Participation in the Organization for Economic Co-operation and Development's (OECD) Program for International Student Assessment (PISA) has continuously expanded: from 43 systems in 2000 to 65 systems in the 2012 cycle, with 71 signed up for PISA 2015. There also has been a growth in sub-national participation, expanding PISA's reach beyond the nation-state. This paper explores sub-national PISA participation in Canada and the USA, asking how PISA is being used within sub-national education policy spaces. We draw on analysis of documents and data from interviews with officials at sub-national, national, and international levels. Findings illustrate some of the diverse motivations and uses of PISA, providing insights into the effects of PISA at the sub-national scale. As such, we argue that competitive comparison in education has deepened through the enhanced granularity of international large-scale assessment data to new scales beyond the nation-state.     

Fifteen years of research on PISA effects on education governance: A critical review

This article provides a literature review on the effects of the OECD's Programme for International Student Assessment (PISA) on education governance and policy process across participating countries. This review seemed necessary because there has been a growing body of literature on this topic since 2003, especially since 2010, because this literature is not always well‐known and because the discourse on the so‐called ‘PISA shock’ remains important, even if it is more of a metaphor than a concept and may be politically partial. The article exploits a dataset of 87 references which show that PISA introduced major changes in the governance of education worldwide. Driven by soft power strategies and new policy transfers, this governance is based on data and measurement tools which redefine the scales of education policies. It also shows that PISA has a strong influence on a variety of national reforms, as illustrated in many case studies. However, this influence strongly depends on domestic policy contexts that scholars intended to capture through different theoretical frameworks. Nonetheless, few propose overarching theorisations of the political meaning of PISA effects on education governance and policy processes. The article concludes by stressing three main challenges for the subsequent studies on these PISA effects: better conceptualising these effects, preserving an epistemology of uncertainty in order to avoid taken for granted views and normalising the research on PISA effects not to perpetually and artificially rediscover its so‐called novelty.     

PISA as an ideational roadmap for policy change: exploring Germany and England in a comparative perspective

Education policy has undergone transformation in many countries over the last decade. In this article, we focus on the effects of the most significant international initiative in secondary education, which is the Organisation for Economic Co-operation and Development's (OECD) Programme for International Student Assessment (PISA). We analyse two countries that provide variation regarding the degree of change in their respective education policy-making due to this study; while Germany substantially reformed its education system in reaction to its mediocre PISA results, almost no change has been observed in England. As we show, alterations and shifts in ideas of education policy best account for such a change.     

Problematizing global educational governance of OECD PISA: Student achievement,categorization, and social inclusion and exclusion

Abstract

This study problematizes the global educational governance of OECD PISA and its statistical data as a governing technology in contemporary discourses of education reforms. The study examines principles that order the discourses and practices of the international comparative assessment. The effort of analysing the impact of an education reform regime led by OECD PISA reveals how statistical reasoning defines problems in educational systems and forms social discourse surrounding educational reform to solve such problems. In doing so, this article focuses on standardization, classification, and normalization for measuring and comparing student achievement and national effectiveness. The study also offers an alternative way of considering the politics of inclusion and exclusion embedded in practices of education reforms propelled by the international comparative assessment.     

Golden relics & historical standards: how the OECD is expanding global education governance through PISA for Development

ABSTRACT

Setting this paper against the backdrop of scholarly research on recent changes in the OECD’s approach and workings in education, I analyse how the OECD has reinforced its infrastructural and epistemological global governance through the Programme for International Student Assessment (PISA) for Development (PISA-D). Drawing on qualitative data, this paper makes three arguments. First, there has been a reinforced effort at the OECD to align national and international large-scale assessments; second, the OECD-ensured PISA-D was enhanced only in so far as it remained comparable with PISA, with a view to joining up lower- and middle-income data infrastructures with the global PISA infrastructure; and third, the OECD has bound together the aims of PISA, PISA-D, the Education and Skills Directorate, the Organisation’s Strategy on Development and the global education agenda (Sustainable Development Goals), thus strengthening its global education governance potential. With a note of concern, I suggest these recent changes in the OECD’s work in education may be spreading a very narrow framework of educational values, which does not sufficiently recognise the complexity of learning and teaching.     

Seeing education with one's own eyes and through PISA lenses: considerations of the reception of PISA in European countries

The paper addresses the Organization for Economic Cooperation and Development's Program for International Student Assessment (PISA) as a public policy instrument, whose worldwide circulation is mediated by processes of reinterpretation, negotiation, and re-contextualization, where national, local, and international agencies intertwine. It is focused on the active reception of PISA in six European spaces (Francophone Belgium, France, Hungary, Portugal, Romania, and Scotland) along its first three cycles. The paper identifies two contrasting developments: the Program's divergent uses and its attractiveness in different social worlds. The paper gives particular attention to what is called the ‘update of reference societies’ in the context of national receptions of PISA. These ‘updates’ are analyzed as part of a composite process that involves domestic reasons, either related to current agendas for education or to deep historical factors, and injunctions related to PISA's rationale and PISA objects.     

On the supranational spell of PISA in policy

Abstract

Background: PISA results appear to have a large impact upon government policy. The phenomenon is growing, with more countries taking part in PISA testing and politicians pointing to PISA results as reasons for their reforms.

Purpose: The aims of this research were to depict the policy reactions to PISA across a number of jurisdictions, to see whether they exhibited similar patterns and whether the same reforms were evident.

Sources of evidence: We investigated policy and media reactions to the 2009 and 2012 PISA results in six cases: Canada, China (Shanghai), England, France, Norway and Switzerland. Cases were selected to contrast high-performing jurisdictions (Canada, China) with average performers (England, France, Norway and Switzerland). Countries that had already been well reported on in the literature were excluded (Finland, Germany).

Design and methods: Policy documents, media reports and academic articles in English, French, Mandarin and Norwegian relating to each of the cases were critically evaluated.

Results: A policy reaction of ‘scandalisation’ was evident in four of the six cases; a technique used to motivate change. Five of the six cases showed ‘standards-based reforms’ and two had reforms in line with the ‘ideal-governance’ model. However, these are categorisations: the actual reforms had significant differences across countries. There are chronological problems with the notion that PISA results were causal with regard to policy in some instances. Countries with similar PISA results responded with different policies, reflecting their differing cultural and historical education system trajectories.

Conclusions: The connection between PISA results and policy is not always obvious. The supranational spell of PISA in policy is in the way that PISA results are used as a magic wand in political rhetoric, as though they conjure particular policy choices. This serves as a distraction from the ideological basis for reforms. The same PISA results could motivate a range of different policy solutions.     

The danger of inadequate conceptualisation in PISA for education policy

Due to the broad acceptance of the Programme for International Student Assessment (PISA) and other comparative studies as instruments of policymaking, its accuracy is essential. This article attempts to demonstrate omissions in the conceptualisation, and consequently in calculation and interpretation, of one of the central points of PISA 2006 and 2009. The authors point to the danger of such omissions for possible evidence-based education policymaking. With regard to the reproduction of social inequalities through education, we focus on variance in student performance between schools and within schools on the science scale (PISA 2006) and in the mother tongue (PISA 2009). The thesis of the PISA study is that there are countries (Finland, Iceland and Norway) where between only 14 and 29% of the average OECD variance (33%) is attributed to between-school variance – which is good – and there are countries (Germany, Bulgaria, Austria, Hungary, Belgium, Slovenia, the Netherlands, etc.), where the variance between schools is at least ‘one-and-a-half times that of the OECD’ – which is bad. For Slovenia, we demonstrate a significantly different share of variance explained by between-school variance of the same or similar cohort if we move the point of research by only nine months. Our main argument is that such a difference in the share of variance is not the result of a substantial change in the results (grooving difference in the performance) but the result of formal organisational change – the transition of the cohort to upper secondary education. The difference in calculations also radically changes policy implications, which is crucial. While PISA data suggest the necessity of policy measures to reduce between-school variance, our calculations suggest the need for reconsideration of policy measures aimed at the reduction of within-school variance, gender differences, and differences in performance between native and immigrant students.     

Media representations of national and international standardized testing in the Israeli education system

This study applies discourse analysis to Israeli media coverage of national and international standardized examinations within Israel's public education system. Through systematic analysis of the topic in the two main Israeli financial publications between the years 2000 and 2013, we explore the nature and narrative of the media and compare the coverage of national and international standardized testing. We find that most of the media attention was devoted to international examinations, while national examinations were covered in a more limited yet critical way, perceived as unnecessary and even dubious. International examinations, in contrast, were described as axiomatic components of the education system. Articles on both national and international standardized testing criticize the education system, blaming teachers, the Ministry of Education, budget constraints, and marginalized populations for Israeli students’ inadequate results. We frame our analysis by alignment of the articles along global–local and also neoliberal–humanistic axes. We structure our assessment within the global–local nexus and discuss the broader implications of the role of the testing in framing the local educational public discourse.     

中央政府与社会教育:理学教育的视角

社会教育由于其在社会治理与发展中的重要作用而被人们所重视。理学教育家也极为关注社会教育问题,对于如何推行社会教育进行了诸多的思考与探索。理学教育家认为,在社会教育的网络体系中,中央政府处于最高的决策与管理地位,发挥着非常重要的作用。对于中央政府如何确定自身在国家社会教育中的地位并充分发挥其作用,理学教育家提出了一些很有价值的建议。     

The OECD and the local: PISA-based Test for Schools in the USA

The Organization for Economic Cooperation and Development (OECD) has recently piloted the Program for International Student Assessment (PISA)-based Test for Schools in the USA. In this paper, I contend that by connecting directly with local school boards this new initiative has the potential to further promote the OECD's educational agenda in local policy debates. I begin to develop this argument by providing an overview of the OECD and its work. I then lay out a theoretical framework around global governance and knowledge production within the context of the OECD. Next, I provide a brief overview of the traditional PISA study and compare it to the new PISA-based Test for Schools initiative. This context provides the foundation for a discussion of the ways in which a school-based international assessment can operate as a governance tool, allowing international organizations to have greater influence in the formation and implementation of local educational policies.     

The politics of PISA: The media,policy and public responses in Norway and England

Using the PISA 2015 releases in Norway and England, this article explores how PISA has been presented in the media and how the policy level has responded to the results. England will be used as an example for comparison. The article presents early media responses from the 20 most circulated daily newspapers in the two countries and discusses them in relation both to the national PISA reports in Norway and England, as well as the international report of the OECD. The media responses are further interpreted in light of previous research in both countries, with a particular focus upon Norway, where previous Ministers of Education have been interviewed about assessment policy and education reforms.     

Education policy in Poland: The impact of PISA (and other international studies)

The impact of the PISA study on Polish education policy has been significant, but probably different from any other country. Poland has not experienced the so‐called ‘PISA shock’, but its education system has been benefiting considerably from PISA. For experts and policy makers, it has been a useful and reliable instrument that has made it possible to measure the effects of consecutive reforms of the school education system. Moreover, PISA and other international studies have influenced the perception of education policy in Poland. The latter has shifted from an ideology‐driven, centralised policy to an evidence‐informed policy, developed with the involvement of multiple stakeholders, although this has mostly affected the thinking of experts and policy makers rather than the general public. The new government (in power from 2015), following public opinion polls, has reversed most of the previous education reforms, eliminating lower secondary schools introduced in 1999.     

The contribution of PISA to the convergence of education policies in Europe

The international comparative studies on students’ outcomes have initiated analyses that have had a growing influence on national and sub‐national education policies in industrialised and developing countries. It is particularly the case of the OECD's Programme for International Student Assessment (PISA) which started in 2000 and has organised surveys every 3 years, so that the 2015 survey was the 6^th. Its influence has been particularly important for several reasons: 1) it assesses the basic competences in reading literacy, maths and science of 15 year‐olds students, i.e. around the end of compulsory education in many countries; 2) the assessment is based on a reliable methodology and the tests are completed by qualitative surveys and studies; 3) and the results lead to recommendations and are amplified by the media in most countries. However, it is not easy to evaluate the real impact of PISA because of the existence of other international studies such as IEA's TIMSS and, particularly in Europe, the influence of the recommendations and benchmarks of the EU that has been growing steadily in the last 25 years. Our analysis of the impact of PISA and EU policy focuses on the evolution of the education policy in France, but also studies its evolution in a few other European countries. Finally, we underline the limits of the influence of PISA and international standards in education towards a convergence of education systems because of the importance of their specific historic and cultural contexts.     

抗战时期国民政府初等教育政策述评

抗战初期国民政府在初等教育阶段仍然沿用战前的义务教育制度，以普及短期小学教育为首要目标，而自1940年初为配合“新县制”的实行开始全面向国民教育制度转轨，并在学校设置、行政管理、经费筹集等方面也表现出与此前相异的某些特征。通观其在战时的整体成效，虽然使得西部各地小学校数量、学生人数及适龄儿童入学率相对战前都有了程度不同的提高，但却因为政策制定的误区及客观条件的限制，在实际的教学成效上仍存在着较大的缺陷与不足。     

Losing sight of Humboldt: a synoptic review of Australian government policy over the last 35 years

Over the last 35 years Australian higher education policy, like that of most countries, has undergone radical changes. This article reviews these changes in terms of four key periods, beginning with the abolition of student fees, through to the recent unprecedented levels of government control and intervention. Policies are compared with each other and common themes across periods, attempts at reinvigorating or reintroducing old ideas, and genuinely new policies are discovered. Finally, the impact of these policies over the last 35 years on the higher education sector, particularly its academics and institutions, is discussed.     

The appropriation of the global discourse in the formulation of national education policies: a case of continuing education of teachers in Greece

Educational research over the last decades has been preoccupied with the way the global discourse has been employed in national educational policy making. Examining a case of teachers’ continuing education in Greece, the paper focuses on the way this global discourse has been selectively appropriated by national agents.

Using data of focused interviews with key agents and the content analysis of policy documents, the paper examines the institutionalisation process arguing that (Greek) education policy is not always subject to rational planning, or global imperatives, but involves informal networks which interact parasitically inside formal policy networks to further sectoral interests.     

中直机关育英小学的创建实践及启示

今天的北京育英学校前身是中共中央中直机关育英小学,诞生于战火硝烟中的1948年,最初是为烈士遗孤、父母在前线子女和中央机关干部子女开办的,学校在艰苦困难的情况下发展壮大,今天已成为享誉中外的名校。     

The uses of affect in education: Chilean government policies

This article draws attention to the uses of affect to produce specific subjectivities and moralities in educational policies. It highlights the connections between specific ideas of the educated subject, the family role presented in governmental educational policies in Chile, and the ways these ideas are linked to the subjectivities and communities which the market requires to function. My argument is that with different intensities, affect regulation has become a strategic component of a government that articulates the relation between ‘right ways to behave at home’ and ‘school success’. As a result, affect makes conservative cultural dispositions look natural. I use discourse analysis to show how these policies use affect to control and monitor behaviors and personal relations, as well circulating cultural logics and ideological structures. I analyze one particular document to show how affect does not work through meanings per se; rather, it circulates productive ideas of families, students' behaviors, and social and cultural frames to organize a ‘good life’.     

重庆直辖后产业结构调整对高等教育的影响

以1996年为基期,对重庆市直辖后近10年的产业结构调整变化和高等教育结构的变化进行了实证分析,分析表明,重庆高等教育结构变化在一定程度上滞后于产业结构的调整变化。而教育作为经济的上层建筑,只有适应经济的发展变化,才能为自身发展拓展更广阔的空间。因此,应该进一步优化重庆市高等教育结构。