The ghostly workings of Danish accountability policies

Abstract

This article proposes a framework for thinking about the ghostly, thus arguing that policy can be understood as a landscape of intersecting and colliding temporalities from which arouse curious workings of barely-there forces, spooky energies and vibrating saturations of affective ambivalences. I present an empirical study of a policy agenda of introducing an assessment culture and improving the management of the Danish public school. I explore how all the routines and habits deemed outdated and sought annihilated by a new policy paradigm continue to haunt head teachers as seething presence of lurking resistance towards the policy aims as well as insidious doubts. Thinking about the ghostly contributes to studies of education policy by locating the reality of power in the mundane everyday doings and experiences of educational practitioners and insisting on the very tangled way people sense and intuit the complexities of contemporary forms of power.     

Vernacular globalisations: neo-statist accountability policies in France and Quebec education

The article argues that there is no single globalisation of education systems, but rather multiple globalisations of each system taken in its individual context. We propose three explanatory factors to account for these vernacular globalisation processes, that is, for individual policy trajectories in each national context: path dependence on earlier policy choices and institutions, education policy-making through bricolage, and finally the translation by national actors of international-level ideas or tools as a function of the debate, institutions or national power dynamics in question. The research design is based on the study of a most-likely case: accountability policy in two school systems – France and Quebec – which show strong variations. Document analyses and semi-structured interviews were conducted in both cases. In the two countries, distinct vernacular globalisations are at work leading to different neo-statist accountability policies. In Quebec, the reinforcement of state power through a growing vertical accountability and the systematic development of regulation tools between policy actors and levels lead to a ‘centralisation by institutional linkage’. In France, we rather witness a ‘globalisation by discursive internalisation’ in which transnational imperatives are integrated in official discourses on the regulation of the education system, but without radically questioning the mainstays of this regulation.     

Datafication in schools: enactments of quality assurance and evaluation policies in Brazil

ABSTRACT

This paper investigates datafication in schools through an analysis of the enactments of quality assurance and evaluation (QAE) policies in Brazil. In doing so, I question how data permeates and changes school environments, school actors’ conduct and their imaginaries. QAE policies encompass large-scale assessments, indicators, rankings and other steering mechanisms, but importantly connect data to quality in education. Here, I analyse the discourses of school actors (principals, coordinators, supervisors, teachers, students and parents) from three Brazilian public schools collected through semi-structured interviews (n = 28). Data manifests in those schools as a technology of government. Schools enact QAE policies in distinct ways, incorporating the idea of governmentality, but also proposing alternative patterns of action.     

Teacher education policies in the United States: The accountability shift since 1980

This conceptual paper examines a tug-of-war between state and national authorities in the United States for control of teacher recruitment, preparation, licensing, and professional development policy-making. A discussion of policy problems and instruments grounds analysis of each governing body's policy-activity since 1980. The analysis reveals how policy instrument changes have sidelined teacher education professionals and shifted programme accountability from the state to national level. Conclusions and recommendations challenge teacher education researchers to alter the current accountability trajectory by becoming active participants in the United States policy-making arena.     

Relationships between learning patterns and attitudes towards two assessment formats

The study examined the relationships between learning patterns and attitudes towards two assessment formats: open‐ended (OE) and multiple‐choice (MC), among students in higher education. Sixteen Semantic Differential scales measuring emotional reactions, intellectual reactions and appraisal of each assessment format, along with measures of learning processes, academic self‐concept and test anxiety, were administered to 58 students. Results indicated two patterns of relationships between the learning‐related variables and the assessment attitudes: high scores on the self‐concept measure and on the three measures of learning processes were related to positive attitudes towards the OE format but negative ones towards the MC format; low scores on the test anxiety measures were related to positive attitudes towards the OE format. In addition, significant gender differences emerged with respect to the MC format, with males having more favourable attitudes than females. Results were discussed in light of an adaptive assessment approach.     

Quest for accountability: exploring the evaluation process of universities

The article explores the organisational impact of evaluation and control mechanisms on universities from the point of view of accountability. Three case studies are analysed with the aim of understanding the significance of these systems both at corporate governance level and in relation to their influence on the behaviour of the academic staff. Open-ended, in-depth interviews were conducted in three universities from two countries in order to collect the opinions of the top managers and academics with different roles and seniority. The combination of four different but partially overlapping analytical frameworks (new public management, neo-institutional sociology, organisational control theory and sense-making) has supported the analysis and the interpretation of the empirical material collected. The analysis sheds light on a somewhat neglected aspect: the interdependence among various systems and tools that simultaneously operate in an organisation and inevitably combine to influence the behaviour of its employees. On this basis indications are given in order to facilitate the introduction and the management of more appropriate evaluation mechanisms both at the national system and the organisational level.     

The effects of accountability on higher education

This paper analyzes the effects of a higher education accountability system in Brazil. For each discipline, colleges were assigned a grade that depended on the scores of their students on the ENC, an annual mandatory exam. These grades were then disclosed to the public and colleges were rewarded or penalized based on them. I find that the ENC had a positive effect on the education and the proportion of full-time faculty and that it increased the number of vacancies offered, applicants and enrollments. Colleges were affected differently depending on grades, ownership and academic organization, changing the distribution of students among them.     

Educational assessment and accountability: a New Zealand case study

This paper discusses the increasing use of assessment as a market signal and as an index of educational accountability. It is argued that assessment policies in New Zealand reflect an uneasy balance between the interests of the new right and more progressive educationists. These influences are examined using three largely contradictory models of educational accountability (professional, market and management). Each model reflects a range of epistemological and ideological assumptions. Thus student assessment serves different and largely conflicting purposes. The paper uses a recent New Zealand policy document (Tomorrow's Standards) to examine the interaction of each model. It is argued that through a failure to state clearly the purpose of assessment, educational reform in this area is overly concerned with the means rather than the ends of education. This has important implications for student motivation and learning. The paper concludes with a comment on current policy development and concludes that some recent initiatives provide the hope that a system of assessment that is both meaningful and relevant to individual learners may be developed.     

Coming to terms with the accountability versus improvement debate in assessment

Concerns about quality and accountability in higher education have led the majority of states to mandate student outcomes assessment. While many institutions have begun to address these requirements as matters of accountability, discussion in most state capitals seems to be more about program improvement than about summative evaluation. These dichotomous perspectives frame a fundamental debate over the nature and direction of the assessment movement in the United States. Accountability and improvement are twin concerns of effective assessment, but their coexistence depends upon the resolution of suspicions and different interpretations of the mission of higher education between state and institutional authorities.     

How do school leaders respond to the growing intrusiveness of accountability policies? Evidence from Italy

ABSTRACT

The role of school principals is an evolving one, calling them to become agents of change, focusing on educational leadership as they take the schools forward. All this is happening in a context that is becoming more challenging and stressful as school leaders try to juggle the state-mandated accountability devices. In relation to the Italian context, this paper analyses the growing penetration of accountability systems in school management and the implications for leadership practices. The results of a research project conducted with school leaders show that accountability systems can provide an opportunity for school improvement if school leaders defuse their potential bureaucracy, consistently integrating them into their practices of leadership, respecting the organisational idea of the school as professional learning community. An authentic educational leadership is a fundamental condition for governing the risks and contradictions that accountability systems bring with them in the complex reality of schools.     

Feedback effects of teaching quality assessment: macro and micro evidence

This study investigates the feedback effects of teaching quality assessment. Previous literature looked separately at the evolution of individual and aggregate scores to understand whether instructors and university performance depends on its past evaluation. I propose a new quantitative-based methodology, combining statistical distributions and transition probabilities matrices, to take into account the dynamics of teaching quality over time both at the macro and the micro level. Using a three-year longitudinal panel from an Italian university, it is shown that evaluation exercises do not impact future teaching performance at either the university level or the individual level.     

The effects of technology‐enhanced formative evaluation on student performance on state accountability math tests

Technology‐enhanced formative evaluation (TEFE) could enhance student achievement while diminishing the burden of formative evaluation for educators. The current study examined data from 360 randomly selected schools that either used a TEFE program for 1 year to 4 years 11 months, for 5 or more years, or not at all. Analyses of covariance found a significant and moderate to large (d = .51 and .78) effect on percentage of students who scored proficient on state accountability tests in math. Moreover, among schools that used TEFE, those with a non‐White student population of at least 50% scored in the proficient range on state math tests at a rate equal to that of those with at least 50% White students. A significant and moderate to large (d = .71) effect was found, however, between these two groups of schools among schools that did not use a TEFE program. © 2010 Wiley Periodicals, Inc.     

Rubric formats for the formative assessment of oral presentation skills acquisition in secondary education

Educational technology research and development - Acquiring complex oral presentation skills is cognitively demanding for students and demands intensive teacher guidance. The aim of this study was...