Creating a space for student voice in an educational evaluation

Evaluation research focusing on educational initiatives that impact on the learning and lives of young people must be challenged to incorporate ‘student voice’. In a context of conventional evaluation models of government-led initiatives, student voice is a compelling addition, and challenges the nature of traditional forms of evaluation. It requires a student-first approach where young people actively report on their experiences, rather than being represented by others. This paper presents an evaluation that draws on large-scale ‘student voice’ contribution. Using the context of a mental health programme that was piloted in secondary schools in Aotearoa New Zealand, this paper explores the importance of a student voice agenda in evaluations. More than 2500 students participated through national surveys and an in-depth case study across five school sites. By foregrounding student voice as an evaluation tool, the ethics of student involvement becomes complex. When authentic student ‘data’ can change or challenge official thinking, students’ voice(s) can either be foregrounded or silenced. Commissioned evaluations are often fraught with wider political agendas, but evaluation researchers have a duty to ensure student voice is represented if it is to inform ongoing government policy that impacts on the lives and learning of young people.     

Promoting a Research Agenda in Education within and beyond Policy and Practice*

Educational research should both inform policy and practice and be forward looking, anticipating the future questions of policymakers, teachers and the community. This paper uses one research organisation, the New Zealand Council for Educational Research (NZCER), as a case study to illustrate possible strategies for promoting research through utilising and building upon research-policymaking and research-practice linkages. It highlights some of the issues, opportunities, and risks for research resulting from the demand for evidence-based policy and from the trend for practitioners to be integral to the research team as research partners and as researchers. It also raises some challenges for research organisations if they are to work effectively both within and beyond the policy and practice parameters of the day. This revised version was published online in August 2006 with corrections to the Cover Date.     

Research Matters: a call for the application of empirical evidence to the task of improving the quality and impact of environmental education

This paper argues for an increase in the application of empirical evidence to the task of improving the quality and impact of environmental education. Whilst the global scene in environmental education appears to portray optimism and great endeavour, there remain key issues to resolve. Such issues include the apparent lack of impact of formal educational programmes on individual's environmental awareness and concern. The paper argues that an empirical research base can illuminate significant findings relating to human motivation and cognition which may help to resolve such issues. It provides an overview and discussion of some of the findings of one particular substantial international research project in order to illustrate the underpinning case for using research to inform both policy and practice and gives some examples of how the evidence generated from this research programme is being used to shape educational policy and practice.     

Educational assessment and accountability: a New Zealand case study

This paper discusses the increasing use of assessment as a market signal and as an index of educational accountability. It is argued that assessment policies in New Zealand reflect an uneasy balance between the interests of the new right and more progressive educationists. These influences are examined using three largely contradictory models of educational accountability (professional, market and management). Each model reflects a range of epistemological and ideological assumptions. Thus student assessment serves different and largely conflicting purposes. The paper uses a recent New Zealand policy document (Tomorrow's Standards) to examine the interaction of each model. It is argued that through a failure to state clearly the purpose of assessment, educational reform in this area is overly concerned with the means rather than the ends of education. This has important implications for student motivation and learning. The paper concludes with a comment on current policy development and concludes that some recent initiatives provide the hope that a system of assessment that is both meaningful and relevant to individual learners may be developed.     

Teachers,schools and using evidence: Considerations of preparedness

Despite assessment being viewed as integral to practice, there are questions about schools’ preparedness to engage in this process. Data from three studies conducted in New Zealand primary schools explore whether use of student achievement data is part of the professional canon or skill set. (1) When implementing new literacy materials, evidence of need did not necessarily inform choice nor was achievement data used to make decisions about effectiveness of materials or use. (2) When a classroom initiative designed to achieve literacy goals was implemented, few schools collected evidence adequate for its evaluation. In both cases, practitioners appeared to hold a theory about acceptable evidence at variance with current policy expectations. Further, they may have lacked necessary skills. (3) Teachers, with practice, learned to interpret data accurately but this skill did not relate to student progress. A high level of pedagogical content knowledge may be needed to relate achievement information to teaching practice.     

Addressing the wicked problem of behaviour in schools

Behaviour management is an influential educational cliché in Australia, Canada, England, New Zealand and US. In practice, efforts to control student conduct in schools frequently utilise a manage-and-discipline model: a misinformed but deeply rooted set of interconnected notions about how to ensure an orderly and productive classroom. Students with disabilities affecting their behavioural development or who have mental health (MH) difficulties frequently face disadvantage, suspension or exclusion as a result of the application of this model in practice. Accommodating the behavioural needs of this population and at the same time, enabling their inclusion therefore represents a significant wicked problem for education in Australia, Canada, England, New Zealand and US. Evidence-based initiatives designed to address this dilemma in the US since the late 1990s, using PBS (Positive Behaviour Support) and also SWPBS (School-Wide Positive Behaviour Support), are outlined but the conclusion is reached that these efforts do not appear to have been successful. Recommendations are made for progress in tackling this wicked problem and include: wholehearted rejection of the manage-and-discipline model by practitioners; targeted support for teachers experiencing (or at risk of experiencing) occupational burnout; and the introduction of tangible educational policy incentives intended to encourage schools to include students who might otherwise face suspension or exclusion on behavioural grounds. Finally, this article advocates radical change in attitudes by teachers towards student conduct in schools and argues that educational practice should align with insights about human behaviour arising from research in developmental psychology.     

Third way values and post-school education policy

Analyses of emerging New Labour policy and practice in the post-compulsory education and training sector have been centrally concerned with the role of ‘third way‘ values and politics in the formulation and development of projects and initiatives. Alternative interpretations of the ‘third way’ conception are examined and located against the background of some flagship schemes, particularly the New Deal Welfare to Work and the University for Industry learndirect initiatives. It is concluded that policies influenced by third way notions involve more rather than less state involvement and centralism than neo-liberal strategies of the past. This New Labour statism - arguably different from both Old Left and New Right centralism - could, conceivably, be justified in terms of achieving the socio-ethical strands of current policy concerned with social inclusion and communitarian approaches to the distribution of educational goods and services in the face of the forces of globalization.     

RE-ENGAGING STUDENTS IN SCIENCE: ISSUES OF ASSESSMENT, FUNDS OF KNOWLEDGE AND SITES FOR LEARNING

International assessment data paints a complex picture of the engagement and achievement of New Zealand students in science. New Zealand was second only to Finland in the top achievers group in PISA 2006, but it also has one of the widest spreads in student achievement, particularly in relation to Mori and Pasifika students. Thus, the challenges faced by New Zealand students, teachers, schools and policy makers resonate with those from elsewhere. New Zealand has a strong research and development tradition around student ideas in science education, but recently, there has been increased recognition at the policy and practice level of the importance of both engagement and participation linked to student identity. A sociocultural orientation to identity has the potential to generate new ways of thinking about and responding to the challenge of engaging students in science. This orientation involves considering classrooms as sites for students working through the development and performance of science-related identities, or not. In this paper, three suggestions from long-term research studies are made for ways forward in addressing the challenge of increasing student engagement and participation through an expansion of the possibilities for students to express and develop science-related identities. These are reconceptualising assessment, the inclusion of student funds of knowledge and strategies for breaching the classroom walls.     

Tertiary teachers and student evaluations: never the twain shall meet?

Internationally, centralised systems of student evaluation have become normative practice in higher education institutions, providing data for monitoring teaching quality and for teacher professional development. While extensive research has been done on student evaluations, there is less research-based evidence about teachers’ perceptions of and engagement with student evaluations, the focus of the research reported in this paper. An interpretive approach framed the study in which data were gathered through questionnaire and interview responses from teaching staff at three New Zealand tertiary institutions. Results highlighted the general acceptance of the notion of student evaluations, recurring ideas about the limitations of evaluations and significant gaps in the way academics engage with student evaluation feedback. Recommendations for enhancing teacher engagement with student evaluation are made to optimise the potential for student evaluations to inform teaching development and to improve students’ learning experiences.     

Innovating in the real world: exploring institutional effects on tertiary teacher innovations in New Zealand

Abstract

Innovation is a key goal of many tertiary education and distance learning providers. This research explores how teachers and educational designers across three New Zealand tertiary institutions worked to innovatively achieve teaching goals. A longitudinal design using the Cultural Historical Activity Theory (CHAT) framework explored the influence of individual and institutional factors on innovation in online course design. Data included interviews, observations of practice, and publicly available institutional documents, which were coded using a grounded theory approach. Peer relationships and institutional technologies were significant in enabling staff to work innovatively. Constraining factors included high workload, research pressures, lack of time to experiment, and limited technological support. Contradictions between institutional policies and teachers’ goals in innovating were noted. This research has relevance to those working in a variety of educational settings due to the increasing influence of institutional and government policy on teaching practice.     

Leading multi‐ethnic schools: adjustments in concepts and practices for engaging with diversity 1

The student population across world is increasingly reflective of diverse cultures, religions and ethnicities. This rich diversity may become a challenge for educational leaders, teachers, and policy‐makers in the absence of an understanding of diverse sources of knowledge people draw on for directing their beliefs and daily practices. This paper explores the multi‐ethnic context in Britain with a focus on Muslim students in English secondary schools, and argues for drawing on diverse ethnic knowledge sources to inform and enrich approaches towards managing diversity. It discusses the concept of Adab derived from Muslim ethics and philosophy, and debates possible contributions of such conceptual adaptations towards improving educational engagement and performance.     

What Is the Function of Mind and Brain?

Byrnes and Fox (1998) provide a useful and important overview of the ways in which cognitive neuroscientific research can inform educational research and practice, but leave unanswered the question: What is the function of mind and brain? An understanding of the function of mind and brain has implications for research in cognitive neuroscience and in educational psychology, and a number of these implications are spelled out in this comment.     

Te Kotahitanga: Addressing educational disparities facing Māori students in New Zealand

The major challenges facing education in New Zealand today are the continuing social, economic and political disparities within our nation, primarily between the descendants of the European colonisers and the Indigenous Māori people. These disparities are also reflected in educational outcomes. In this paper, an Indigenous Māori Peoples' solution to the problems of educational disparities is detailed. Te Kotahitanga is a research and professional development project that seeks to improve the educational achievement of Māori students in mainstream secondary schools. Students ‘voices’ were used to inform the development of the project in a variety of ways: firstly to identify various discursive positions related to Māori student learning; secondly, to develop professional development activities, and thirdly, to create an Effective Teaching Profile. The paper concludes by identifying how implementing the Effective Teaching Profile addresses educational disparities.     

Precision Education Initiative: Moving Toward Personalized Education

This article propose the Precision Education Initiative, which is the tailoring of education to the specific characteristics of the individual student. Mirroring precision medicine, the author lays out both near‐term and longer term goals that educational research, and importantly educational practice, should follow.     

Bridging the gap between policy and practice: adopting a strategic vision for partnership working in special education

The desirability of parents and professionals in special education working in partnership continues to be expressed through Government policy and legislation and through voluntary sector initiatives. Moreover, partnership working attracts significant financial investment. Yet effective, working parent - professional partnerships often remain elusive in practice. In this article, Susanna Pinkus, a teacher, consultant and teaching practice supervisor who recently completed her PhD, describes her research into partnerships between parents and professionals. She bases her assertions on the daily experiences of 14 parents based in four London education authorities and attributes an absence of effective collaboration to lack of understanding about how partnerships between parents and professionals do, and should, function in the special educational context. In order to bridge this gap between the rhetoric of policy and the difficulties that are frequently reported in developing parent-professional relationships in practice, Susanna Pinkus identifies and discusses four principles as being central to forming effective partnerships.     

An evaluation of characteristics of environmental education practice in New Zealand schools

This paper reports on a national evaluation project that investigated characteristics of environmental education (EE) practice in New Zealand schools in 2002–2003. The research included a review of New Zealand and international environmental education literature, a survey of nearly 200 New Zealand schools and case studies of environmental education practice in eight schools. In this paper we describe and discuss key features of environmental education practice in New Zealand schools at the time of the research. We consider the rewards and challenges for teachers, students, schools and the wider school community arising from the schools’ implementation of this non‐compulsory curriculum subject. We conclude by considering what the findings told us about current EE practice and how these findings might inform a greater emphasis towards environmental education/education for sustainability in New Zealand schools at a time of national curriculum policy change.     

Excavating cultural imperialism in student mobility programmes

The New Colombo Plan and similar student mobility initiatives in Aotearoa/New Zealand have been pitched as reversing the culturally imperialist focus of the original Colombo Plan (CP) because they involve sending Australian and Aotearoa/New Zealand students to the Indo-Pacific region instead of funding Asian students to study overseas. However, changes in this direction of student mobility mask ongoing geopolitical inequities. In order to interrogate these subtle power relations, this article adopts a Foucauldian genealogical approach. It briefly outlines the competing goals of the original CP before undertaking an analysis of the discourses evident in the Australian government’s New Colombo Plan and in the Education New Zealand’s Prime Minister’s Scholarship for Asia. This discourse analysis illustrates the extent to which the new student mobility programmes established in Australia and Aotearoa/New Zealand involve consuming the ‘Indo-Pacific’ and ‘Asian’ Other and often serves to reinforce rather than address global geopolitical inequities.     

Fred Clarke and the internationalisation of studies and research in education

Fred Clarke (1880–1952) was a key figure in the internationalisation of educational studies and research in the first half of the twentieth century. Clarke aimed to heighten the ideals and develop the practices of educational studies and research through promoting mutual influences in different countries around the world. He envisaged the Institute of Education at the University of London, England, as having a leading role, and was the director of the Institute from 1936 until 1945. His notion of internationalisation was reciprocal and transnational in nature, with aspirations for partnership within a common tradition. This built on the ideal of a “Commonwealth” that was current in the interwar years, and emphasised the affinities between the dominion nations and in particular Canada, South Africa, Australia and New Zealand. It also drew on the financial support and cultural influence of the Carnegie Corporation in New York. Two specific projects taken forward by Clarke to put these ideas into practice were his “world tour” of 1935 and his role as the “Adviser to Oversea Students” at the Institute of Education. These initiatives helped to convert strategic visions and policies into social practices, and to shape the subject of Education in higher education as a multi-disciplinary field in the generation after the Second World War.