Is SES really that important for educational outcomes in Australia? A review and some recent evidence

This paper demonstrates that the emphasis on students’ socioeconomic status (SES) in research and policy circles in Australia is unwarranted. The bivariate relationships between SES and educational outcomes are only moderate and the effects of SES are quite small when taking into account cognitive ability or prior achievement. These two influences have much stronger relationships with students’ outcomes than SES and their effects cannot be attributed to the influence of SES at earlier points of time. The theoretical explanations for socioeconomic inequalities in education (e.g. schools and cultural factors) are problematic and are not supported by empirical work. The much weaker than assumed effects of SES has implications for research and policy.     

Socioeconomic school segregation in a market-oriented educational system. The case of Chile

This paper presents an empirical analysis of the socioeconomic status (SES) school segregation in Chile, whose educational system is regarded as an extreme case of a market-oriented education. The study estimated the magnitude and evolution of the SES segregation of schools at both national and local levels, and it studied the relationship between some local educational market dynamics and the observed magnitude of SES school segregation at municipal level. The main findings were: first, the magnitude of the SES segregation of both low-SES and high-SES students in Chile was very high (Duncan Index ranged from 0.50 to 0.60 in 2008); second, during the last decade, SES school segregation tended to slightly increase in Chile, especially in high schools (both public and private schools); third, private schools – including voucher schools – were more segregated than public schools for both low-SES and high-SES students; and finally, some market dynamics operating in the Chilean education (like privatization, school choice, and fee-paying) accounted for a relevant proportion of the observed variation in SES school segregation at municipal level. These findings are analyzed from an educational policy perspective in which the link between SES school segregation and market-oriented mechanisms in education plays a fundamental role.     

The Challenge of Controlling for SES in Social Science and Education Research

This article addresses the difficulties of controlling for socioeconomic status (SES) in social science and educational studies. The article reviews the history behind controlling for SES and points out the shortcomings of the research approaches of the past. I then assert that there still remain a number of weaknesses in the ways that are presently and commonly used for controlling for SES. I argue that the field of the natural sciences is well ahead of the social sciences in addressing some of the difficulties in measuring the effects of SES. Among the issues that natural scientists are investigating include the notion of reciprocal causality and SES as a catch all variable, as well as examining the factors that affect SES. The article examines a number of methods that researchers are introducing to examine the effects of SES in more sophisticated ways. These methods include considering variables that influence SES, taking measures of SES at different points in time, examining intervening variables that act between SES and the variables under study, and other approaches.     

The Surprisingly Modest Relationship Between SES and Educational Achievement

Measures of socioeconomic status (SES) are routinely used in analyses of achievement data to increase statistical power, statistically control for the effects of SES, and enhance causality arguments under the premise that the SES-achievement relationship is moderate to strong. Empirical evidence characterizing the strength of the SES-achievement relationship and its moderators suggests that this relationship is surprisingly modest, with an average SES-achievement correlation of .22, although it appears to have strengthened in the past 3 decades. The modest SES-achievement relationship has important implications for using SES measures in educational data analyses. We provide evidence of this relationship and of the need to use theoretical models to guide the construction and selection of SES measures in analyses of achievement data.     

Secondary analysis of large-scale assessment data: an alternative to variable-centred analysis

International large-scale assessments are now part of the educational landscape in many countries and often feed into major policy decisions. Yet, such assessments also provide data sets for secondary analysis that can address key issues of concern to educators and policymakers alike. Traditionally, such secondary analyses have been based on a variable-centred approach that gives rise to league tables. In the study reported here, a person-centred analysis is used as an alternative to the traditional approach. Data from the International Civic and Citizenship Education Study (ICCS) were analysed to investigate Asian students' attitudes to their future civic participation. Cluster analysis with validity measures showed that 4 distinct groups of students were identified within the societies studied thus highlighting the diversity within the samples. These results cannot be achieved with a conventional variable approach to analysis, and they suggest the usefulness of exploring alternative approaches to secondary data analysis.     

Early Language Learning and Literacy: Neuroscience Implications for Education

The last decade has produced an explosion in neuroscience research examining young children's early processing of language that has implications for education. Noninvasive, safe functional brain measurements have now been proven feasible for use with children starting at birth. In the arena of language, the neural signatures of learning can be documented at a remarkably early point in development, and these early measures predict performance in children's language and pre‐reading abilities in the second, third, and fifth year of life, a finding with theoretical and educational import. There is evidence that children's early mastery of language requires learning in a social context, and this finding also has important implications for education. Evidence relating socioeconomic status (SES) to brain function for language suggests that SES should be considered a proxy for the opportunity to learn and that the complexity of language input is a significant factor in developing brain areas related to language. The data indicate that the opportunity to learn from complex stimuli and events are vital early in life, and that success in school begins in infancy.     

Defining educational research: A perspective of/on presidential addresses and the australian association for research in education

This paper is concerned with the definition of the field of educational research and the changing and developing role of the Australian Association for Research in Education (AARE) in representing and constituting this field. The evidence for the argument is derived from AARE Presidential Addresses across its 40-year history. The paper documents the enhanced complexity and diversity of the field over these 40 years, including the emergence of a global educational policy field, theoretical and methodological developments in the social sciences and new research accountabilities such as the Excellence in Research for Australia (ERA) measure. Specifically, the paper suggests that the evidence-based movement in public management and education policy, and the introduction of the ERA, potentially limit and redefine the field of educational research, reducing the usefulness and relevance of educational research to policy makers and practitioners. This arises from a failure to recognise thatEducation is both a field of research and a field of policy and practice. Located against both developments, the paper argues for a principled eclecticism framed by a reassessment of quality, which can be applied to the huge variety of methodologies, theories, epistemologies and topics legitimately utilised and addressed within the field of educational research. At the same time, the paper argues the need to globalise the educational research imagination and deparochialise educational research. This call is located within a broader argument suggesting the need for a new social imaginary (in a post-neoliberal context of the global financial crisis) to frame educational policy and practice and the contribution that educational theory and research might make to its constitution. In relation to this, the paper considers the difficulties that political representations of such a new imaginary might entail for the President and the Association, given the variety of its membership and huge diversity of its research interests.     

EIGHTH GRADE MATHEMATICS TEACHERS’ FORMATIVE ASSESSMENT PRACTICES IN SES-DIFFERENT CLASSROOMS: A TAIWAN STUDY

In this qualitative case study, the researchers explored 3 8th grade teachers?? formative assessment practices as it occurred during their mathematics instruction at socioeconomic status (SES)-different schools in Taiwan. Instructionally embedded formative assessment we refer to as discourse-based assessment practice (DAP). In Taiwan, there is a large mathematics achievement gap among high SES and low SES and minority students in 8th grade. Addressing this issue at the level of classroom practice, we attempt to document teachers?? DAP using a parsimonious, but practical framework for analyzing classroom discourse in 23 lessons. For the purpose of this study, 3 lessons for each teacher are represented. The extended sequence (Mehan, 1979) was the primary unit of analysis, to which we applied our framework for illuminating and differentiating the teachers?? press for student understanding through questions and feedback. The analysis of the teacher??s instruction at the high SES indicated that it was more formative than the others, pressing for mathematical understanding. The 2 teachers at the low SES schools pressed for rote understanding, though there were qualitative differences between them. The findings raise more questions and implications for research and education policy. In Taiwan where there is scant research on classroom practices, DAP as an instructional improvement may be a starting point for educational improvement for all its students.     

Education research Australia: a changing ecology of knowledge and practice

Processes of national research assessment, such as Excellence in Research for Australia (ERA) are a type of audit technology that confronts and steers established institutional identities and traditions. This nexus between policy and practice drives boundary work that diffracts prevailing policy logics, organisational practices, and habits of mind. We use this notion of ‘boundary work’ as an analytical lens for understanding the nature and effects of ERA in the Australian educational research space. This paper explains the methodology that informed the AARE–ACDE research reported in Strategic Capacity Building for Australian Educational Research. It documents the policy logic of ERA and the way it cuts across the established ecology of educational research, revealing social and symbolic work that is remaking the boundaries of educational research. We report on the historical trajectory of Australian educational research, the way ERA codes research outputs, and how educational researchers are repositioning in this shifting research space. We argue that there are specific loci of boundary work where capacity building in Australian educational research can make a difference to future educational knowledge building.     

Implementation and Outcomes of Supplemental Educational Services: The Tennessee State-Wide Evaluation Study

Supplemental Educational Services (SES), a component of the No Child Left Behind (NCLB) Act, provides free tutoring to economically disadvantaged children who are attending Title I schools in their 2nd or more years of school improvement. This research evaluated SES in Tennessee to determine the: (a) impacts on student achievement, and (b) perceptions of SES implementation and outcomes by teachers, district coordinators, principals/site coordinators, and parents. Using value-added methodology, statistical analyses of achievement data controlled for both student ability and teacher effects in 2 alternative models. Not surprisingly, parent reactions to SES were highly positive, whereas those by the 3 other stakeholder groups were more mixed. Achievement results from both analytical models yielded mostly small and nonsignificant provider effects. The implications of the findings for evaluating SES are discussed with regard to both research and policy issues. Recommendations are offered for broadening the evaluation of SES through smaller mixed-methods studies to examine implementation and educational outcomes in more highly controlled contexts.     

Is Concentrated Advantage the Cause? The Relative Contributions of Neighborhood Advantage and Disadvantage to Educational Inequality

Supported by persistent educational inequality and growth of the field of neighborhood effects research, this meta-analysis investigates the relative association of neighborhood advantage and disadvantage to educational outcomes; the consistency of associations across different educational indicators; and the moderating influence of model specifications within primary studies. Using multilevel statistical methodology, this synthesis finds that studies of the relationship between the presence of higher income neighbors and education outcomes produce effect-sizes that are more often significant; in keeping with the hypothesized direction of their effects; and of greater magnitude than similar investigations of low SES effects. These results appeared consistent after disaggregating the effect-sizes according to the type of educational indicator and controlling for differences in the specifications of the primary study models. A discussion of the findings, alternative hypotheses and implications for policy and research conclude the paper.     

Mixed methods in educational psychology inquiry

Mixed methods research has the potential to advance theory and enhance the usefulness of research findings. However, the success of a mixed methods research inquiry is tied to how well researchers integrate the quantitative and qualitative strands, and to how well researchers address the standards for quality in quantitative, qualitative, and mixed methods. In this introduction article, we define mixed methods research and discuss what mixed methods research can offer to the field of educational psychology. Then we consider what constitutes integration and rigor in mixed methods research and describe three core mixed methods research designs. Following this overview, we briefly introduce each article to this special issue, along with the commentary by Vicki Plano Clark. We also discuss how the use of mixed methods can help address common educational problems including: (a) identifying and exploring socially-situated and contextualized learning processes; (b) providing insights into differences across individuals with respect to educational outcomes; and, (c) building instruments that reflect the experiences of individuals who will be assessed by these instruments. Finally, we close with thoughts on the future of mixed methods research.     

Alleviating or exacerbating disadvantage: does school attended mediate the association between family background and educational attainment?

ABSTRACT

Opportunities for social mobility are generated by education systems designed to alleviate the effects of social origin by providing equality of opportunities and resources. The persistence of the strong association between socioeconomic status (SES) and child’s educational achievement and attainment suggests that social origin continues to play an integral role in the educational outcomes of successive generations of Australians. Sociologists draw on a range of theoretical perspectives to explain this association including Bourdieu’s cultural and social capital theories. Using data collected by the Longitudinal Survey of Australian Youth 2009 (LSAY09) project, I examine the associations between student SES, school SES and two outcome variables: Programme for International Student Assessment (PISA) score and university enrolment. The results indicate that low SES students attending high SES schools perform better on PISA tests than low SES students attending low SES schools. After controlling for PISA score, low SES students were less likely than their high SES peers to enrol at university. Furthermore, students attending low SES schools were less likely than their peers attending high SES schools to enrol at university, net of their individual SES and their PISA scores.     

Testing the validity of value‐added measures of educational progress with genetic data

Value‐added measures of educational progress have been used by education researchers and policy‐makers to assess the performance of teachers and schools, contributing to performance‐related pay and position in school league tables. They are designed to control for all underlying differences between pupils and should therefore provide unbiased measures of school and teacher influence on pupil progress, however, their effectiveness has been questioned. We exploit genetic data from a UK birth cohort to investigate how successfully value‐added measures control for genetic differences between pupils. We use raw value‐added, contextual value‐added (which additionally controls for background characteristics) and teacher‐reported value‐added measures built from data at ages 11, 14 and 16. Sample sizes for analyses range from 4,600 to 6,518. Our findings demonstrate that genetic differences between pupils explain little variation in raw value‐added measures but explain up to 20% of the variation in contextual value‐added measures (95% CI = 6.06% to 35.71%). Value‐added measures built from teacher‐rated ability have a greater proportion of variance explained by genetic differences between pupils, with 36.3% of their cross‐sectional variation being statistically accounted for by genetics (95% CI = 22.8% to 49.8%). By contrast, a far greater proportion of variance is explained by genetic differences for raw test scores at each age of at least 47.3% (95% CI: 35.9 to 58.7). These findings provide evidence that value‐added measures of educational progress can be influenced by genetic differences between pupils, and therefore may provide a biased measure of school and teacher performance. We include a glossary of genetic terms for educational researchers interested in the use of genetic data in educational research.     

Inequality in top performance: an examination of cross-country variation in excellence gaps across different levels of parental socioeconomic status

This article examines the extent to which parental socioeconomic status (SES) affects the likelihood of a child becoming a top-performing student, offering an international perspective by reporting this relationship in 31 developed countries. The impact of 3 important educational system characteristics (differentiation in terms of early tracking, standardisation, and private schooling) on the relationship between parental SES and top performance was determined. We employed multilevel logistic regression models on data from the Programme for International Student Assessment (PISA) 2015 (N?=?216,980) to reveal that children with low parental SES have a lower probability of becoming a top-performing student than those with high parental SES, although this association differs between countries. The negative relationship between a disadvantaged parental background and top performance was not affected by the educational system characteristics under investigation.     

Teachers matter: Measures of teacher effectiveness in low-income minority schools

Teachers make a difference in student academic growth. Students from low-income, minority communities attend schools with less resources and less qualified teachers than students in wealthier communities. The Race to the Top (RTTT) policy by the U.S. Department of Education has attempted to address the achievement gap based on SES and the disparity in the quality of teachers between communities. The policy stipulates that teacher effectiveness be determined, in significant part, by student growth measures and supplemented with multiple observation-based assessments. The emphasis placed on student outcomes to indicate teacher effects has served to link teacher evaluations with teacher effectiveness. This review article examines the reported benefits and critical responses to the use of a prominent student growth measure, the Education Value-Added Assessment System (EVAAS), in terms of its implementation as an evaluation tool of teacher effectiveness in low-income, minority schools. Models of observational teacher evaluations, taking into consideration common attributes of effective teachers in low-income schools, are presented as supplemental measures to provide more in-depth information to interpret value-added analyses and to minimize possible misinterpretation of student growth data or the misclassification of teachers’ effectiveness for teachers in low-income schools. Information obtained from a combination of evaluation measures can be used to identify both effective and ineffective teachers, to target areas in need of improvement to increase teacher effectiveness, and to make decisions concerning the equitable distribution of effective teachers, especially for students who are most in need.     

Researching race/ethnicity and educational inequality in the Netherlands: A critical review of the research literature between 1980 and 2008

This article describes and critically analyzes how educational sociologists in the Netherlands have studied the relationship between race/ethnicity and educational inequality between 1980 and 2008. Five major research traditions are identified: (1) political arithmetic; (2) racism and ethnic discrimination; (3) school characteristics; (4) school choice; and (5) family background. The development of particular research traditions is explained by pointing to more general developments in terms of social policy and intellectual climate in the Netherlands. This study builds on a similar, recently published literature review that focuses on the UK context by critically comparing the development and findings from these different bodies of research literature. The conclusions suggest that the Netherlands, like England, developed strong research traditions in this area of research since the 1980s and that both countries can learn from each other and advance future research in this area by developing more comprehensive research agendas. More generally, this review illustrates the usefulness of conducting nationally comparative literature reviews in assessing the development of particular bodies of research and in bringing together knowledge produced in different national settings.     

Differences in educational outcomes of African American students from different socioeconomic backgrounds

This research tested a structural equation model of educational outcomes for three socioeconomic status (SES) groups of African American students enrolled in a community college. The structural model, which was based on a variant of Tinto's (1987) model, contained two exogenous constructs, educational intentions/commitment and external commitments, and three endogenous constructs, academic integration, social integration, and educational outcomes. The study demonstrated that higher levels of academic and social engagement had positive direct effects on educational outcomes for all students regardless of SES background. Other paths that were supported included the positive direct effects of educational intentions/commitment on academic and social integration and the negative impact of external commitments on social integration. Significant structural differences were not present in the measurement of model constructs or the process of educational outcomes among lowest, lower to middle, and middle to upper SES groups.     

What can evidence-use in practice learn from evidence-use in policy?

Abstract

Background: This paper approaches evidence-informed practice from the perspective of evidence-informed policy-making. Using the findings of a recent study of evidence-use by educational policy-makers to raise questions about evidence-use by educational practitioners, it seeks to explore what such a study might tell us about how to understand and improve evidence-use by educational practitioners.

Purpose: The paper aims, therefore, to identify potential connections, shared insights and common issues between evidence-use in policy and evidence-use in practice. It does this by focusing on two specific areas: the nature of the evidence (i.e. what evidence is used) and the nature of the use (i.e. how evidence is used). The paper outlines what was found about each of these aspects of evidence-use in policy, and then considers what questions and issues these findings might raise for evidence-use in educational practice.

Sample: The empirical study on which this paper is based was an in-depth study of the use of evidence within educational policy development in Australia. It focused on the development of three specific education policies within one Australian state education department and involved interviews with 25 policy-makers who were actively involved in the development of these policies.

Design and methods: The policy-based study involved the following data collection processes: (i) in-depth semi-structured interviews with 25 policy-makers who were involved in the development of the selected policies; (ii) documentary analysis of policy documents, background research reports and other relevant papers relating to the selected policies; (iii) unstructured observation (where possible) of meetings and events connected with the development of the selected policies; and (iv) feedback from 40 wider policy staff who took part in a verification workshop to discuss the project’s emerging findings.

Findings: Drawing on the findings from the original policy study, two areas of potential connection to evidence-use in practice are explored. First, in relation to ‘varieties of evidence and uses’, the negotiation of diverse evidence types and the potential for using evidence in multiple and varied ways appear to be features of evidence-use that are common to educational policy-makers as well as educational practitioners. Secondly, in relation to ‘narrowness of evidence sources’, there is potential for both policy-makers and practitioners to use a narrow (rather than broad) selection of evidence, due to a tendency to work with certain evidence types as a starting point (e.g. performance data) and a tendency to draw on certain evidence sources more frequently (e.g. well-known, familiar research sources).

Conclusions: This paper emphasises: (i) the need for more integrated (or joined-up) understandings of evidence-use across contexts of practice and contexts of policy; (ii) the importance of continued efforts to understand and represent evidence-use more effectively within educational practices; and (iii) the value of paying careful attention to the quality and qualities of evidence-use within and across the different settings of educational practice and policy.