Effect sizes,confidence intervals,and confidence intervals for effect sizes

The present article provides a primer on (a) effect sizes, (b) confidence intervals, and (c) confidence intervals for effect sizes. Additionally, various admonitions for reformed statistical practice are presented. For example, a very important implication of the realization that there are dozens of effect size statistics is that authors must explicitly tell readers what effect sizes they are reporting. With respect to confidence intervals, when interpreting a 95% interval, we should never say that we are 95% confident that our interval captures the estimated population parameter. It is explained that effect sizes should be reported even for statistically nonsignificant effects. And, most importantly of all, it is emphasized that effect sizes should not be interpreted using Cohen's benchmarks. Instead, we ought to interpret our effects in direct and explicit comparison against the effects in the related prior literature. © 2007 Wiley Periodicals, Inc. Psychol Schs 44: 423–432, 2007.     

New Confidence Intervals and Bias Comparisons Show That Maximum Likelihood Can Beat Multiple Imputation in Small Samples

When analyzing incomplete data, is it better to use multiple imputation (MI) or full information maximum likelihood (ML)? In large samples ML is clearly better, but in small samples ML’s usefulness has been limited because ML commonly uses normal test statistics and confidence intervals that require large samples. We propose small-sample t-based ML confidence intervals that have good coverage and are shorter than t-based confidence intervals under MI. We also show that ML point estimates are less biased and more efficient than MI point estimates in small samples of bivariate normal data. With our new confidence intervals, ML should be preferred over MI, even in small samples, whenever both options are available.     

Scholarly Productivity of Editorial Board Members of Three American Counseling and Counseling Psychology Journals

The scholarly journals in professional and scientific fields serve the function of communicating new knowledge and informed discourse on the major issues affecting the field of counseling, and editorial board members (EBMs) serve as gatekeepers of what information will be communicated. The ability of EBMs to make sound judgments directly affects the quality of research and scholarship published. This study analyzed one important EBM qualification, the scholarly productivity of the editorial board members of three major American counseling journals (The Counseling Psychologist [TCP], the Journal of Counseling Psychology [JCP], and the Journal of Counseling and Development [JCD]). An analysis of the productivity rates of editorial board members on these journals was conducted using the PsycINFO database. The results indicated that editorial board members of JCP have significantly more experience publishing than members of TCP and JCD. The differential publication rates of editorial board members suggest that these three journals place different emphasis on scholarly productivity as part of their selection criteria for editorial board membership and may reflect that the three journals have different missions and serve different clientele. These findings have implications, not only for the profession of counseling in the United States, but also for the international counseling community.This article is dedicated to our esteemed colleague, Stephen G. Weinrach, who died after a long and courageous battle with leukemia on April 24, 2004. This article was the last that Steve was working on prior to his death. It was his brainchild. The contributions that Steve made to the counseling profession over the years are inestimable. He was truly through his numerous writings and professional association activities the “conscience of the couseling profession.” He is dearly missed.     

Moderated Mediation Analysis Using Bayesian Methods

Conventionally, moderated mediation analysis is conducted through adding relevant interaction terms into a mediation model of interest. In this study, we illustrate how to conduct moderated mediation analysis by directly modeling the relation between the indirect effect components including a and b and the moderators, to permit easier specification and interpretation of moderated mediation. With this idea, we introduce a general moderated mediation model that can be used to model many different moderated mediation scenarios including the scenarios described in Preacher, Rucker, and Hayes (2007). Then we discuss how to estimate and test the conditional indirect effects and to test whether a mediation effect is moderated using Bayesian approaches. How to implement the estimation in both BUGS and Mplus is also discussed. Performance of Bayesian methods is evaluated and compared to that of frequentist methods including maximum likelihood (ML) with 1st-order and 2nd-order delta method standard errors and mL with bootstrap (percentile or bias-corrected confidence intervals) via a simulation study. The results show that Bayesian methods with diffuse (vague) priors implemented in both BUGS and Mplus yielded unbiased estimates, higher power than the ML methods with delta method standard errors, and the ML method with bootstrap percentile confidence intervals, and comparable power to the ML method with bootstrap bias-corrected confidence intervals. We also illustrate the application of these methods with the real data example used in Preacher et al. (2007). Advantages and limitations of applying Bayesian methods to moderated mediation analysis are also discussed.     

Editorial: A Vision of a Fair and Efficient,Diverse and Inclusive,Cumulative Science of Child Development in the Best and Worst of Times

If you have come here in search of the submission requirements at Child Development, this is perhaps not the editorial you are looking for. Consider visiting instead our revised instructions to authors . Nor does this essay simply detail the priorities of the incoming board and the initiatives we will be implementing over the next 6 years, though these are summarized in Table 1. Rather, this editorial was written to articulate clearly the scientific values underlying current plans and policies at the journal in support of publishing the highest quality and highest impact research on child development. I emphasize two interrelated themes: (a) our plans for continuing to emphasize and enhance diversity and inclusion in research on child development and (b) our policies that remove impediments to cumulative developmental science. Discussion focuses primarily on how we are incentivizing efforts to achieve these widely held yet too often neglected goals, taking as its point of departure emerging challenges to a fair and efficient editorial process at the journal. In so doing, I mean to highlight the essential work of continuously cultivating editorial structures that firmly embed in developmental science fundamental scientific values, principles that make it possible for research on child development to flourish in both the best and worst of times.     

ABANDONING THEORETICAL FORTRESSES: POSSIBILITIES FOR INTERACTION

In this review essay, William Proefriedt argues that it may be possible to reformulate three apparently irreconcilable stances in a manner that would allow more interaction among the elements championed within each stance. The arguments addressed are (1) the argument for the efficacy of educational reform; (2) the argument that social and economic realities decisively undercut the efficacy of educational reform; and (3) the argument that the heritability of IQ is dramatically more determinative of individuals' school and economic success than any set of school policies and practices. Proefriedt seeks to examine these positions as they have been developed in Linda Darling‐Hammond et al.'s Powerful Learning: What We Know About Teaching for Understanding, Richard Rothstein's Class and Schools: Using Social, Economic, and Educational Reform to Close the Black‐White Achievement Gap, and Charles Murray's Real Education: Four Simple Truths for Bringing America's Schools Back to Reality. He concludes that the three analyses under consideration can be formulated so that each might serve to complement the strengths and correct the deficiencies of the others, thus yielding a broader explanatory scheme that could lead to wiser policies.     

Journals in criminal justice and criminology: An updated and expanded guide for authors

This article provides an annotated list of 326 journals in criminal justice and criminology. After consulting the “notes for contributors” sections of each journal, the authors mailed a self-administered survey to all journal editors soliciting their input on their editorial policies. Journal websites were also consulted to construct the journals' mission, scope, and editorial focus. A total of 221 editors returned the survey for a return rate of 68%. The following entries present an annotation that summarizes the mission, philosophy, and editorial policies of each journal. Following the annotations, the chart documents contact information for the editors and editorial policies concerning submissions to each journal.     

Assessing school effectiveness: Evidence from the Irish context

Abstract

This paper considers the theories of language educaation and infant pedagogy of Professor Timothy Corcoran, Professor of Education in University College, Dublin. He played a pivotal role in the debates on education at the 1920s. These opinions were to become decisive in the formation of the New Free State's education programmes and policies. He held that infant classes ought to be the prime agents in the revival of the Irish Language. As a result the National Programme of Primary Instruction (1922) required that all the work in the infant classes should be conducted through Irish. He castigated the enlightened principles of Rousseau, Pestalozzi, Froebel and Montessori arguing that Irish education should not give up its sane traditions for doctrines derived from ‘poisoned sources’. His antagonism towards the thinking of the progressive educational theorists meant that the infants of Ireland had to wait until 1948 for a revised programme that would be more in line with the thinking of the day.     

Gender Composition of Editors and Editorial Boards in Seven Top Criminal Justice and Criminology Journals from 1985 to 2017

This paper examines the gender composition of editors and editorial board members of seven top criminal justice and criminology (CCJ) journals from 1985 through 2017. The findings indicate that women have historically been, and continue to be, underrepresented in these positions. From 1985 through 2017, women comprised 14% of all Editors-in-Chief, 27% of all Associate Editors, and 22% of all Editorial Board members. While there was a period during the early 2000s when Justice Quarterly and Criminology achieved gender parity in representation across all of the editorial roles, this equality was short lived. The other journals have never achieved gender parity, and, on average, women have comprised 3.8% to 35.2% of the editorial positions at each of the journals. The implications of this imbalance for women’s scholarship and professional success are discussed, and recommendations for changes to CCJ journal policies and practices to ensure more equity are provided.     

Empathy,Experience and SMSC (Spiritual,Moral, Social and Cultural Education)

Having commented on the developments in PSE and SMSC [Spiritual, Moral, Social and Cultural Education] Ron Best suggests that the motivation for these has been more political than child centred. He is particularly critical of the trend towards specifying learning outcomes as matrices, which he characterizes as the kind of bureaucratization which dehumanizes an essentially human activity. He argues that we need to start with experience and that empathy, though currently undervalued, should be a key dimension of this. The meaning of empathy is then elaborated and in conclusion the case for its central importance presented.     

WHAT DOES PHILOSOPHY HAVE TO OFFER EDUCATION,AND WHO SHOULD BE OFFERING IT?

In this review essay Stanton Wortham explores how philosophy of education should both turn inward, engaging with concepts and arguments developed in academic philosophy, and outward, encouraging educational publics to apply philosophical approaches to educational policy and practice. He develops his account with reference to two recent ambitious projects: The Oxford Handbook of Philosophy of Education, edited by Harvey Siegel, and the two‐volume yearbook of the National Society for the Study of Education (NSSE), titled Why Do We Educate? edited by Gary Fenstermacher (series editor), David Coulter and John Wiens (volume 1), and Mark Smylie (volume 2). These two projects initially appear to be opposed, with the Handbook emphasizing elite philosophy and the Yearbook emphasizing public engagement. Wortham argues that each project is in fact more complex, and that they are in some respects complementary. He concludes by making a case against a simple hierarchy of basic and applied knowledge and calling for a more heterogeneous philosophy of education.     

Participation and equity in higher education: are we going back to the future?

The December 2008 special issue of the Oxford Review of Education provided a review of education policy during Tony Blair’s tenure as Prime Minister. This paper forms a response to the ten contributions to that special issue and discusses some of the issues raised in them. While a few positive aspects of education under New Labour were identified in the special edition, it focused more on the failures of New Labour than its achievements. A common theme to emerge from the papers included the government’s pursuit of neo‐liberal market policies at the expense of its professed commitment to social justice. While accepting that the government’s failure to tackle the differences in educational outcomes between advantaged and disadvantaged pupils constitutes a major failing, the present author argues that significant achievements, such as early years provision, were neglected in the special issue. He also discusses the electoral considerations facing New Labour and the personal role of Tony Blair in determining policy. The paper goes on to consider whether New Labour’s education policy has changed since the departure of Blair and identifies some hints of a potentially more progressive approach developing under Brown. It concludes by suggesting that contributing towards a debate about alternatives to Blairite policies should now become a priority for the ‘educational establishment’.     

Trends in Female Authorships, Editorial Board Memberships, and Editorships in Educational Psychology Journals from 2003 to 2008

Robinson, McKay, Katayama, and Fan (Contemporary Educational Psychology, 23, 331–343, 1998) reported that women were underrepresented in terms of authorships, editorial board memberships, and editorships in the field of educational psychology based on membership trends. More recently, Evans, Hsieh, and Robinson (Educational Psychology Review, 17, 263–271, 2005) reported that women had made gains as editors but had not kept pace with organizational membership in terms of authorships and editorial board memberships. Our goal in this paper was to further examine women’s participation in educational psychology journals by extending the datasets of Robinson et al. and Evans et al. The number of female authors per article, particularly those from non-US institutions, has continued to increase. However, consistent with Evans et al., although females are continuing to make numerical gains in both authorships—both primary and secondary—and editorial board memberships, their involvement has not kept pace in relation to membership trends.     

The neo-liberal education policies of epimeleia heautou: caring for the self in school markets

The paper argues that neo-liberal education policy has capitalized on a historical concern to care for the self, or the Greek epimeleia heautou. We discuss epimeleia heautou in relation to education policies that emphasize greater choice in curriculum offerings, and in relation to school choice policies more generally. Thus, a premise of our argument is that school choice policies accommodate a much greater range of selves to be cared for. The analysis examines the neo-liberal subject, homo ?conomicus, in relation to education policy that produces choices of the self and choices for its care. We conclude by discussing conceptions of the self in relation to two aporias of neo-liberal educational equality produced through ethnic-specific schools.     

Ethical Issues in the Malaysian Education System

Malaysia is a multi-ethnic country in which the government gives preferential treatment in education, employment, and ownership to its majority ethnic group: Bumiputera. However, affirmative action policies in the current Malaysian context should work according to John Rawls’ Theory of Justice by being based on income rather than ethnicity. Certainly Malaysian Government should be praised for giving freedom to the Chinese and Indians to select their preferred school and this is partly consistent with Amartya Sen’s view of freedom; however this article argues that these communities are apparently given constraint freedom of choice.     

An Englishman's Home is his Castle? A Response to Paul Willis's ‘Unemployment: the final inequality‘

This paper argues that Paul Willis's latest article is important in highlighting unemployment as a major form of inequality but that, just as in Learning to Labour, Willis's orientation is a male one and that this has the effect of marginalising and misrepresenting the interests of women. The paper further suggests that some of Willis's recommendations are somewhat anachronistic and also too class oriented. While we believe that class should be central to any analysis of unemployment, we would stress that gender and ‘race’ should also be central. Willis, we argue, has made an attempt to broaden his analysis but this has been largely unsuccessful. The paper concludes with a critique of some of Willis's terminology.     

Implementing Confidence Assessment in Low-Stakes,Formative Mathematics Assessments

Confidence assessment (CA) involves students stating alongside each of their answers a confidence rating (e.g. 0 low to 10 high) to express how certain they are that their answer is correct. Each student’s score is calculated as the sum of the confidence ratings on the items that they answered correctly, minus the sum of the confidence ratings on the items that they answered incorrectly; this scoring system is designed to incentivize students to give truthful confidence ratings. Previous research found that secondary-school mathematics students readily understood the negative-marking feature of a CA instrument used during one lesson, and that they were generally positive about the CA approach. This paper reports on a quasi-experimental trial of CA in four secondary-school mathematics lessons (N = 475 students) across time periods ranging from 3 weeks up to one academic year, compared to business-as-usual controls. A meta-analysis of the effect sizes across the four schools gave an aggregated Cohen’s d of –0.02 [95% CI –0.22, 0.19] and an overall Bayes Factor B₀₁ of 8.48. This indicated substantial evidence for the null hypothesis that there was no difference between the attainment gains of the intervention group and the control group, relative to the alternative hypothesis that the gains were different. I conclude that incorporating confidence assessment into low-stakes classroom mathematics formative assessments does not appear to be detrimental to students’ attainment, and I suggest reasons why a clear positive outcome was not obtained.