Statistical Techniques Employed in AERJ and JCP Articles from 1988 to 1997: A Methodological Review

The authors of the present methodological review investigated the patterns of statistical usage and reporting practices in 756 articles published in the American Educational Research Journal (AERJ) and in the Journal of Counseling Psychology (JCP) over a 10-year period. First, some findings from other similar reviews are summarized. Second, the authors present a framework for characterizing selected research practices that emphasizes, in part, elements of the recent report of the American Psychological Association (APA) Task Force on Statistical Inference (Wilkinson & APA Task Force on Statistical Inference, 1999). Third, characterizations of 10 years of analytic practices in 2 journals are presented and evaluated within that framework. The article concludes with a discussion of the changes that may be necessary to improve the statistical state of affairs in behavioral research.     

Further Reflections on Hypothesis Testing and Editorial Policy for Primary Research Journals

Questions have recently been raised about the value of statistical hypothesis testing, as well as the associated policy implications for publishing empirically based research in professional journals. In this Reflections note, we extend our (Robinson and Levin, 1997) earlier thoughts on what could, should, and should not be done to existing editorial practices.     

Statistical Significance and Effect Size in Education Research: Two Sides of a Coin

Abstract

In education research, statistical significance and effect size are 2 sides of 1 coin; they complement each other but they do not substitute for each other. Good research practice requires that, to make sound research decisions, both sides should be considered. In a simulation study, the sampling variability of 2 popular effect-size measures (d and R ²) was examined. The variability showed that what is statistically significant may not be practically meaningful, and what appears to be practically meaningful could have been the result of sampling error, thus not trustworthy. Some practical guidelines are suggested for combining the 2 sources of information in research practice.     

Constructive Criticisms of Methodological and Editorial Practices

Thompson (1999a and elsewhere) has taken strong positions on a variety of methodological issues. In this article, the authors critique some of those positions and provide alternative views for each.     

Making Social Work Count: A Curriculum Innovation to Teach Quantitative Research Methods and Statistical Analysis to Undergraduate Social Work Students in the United Kingdom

Students in the United Kingdom (UK) are found to lack knowledge and skills in quantitative research methods. To address this gap, a quantitative research method and statistical analysis curriculum comprising 10 individual lessons was developed, piloted, and evaluated at two universities The evaluation found that BSW students’ (N = 81) self-efficacy improved significantly from pre- to posttest, but statistical knowledge improved only slightly and the improvement was not statistically significant. The findings point to recommendations for social work educators in the UK and beyond to consider when integrating the 10-input quantitative method curriculum and when teaching research methods and statistics to undergraduate social work students.