Language‐Focused Interventions on Math Performance for English Learners: A Selective Meta‐Analysis of the Literature

This meta‐analysis synthesized research on math performance outcomes for English learners (EL) as a function of language‐focused (math vocabulary) interventions. We included group and single‐subject design studies with children from kindergarten to 8th grade (3,766 students for group, 30 for single‐subject). Group studies yielded a mean Hedges’ g of 0.26 in favor of the interventions relative to the control conditions, whereas single‐subject studies yielded a mean Percentage of Non‐Overlapping Data of 81.01% and Phi coefficient of .66 relative to baseline. Although group studies yielded small effect sizes (ESs), we found significant moderators for grade level, intervention focus, and length of intervention. Single‐subject studies yielded higher ESs than group studies, and were considered generally effective, with a high ES. This finding was attributed to a direct focus on children with math difficulties and one‐to‐one instruction. The implications for practice and future research are discussed.     

The Effects of Incentives on Workplace Performance: A Meta‐analytic Review of Research Studies 1

A meta‐analytic review of all adequately designed field and laboratory research on the use of incentives to motivate performance is reported. Of approximately 600 studies, 45 qualified. The overall average effect of all incentive programs in all work settings and on all work tasks was a 22% gain in performance. Team‐directed incentives had a markedly superior effect on performance compared to individually‐directed incentives. This effect was not influenced by the location of the study (business, government, or school), the competitive structure of the incentive system (programs where only the highest performers get incentives versus programs where everyone who increased performance receives incentives), the type of study (whether the study was a laboratory experiment or a field study), or the performance outcome (quality, quantity, or both). In these studies, money was found to result in higher performance gains than non‐monetary, tangible incentives (gifts, travel). More research is needed on the relative cost‐benefit of cash and gift incentives, and the way different types of tangible incentives are selected. Long‐term programs led to greater performance gains than shorter‐term programs did, and somewhat greater performance gains were realized for manual than for cognitive work. Explanations based on cognitive psychological principles accompany each of the analyses.     

Meta‐Analysis of Mathematic Basic‐Fact Fluency Interventions: A Component Analysis

Mathematics fluency is a critical component of mathematics learning yet few attempts have been made to synthesize this research base. Seventeen single‐case design studies with 55 participants were reviewed using meta‐analytic procedures. A component analysis of practice elements was conducted and treatment intensity and feasibility were examined. Findings suggest that drill and practice with modeling produced the largest effect sizes. Treatments with more than 3 components yielded higher effect sizes than those with fewer than 3, and a combination of treatment agents lead to better outcomes than a single agent. Other findings pertaining to prebaseline assessment, treatment time, experimental design employed, and treatment setting are also discussed.     

A Meta‐Analysis of Research on the Read Aloud Accommodation

Read aloud is a testing accommodation that has been studied by many researchers, and its use on K‐12 assessments continues to be debated because of its potential to change the measured construct or unfairly increase test scores. This study is a summary of quantitative research on the read aloud accommodation. Previous studies contributed information to compute average effect sizes for students with disabilities, students without disabilities, and the difference between groups for reading and mathematics using a random effects meta‐analytic approach. Results suggest that (1) effect sizes are larger for reading than for math for both student groups, (2) the read aloud accommodation increases reading test scores for both groups, but more so for students with disabilities, and (3) mathematics scores gains due to the read aloud accommodation are small for both students with and without disabilities, on average. There was some evidence to suggest larger effects in elementary school relative to middle and high school and possible mode effects, but more studies are needed within levels of the moderator variables to conduct statistical tests.     

The Role of Reflection in the Effects of Community Service on Adolescent Development: A Meta‐Analysis

This meta‐analysis assessed the effect of community service on adolescent development and the moderation of this effect by reflection, community service, and adolescent characteristics to explicate the mechanisms underlying community service effects. Random effects analyses, based on 49 studies (24,477 participants, 12–20 years old), revealed that community service had positive effects on academic, personal, social, and civic outcomes. Moderation analyses indicated that reflection was essential; the effect for studies that include reflection was substantial (mean ES = .41) while community service in the absence of reflection yielded negligible benefits (mean ES = .05). Effects increased when studies include more frequent reflection and community service, reflection on academic content, and older adolescents. These findings have implications for understanding and improving community service.     

The Effects of Read‐Aloud Accommodations for Students With and Without Disabilities: A Meta‐Analysis

Read‐aloud accommodations have been proposed as a way to help remove barriers faced by students with disabilities in reading comprehension. Many empirical studies have examined the effects of read‐aloud accommodations; however, the results are mixed. With a variance‐known hierarchical linear modeling approach, based on 114 effect sizes from 23 studies, a meta‐analysis was conducted to examine the effects of read‐aloud accommodations for students with and without disabilities. In general, both students with disabilities and students without disabilities benefited from the read‐aloud accommodations, and the accommodation effect size for students with disabilities was significantly larger than the effect size for students without disabilities. Further, this meta‐analysis reveals important factors that influence the effects of read‐aloud accommodations. For instance, the accommodation effect was significantly stronger when the subject area was reading than when the subject area was math. The effect of read‐aloud accommodations was also significantly stronger when the test was read by human proctors than when it was read by video/audio players or computers. Finally, the implications, limitations, and directions for future research are discussed.     

Where the Performance Issues Are and Are Not: A Meta‐Analytic Examination

The purpose of this study was to examine the often touted but rarely quantified claims of where performance problems actually occur in organizations. Starting in the mid–20th century, organizational development and performance consultants have followed the belief that the vast majority of organizational problems (85%) are tied to variables controlled by the organization and only a small percentage (15%) of performance problems are attributed to the worker. This study is a meta‐analysis that examined 327 performance technology (PT) analysis projects and coded the recommendations according to PT models to quantify the ratio between organizational and individual performance recommendations and corresponding problems. We find broad support for the conventional wisdom regarding the ratio of organizational issues to individual workers.     

Mean Effects of Test Accommodations for ELLs and Non‐ELLs: A Meta‐Analysis of Experimental Studies

The objective was to examine the impact of different types of accommodations on performance in content tests such as mathematics. The meta‐analysis included 14 U.S. studies that randomly assigned school‐aged English language learners (ELLs) to test accommodation versus control conditions or used repeated measures in counter‐balanced order. Individual effect sizes (Glass's d) were calculated for 50 groups of ELLs and 32 groups of non‐ELLs. Individual effect sizes for English language and native language accommodations were classified into groups according to type of accommodation and timing conditions. Means and standard errors were calculated for each category. The findings suggest that accommodations that require extra printed materials need generous time limits for both the accommodated and unaccommodated groups to ensure that they are effective, equivalent in scale to the original test, and therefore more valid owing to reduced construct‐irrelevant variance. Computer‐administered glossaries were effective even when time limits were restricted. Although the Plain English accommodation had very small average effect sizes, inspection of individual effect sizes suggests that it may be much more effective for ELLs at intermediate levels of English language proficiency. For Spanish‐speaking students with low proficiency in English, the Spanish test version had the highest individual effect size (+1.45).     

Team Knowledge Sharing Intervention Effects on Team Shared Mental Models and Student Performance in an Undergraduate Science Course

The purpose of this study was to examine the effects of a shared mental model (SMM) based intervention on student team mental model similarity and ultimately team performance in an undergraduate meteorology course. The team knowledge sharing (TKS) intervention was designed to promote team reflection, communication, and improvement planning. Results reveal that the TKS intervention was partially effective in enhancing student team SMM and team scores on meteorology lab assignments. The TKS intervention has potential for use in science courses where a teaming approach is used. Similar interventions could likely be developed, empirically examined, and potentially employed to promote success in handling complex challenges while working in teams in the classroom and beyond.     

A Pilot Study of Classroom‐Based Cognitive Skill Instruction: Effects on Cognition and Academic Performance

Cognitive skills are associated with academic performance, but little is known about how to improve these skills in the classroom. Here, we present the results of a pilot study in which teachers were trained to engage students in cognitive skill practice through playing games. Fifth‐grade students at an experimental charter school were randomly assigned to receive cognitive skill instruction (CSI) or instruction in geography and typing. Students in the CSI group improved significantly more than the control group on a composite measure of cognitive skills. CSI was more effective for students with lower standardized test scores. Although there was no group effect on test scores, cognitive improvement correlated positively with test score improvement only in the CSI group. Beyond showing that cognitive skills can be improved in the classroom, this study provides lessons for the future of CSI, including changes to professional development and challenges for scalability.     

教学团队共享心智模式与关系绩效的关系研究

文章采用教学团队共享心智模式与关系绩效问卷,对广东省507名初中教师进行研究,结果发现:不同性别、年龄、学历、教龄、职称的教师在教学团队共享心智模式中存在显著差异;不同年龄、教龄的教师在关系绩效中存在显著差异;教学团队共享心智模式与关系绩效之间存在显著正相关;教学团队共享心智模式能有效预测关系绩效。     

Promoting Positive Youth Development Through School‐Based Social and Emotional Learning Interventions: A Meta‐Analysis of Follow‐Up Effects

This meta‐analysis reviewed 82 school‐based, universal social and emotional learning (SEL) interventions involving 97,406 kindergarten to high school students (M_age = 11.09 years; mean percent low socioeconomic status = 41.1; mean percent students of color = 45.9). Thirty‐eight interventions took place outside the United States. Follow‐up outcomes (collected 6 months to 18 years postintervention) demonstrate SEL's enhancement of positive youth development. Participants fared significantly better than controls in social‐emotional skills, attitudes, and indicators of well‐being. Benefits were similar regardless of students’ race, socioeconomic background, or school location. Postintervention social‐emotional skill development was the strongest predictor of well‐being at follow‐up. Infrequently assessed but notable outcomes (e.g., graduation and safe sexual behaviors) illustrate SEL's improvement of critical aspects of students’ developmental trajectories.     

Formative Assessment: A Meta‐Analysis and a Call for Research

An effect size of about .70 (or .40–.70) is often claimed for the efficacy of formative assessment, but is not supported by the existing research base. More than 300 studies that appeared to address the efficacy of formative assessment in grades K‐12 were reviewed. Many of the studies had severely flawed research designs yielding uninterpretable results. Only 13 of the studies provided sufficient information to calculate relevant effect sizes. A total of 42 independent effect sizes were available. The median observed effect size was .25. Using a random effects model, a weighted mean effect size of .20 was calculated. Moderator analyses suggested that formative assessment might be more effective in English language arts (ELA) than in mathematics or science, with estimated effect sizes of .32, .17, and .09, respectively. Two types of implementation of formative assessment, one based on professional development and the other on the use of computer‐based formative systems, appeared to be more effective than other approaches, yielding mean effect size of .30 and .28, respectively. Given the wide use and potential efficacy of good formative assessment practices, the paucity of the current research base is problematic. A call for more high‐quality studies is issued.     

Science Instruction for Students with Learning Disabilities: A Meta‐Analysis

Although science has received much attention as a political and educational initiative, students with learning disabilities (LD) perform significantly lower than their nondisabled peers. This meta‐analysis evaluates the effectiveness of instructional strategies in science for students with LD. Twelve studies were examined, summarized, and grouped according to the type of strategy implemented. Effect sizes (ES) were calculated for each study. Across all studies, a mean ES of .78 was obtained, indicating a moderate positive effect on students with LD science achievement. Findings also align with past reviews of inquiry‐based instruction for students with special needs, indicating that students with LD need structure within an inquiry science approach in order to be successful. Additionally, results suggest that mnemonic instruction is highly effective at increasing learning disabled students' acquisition and retention of science facts.     

Structured Constructs Models Based on Change‐Point Analysis

This study proposes a structured constructs model (SCM) to examine measurement in the context of a multidimensional learning progression (LP). The LP is assumed to have features that go beyond a typical multidimentional IRT model, in that there are hypothesized to be certain cross‐dimensional linkages that correspond to requirements between the levels of the different dimensions. The new model builds on multidimensional item response theory models and change‐point analysis to add cut‐score and discontinuity parameters that embody these substantive requirements. This modeling strategy allows us to place the examinees in the appropriate LP level and simultaneously to model the hypothesized requirement relations. Results from a simulation study indicate that the proposed change‐point SCM recovers the generating parameters well. When the hypothesized requirement relations are ignored, the model fit tends to become worse, and the model parameters appear to be more biased. Moreover, the proposed model can be used to find validity evidence to support or disprove initial theoretical hypothesized links in the LP through empirical data. We illustrate the technique with data from an assessment system designed to measure student progress in a middle‐school statistics and modeling curriculum.     

Instructing Struggling Older Readers: A Selective Meta‐Analysis of Intervention Research

This article synthesizes the experimental literature on reading interventions for upper elementary and middle school students identified with reading disabilities on norm‐referenced reading measures. Ten studies (12 independent samples) yielded 70 effect sizes on norm‐referenced reading measures with an aggregated mean of 0.41 (SE= .04) in favor of the experimental condition. Moderate effect sizes emerged on norm‐referenced measures of word identification (M= 0.41), decoding (M= 0.43), and comprehension (M= 0.73) and low effect sizes for fluency (M=–.29). Intervention outcomes did not significantly vary as a function of the reading skills measured, type of reading instruction, and/or variations in sample characteristics. Studies yielding low and relatively moderate effect sizes shared a number of instructional components. Overall, the magnitude of the results for experimental reading intervention studies for students with reading disabilities in the middle school age range was small to moderate. Implications of the study were discussed.     

Meta‐analysis and mega‐analysis: A simple introduction

Statistical methods are increasingly being used to integrate findings from the ever‐expanding universe of empirical research. Meta‐analysis encompasses various techniques for synthesizing summary statistics, and mega‐analysis pools raw data across studies. This paper offers an introduction to meta‐analysis and mega‐analysis that complements the study of analysis of variance (ANOVA). After a brief conceptual discussion, we provide simple numerical examples.     

A Meta‐Analysis of the Relationship Between Experiential Learning and Learning Outcomes

Experiential learning activities have been used for over 40 years with the hope that they increase students learning. However, a definitive study that showed their overall effectiveness has not been produced. The purpose of this study is to address this gap in the literature. This meta‐analysis examined a 43‐year span and identified 13,626 journal articles, dissertations, thesis articles, and conference proceedings written about experiential learning and found only 89 of these studies contained empirical data with both a treatment and control group. Meta‐analysis of these studies show that students experienced superior learning outcomes when experiential pedagogies were employed. Further, learning outcomes were almost a half standard deviation higher (d = .43) in classes employing experiential learning pedagogies versus traditional learning environments. This review definitively, and quantitatively, shows the importance of experiential learning activities. We use these results to discuss future research areas that need to be addressed based on our analysis of potential moderators and provide recommendations on how to best employ experiential learning pedagogies.     

Writing Characteristics of Students with Attention Deficit Hyperactive Disorder: A Meta‐Analysis

Students with Attention Deficit Hyperactivity Disorders (ADHD) frequently experience significant difficulty mastering basic academic skills. This meta‐analysis focuses on one specific potential area of learning difficulties for these students: namely, writing. To identify the extent and depth of the potential writing challenges faced by students with ADHD, we conducted a meta‐analysis comparing the writing performance of grade 1 to 12 students with ADHD to their normally achieving peers. We located 44 papers, yielding 45 studies with 87 effect sizes. The average weighted effect sizes showed that students with ADHD obtained lower scores than their normally achieving peers for writing quality (–0.78), output (–0.64), number of genre elements (–0.69), vocabulary (–0.76), spelling (–0.80), and handwriting (–0.62). Contrary to expectations, moderator analyses found that neither study quality nor the source from which ADHD students were drawn (i.e., school/community vs. clinic/hospital) accounted for variability above sampling error alone.     

Family Correlates of False Belief Understanding in Early Childhood: A Meta‐Analysis

This meta‐analysis seeks to integrate findings from 25 years of research on family correlates of young children's false belief understanding (FBU). Using data from 93 studies of 3‐ to 7‐year‐old children, we examined the correlations between FBU and four of the most widely studied family factors: parental socioeconomic status, number of siblings, parental mental‐state talk, and mind‐mindedness. FBU exhibited modest associations with each family variable and these associations held even when individual differences in verbal ability were taken into account. Moderator analyses revealed key child‐related factors (e.g., age, gender) as well as methodological factors that amplified or attenuated the relations between FBU and each family variable. Crucially, available longitudinal data highlight the importance of family factors in the development of FBU.