A meta-analysis on the relationship between school characteristics and student outcomes in science and maths – evidence from large-scale studies

ABSTRACT

In the present meta-analysis, we examine how secondary school characteristics – such as schools’ academic press, school climate, material resources, personnel resources, classroom climate, instructional practices, out-of-school activities, and socioeconomic status (SES) composition – provide opportunities for students to engage in science and maths, and how these matter with regard to students’ cognitive and motivational-affective outcomes. The meta-analysis includes 71 (international) articles from large-scale studies with a total of 3,960,281 students, 260,390 schools, and 285 effect sizes that were transformed to correlation coefficients. Multilevel meta-analyses were performed. Results identified a number of school variables that can be regarded as relevant for making a difference in student outcomes and at the same time be influenced by education. These refer to school variables such schools’ academic press, classroom climate, instructional practices, and out-of-school activities. Moreover, SES composition was significantly related to student outcomes. Material and personnel resources as well as school climate yielded a close to zero effect. No differences were found between cognitive and motivational-affective outcome variables or between science and maths. The results point to the most promising school characteristics for promoting students’ outcomes and emphasise schools’ potential for students’ engagement in science and maths.     

How valid are scholars' departmental rating models for assessing the quality of graduate programs?

The validity of the scholars' departmental rating (SDR) model for determining the quality of an institution's graduate program has been the subject of intense controversy for over a half-century. This study, using the aggregated data from each of four classical rankings of graduate programs in United States universities, found that the rankings of institutions in separate studies correlate significantly with each other and that the results from the SDR model correlate significantly with the objective measures of academic honors, basic research, and research and development awards. The author concludes that the SDR model is valid for the purposes intended.     

Child peer sexual abuse: preliminary data on outcomes and disclosure experiences

OBJECTIVE: This study compared experiences of children sexually abused by peers to those of children abused by adolescents/adults. Variables examined included perceived negativity of the abuse, self-reported outcomes, overall psychological functioning, and disclosure. METHOD: An archival data set containing retrospective reports of childhood sexual experiences was culled for instances of sexual abuse by child peers and adolescents/adults. An equivalent nonabused comparison group was identified. The Self-Report Outcome Checklist (SROC; Gilbert, 1994b), the MMPI-Hugo Short Form (Hugo, 1971) and a disclosure survey were also retrieved from these data. RESULTS: Compared to abuse by peers, abuse perpetrated by adolescents/adults was more intrusive and intrafamilial. Both groups rated their experiences as equally negative, and reported equally pervasive outcomes. Those abused by adolescents/adults reported significantly higher scores on the Psychopathic Deviate, Psychasthenia, and Schizophrenia scales compared to nonabused controls; similar findings did not emerge for those abused by child peers. Less than a fourth in either abuse group reported disclosing their experience to a parent. Among those who did not disclose, participants abused by child peers anticipated less support from both parents and more anger from their mothers. CONCLUSIONS: The findings suggest that child peer sexual abuse may be associated with adverse outcomes.     

Change in Fluid and Crystallized Intelligence and Student Achievement: The Role of Intellectual Engagement

Intellectual engagement (IE) refers to enjoyment of intellectual activities and is proposed as causal for knowledge acquisition. The role of IE for cognitive development was examined utilizing 2‐year longitudinal data from 112 ninth graders (average baseline age: 14.7 years). Higher baseline IE predicted higher baseline crystallized ability but not changes therein, and was not associated with fluid ability. Furthermore, IE predicted change in school grades in language but not in mathematics grades or in standardized tests. These findings suggest that IE is not a major predictor of knowledge acquisition in adolescence, where degree of self‐determination in intellectual behaviors may be relatively limited. Open questions for future research are addressed, including reciprocal longitudinal associations between IE and academic and cognitive development.     

Übereinstimmung,Variabilität und Reliabilität von Schülerurteilen zur Unterrichtsqualität auf Schulebene

Using student ratings to assess instructional quality of schools should fulfill three requirements: (1) an appropriate level of inter-rater agreement within schools, (2) systematic variance of student ratings between schools, (3) an adequate reliability level of aggregated student ratings. Using international PISA-data (2000–2012; 81 countries, over 55,300 schools, over 1.3 million 15-year olds) this study investigated how these requirements were met regarding indicators of instructional quality (classroom management, cognitive activation, individual learning support). We computed the interrater agreement index r_WG(J), as well as the intraclass correlations ICC(1) and ICC(2). Our results showed that (1) student ratings demonstrated a moderate or strong level of agreement for most indicators of instructional quality and (2) instructional quality assessed by students varied systematically between schools. Yet, (3) reliability of aggregated student ratings was not sufficient in many countries. We discuss these results regarding conventions to evaluate agreement, variability, and reliability of student ratings at the school level.     

Mental health services in schools: A qualitative analysis of challenges to implementation,operation, and sustainability

Schools are increasingly recognized as a critical venue for the provision of comprehensive behavioral and mental health services for students. Unfortunately, difficulties associated with operating programs in schools often prevent evidence‐based practices from being implemented and sustained as intended. In this study, the experiences of school and community providers who were funded through the Safe Schools/Healthy Students Initiative to implement mental health services in a large, urban school district were investigated using a qualitative focus group methodology. Providers identified the major challenges they encountered with implementing, operating, and sustaining their programs as well as the strategies that they used to overcome those challenges. Strategies to enhance support of school‐based mental health programs are discussed. © 2005 Wiley Periodicals, Inc. Psychol Schs 42: 361–372, 2005.     

Individual performance across motoric self-regulation tasks are not correlated for pet dogs

Inhibitory control, the ability to restrain a prepotent but ineffective response in a given context, is thought to be indicative of a species’ cognitive abilities. This ability ranges from “basic” motoric self-regulation to more complex abilities such as self-control. During the current study, we investigated the motoric self-regulatory abilities of 30 pet dogs using four well-established cognitive tasks – the A-not-B Bucket task, the Cylinder task, the Detour task, and the A-not-B Barrier task – administered in a consistent context. One main goal of the study was to determine whether the individual-level performance would correlate across tasks, supporting that these tasks measure similar components of motoric self-regulation. Dogs in our study were quite successful during tasks requiring them to detour around transparent barriers (i.e., the Cylinder and Detour tasks), but were less successful with tasks requiring the production of a new response (i.e., A-not-B Bucket and A-not-B Barrier tasks). However, individual dog performance did not correlate across tasks, suggesting these well-established tasks likely measure different inhibitory control abilities, or are strongly influenced by differential task demands. Our results also suggest other aspects such as perseveration or properties of the apparatus may need to be carefully examined in order to better understand canine motoric self-regulation or inhibitory control more generally.     

A Quasi-Experiment Examining Expressive and Receptive Vocabulary Knowledge of Preschool Head Start Children Using Mobile Media Apps

This study examined the efficacy of using different types of mobile media apps to increase the receptive and expressive vocabulary development of 3-, 4-, and 5-year-old preschool children living in economically disadvantaged communities. Children and teachers in four Head Start classrooms participated in the quasi-experimental study, which included an 8-week intervention in which the children interacted with one of two types of apps: one classroom used four scaffolding-like vocabulary apps for an average of 1.8 h per day (n?=?16) and one classroom used four open-ended vocabulary apps for an average of 1.3 h per day (n?=?15). Two classrooms served as comparison groups (n?=?18; n?=?14) which used apps that were chosen by the Head Start program with no specific instructional method for approximately 1 h per day. Children’s vocabulary was assessed pre- and post-intervention using the PPVT-4, the EVT-2, and iPad Receptive and Expressive Vocabulary Assessments. Using a repeated measures analysis of variance with split plot analysis, children who used scaffolding-like vocabulary apps performed statistically significantly higher on the PPVT-4 than children who used open-ended vocabulary apps. There were no significant differences between groups on the EVT-2. The study contributed to the literature on teacher instruction of utilizing scaffolding-like apps to increase preschool vocabulary knowledge.