Empirical Performance of Covariates in Education Observational Studies

This article summarizes results from 12 empirical evaluations of observational methods in education contexts. We look at the performance of three common covariate-types in observational studies where the outcome is a standardized reading or math test. They are: pretest measures, local geographic matching, and rich covariate sets with a strong theory of treatment selection. Overall, the review demonstrates that although the pretest often reduces bias in observational studies, it does not always eliminate it. Its performance depends on the pretest's correlation with treatment selection and the outcome, and whether preintervention trends are present. We also find that although local comparisons are prioritized for matching, its performance depends on whether comparable no-treatment cases are available. Otherwise, local comparisons may produce badly biased results. In cases where researchers have a strong theory of selection and rich covariate sets, observational methods perform well, but additional replication studies are needed. Finally, observational methods that rely on demographic covariates without a theory of selection rarely produce unbiased treatment effects. The article concludes by offering education researchers empirically based guidance on covariate selection in observational studies.     

Integrating positive psychology into schools: Implications for practice

Traditional approaches for working with children and families in the schools focus on problems and disturbance. The concept of positive psychology as a way to change this focus is offered through exploration of its integration within school psychology. Specifically, the application of positive psychology can form the basis of preventive practices within the school setting. Examples of this application are provided within common roles of the school psychologist (consultation, direct work, educational assessment and planning). © 2004 Wiley Periodicals, Inc. Psychol Schs 41: 163–172, 2004.     

Assessing the psychosocial environment of science classes in Catholic secondary schools

Much Catholic school and church rhetoric suggests that Catholic schools possess distinctive learning environments. Research into this aspect of Catholic schooling has been hampered by the lack of an appropriate assessment instrument. By drawing on contemporary church literature, the perceptions of personnel involved in Catholic education and existing classroom environment questionnaires, a new instrument was developed to assess student perceptions of classroom psychosocial environment in Catholic schools. The use of this instrument in 64 classrooms in Catholic and Government schools indicated significant differences on some scales. The distinctive nature of Catholic schooling did not extend to all classroom environment dimensions deemed important to Catholic education. Specializations: Catholic education, learning environments. Specializations: conceptual change in students, science teacher professional development, scientific reasoning, learning environments. Specializations: learning environments, science education, educational evaluation, curriculum.     

Students’ perception of frequent assessments and its relation to motivation and grades in a statistics course: a pilot study

This pilot study measures university students’ perceptions of graded frequent assessments in an obligatory statistics course using a novel questionnaire. Relations between perceptions of frequent assessments, intrinsic motivation and grades were also investigated. A factor analysis of the questionnaire revealed four factors, which were labelled value, formative function, positive effects and negative effects. The results showed that most students valued graded frequent assessments as a study motivator. A modest number of students experienced positive or negative effects from assessments and grades received. Less than half of the students used the results of frequent assessments in their learning process. The perception of negative effects (lower self-confidence and more stress) negatively mediated the relation between grades and intrinsic motivation. It is argued that communication with students regarding the purpose and benefits of frequent assessments could mitigate these negative effects.     

Evaluating deaf students' readiness to meet the English language and literacy demands of postsecondary educational programs

The purpose of this study was to investigate alternative methods for evaluating deaf students' readiness to meet the English language and literacy demands of postsecondary educational programs. In the first part of the study, scores obtained by a large sample of deaf students on the ACT Assessment (ACT Composite score and scores on the ACT English and Reading tests) were compared to their scores on various measures of English language and literacy skills. In the second part of the study, the performance of a smaller sample of deaf students on the ESL Reading and ESL Grammar/Usage components of COMPASS/ESL was compared to their performance on a set of concurrent measures of English skills. The results of this investigation demonstrate that neither the ACT Assessment nor COMPASS/ESL are appropriate for the full range of deaf students seeking admission to postsecondary educational programs. However, the ACT Assessment is appropriate for deaf students seeking admission to transferable (BS and AAS) degree programs, and the ESL Reading and Grammar/Usage tests appear to be appropriate for deaf students seeking admission to nontransferable (AOS) degree programs. Taken together, the combination of the ACT Assessment and COMPASS/ESL appear able to provide a valid, reliable, and coherent approach to admissions screening assessment for the full range of deaf students seeking admission to postsecondary programs.     

Risk factors for infant maltreatment: a population-based study

CONTEXT: Of the approximately 900,000 children who were determined to be victims of abuse or neglect by US child protective services in 2002, the birth-to-3 age group had the highest rate of victimization (1.6%) and children younger than 1 accounted for the largest percentage of victims (9.6%). OBJECTIVE: To identify perinatal and sociodemographic risk factors associated with maltreatment of infants up to 1 year of age. DESIGN AND SETTING: Observational cohort study. PARTICIPANTS: 189,055 children born in 1996 in Florida. MAIN OUTCOME MEASURE: Infant maltreatment, defined as a verified report of abuse, neglect, or threatened harm that occurred between day 3 of life and 1 year. RESULTS: 1,602 children (.85%) of the 1996 birth cohort had verified instances of maltreatment by age 1. Of 15 perinatal and sociodemographic variables studied, 11 were found to be significantly related to infant maltreatment. Five factors had adjusted relative risks (RR) of two or greater: Mother smoked during pregnancy (RR 2.8); more than two siblings (RR 2.7); Medicaid beneficiary (RR 2.1); unmarried marital status (RR 2.0); low birth weight infant (RR 2.0). Infants who had four of these five risk factors had a maltreatment rate seven times higher than the population average. CONCLUSIONS: Data on nearly all risk factors found to be significantly associated with infant maltreatment are available on the birth certificate. Such information can be incorporated into a population-based risk-assessment tool that could identify subpopulations at highest risk for infant maltreatment. Because resources are limited, these groups should be given priority for enrollment in child abuse prevention programs.     

Instrumental escape learning in the rat at 24-hour intertriai interval: Effects of magnitude and schedule of reinforcement

Three experiments investigated the effects of magnitude and schedule of reinforcement and level of training in instrumental escape learning at a 24-h intertriai interval. In Experiment I, two magnitudes of reinforcement were factorially combined with two schedules of reinforcement (CRF and PRF). Under PRF, large reward produced greater resistance to extinction than did small reward, while the reverse was true under CRF. In Experiment II, two levels of acquisition training were factorially combined with three schedules of reinforcement (CRF, single-alternation, and nonalternated PRF). Patterned running was observed late in acquisition in the single-alternation extended-training condition. Resistance to extinction was greater for the nonalternated PRF condition than for the single-alternation condition following extended acquisition, and the reverse was true following limited acquisition. Experiment III confirmed the extinction findings of Experiment II. The results of all three experiments supported an analysis of escape learning at spaced trials in terms of Capaldi’s (1967) sequential theory.     

Personality as a Predictor of First‐Semester Adjustment to College: The Mediational Role of Perceived Social Support

Personality was hypothesized to predict college adjustment because of the role of perceived social support. A sample of 111 freshmen completed measures of personality, perceived social support, and college adjustment twice in their 1st semester. Perceived social support mediated the relationships between 3 personality factors (Emotional Stability, Social Boldness, and Abstractedness) and college adjustment, highlighting perceived social support as a point of intervention to improve 1st‐semester students' college adjustment.     

Dynamical Patterns in the Development of Clapping

The development of a complex rhythmical behavior—clapping—is modeled using a formal, explicit model of coupled oscillator dynamics. Even though this behavior manifests a good deal of nonstationarity and high variability within and across subjects, results indicate that these properties may be dynamically modeled quantitatively as well as qualitatively. Results suggest that clapping goes through a less stable period of relative coordination between 3 and 7 years before more stable absolute coordination is achieved. Nevertheless, in that the clapping behavior is affected in highly predictable ways by inertial loading of the limbs, the same underlying dynamic seems responsible for the coordination of both the younger and older children. Developmentally, the behavior of the coordination variable (relative phase) changes from a nonconstant magnitude in younger clappers to a constant magnitude in older clappers. These results suggest that development of proficiency in rhythmic motor skills displays developmental changes that can be understood well in dynamical terms.