Empirical Performance of Covariates in Education Observational Studies

This article summarizes results from 12 empirical evaluations of observational methods in education contexts. We look at the performance of three common covariate-types in observational studies where the outcome is a standardized reading or math test. They are: pretest measures, local geographic matching, and rich covariate sets with a strong theory of treatment selection. Overall, the review demonstrates that although the pretest often reduces bias in observational studies, it does not always eliminate it. Its performance depends on the pretest's correlation with treatment selection and the outcome, and whether preintervention trends are present. We also find that although local comparisons are prioritized for matching, its performance depends on whether comparable no-treatment cases are available. Otherwise, local comparisons may produce badly biased results. In cases where researchers have a strong theory of selection and rich covariate sets, observational methods perform well, but additional replication studies are needed. Finally, observational methods that rely on demographic covariates without a theory of selection rarely produce unbiased treatment effects. The article concludes by offering education researchers empirically based guidance on covariate selection in observational studies.     

Liberal studies and critical pedagogy in further education colleges: ‘where their eyes would be opened’ (sometimes)

This paper revisits the liberal studies movement, a significant feature of the English further education (FE) sector from the 1950s until the beginning of the 1980s. Its central argument is that liberal and general studies (LS/GS) and similar provision offered a vehicle where, at least in some circumstances, certain politically-motivated FE teachers were able to engage in forms of mutual, dialogic teaching and learning which can be conceptualised as critical pedagogy—or at least as close to critical pedagogy as can be achieved within the formal education system in a nation such as England. The paper draws on interviews with former FE lecturers who taught various forms of liberal studies to vocational students in FE colleges across England during the 1960s, 1970s, and 1980s. Whilst it is recognised that LS/GS was always contested terrain, data presented in this paper provide evidence to suggest that the spirit of critical pedagogy existed amongst a certain strand within the liberal studies movement, at least for a time—even if not all learners wished to be emancipated by their studies.     

Changing thoughts,changing practice: examining the delivery of a group CBT-based intervention in a school setting

Promoting mental health and well-being for children and young people in the UK has attracted increasing prominence in recent years and has been a focus for government strategy within health and education. Training and practice in educational psychology has increasingly focused on developing skills and expertise to provide therapeutic support within school contexts, at an early stage of need. One approach, Cognitive Behaviour Therapy (CBT), has been heralded as an effective, evidence-based intervention for anxiety. This research examines the factors influencing the outcomes of a group CBT-based intervention, run by an Educational Psychologist (EP), in a school setting. The findings suggest that influential variables included pupil identification, measures of change applied and the role of school staff. It is concluded that EPs can play a key role in increasing access to psychological therapies, alongside considering due caution in relation to the application of traditional clinical approaches in school contexts.     

Single‐sex classes in co‐educational schools

This research investigated social and academic outcomes from single‐sex classrooms in a Tasmanian coeducational government primary school. Interviews, observations and surveys formed the basis of the evidence. Teachers, parents and children reported positive benefits from the class organisation, but these differed according to gender. Staff identified increased confidence and higher self‐esteem among girls, whereas boys developed increased motivation and more commitment to schoolwork. Teachers and parents noted that boys’ accountability and self‐discipline improved. Teachers adopted different strategies from those used with mixed‐gender classes and gained higher levels of satisfaction from teaching, attributable to increased children’s time ‘on task’. Paradoxically, standardised school testing indicated no increase in academic achievements. However, there may be an extended lag between establishing changed social relationships and measurable academic outcomes, suggesting that if the new class structure is to achieve its full potential, it should be established early in primary school and continue to adolescence.     

Implementing Example-Based Learning and Teaching in the Context of Vocational School Education in Business Administration

Starting from problems of knowledge application in the context of vocational school training in business administration, an instructional approach based on worked-out examples was developed. The effectiveness of additional instructional measures (e.g. an elaboration training) was investigated experimentally. Together with teachers, the approach was adapted to conditions of regular book-keeping lessons at vocational school; then it was implemented and evaluated in practice. The positive results of the first evaluation study in which applicable knowledge was fostered were replicated in additional evaluation studies in which some aspects of the approach were optimised. The main results of the evaluation studies underline the effectiveness of example-based learning and teaching. Furthermore they show that this approach can be transferred successfully to vocational school lessons. In the general discussion, recommendations for further improving and successfully implementing example-based lessons are given. This revised version was published online in July 2006 with corrections to the Cover Date.     

Temperament, Emotion, and Cognition at Fourteen Months: The MacArthur Longitudinal Twin Study

200 pairs of twins were assessed at 14 months of age in the laboratory and home. Measures were obtained of temperament, emotion, and cognition/language. Comparisons between identical and fraternal twin correlations suggest that individual differences are due in part to heritable influences. For temperament, genetic influence was significant for behavioral observations of inhibition to the unfamiliar, tester ratings of activity, and parental ratings of temperament. For emotion, significant genetic influence was found for empathy and parental ratings of negative emotion. The estimate of heritability for parental report of expression of negative emotions was relatively high, whereas that for expression of positive emotions was low, a finding consistent with previous research. For cognition and language, genetic influence was significant for behavioral indices of spatial memory, categorization, and word comprehension. Shared rearing environment appears influential for parental reports of language and for positive emotions, but not for other measures of emotion or for temperament.