Examining the Rule of Thumb of Not Using Multilevel Modeling: The “Design Effect Smaller Than Two” Rule

Educational researchers commonly use the rule of thumb of “design effect smaller than 2” as the justification of not accounting for the multilevel or clustered structure in their data. The rule, however, has not yet been systematically studied in previous research. In the present study, we generated data from three different models (which differ in the location of the clustering effect). With a 3 (design effect) × 5 (cluster size) × 4 (number of clusters) Monte Carlo simulation study we found that the rule should not be applied when researchers: (a) are interested in the effects of higher-level predictors, or (b) have a cluster size less than 10. Implications of the findings and limitations of the study are discussed.     

What do families of the ‘professional and managerial’ class educate their children for? The links between happiness and autonomy

Based on a qualitative study involving 124 professional and managerial class families in Catalonia (Spain), this paper describes the aims and objectives these families have for the education of their children. During the fieldwork, when asked what they were aiming for in the education of their children, almost all of the parents replied ‘for them to be happy’. But what kind of happiness are they talking about? What kind of education might lead to happiness? Drawing principally on the work of Kellerhals and Montandon and their ‘contractual model of education’ and Bauman’s concepts of ‘secondary security’ and ‘homo eligens’, although also taking into account the related contributions of Lareau, Vincent and Ball, Stefansen and Aarseth, and Kusserow, the paper aims to demonstrate the strong connection these families make between happiness and ‘absolute’ autonomy, understood as two sides of the same coin and seen, by the participants, as the guiding principle that should shape the way they bring their children up.     

Images as representations: visual sources on education and childhood in the past

The challenge of using images for the history of education and childhood will be addressed in this article by looking at them as representations. Central is the relationship between representations and reality. The focus is on the power of paintings as representations of aspects of realities. First the meaning of representation for images as sources for the history of education and childhood – mirrors of realities, complex symbol systems or representations – is explained. A distinction is made between images of real people and images of patterns of human behaviour and the value of the phenomenon of historical sensation as a methodological instrument for insight in that relationship is dealt with. Second, a specific genre of paintings from the seventeenth century, namely portraits of dead children, will be described and analysed to make clear that their value for the history of education and childhood can be studied adequately only by using those images as representations and by interpreting them within the cultural rules and regulations of time and place. This analysis results in the conclusion that images should be considered in their function as representations of aspects of educational and childhood reality.     

Longitudinal assessment of progress in reasoning capacity and relation with self-estimation of knowledge base

The aim of the study was to investigate progress in reasoning capacity and knowledge base appraisal in a longitudinal analysis of data from summative evaluation throughout a medical problem-based learning curriculum. The scores in multidisciplinary discussion of a clinical case and multiple choice questionnaires (MCQs) were studied longitudinally for 213 students from years 2 to 5. The capacity of core knowledge delimitation was calculated as the difference between the levels of average ascertainment degrees given for correct and incorrect answers at MCQ. For both multidisciplinary discussion of a clinical case evaluation and self-estimation of core knowledge, the capacity increases throughout the curriculum. The reasoning capacity assessed through multidisciplinary discussion of a clinical case is positively correlated with MCQ scores and the capacity to discriminate the mastered core knowledge. In conclusion, this study indicates that self-estimation of core knowledge is associated with an increase in reasoning performance through a well-organised knowledge base. Since that ability is related to success or failure, it is suggested that student awareness about delimitation of mastered core knowledge is considered as part of learning.     

Comparing effects and side effects of different school inspection systems across Europe

In this article, different inspection models are compared in terms of their impact on school improvement and the mechanisms each of these models generates to have such an impact. Our theoretical framework was drawn from the programme theories of six countries’ school inspection systems (i.e. the Netherlands, England, Sweden, Ireland, the province of Styria in Austria and the Czech Republic). We describe how inspection models differ in the scheduling and frequency of visits (using a differentiated or cyclical approach), the evaluation of process and/or output standards, and the consequences of visits, and how these models lead to school improvement through the setting of expectations, the use of performance feedback and actions of the school's stakeholders. These assumptions were tested by means of a survey of principals in primary and secondary schools in these countries (n?=?2239). The data analysis followed a three-step approach: (1) confirmatory factor analyses, (2) path modelling and (3) fitting of multiple-indicator multiple-cause models. The results indicate that Inspectorates of Education that use a differentiated model (in addition to regular visits), in which they evaluate both educational practices and outcomes of schools and publicly report inspection findings of individual schools, are the most effective. These changes seem to be mediated by improvements in the schools’ self-evaluations and the schools' stakeholders’ awareness of the findings in the public inspection reports. However, differentiated inspections also lead to unintended consequences as principals report on narrowing the curriculum and on discouraging teachers from experimenting with new teaching methods.