Measurement of quality in child care centers

Assessment of quality of care in 363 classrooms with infants, toddlers, and preschool children was conducted in 120 child care centers in three states with widely varying regulations. Three major process measures, InfantToddler Environment Rating Scale (ITERS; Harms, Cryer & Clifford, 1987), Early Childhood Environment Rating Scale (ECERS; Harms & Clifford, 1980), and the Assessment Profile for Early Childhood Programs (Abbott-Shim & Sibley, 1987) were included. Regulatable aspects of quality of child care included ratio of caregivers to children, group size, teacher training in child development or child care, teacher education, highest wage paid to a teacher in the center, and staff turnover. The goal of the study was to evaluate how well the quality of child care is measured by process and regulatable variables. For research purposes, the process measures proved to be highly redundant, both internally and with each other. Much smaller sets of items, drawn randomly from the instruments' item pools, were found to be perfectly acceptable measures of quality of care. Regulatable measures did not prove to be acceptable measures of quality care, except for teachers' wages, which were highly correlated with process measures of quality.     

Child Care Quality and Children's Engagement

The goal of this study was to understand the relationship between child care quality and children's engagement behavior. Seventy-eight toddlers from 17 child care centers were individually observed to determine the percentage of time they spent in sophisticated, unsophisticated, or differentiated engagement, or focused attention. The percentage of group engagement in classroom activities was recorded as well. Program quality ratings consisted of measures of the classroom environments, including the teachers. All the contextual quality measures but 1 were associated with unsophisticated engagement. Only global classroom quality was related to sophisticated engagement. The percentage of toddlers engaged in activities was associated with other program quality measures but not with observations of individual child engagement conducted at different times.     

New evidence on the validity of the Arnett Caregiver Interaction Scale: Results from the Early Childhood Longitudinal Study-Birth Cohort

The Arnett Caregiver Interaction Scale (CIS) has been widely used in research studies to measure the quality of caregiver–child interactions. The scale was modeled on a well-established theory of parenting, but there are few psychometric studies of its validity. We applied factor analyses and item response theory methods to assess the psychometric properties of the Arnett CIS in a national sample of toddlers in home-based care and preschoolers in center-based care from the Early Childhood Longitudinal Study-Birth Cohort. We found that a bifactor structure (one common factor and a second set of specific factors) best fits the data. In the Arnett CIS, the bifactor model distinguishes a common substantive dimension from two methodological dimensions (for positively and negatively oriented items). Despite the good fit of this model, the items are skewed (most teachers/caregivers display positive interactions with children) and, as a result, the Arnett CIS is not well suited to distinguish between caregivers who are “highly” versus “moderately” positive in their interactions with children, according to the items on the scale. Regression-adjusted associations between the Arnett CIS and child outcomes are small, especially for preschoolers in centers. We encourage future scale development work on measures of child care quality by early childhood scholars.     

Evaluating the Early Childhood Environment Rating Scale (ECERS): Assessing differences between the first and revised edition

Before 1998, most large-scale studies of center-based child care programs measured quality using the 1980 version of the Early Childhood Environment Rating Scale (ECERS). To know whether data from studies conducted after 1998 using the revised ECERS-R can be fairly compared to data from studies using the 1980 ECERS, simultaneous assessments using both measures in a sample of 68 classrooms were conducted. The results suggest that the original ECERS and ECERS-R can be viewed, as their authors intended, as comparable measures of quality. Scores were highly correlated and similarly distributed. Principal components analysis resulted in two factors for both measures. Both measures fall short in addressing staff stability and key components of culturally sensitive practice, such as communicating with families in their home language.     

Effects of a community initiative on the quality of child care

This study examined the effects of a broad-based community initiative (Smart Start) to improve the quality of child care for preschoolers. Data were collected in 1994 and 1996 from over 180 child care centers in 12 counties implementing the community initiative. The quality of child care, as measured by the Early Childhood Environment Rating Scale (ECERS; Harms & Clifford, 1980), was significantly higher in 1996 than 1994, both across the entire sample and across the subset of 91 centers observed in both years. The quality of child care in 1996 was significantly related to the number of local quality improvement activities in which the child care centers participated. This and additional evidence presented in the paper show that a comprehensive community initiative can improve child care quality if significant funds and activities are focused on the issue.     

Assessing quality characteristics of center-based early childhood environments in Germany and Portugal: A cross-national study

Based on the knowledge that direct assessment of the quality of early childhood educational environments is becoming more and more important, this article deals with a coordinated adaptation of the Early Childhood Environment Rating Scale (ECERS) in Germany and Portugal. The ECERS, developed by Harms and Clifford (1980), is a complex rating scale, comprising 37 items, which is implemented to assess major quality characteristics of early childhood classrooms and has been used quite extensively in the US as well as in other countries. In this article we describe how the scale was adapted and we report selected results of a jointly coordinated comparative study on a sample of 103 early childhood classrooms in Germany and 88 in Portugal. The classrooms were classified according to three different types in each country. In particular, we report the item characteristics of the adapted versions, reliabilities and intercorrelations of the total scale and the apriori-subscales, and results of factor analyses. A one-way ANOVA indicates group differences between the six types of classrooms which can be meaningfully interpreted.     

Toddlers' and Preschoolers' Experience in Family Day Care: Age Differences and Behavioral Correlates

One hundred and twelve children, 56 toddlers and 56 preschoolers, were observed in their family child care settings to determine whether toddlers cared for in settings that also included preschoolers were, relative to the preschoolers, receiving more or less high-quality care and/or whether their functioning at child care appeared to be more or less dependent on aspects of the care providers’ interactions with the children. Quality of care was analyzed along two dimensions: sensitive/supportive care and structured care. Four indices of child functioning at child care were examined: integration in social activities, attention, positive mood, and angry/aggressive behavior. Results indicate that toddlers received less sensitive, supportive care than preschoolers in these mixed-age settings and toddlers were less socially integrated and less engaged in activities in the child care setting. Preschoolers displayed increased levels of angry/aggressive behavior relative to toddlers. In addition, associations of care provider behaviors and child functioning were larger for toddlers than preschoolers, suggesting that toddlers were more dependent on caregiver support for more successful functioning in these family child care settings. For both toddlers and preschoolers, care provider behavior and child functioning was generally poorer in settings with more children.     

Quality of Australian childcare and children's social skills

This study investigated the relationships and interactions between childcare quality (Early Childhood Environmental Rating Scale – Revised edition [ECERS‐R]/Early Childhood Environmental Rating Scale – Extension [ECERS‐E]) and children's social skills (SSRS) in different sociodemographic areas within one Australian city. Multiple regression analysis revealed that some subscales of ECERS‐R and ECERS‐E (language–reasoning, programme structure, space and furnishings, parents and staff, literacy, mathematics, science and environment) predicted the level of children's social skills and the frequency of problem behaviour, with positive and negative effects. Interestingly, although total scores for ECERS‐R and ECERS‐E were not significant predictors of social skills scores, interaction between total ECERS‐R and ECERS‐E scores was a significant predictor. With some qualifications the study provides evidence that both the childcare centre's neighbourhood and the quality of childcare provision are related to children's social skills. The interaction between social/emotional and academic aspects of quality suggests that we need to consider synergistic dimensions in quality in order to optimally enhance social skills in children.     

An analysis of Irish pre-school practice and pedagogy using the early childhood environmental four curricular subscales

This paper presents the findings of original research which applied the Early Childhood Environmental Rating Scale Extension (ECERS/E) four Curricular Subscales in 26 pre-schools throughout Ireland to measure and assess the provision of literacy, maths, science and environment, and diversity as follows: inadequate, minimal, good or excellent. The rating instrument was chosen as it relates closely to the Relational Pedagogical (RP) approach in the Irish curriculum Aistear; the Early Childhood Curriculum Framework. The approach uses four interconnected themes well-being, identity and belonging, communicating and exploring and thinking. The results are analysed using quantitative ECERS/E findings and offer evidence-based empirical results on pre-school quality using international standards of best practice. The study reveals a minimal standard in the provision of literacy and maths. Provision in science and environment and diversity are inadequate. The findings have implications concerning the capacity of pre-school services to implement quality and curriculum frameworks Síolta and Aistear and question the appropriateness of the current pre-school inspection systems in improving standards.     

The Parent–Caregiver Relationship Scale: Rounding Out the Relationship System in Infant Child Care

The Parent–Caregiver Relationship Scale (PCRS) was developed and field tested as a measure of the perceived quality of the relationship between the parent and the child care provider ("caregiver") of an infant or toddler. PCRS items were based on review of the parent–caregiver relations literature and interviews with parents and caregivers. The parent and caregiver forms of the scale were administered to 217 parents and caregivers in child care centers and family child care homes. Analysis of the scale and its psychometric properties resulted in potentially useful subscales with adequate reliability. The PCRS showed predicted correlations with other child care context variables, providing preliminary support for its validity. The PCRS shows promise as a relationship-level measure for studies of infants, parents, and caregivers in the context of full-time child care.     

Correlates of affectionate and angry behavior in child care educators of preschool-aged children

The present study marks the first empirical exploration designed to investigate factors related specifically to child care educators’ levels of affection and anger. Based on the presumption that their affectionate and angry behaviors would have major implications for the development of the children for whom they care, the aim of the present investigation is to provide the groundwork for identifying what factors are associated with educator warmth and anger in child care settings.Several categories of variables were used to predict affectionate and angry caregiver behavior. These included educator characteristics, such as training and experience, personal resources such as well-being, self-esteem and social support, the work environment as measured by regulatable characteristics, wages and global quality, and the caregiver’s perceptions and opinions about her work. A multi-method, multi-respondent approach was employed, including researcher observations, educator self-report questionnaires, and objective data collected from directors and from Québec’s official licensing agency.The findings from this study suggest that different sets of variables are related to affection and anger. The work environment had a greater relation with caregivers’ affectionate behavior, whereas more internal, negative perceptions were linked to the expression of anger in the classroom. Though educator training did not predict anger or affection, training did in fact become very important to the quality of the interactions the educators had with the children when other risk factors were present.     

Comparisons of observed process quality in early child care and education programs in five countries

In this cross-national study, observed process quality in preschool classrooms was compared across five countries—Austria (n = 37), Germany (n=103), Portugal (n=88), Spain (n=80), and the U.S.A. (n=390). Process quality was assessed using the Early Childhood Environment Rating Scale (ECERS) and the Caregiver Interaction Scale (CIS). Both instruments had comparable properties when used in the different countries. A MANOVA found overall ECERS differences between countries, with Austria and Germany scoring higher than Spain, and Austria higher than the U.S.A. CIS Sensitivity scale differences showed Austria and Spain with higher scores than the U.S.A. Tests of homogeneity of variance showed U.S.A. with the highest standard deviations. A discriminant analysis, using countries as groups and ECERS items as criterion variables, revealed differences between countries on two discriminant functions: Personalized Care and Availability and Use of Space and Play Materials. Results are discussed in terms of the early childhood traditions and infrastructures found in the five countries.     

Using quality rating scales for professional development: experiences from the UK

The ECERS‐R and ITERS‐R are among two of the most widely used observational measures for describing the characteristics of early childhood education and care. This paper describes a professional development programme currently taking place in seven regions across England, designed to train local government staff in the application of the scales as tools for improving practice. While the scales offer a transparent and measurable means of assessing and improving quality, a number of differences between criteria presented by the scales and by national regulations, curricular guidelines and notions of quality have been identified.     

Relation of Rearing Environment to Adaptive Behavior of Egyptian Toddlers

2 questions were explored: (1) Do observed relations found in Western cultures between specific psychosocial environmental factors and toddlers adaptive behavior resemble the pattern of relations found in a non-Western setting? (2) Does the specificity of relations between environment and performance found in Western cultures also operate in a non-Western culture? Subjects were 153 Egyptian toddlers, 18–30 months of age, and their caregivers. Twice a month between 18 and 30 months toddlers were observed in naturalistic interactions with their caregivers, and measures of caregiver behavior and toddler functioning were coded. Replicating previous results from Western cultures, canonical analysis indicated that caregiver vocal stimulation was positively related to indices of toddler behavioral competence, while nonverbal response to vocalization and physical contact stimulation were negatively related. The salience of sib caregivers was also noted. Particularly for the age period between 24 and 29 months, results indicated specificity of environmental action such that measures of caregiver vocal stimulation were uniquely related to measures of toddler vocalization, while caregiver response to distress was uniquely related to toddler emotionality. The present pattern of results suggests at least some degree of cross-cultural generalizability of environment-development relations and of the specificity model of environmental action.     

Parents’ perceptions of their children’s child care: a cross-national comparison

This study compares how parents in Germany and the USA perceive the quality of ECE services their preschoolers receive in the two different cultures and ECE systems existing in the countries. The sample included 2,407 parents in the USA and 392 in Germany. Classroom quality was assessed by trained observers using the USA and German versions of the Early Childhood Environment Rating Scale (ECERS). Parents’ perceptions of ECE programs were measured with a parent questionnaire (ECERSPQ), which is an adaptation of the ECERS. Findings show that in both countries, parents indicate high importance for the aspects of quality required in the ECERS/ECERSPQ, that parents assign substantially higher quality scores to their children’s classrooms than do trained observers, and parent quality assessments are influenced by the relative importance they attribute to aspects of quality. Findings are discussed in terms of assisting parents to become more discriminating in their child care choices.     

Defining Quality Child Care: Multiple Stakeholder Perspectives

Multiple perspectives regarding the definition of quality child care, and how child care quality can be improved, were examined using a focus group methodology. Participants were representatives from stakeholder groups in the child care profession, including child care center owners and directors (3 groups), parents (3 groups), child caregivers (3 groups), policy makers (1 group), and social service providers (1 group). Qualitative analysis revealed 6 components of quality that were consistently discussed across all participant groups: (a) communication and rapport, (b) caregiver practices, (c) staff characteristics, (d) finances and resources, (e) visibility and involvement, and (f) professionalism. Analyses highlighted differences among stakeholder groups and the complex interplay among quality components. Findings are compared to previously documented perspectives on child care quality, and a conceptual model is presented that (a) summarizes findings about how proximity to child impacts definitions of quality and (b) highlights the central role played by child care center directors. Implications for child care practice and policy are discussed.     

Defining Quality Child Care: Multiple Stakeholder Perspectives

Multiple perspectives regarding the definition of quality child care, and how child care quality can be improved, were examined using a focus group methodology. Participants were representatives from stakeholder groups in the child care profession, including child care center owners and directors (3 groups), parents (3 groups), child caregivers (3 groups), policy makers (1 group), and social service providers (1 group). Qualitative analysis revealed 6 components of quality that were consistently discussed across all participant groups: (a) communication and rapport, (b) caregiver practices, (c) staff characteristics, (d) finances and resources, (e) visibility and involvement, and (f) professionalism. Analyses highlighted differences among stakeholder groups and the complex interplay among quality components. Findings are compared to previously documented perspectives on child care quality, and a conceptual model is presented that (a) summarizes findings about how proximity to child impacts definitions of quality and (b) highlights the central role played by child care center directors. Implications for child care practice and policy are discussed.     

Experiences in day care and social competence among maltreated children

The experience of 39 preschool-age maltreated children from 13 child care facilities was examined to determine the extent to which the children's social development was related to the quality of day-care service. Maltreated children assigned by the Arkansas Department of Social Services to three different types of child care facilities were observed: specialized day-care programs, regular day-care centers and family day homes. The children scored below average in intelligence and were rated by their parents as displaying higher than normal rates of disturbed behavior. While no comparison group of non-maltreated children was included in the study, observations of the maltreated children in the child care setting revealed substantially more positive than negative social behavior. The children were reasonably effective in interacting with adult caregivers in day care. The maltreated children were also productive in most encounters with peers. Ratings of the quality of care received in day care were significantly correlated with the children's social competence in child care. Aspects of social behavior in maltreated children were related to the organization of the program, the physical facilities, traits of the caregiver, and caregiver expectations for the children.