The effect of instructional quality on low‐ and high‐performing students

The study assessed the effects of the quality of reading and math instruction and classroom climate on the academic skills and engagement of 314 children in 245 classrooms at the end of third grade. All of the children in the study were from families with low incomes. On a classroom observation measure developed for the study, regression analyses revealed that relatively high ratings on the reading and math instruction subscales, which were scored after a half‐day observation, predicted better reading and math achievement test scores, respectively, for third graders who had previously had poor academic performance, but did not have a significant effect for relatively high‐performing students. High teacher ratings on the reading instruction and classroom climate observation scales predicted high levels of student engagement. The findings suggest the importance of high‐quality teaching for economically disadvantaged children who have poor academic skills.     

The utility of kindergarten teacher ratings for predicting low academic achievement in first grade

The purpose of this study was to assess the predictive value of kindergarten teachers' ratings of pupils for later first-grade academic achievement. Kindergarten students were rated by their teachers on a variety of variables, including math and reading performance, teacher concerns, and amount of learning relative to peers. These variables were then analyzed with respect to outcome measures for math and reading ability administered in the first grade. The teachers' ratings of academic performance were significantly correlated with scores on the outcome measures. Analyses were also carried out to determine sensitivity, specificity, and predictive values of the different teacher ratings. The results indicated high overall accuracy, sensitivity, specificity, and negative predictive value for the ratings. Positive predictive value tended to be lower. A recommendation to follow from these results is that teacher ratings of this sort be used to determine which children should receive cognitive screening measures to further enhance identification of children at risk for learning disability. However, this recommendation is limited by the lack of empirically supported screening measures for math disability versus well-supported screening tools for reading disability.     

Measures of Children's Knowledge and Regulation of Cognition

Two studies were conducted to investigate measures of children's metacognition. Experiment 1 presented two versions of a self-report inventory, the Jr. MAI, appropriate for assessing metacognition in children in grades 3–9. Factor analyses are interpreted that illustrate how the items measure components of metacognition. Experiment 2 further addressed properties of the two versions and compared the instrument to other inventories, teacher ratings of children's metacognition, and student achievement scores. Findings indicated high correlations between the Jr. MAI and an existing metacognitive problem-solving inventory (Fortunato, Hecht, Tittle, & Alvarez, 1991). Moderate correlations between the Jr. MAI and other self-report instruments of metacognition while reading (Jacobs & Paris, 1987; Schmitt, 1990) and low correlations between the Jr. MAI and teacher ratings of metacognition and overall achievement scores were also found. Gender and grade level differences in metacognition are presented and discussed. The instruments are appended.     

Turkish prospective early childhood teachers’ emotional intelligence level and its relationship to their parents’ parenting styles

The current study explored Turkish prospective early childhood teachers’ emotional intelligence scores in order to determine whether levels indicated differentiations according to grade level, and parenting style. Participants responded to the Turkish version of the Parenting Style Inventory and Emotional Intelligence Scale (EIS). EIS also contains the Perception of Own Emotions (POE), Understanding Others’ Emotions (UOE) and Regulating Emotions (RE) subscales. Study findings revealed that participants had moderate scores on the POE, UOE, and RE subscales and for whole emotional intelligence. Significant differences in total emotional intelligence and some subscales were found among grade levels and parenting styles. However findings showed that prospective teachers’ EI level did not increase as their professional education level increases. Also, prospective teachers with neglecting parents obtained the lowest mean scores from the total scale and every subscale for EIS. The study concluded that teacher education programs should support emotional development too.     

Teachers’ Ability to Identify Children at Early Risk for Reading Difficulties in Grade 1

The aim of the study was to investigate what kinds of assessment practices classroom teachers and special educational needs (SEN) teachers use in assessing first grade students' pre-reading skills (letter knowledge and phonological skills). Further, we investigated to what extent teachers were able to identify difficulties in pre-reading skills of the children with the lowest achievement scores. The accuracy of teacher ratings of students' pre-reading skills was studied by comparing teacher ratings to actual test scores. The data from two Finnish longitudinal studies were used: JLD sample (class teachers, n = 91; SEN teachers, n = 51; 200 students) and First Steps sample (class teachers, n = 136; SEN teachers, n = 34; 598 students). Results showed first, that most classroom teachers used qualitative assessment and SEN teachers also relied on tests. Secondly, although teacher ratings correlated with the test scores, closer investigation of sensitivity and specificity of the teacher ratings revealed that a number of children in need of extra support for their early reading development according to test scores remained unidentified. Moreover, there were some students identified by the teacher to have difficulties despite test scores not confirming that. The findings underline the importance for developing more specific and reliable assessment tools for teachers to use for pedagogical purposes, and respectively, the need to pay more attention to early identification of reading difficulties in teacher training program curricula.     

Psychometric data for teacher judgments regarding the learning behaviors of primary grade children

The psychometric properties of the Classroom Performance Profile (CPP), a teacher rating scale, were investigated using primary grade children from economically at‐risk families. Students were rated as they progressed from kindergarten through third grade. The CPP demonstrated high internal consistency yielding Cronbach alpha coefficients for the total score of at least .96. CPP ratings were correlated with scores from the Woodcock‐Johnson Psycho‐Educational Battery–Revised: Tests of Achievement and the Social Skills Rating System–Teacher Form, Elementary Level. Results suggest that the CPP ratings were positively correlated with measures of academic achievement, academic competence, and social skills, and negatively correlated with problem behaviors. © 2002 Wiley Periodicals, Inc.     

Predictive validity evidence for an assessment program based on the Work Sampling System in mathematics and language and literacy

This study examined the predictive nature of teacher ratings of student performance on the mathematical thinking and language and literacy domains of a state mandated curriculum-embedded performance assessment for children in first grade to student achievement on a criterion-referenced test in third grade in mathematics and English language arts, using a multilevel modeling approach. The sample included 1,281 elementary school children nested within 132 classrooms in an urban school district in South Carolina. Results showed positive associations between first grade teacher ratings and students’ third grade achievement. However, first grade teacher ratings were not found to uniquely contribute to the proportion of explained variance in third grade performance on a high-stakes statewide assessment, over and above student demographic variables.     

Examining the Relationship Between Technological Pedagogical Content Knowledge (TPACK) and Student Achievement Utilizing the Florida Value-Added Model

Utilizing a correlational research design, we sought to examine the relationship between the technological pedagogical content knowledge (TPACK) of in-service teachers and student achievement measured with each individual teacher's Value-Added Model (VAM) score. The TPACK survey results and a teacher's VAM score were also examined, separately, with respect to teacher attributes. Upon examination of VAM scores and teacher attributes, the subject area, the percentage of economically disadvantaged students at the teacher's school, and the grade level of the teacher were all significantly related to VAM scores. In addition, the TPACK survey results overall and its constructs were examined with teacher attributes. The significant relationships were gender, subject area, the number of certifications, highest degree held by the teacher, years teaching, and teaching in/out of area. The analysis showed no significant relationship between a teacher's VAM score and the TPACK survey overall or its individual constructs.     

Student Interest,Grading Leniency,and Teacher Ratings: A Conceptual Analysis

This study explored the extent to which student interest and grading leniency were predictive of teacher ratings. Unlike other teacher rating research, however, this study measured student interest at the beginning and end of seven sections of two courses; further, grading leniency was explicitly defined and measured, not inferred from expected grade and workload. Data indicate that precourse interest was positively associated with expected grade, but was not predictive of ratings, nor did it moderate the expected grade–rating association. Rather, interest change was positively associated with expected grade and predictive of ratings. Further, interest change and grading leniency provided incremental variance in ratings, beyond that provided by expected grade.     

The Validity of Teacher Ratings of Adolescents' Social Skills

The validity of teacher ratings of adolescents' social skills was examined in a follow-up study of a cohort sample of 395 students from seventh to ninth grade. The internal consistency of the teacher ratings on Social Skills Rating System (SSRS) was examined at two points in time, and the multidimensionality of the SSRS was confirmed through factor analyses. The findings indicated multi-informant consistency in ratings: teacher ratings consistently covaried with teacher ratings of problem behaviour in the classroom and academic competence, sociometric nominations by peer students, and grade point average in selected school subjects. Teacher ratings also produced construct-relevant group differences, with students referred to psychosocial and educational helping services receiving significantly lower ratings than their nonreferred peers.     

Teachers’ and school administrators’ attitudes and beliefs of teacher evaluation: a preliminary investigation of high poverty school districts

This study examined attitudes and beliefs regarding teacher evaluation of teachers and their school administrators in the state of New Jersey, USA. The sample included 33 school administrators and 583 Pre-K through 12th grade teachers from four high-poverty urban school districts (22 schools). Participant attitudes and beliefs were assessed using the Teacher Evaluation Experience Scale (TEES; Reddy et al. in Educational Assessment, 21(2), 120–134, 2016). TEES is a multi-informant assessment designed to measure teachers’ and school administrators’ experiences with teacher evaluation through five scales (i.e., total and subscales of system, feedback, process, and motivation to change) and six open-ended questions. Based on the qualitative analyses, teachers identified collaborative communication and evaluation feedback as the most helpful aspects of their evaluation process. Based on the quantitative analyses, however, their average ratings did not exceed neutral on any of the four subscales. Overall findings suggest that school administrators’ experiences with teacher evaluation are more favorable than teachers’ experiences. Moderate correlations are found between participant characteristics and TEES scales. Implications for teacher evaluation are presented.     

Interpersonal problem solving and children's social competence: Are current measures valid?

Ninety-four first- and second-grade students participated in a study designed to determine whether a measure of interpersonal problem-solving skill would predict the social competence of children with no clinical history. The social competence measures used in the study included peer ratings (sociometric scores) and teacher ratings. The interpersonal problem-solving measure used yielded three separate scores obtained from ratings of open-ended responses to hypothetical peer problems. To enable control of other variables known to affect social competence, measures of IQ, academic achievement, and SES also were included. Results did not confirm a prior expectation that problem-solving scores would correlate well with competence measures. Correlations between the three problem-solving scores and both peer and teacher ratings all were in the range between .04 and .20. On the other hand, intelligence, achievement, and SES had moderate to high correlations with competence measures (range = .04–.77). In stepwise multiple regressions, only achievement and SES predicted peer and teacher ratings when other variables were controlled.     

Procrastination,conscientiousness, anxiety,and goals: Exploring the measurement and correlates of procrastination among school‐aged children

We explore the reliability and validity of a self‐report measure of procrastination and conscientiousness designed for use with third‐ to fifth‐grade students. The responses of 120 students are compared with teacher and parent ratings of the student. Confirmatory and exploratory factor analyses were also used to examine the structure of the scale. Procrastination and conscientiousness are highly correlated (inversely); evidence suggests that procrastination and conscientiousness are aspects of the same construct. Procrastination and conscientiousness are correlated with the Physiological Anxiety subscale of the Revised Children's Manifest Anxiety Scale, and with the Task (Mastery) and Avoidance (Task Aversiveness) subscales of Skaalvik's (1997) Goal Orientation Scales. Both theoretical implications and implications for interventions are discussed. © 2002 Wiley Periodicals, Inc.     

Depressive symptomatology in learning-disabled and nonlearning-disabled students

The present study examined the level of depressive symptomatology in a sample of 100 learning-disabled and nonlearning-disabled fourth-, fifth-, and sixth-grade students. Depressive symptomatology was assessed using the Children's Depression Inventory (CDI). In addition, students were rated by their classroom teachers on behaviors related to depression based on the DSM-III criteria. It was found that students identified as learning disabled obtained significantly higher scores on the CDI and the behavior rating scale than did children in the regular education classroom. There were no significant differences among grade levels for CDI scores, but a trend was noted. A significant difference was found among grade levels for the behavior rating scale scores. There was a significant positive correlation between CDI scores and teacher ratings of depressive characteristics.     

Predictors of the developmental appropriateness of the beliefs and practices of first,second, and third grade teachers

This study identified classroom characteristics and teacher characteristics that were related to the self-reported beliefs and classroom practices of first, second, and third grade teachers. Teachers (n = 277) representing 77% of the potential subjects completed and returned The Primary Teacher's Beliefs and Practices Survey, a measure based on the developmentally appropriate standards advocated by NAEYC. Factor analyses of the survey supported the use of four proposed subscales: developmentally appropriate beliefs, developmentally appropriate activities, developmentally inappropriate beliefs, and developmentally inappropriate activities. Hierarchical multiple regression analyses indicated that classroom characteristics (class size, grade level, number of children with disabilities, and number of children on free or reduced lunch) and teacher characteristics (perceived relative influence and area of certification) predicted teacher beliefs and practices. After controlling for the classroom variables, teacher characteristics added significantly to the prediction of developmentally inappropriate activities.     

Improving teacher prediction of children at risk for reading failure

Whether screening tests or teacher ratings best predict children at risk for reading failure continues to be an area of disagreement in the early identification literature. Our early studies confirmed low positive identification rates (30%) when kindergarten teachers were asked to predict future reading achievement using a traditional rating scale, while a project-developed, theory-based screening battery correctly identified 81% of poor readers. Construction of a teacher rating scale of current skill levels on research-validated precursors to reading improved prediction in the current study, although results were still inferior to the screening test (64% and 80% valid positives, respectively). Combining test results and teacher ratings resulted in 88% identification of those who failed in first, second, or third grade, suggesting that both teacher ratings and screening tests should be used to identify the largest number of those who will later fail in reading. © 1998 John Wiley & Sons, Inc.     

INTERNAL FACTOR STRUCTURE AND CONVERGENT VALIDITY EVIDENCE: THE SELF‐REPORT VERSION OF SELF‐REGULATION STRATEGY INVENTORY

Using a sample of 348 middle school students, we gathered evidence regarding the internal consistency of scores, as well as the internal factor structure and convergent validity evidence for inferences from a self‐report questionnaire called the Self‐Regulation Strategy Inventory–Self Report. Confirmatory factor analysis revealed that the fit indexes for a hierarchical model (composite, three factors) and a single‐level, three‐factor model were highly similar but mixed. Respecification of the hierarchical model based on conceptual overlap of items led to substantial improvement in the overall fit of the model, as indicated by the root mean square error of approximation, chi‐square/df, and the comparative fit index. Correlational analyses also provided strong convergent validity evidence, as the three subscales exhibited statistically significant relations with four motivation beliefs (i.e., self‐efficacy, perceived instrumentality, task interest, perceived responsibility) and two distinct markers of regulation‐related behaviors (i.e., teacher ratings, office discipline referrals).     

EFFECTS OF TEACHER–CHILD INTERACTION TRAINING (TCIT) ON TEACHER RATINGS OF BEHAVIOR CHANGE

Problem behaviors in preschool‐aged children negatively affect teacher‐child relationships and children's skill development. In this clinical replication of an initial study, we implemented Teacher–Child Interaction Training (TCIT), a teacher‐delivered, universal intervention designed for early childhood settings. The initial study evaluated the TCIT program in a sample of 4‐ to 5‐year‐old children, whereas the current study focused on 2‐ to 3‐year‐old children. Teacher ratings of children's behavior indicated a significant main effect for time on children's protective factor scores, but not on behavioral concerns. However, for children whose ratings fell in the below‐average range at baseline, significant large effect sizes were obtained for changes over time for both protective factors and behavioral concerns. Higher levels of teacher skill change were significantly associated with overall higher protective factor scores, as well as lower behavioral concern scores for children when baseline levels of behavioral concerns were high. Results provide further support for the effectiveness of TCIT as a universal intervention designed to improve children's behaviors through targeted improvements in teachers’ relationship‐building skills and classroom management strategies.     

Teacher efficacy and teacher competency ratings

This cross-validation study investigated the relationships among teacher sense of efficacy, superintendents' ratings of teacher competency, and selected demographic and background variables. One hundred fifty-five teachers from 15 districts in a Southeastern state participated in the study. Multiple regression indicated variables significantly related to efficacy scores were: competency rating by superintendent, birth order, and whether the teacher would again choose teaching as a career. Using discriminant analysis, superior and average competency teachers could be differentiated from low competency teachers on the basis of four significant variables, one of which was efficacy scores. This analysis placed 80.52% of the teachers in the appropriate group, and accounted for 29% of the variance in groups. Analyses also indicated some support for the consistency of superintendents' ratings of teachers across districts.     

Contributions of Children's Temperament to Teachers' Judgments of Social Competence From Kindergarten Through Second Grade

Research Findings: Children's social competence has been linked to successful transition to formal school. The purpose of this study was to examine the contributions of children's temperament to teachers' ratings of their social competence from kindergarten through 2nd grade. Children (N = 1,364) from the National Institute of Child Health and Human Development Early Child Care Research Network participated in this study. Mothers rated children's shyness, attentional focusing, and inhibitory control with the Children's Behavior Questionnaire at 4½ years, and teachers rated children's social competence with three subscales (cooperation, assertion, and self-control) of the Social Skills Rating System at kindergarten, 1st, and 2nd grade. Latent growth curve analysis indicated that both shyness and effortful control contributed to children's social competence. Bolder children were likely to have higher assertion ratings, and shyer children with greater attentional focusing were likely to have higher assertion ratings. Shyer children and children with greater inhibitory control and attentional focusing were likely to have higher teacher ratings of self-control and cooperation. Practice or Policy: Findings highlight the importance of considering child temperament characteristics when understanding children's social competence and successful adjustment to kindergarten. Information may help parents, preschool teachers, and early elementary teachers prepare children who may be at particular risk for lower social competence.