The Sensitivity of Value-Added Teacher Effect Estimates to Different Mathematics Achievement Measures

Using longitudinal data from a cohort of middle school students from a large school district, we estimate separate "value-added" teacher effects for two subscales of a mathematics assessment under a variety of statistical models varying in form and degree of control for student background characteristics. We find that the variation in estimated effects resulting from the different mathematics achievement measures is large relative to variation resulting from choices about model specification, and that the variation within teachers across achievement measures is larger than the variation across teachers. These results suggest that conclusions about individual teachers' performance based on value-added models can be sensitive to the ways in which student achievement is measured.     

FORMATIVE ASSESSMENT IN TEACHER EDUCATION: THE DEVELOPMENT OF A DIAGNOSTIC LANGUAGE TEST FOR TRAINEE TEACHERS OF GERMAN

ABSTRACT:  This article describes the development and validation of a diagnostic test of German and its integration in a programme of formative assessment during a one-year initial teacher-training course. The test focuses on linguistic aspects that cause difficulty for trainee teachers of German as a foreign language and assesses implicit and explicit grammatical knowledge as well as students' confidence in this knowledge. Administration of the test to 57 German speakers in four groups (first-year undergraduates, fourth-year undergraduates, postgraduate trainees, and native speakers) provided evidence of its reliability and validity.     

Diarrhea Management Training in Early Childhood Settings

This study addresses the health of young children and how to safely and effectively care for children with diarrhea in the home and in early child care settings. A baseline survey showed the prevalence of oral rehydration solution (ORS) usage at last diarrhea bout to be low. An educational workshop was developed to train parents and child care professionals on how to properly manage young children with diarrhea and reduce the risk of diarrhea spread at home and in early childhood settings. Specific intervention activities are discussed and program activities, including specially designed materials for mixing homemade ORS are described. A comparison of pre- and postintervention data indicates substantial gains in knowledge among both urban and rural populations. Implications of research findings are discussed along with suggestions for future research.     

Instructions for Authors

Instructions for Authors

Instructions for Authors     

The stability of kindergarten teachers’ effectiveness: A generalizability study comparing the Framework For Teaching and the Classroom Assessment Scoring System

To meet recent accountability mandates, school districts are implementing assessment frameworks to document teachers’ effectiveness. Observational assessments play a key role in this process, albeit without compelling evidence of their psychometric rigor. Using a sample of kindergarten teachers, we employed Generalizability theory to investigate (across teachers, raters, and lessons) the stability of scores obtained with two different observation measures: The CLASS K-3 and the FFT. We conducted a series of Decision studies to document (for both measures’ constituent domains) the number of lessons per teacher and raters per lesson that would justify the use of observation scores for high stakes decisions. Acceptable, stable scores for individual-level decisions about teachers may generally require more raters and lessons than is typically used in practice (1–2 raters and fewer than 3 lessons). The considerable variability of observation-based scores raises concerns about either measure’s appropriateness for making individual or group decisions about teachers’ effectiveness.     

Influences of Writing Tasks on Students' Answers to Recall and Higher-Level Test Questions

This paper reports on two inter-related studies that examined the use of non-traditional writing strategies within secondary school science classrooms. The first study involved Year 10 students who incorporated one letter writing experience into the learning sequence when studying genetics. The second study was with Year 9 students who used both a non-traditional laboratory writing heuristic and letter writing as part of the learning sequence when studying a topic on light. The same teacher was involved in both case studies. A higher-level analogy question was added to the teacher-prepared tests for each study to examine if students who participated in writing-to-learn activities were able to perform significantly better as a group than a group of students who completed traditional teacher directed laboratory activities and note-taking. Results indicate that for the first study there was not a significant difference using t-test analysis, while for the second study involving two writing treatments there was a statistically significant difference using t-test analysis. There was no statistically significant difference in responses between treatment and control groups when answering low level recall questions for either case study. Student interviews indicated awareness by students of the metacognitive value gained by using the non-traditional writing types.