Measurement of teacher performance: A study in instrument development

The procedures used to produce a research-based teaching evaluation system, containing low-inference indicators of effective and ineffective teacher behavior, included instrument development, content validation, and field testing. An extensive reliability study produced estimates for three types of consistency: intercoder agreement (r = 0.85), stability across teaching situations r = 0.86, and discriminant reliability among teachers (r = 0.79). The norming component of the study conducted in 45 schools, generated over 1200 observations of current teacher practice at all grade levels and in various subject areas. The results indicated the substantially generic nature of these behaviors; only grade level and instructional method (interactive, lecture, and independent seatwork) produced meaningful differences among groups of teachers. In addition, the average teacher used most of the effective behaviors (70%), and a few of the ineffective behaviors (8%) during observation. These results support the instrument's value in teacher training, remediation, and evaluation.     

Contextualizing the Interpretation of Reliability Data

What is the relationship between the context and substantive meaning of a measure and the assessment of the reliability of the measure? Does the interpretation of a reliability coefficient depend on the nature of the measure? How does this approach to reliability relate to alternative assessments?     

Carbohydrate and carbohydrate + protein for cycling time-trial performance

Carbohydrate intake during endurance exercise delays the onset of fatigue and improves performance. Two recent cycling studies have reported increased time to exhaustion when protein is ingested together with carbohydrate. The purpose of the present study was to test the hypothesis that ingestion of a carbohydrate + protein beverage will lead to significant improvements in cycling time-trial performance relative to placebo and carbohydrate alone. Thirteen cyclists completed 120 min of constant-load ergometer cycling. Thereafter, participants performed a time-trial in which they completed a set amount of work (7 kJ kg(-1)) as quickly as possible. Participants completed four experimental trials, the first for familiarization and then three randomized, double-blind treatments consisting of a placebo, carbohydrate, and carbohydrate + protein. Participants received 250 ml of beverage every 15 min during the constant-load ride. Time-trial performance for carbohydrate (37.1 min, s = 3.8) was significantly (P < 0.05) faster than placebo (39.7 min, s = 4.6). Time-trial performance for carbohydrate + protein (38.8 min, s = 5.5) was not significantly different from either placebo or carbohydrate. Ingestion of a carbohydrate beverage during two hours of constant-load cycling significantly enhanced subsequent time-trial performance compared with placebo. The carbohydrate + protein beverage provided no additional performance benefit.