Examiner scoring of ambiguous WISC-R responses

Fabricated test protocols were used to study how effectively examiners agree in scoring ambiguous WISC-R responses. Clinical and school psychologists (N = 62) and graduate students (N = 48) scored WISC-R Similarities, Comprehension, and Vocabulary responses obtained in a group administration procedure. From over 15,000 responses obtained, only unusual, atypical, or ambiguous responses were selected; 726 responses were scored, with 11 groups of 10 raters each scoring 66 responses. Considerable scoring disagreement occurred. Unanimous agreement (within each group of 10 raters) was found on only 13% of the responses, while 80% of the raters agreed on 44% of the responses. Rates of scoring agreement were not related to level of rater experience, but were related to specific subtests. Higher rates of agreement were found on the Similarities and Comprehension subtests than on the Vocabulary subtest for both experienced and inexperienced raters. The results suggest that even with the improved WISC-R manual, scoring remains a difficult and challenging task.     

The relationship of the WISC-R and WRAT: A study based upon a selected population

So as to compare predicted achievement based upon WISC-R IQs and observed achievement by the WRAT standard scores, both instruments were administered by the same school psychologist to 282 urban students referred for psychological evaluation. The correlations obtained, even on this nonrandom population, were substantial, significant (p < .001), and should be useful to school psychologists in statistically relating intelligence test scores to school achievement.     

A comparison of the WISC and WISC-R

So as to compare the results of the WISC and WISC-R, both instruments were administered to 58 children randomly selected from a school population of 583. All administration and scoring was performed by the same psychologist, with a two-month interval separating the administrations for each child. All IQs were significantly higher (p <.01) on the WISC, with the Performance difference being greater than the verbal difference. Also, 8 of the 10 required subtest scaled scores were significantly greater (p <.05) on the older instrument. Regression equations were obtained to predict WISC-R IQs from WISC scores.     

Teacher as token dispenser: Effect of an observer

Data were collected on rate per minute of administering token reinforcement for one male and six female teachers enrolled in a behavior modification course. Data were obtained from record cards maintained by pupils for tokens received during an observer-present condition and for an observer-absent condition. Comparison of reinforcement rates for observer-present vs. absent indicated significantly higher rates of token delivery (p <.025) in the observer-present condition. The observer effect has important implications for those programs in which assessment procedures introduce an observer into the classroom to collect data on changes in teacher behavior.