Common WISC-III examiner errors: Evidence from graduate students in training

Sixty WISC-III protocols, administered by graduate students in training, were examined to obtain preliminary data on the frequency and types of administration and scoring errors that examinees commit. Results were compared with previous studies that have evaluated examiner errors on the Wechsler scales. In general, the present results were consistent with those of previous studies that have illustrated that a large number of scoring errors are committed by graduate students as well as by other professional groups. The majority of errors committed by participants in this study were general errors. That is, errors were not specific to a particular subtest. The five most frequent errors included failure to query, failure to record responses verbatim, reporting Full Scale IQ incorrectly, reporting Verbal IQ incorrectly, and adding individual subtest scores incorrectly. However, the traditional difficult to score Verbal subtests were not as troublesome for examiners in this study as they were for examiners in previous studies. In addition, significant decreases in the mean number of errors per protocol and in the number of most frequently occurring errors per protocol were noted. © 1998 John Wiley & Sons, Inc.     

WISC-R: The first five years

Since its introduction five years ago (1974), 113 articles or papers have appeared regarding the WISC-R, including empirical investigations of its nature, as well as its comparability with a variety of other measures of intelligence and achievement, including the WISC. While not all this research has been carefully done, two general conclusions can be derived from the review. First, although the WISC-R involves modification in administration, design, and presentation of items, as well as a complete restandardization, the literature substantially suggests that it remains very similar in nature to its predecessor, the WISC. Investigations of factor analytic structures, standard errors, reliability coefficients, and subtest intercorrelations support the conclusion that individuals perform on the WISC-R largely the same as they do on the WISC. The second conclusion points out (with few exceptions): consistently lower scores were obtained on the WISC-R than on several other measures, including the WISC, the WAIS, the Slosson Intelligence Test, the Peabody Picture Vocabulary Test, and the Stanford Binet, which was revised shortly before the WISC. These lower scores on the WISC-R may be due to a variety of influences, including examiner variance, an artifact of design leading to inflated scores on the WISC, and finally and most obviously, the restandardization of the scale. The amount of literature that has appeared over the five-year period suggests that practitioners and researchers are as interested in learning about the WISC-R as they were about the WISC. Despite this fact and the conclusion that the WISC and WISC-R are substantially similar, the present authors encourage caution in the overgeneralization of findings until additional literature develops.     

Investigation of the WISC-R for use with retarded children: Correlation with the 1972 Stanford-Binet and comparison of WISC and WISC-R profiles

A group of 80 mentally retarded youngsters, aged 6 to 16, was tested on the WISC-R, primarily to assess the continuity of measurement between the old and new WISCs. The WISC-R IQs correlated .65 to .82 with Stanford-Binet IQ for a subsample of 45 children, resembling the coefficients between the 1949 WISC and the Binet for retarded groups. In addition, the WISC-R test profiles for the 80 children corresponded closely to the WISC test profiles for many retarded samples. Thus, there was evidence to support the continuity of the WISC-R with its predecessor for retarded populations.     

Interpreting WISC-R and McCarthy scatter: A caution

In this investigation, indices of scatter on the WISC-R and McCarthy Scales were examined for 20 educable mentally retarded and 20 learning disabled children in relation to a similar control group. The scatter found in the two exceptional samples was also compared to the variability found in the standardization samples of the WISC-R and McCarthy. Results indicated that the learning-disabled sample exhibited more WISC-R subtest scatter and McCarthy Scale variability than the standardization sample but not more than the control group. The implications of these findings are discussed.     

Plowden's concern for standards

The Action on Principled Pedagogy and Learning Evaluation (APPLE) project is a cross cultural study of teaching in primary/elementary schools in England and North Carolina. The study is focused on variance in teaching, how teaching differs from the best, or most effective, that it might be, and on the relationship between professional knowledge for teaching and teachers' roles and actions. The major products of this study were: (a) a set of 16 dimensions of teaching and a model for analysis of the degree to which each dimension is an asset or barrier to learning in any given instruction and (b) a new typology of teaching, based on variance from the best that could be rather than in comparison to others. In this article we describe, briefly, the APPLE project, present the dimensions and the new typology and discuss their implications for the professionalisation of teaching. In particular, the finding that even amongst the best teachers, the ability to articulate practice in a clear, technical language is rare, is, it is argued, a major barrier to the definition of teaching as a professional activity.     

Reading between the lines: exploring methods for analysing professional examiner feedback discourse

This paper uses the remote interactions of professional examiners working for a UK-based awarding body as a vehicle for discussing the benefits of the use of different methods for analysing such discourse. Communication is an area of interest for sociocultural theory because it can potentiate cognitive shifts in participants and affords learning. In the professional examiner context the feedback given to examiners by more senior colleagues on their performance is a mechanism through which the examiners ensure that their work articulates [Schmidt 2011. “Taking CSCW Seriously: Supporting Articulation Work.” In Cooperative Work and Coordinative Practices, 45–72. Computer Supported Cooperative Work. London: Springer]. Moreover, this communication has a learning function that helps examiners to become members of the professional community. The study captures feedback interaction data from 21 examiners. Once the study context is outlined, the paper briefly discusses three different approaches that have been widely used to analyse communication data. The paper then goes on to propose, using case study analyses of some of the study data, how these methods can be used to augment each other as part of a general sociocultural discourse analysis framework to construct a broad picture of communication.     

A short form of the WISC-R for gifted students

Much effort has been devoted to the derivation of short forms of intelligence tests. The present study was undertaken to develop a short form of the WISC-R for the intellectually gifted. The results confirmed previous findings that the Vocabulary and Block Design dyad comprise the best two-subtest short form. The present study indicated that the Similarities, Vocabulary, Block Design, and Object Assembly tetrad could be the most useful in time and reliability.     

Stability of WISC-R subtest profiles for learning disabled children

Stability of the WISC-R subtest profile for 161 learning disabled (LD) children over a 7-month test-retest interval was examined. A unique subtest profile reported earlier (Smith, Coleman, Dokecki, & Davis, 1977a) was replicated. Performance IQ was significantly greater than Verbal IQ at both testing occasions. A mean test-retest increase was observed for Performance IQ, but not for Verbal IQ.     

Sex differences on the WISC-R for retarded children and youth

This study investigated sex differences on the WISC-R subtests for retarded males and females who were matched in terms of WISC-R Full Scale IQs. The sample consisted of 126 children and youth (63 females, 63 males) ranging in chronological age from 7–3 to 8–3, with a mean CA of 7–8. Each subject was matched in terms of Full Scale IQ score. A 2 × 10 analysis of variance with repeated measures on a single factor was used to analyze the data. Students' T and Fisher's F ratios were calculated, and differences between subtest means were analyzed by Newman-Keuls test for sample effects. Evidence from the investigation indicated that a significant interaction effect existed between sex and subtest scores.     

A short-form version of the WISC-R for the learning disabled

This study investigated the best short form version of the WISC-R for learning disabled (LD) students. The WISC-R was administered to 234 LD and 290 children who were referred for psychological evaluation but were found not eligible (NE) for special education services from 45 school districts in Michigan. Stepwise multiple regressions were calculated to ascertain the best tetrads of Full Scale IQ (FS IQ) for the two groups. For the NE sample, Vocabulary, Picture Arrangement, Picture Completion, and Information were the best four indicators of FS IQ, accounting for about 80% of the variance in Full Scale scores. For the LD sample, the best four predictors of FS IQ were Similarities, Block Design, Picture Completion, and Vocabulary, accounting for about 80% of criterion variance. Using the WISC-R standardization data, Sattler identified the Information, Vocabulary, Comprehension, and Block Design subtests as one of the best short form versions for predicting FS IQ. For the LD sample of the present study, Sattler's composite yielded a multiple R of .873 with FS IQ, whereas our best four predictors yielded a multiple R of .896. It appears that Sattler's tetrad is about as good a predictor of FS IQ for LD students as that found in the present data.     

Comparison of the SIT with the WISC-R for gifted students

There has been a need to identify a quick screening and reevaluation instrument to determine eligibility status for specialized programs. The Slosson Intelligence Test (SIT) is one instrument that has been suggested for this purpose. In a ten-year review of validity studies with the SIT, Stewart and Jones (1976) found substantial correlations between the SIT and WISC. They recommended that future validity studies with the SIT focus on specific subgroups with restricted IQ ranges. The present study compared the SIT with the WISC-R for a group of intellectually gifted students. The results indicated reduced correlations between the measures. The calculated regression equation was dissimilar to the one reported by Stewart and Jones for nonrestricted IQ populations, although predictive ability was greater. The need for comparing the SIT with other measures for specific subgroups was supported.     

A practitioner's comparison: The 1972 Stanford-Binet and the WISC-R

This paper compares the 1972 Norms Edition of the Stanford-Binet Intelligence Scale, Form LM, and the Wechsler Intelligence Scale for Children, Revised (1974), from a practitioner's viewpoint The strengths and weaknesses of each instrument are explored in relation to (a) standardization data given in the manuals, (b) ease of administration and interpretation, (c) age-range limitations and finally, (d) the utility of both instruments as aids in prediction of academic success.     

The WISC-R and evidence of item bias for native-American Navajos

The study investigated cultural bias in the 79 items of the three verbal tests of the Wechsler Intelligence Scale for Children-Revised (WISC-R). The Information, Similarities, and Vocabulary subtests were administered to 40 Anglo and 40 Native- American Navajo subjects matched for grade level. The responses of the two groups of subjects on individual items were analyzed by log-linear technique using the likelihood ratio chi-square statistic. The findings revealed that performance of subjects was homogeneous across groups on most of the items of three verbal subtests of the WISC-R. Only 15 (19%) of the 79 items comprising Information, Similarities, and Vocabulary subtests were found to be biased against the Navajo sample. Five of these items are from the Information, four from the Similarities, and the remaining six items are from the Vocabulary subtest. Implications of these findings for the psychoeducational assessment of minority children were discussed.     

WISC-R patterns for learning disabled children at three SES levels

WISC-R and socioeconomic status (SES) data were collected on 122 learning disabled (LD) children who had been assigned to self-contained LD classrooms. The children were divided into three groups on the basis of family SES: high, middle, and low. Three questions were explored: (a) Is there a relationship between SES and IQ test scores among LD-labeled children? (b) Is the pattern of subtest scores independent of SES level? (c) Is the Verbal-Performance IQ test score discrepancy independent of SES level? Results supported affirmative answers to all three questions. Discussion centered around the implications of these results for future research on the utility of the WISC-R for diagnostic purposes.     

Linking errors in international large-scale assessments: calculation of standard errors for trend estimation

Abstract

One major aim of international large-scale assessments (ILSAs) is to monitor changes in student performance over time. To accomplish this task, a set of common items is repeatedly administered in each assessment and linking methods are used to align the results from the different assessments on a common scale. The present article introduces a framework for discussing linking errors in ILSAs, in which different components of linking errors are distinguished (country-by-item interaction, assessment-by-item interaction and country-by-assessment-by-item interaction). Furthermore, the different components of linking errors are used to analytically derive standard errors for national trend estimates. In a simulation study, the proposed standard error formula outperforms the method that is used in PISA. In addition, the PISA 2006 and 2009 reading data are used to illustrate how the interpretation of national trend estimates can change when different procedures are applied to calculate standard errors.     

Stability of WISC-R intelligence scores: Implications for 3-year reevaluations of learning disabled students

Student records of 170 learning disabled students from two area agencies were examined to determine the stability of WISC-R test scores administered as part of the 3-year reevaluation of students required by Public Law 94–142. The WISC-R had been readministered to 150 of these students. Stability coefficients were .72, .70, and .74 for the Verbal, Performance, and Full Scale IQ scores. Changes in Full Scale scores were 4 points or less for 52% of the sample. Changes greater than 15 points were noted for 4% of the sample. Results suggest that WISC-R scores are reasonably stable over a 3-year interval, and routine readministration of the WISC-R should not be required or encouraged.     

Relationship between WISC-R and WRAT in children referred for learning difficulties

Correlations between the WISC-R Full, Verbal, Performance, and Freedom from Distractibility Scale IQs, WISC-R subtest scaled scores, and Wide Range Achievement Test Reading, Spelling, and Arithmetic standard scores were computed for a sample of 114 children (64 boys, 50 girls), aged 6 to 16 years, who were referred for psychological evaluation because of academic or learning difficulties. The Full Scale IQ, Verbal Scale IQ, and Freedom from Distractibility IQ correlated moderately with the three achievement area standard scores (rs of .48 to .59). However, the Performance Scale IQ correlated minimally with reading and spelling scores (rs of .26 and .27), but moderately with arithmetic scores (r = .40). The results support the concurrent validity of the WISC-R.