Scoring difficulties on the Wechsler intelligence scales gary

Several studies concerning scoring difficulties on the Wechsler intelligence scales were reviewed. Since the scoring of responses on the comprehension, similarities and vocabulary subtests of the Wechsler scales demands judgements by the examiner, the possibility of poor interscorer reliability is increased. In fact, research on the scoring of ambiguous responses on these subtests has demonstrated a high percentage of disagreement among scorers. More thorough scoring standards and revision of test items which lend themselves to ambiguous replies are needed.     

Interscorer reliability of the Minnesota Percepto-Diagnostic Test-Revised

This study investigated the interscorer reliability between a novice and a professional psychologist for the Minnesota Percepto-Diagnostic Test-Revised (MPDT-R). The sample consisted of 30 individuals (18 males and 12 females) who were referred to the Applied Neuroscience Institute of the University of Maryland Eastern Shore. Results from the study indicated that for three of the four MPDT-R scores there was a significant positive correlation between expert and novice scoring criteria. Implications for the assessment of perceptual-motor problems using the MPDT-R are discussed.     

Common WISC-III examiner errors: Evidence from graduate students in training

Sixty WISC-III protocols, administered by graduate students in training, were examined to obtain preliminary data on the frequency and types of administration and scoring errors that examinees commit. Results were compared with previous studies that have evaluated examiner errors on the Wechsler scales. In general, the present results were consistent with those of previous studies that have illustrated that a large number of scoring errors are committed by graduate students as well as by other professional groups. The majority of errors committed by participants in this study were general errors. That is, errors were not specific to a particular subtest. The five most frequent errors included failure to query, failure to record responses verbatim, reporting Full Scale IQ incorrectly, reporting Verbal IQ incorrectly, and adding individual subtest scores incorrectly. However, the traditional difficult to score Verbal subtests were not as troublesome for examiners in this study as they were for examiners in previous studies. In addition, significant decreases in the mean number of errors per protocol and in the number of most frequently occurring errors per protocol were noted. © 1998 John Wiley & Sons, Inc.     

Effects of two instructional sets on the validity of the Kaufman assessment battery for children–nonverbal scale with a group of severely hearing impaired children

The purpose of the study was to investigate the use of the Kaufman Assessment Battery for Children (K-ABC)–Nonverbal Scale with severely hearing impaired children. The K-ABC was administered to 49 children enrolled at a public residential school for the deaf. Test instructions were given to one group employing American sign language (ASL), plus pantomime and gestures, while the other group received pantomime and gesture (PG) instructions only. No significant difference was found between the two group mean nonverbal K-ABC scores. Also, neither group scored significantly different from the K-ABC norms. Both groups scored significantly lower than K-ABC norms on the Spatial Memory subtest. Significant correlations were found between the K-ABC and Wechsler Intelligence Scale for Children-Revised (WISC-R). A significant correlation also was found between K-ABC scores and Reading Comprehension. A post hoc analysis of data found that, regardless of the instructional set, the children scored significantly lower on the Nonverbal K-ABC than they did on the WISC-R Performance Scale. The study provides support for the appropriateness of the K-ABC for use with deaf children.     

The reliability of the WISC-R performance scale with deaf children

Though the Wechsler tests are widely used to assess the intellectual ability of hearing impaired children, data on the reliability of the WISC-R with this population have been lacking. The Performance Scale of the WISC-R was administered to 59 prelingually deaf children attending a state-supported day school program. The reliability coefficients and standard errors of measurement were computed for each subtest and for the Performance Scale IQ. The results compare favorably with those found by Wechsler with the standardization sample.     

The technical adequacy of curriculum-based writing measures with English learners

The purpose of this study was to examine the validity and reliability of Curriculum-Based Measures in writing for English learners. Participants were 36 high school English learners with moderate to high levels of English language proficiency. Predictor variables were type of writing prompt (picture, narrative, and expository), time (3, 5, and 7 min), and scoring procedure (words written, words spelled correctly, correct word sequences, correct minus incorrect word sequences). Criterion variables were teacher ratings of writing performance and student performance on the Test of Written Language-III, the writing subtest of the Test of Emerging Academic English, and the Minnesota state writing test. Results supported the validity and reliability of a 5 to 7-min writing sample written in response to a narrative or picture prompt and scored for percent of correct word sequences, correct minus incorrect word sequences, or words written plus correct minus incorrect word sequences.     

Cognitive and motivational profile shape predicts mathematical skills over and above profile level

The interpretation of subtest profiles from intelligence testing remains popular among many practitioners who use subtest performance to draw diagnostic conclusions, in spite of criticism by some researchers, who point to the low reliability and predictive validity of subtest scores in predicting achievement outcomes. Prior research outlines two approaches to the study of subtest variation: the examination of interindividual variation in specific cognitive domains or subtests as compared to a standard sample, and the examination of intraindividual strengths and weaknesses, regardless of overall level. The present study seeks to add to knowledge in this field with data from 567 children ages 5 to 10 years who exhibit meaningful subtest variation on a new test of intellectual abilities. Results from the present sample point to statistically significant utility, with small to medium effects, of intraindividual cognitive and motivational profile shape over and above profile level in predicting mathematical skills. We discuss implications for school psychological and educational assessment research.     

Recategorized WISC-R scores of learning disabled children and differential diagnosis

This study analyzed WISC-R profiles along a three-factor approach (Spatial; Verbal-Comprehensive; Attention-Concentration), as suggested by Bannatyne (1968) for purposes of differential diagnosis. The WISC-R profiles of 278 school-verified learning disabled children were compared to those of four other groups: Educable Mentally Impaired (N = 141), Emotionally Impaired (N = 67), Otherwise Impaired (N = 61), and Nonimpaired (N = 294). The total sample was drawn from the State of Michigan public schools. Statistically significant differences were found between the learning disabled group and the other four groups on WISC-R subtest scores. Further analysis revealed that 36% of the learning disabled and 32% of normal children exhibited this WISC-R profile. Analysis of WISC-R profiles of Spatial→Verbal→Attention was not useful in differential diagnosis among the five groups. The results are discussed in terms of the limited utility of a three-factor analysis of WISC-R subtest scores for the purpose of differential diagnosis.     

Examiner scoring of ambiguous WISC-R responses

Fabricated test protocols were used to study how effectively examiners agree in scoring ambiguous WISC-R responses. Clinical and school psychologists (N = 62) and graduate students (N = 48) scored WISC-R Similarities, Comprehension, and Vocabulary responses obtained in a group administration procedure. From over 15,000 responses obtained, only unusual, atypical, or ambiguous responses were selected; 726 responses were scored, with 11 groups of 10 raters each scoring 66 responses. Considerable scoring disagreement occurred. Unanimous agreement (within each group of 10 raters) was found on only 13% of the responses, while 80% of the raters agreed on 44% of the responses. Rates of scoring agreement were not related to level of rater experience, but were related to specific subtests. Higher rates of agreement were found on the Similarities and Comprehension subtests than on the Vocabulary subtest for both experienced and inexperienced raters. The results suggest that even with the improved WISC-R manual, scoring remains a difficult and challenging task.     

The working memory rating scale: A classroom-based behavioral assessment of working memory

The aim of the present study was to investigate the potential of the Working Memory Rating Scale (WMRS), an observer-based rating scale that reflects behavioral difficulties of children with poor working memory. The findings indicate good internal reliability and adequate psychometric properties for use as a screening tool by teachers. Higher (i.e., more problematic) teacher ratings on the WMRS were associated with lower memory scores on direct assessments of working memory skills, as measured by the Automated Working Memory Assessment (AWMA) and the WISC-IV Working Memory Index. The use of the WMRS will allow educators to draw on their expertise in the classroom for early detection of children with working memory failures.     

An examination of the predictive validity of the keymath diagnostic arithmetic test and the wide range achievement test in exceptional children

Thirty-seven Title I elementary school children were administered the Arithmetic subtest of the Wide Range Achievement Test and the KeyMath Diagnostic Arithmetic Test. One year later, the Metropolitan Achievement Test was administered. While correlations between the Wide Range and the Metropolitan did not reach significance (r =.17), the KeyMath demonstrated a substantial relationship (r -.63). Reasons for such differences in correlations are discussed. It is suggested that the reliability and predictive validity of the KeyMath be extended to different ages and populations.     

多元概化理论在高等教育自学考试命题质量控制中的应用——以北京市《英语水平考试（一）笔试》为例

概化理论作为新一代测量理论逐渐应用于大规模考试领域。文章运用多元概化理论对自学考试课程《英语水平考试（一）笔试》试卷的测量信度、试卷总分合成、及格线决策信度、试卷结构优化等问题进行探讨。研究发现：本次考试的测量信度较高;各分测验对全域总分的方差贡献比例与试卷赋分意图基本一致;该试卷以60分作为及格线具有较高的决策信度;将各分测验题量同时增至15题或单独将词汇分测验题量增至20题,可有效提高测量信度。     

自学考试的题型优化——基于多元概化理论的思想

概化理论提出了新的测量信度观并逐渐应用于大规模考试领域。本文运用多元概化理论对高等教育自学考试课程《综合英语(四)》听力测验的测量信度、测验总分合成、题型设计优化等问题进行探讨。研究发现:本次听力测验的总体测量信度较高,但"短文理解"分测验的测量信度较低;各分测验对全域总分的方差贡献比例与测验编制时的赋分比例存在一定差距;在删除"短文理解"分测验后将各分测验题量同时增至10题,可有效提高听力测验的测量信度。     

Memory Profile of Children with Nonverbal Learning Disability

The aim of this study was to compare visual and verbal memory in children with nonverbal learning disability (NLD) using the Children's Memory Scale and to identify the profile of strengths and weaknesses in visual memory abilities. Performance was significantly lower on measures of visual than verbal memory, indicating that children with NLD have deficits in visual memory despite adequate verbal memory. A unique pattern of performance emerged for the visual but not the verbal subtests. Performance on the Faces Immediate subtest was well below average, although other measures of visual memory were within the average range. Hence, it appears that children with NLD have a specific deficit on immediate memory for faces. This facial memory deficit may be linked to a deficit in right hemisphere functioning, which has already been implicated in facial processing and may also be linked with other disorders (e.g., autism spectrum disorder) in which similar facial processing deficits have been documented. More research is needed to further understand the visual memory profile of children with NLD and to inform instruction and remediation.     

The Four Year Reliability of a Test of Learning Problems

Learning disabled, emotionally disturbed, and unclassified male students (N = 123) originally tested with the Elizur Test of Psycho-Organicity (ETPO) when they were 6 to 11 years of age by Brooks (1) and Jackson (7), were followed-up and reassessed four years later. The test-retest reliability of the total ETPO score was .70, and subtest reliabilities ranged from .47 to .62. The pattern of subtest intercorrelations also remained stable over the four year interval. It was concluded that the ETPO is sufficiently stable for use with school-aged boys, though individual subtest scores should be used with caution.     

A procedure for determining the level of abstraction of science reading material

The objectives of this study were to develop a method for scoring the level of abstraction (LOA) of science reading material and explore its relationship with other methods for assessing curriculum materials. LOA is defined as the ratio of the nonconcrete concepts to the total number of concepts in a written passage expressed as a percent. Using passages taken from life, earth, and physical science textbooks written at three different levels, data were collected to obtain preliminary agreement from science educators in the classification of concepts, determine interscorer reliability, and compare student and passage variables. Participants consisted of 24 science educators, 60 science teachers from elementary, middle, and high schools, and 425 urban students in Grades 5, 7, and 10. Instruments used were (a) the procedure to determine level of abstraction developed in this study, (b) the cloze procedure, and (c) “Reading Level: Programs for Teachers.” No significant correlations were found between (a) passage LOA and passage readability level, (b) student cloze scores and passage LOA, (c) passage LOA and teacher prediction of student success, and (d) student cloze scores and passage readability level. However, the lack of significant correlations between LOA and cloze scores combined with the fact that the LOA is based upon deep structure rather than surface structure of written material indicate the possible uniqueness of the LOA and highlight the importance of further investigation of the LOA in its relationship to student comprehension of written material.     

A comparison of the WISC information and arithmetic subtests with a multiple choice procedure using kindergarten,first-, and second-grade children

Fifty-nine children in kindergarten, first, and second grade were given the WISC information and arithmetic subtest. Approximately three weeks later, the subjects were presented with the same questions, and four multiple choice answers were shown and read to them. The number of correct responses on each subtest for each presentation method was recorded. The multiple choice method of presentation response yielded significantly higher scaled scores than did the standard WISC presentation with the free response mode of testing.     

The role of sex differences in the referral process as measured by the Peabody Picture Vocabulary Test-Revised and the Wechsler Intelligence Scale for Children-Revised

The Peabody Picture Vocabulary Test-Revised (PPVT-R) and the Wechsler Intelligence Scale for Children-Revised (WISC-R) are two tests that are often used in the assessment process for special education referrals. Sex differences apparent in these tests were examined in a sample of Arkansas school children who were first-time referrals for a psychological evaluation. The subjects' PPVT-R standard scores, WISC-R IQ scores, and WISC-R subtest scores were divided into groups according to one-year intervals from ages 6 through 16. A separate 2 × 11 (subjects' sex x subjects' age) analysis of variance was performed for each dependent variable. Results indicated significant sex differences among WISC-R Full Scale, Verbal, and Performance IQs and PPVT-R standard scores (p < .01). Several WISC-R subtests also revealed significant sex differences. Further significant sex differences were indicated at several age groups on each dependent variable, with males consistently scoring higher than females on 87%. of the dependent measures excluding the WISC-R subtest Coding, on which females scored higher. Implications concerning the referral process are discussed.     

A Study of Intelligence Scales for Grades Two and Three

Abstract

The importance of dear, legible handwriting in academic achievement should not be underestimated. A pressing need for a reliable instrument to measure rate and quality of penmanship led to the construction of the Children's Handwriting Evaluation Scale (CHES). The scoring standards for the CHES are based on the writing of 1,365 children in grades 3-8. Rate scales make it easy to pinpoint children whose copying rate requires remediation. Quality standards, carefully defined and clearly illustrated, indicate areas where help is needed. The reliability of objective scoring is based on a comparison of judgments of four independent raters which shows significant intraclass correlation. The CHES also provides a projective scoring key based on accepted graphological interpretations.     

Visual constructive and visual-motor skills in deaf native signers

Visual constructive and visual-motor skills in the deaf population were investigated by comparing performance of deaf native signers (n=20) to that of hearing nonsigners (n=20) on the Beery-Buktenica Developmental Test of Visual-Motor Integration, Rey-Osterrieth Complex Figure Test, Wechsler Memory Scale Visual Reproduction subtest, and Stanford-Binet Intelligence Scale Paper Folding and Cutting subtest. Deaf signers were found to perform similarly to hearing controls, suggesting that these tests are valid assessment instruments to use with deaf individuals.