Statistics for the enhancement of profile analysis on the test of language development-primary

The Test of Language Development-Primary is a recently published, comprehensive measure of young children's general language development. The manual provides much information on test development and standardization of the scale relevant to traditional normative interpretation, but says little about the statistical basis for profile analysis of the various subtest scaled scores. The present paper provides the necessary information for determining statistically reliable strengths and weaknesses in the performance of a single individual on each subtest, as compared to the mean level of performance across all subtests. Provided at each of five age levels are the standard errors of the difference between each score and the mean of all scores and the differences required for statistical significance at .05 and .01 significance levels.     

Significant differences between individual subtest scaled scores and average scaled scores on the Wechsler Preschool and Primary Scale of Intelligence-Revised

This paper presents age-referenced tables that are used for determining significant differences between individual subtest scaled scores and average subtest scores on the Wechsler Preschool and Primary Scale of Intelligence-Revised (WPPSI-R). The tables provide differences required at the .05 and .01 levels of significance between any Verbal scale subtest and the average of Verbal scale subtests, any Performance scale subtest and the average of Performance scale subtests, and any subtest with the average of all subtests administered. The information presented is useful for WPPSI-R profile analysis.     

An analysis of the factor structure of the WISC-R and the effect of color on the coding subtest

The Wechsler Intelligence Scale for Children-Revised was administered to 76 subjects from 8–0 to 16–11 years. All subjects were students from rural school districts in southwest Minnesota, and were referred to a consulting school psychologist for various learning problems. The subtest scores for each subject were factor analyzed, using a principal-factor method. Three factors were found consistent with previous research, although there were mild positive loadings of all subtests except Coding on the two primary factors, suggesting that the test items measure a consistent ability such as Spearman's g. In the second aspect of the study, each subject's results on the old and new color formats of the Coding B subtest were compared. No order effects were found, and there was a highly significant difference in raw score and scaled score favoring the color format. This suggests the possibility of a color enhancement effect, at least with students having learning problems. Caution is advised for interpreting coding scores as an index of distractibility as recommended in the literature, if the subject has color-deficient vision.     

Statistically significant differences between subtest scores on the test of reading comprehension

The authors contend that erroneous conclusions concerning intraindividual strengths and weaknesses may result when comparing scaled scores on subtests of The Test of Reading Comprehension. Examination of scaled scores may seem to indicate that a given student has performed better on one subtest than on another when, in reality, the difference between the two scores is not statistically significant. The authors present a table in which statistically significant differences between subtest scaled scores are identified. Use of the table enables more precise determination of intraindividual strengths and weaknesses.     

Evaluating subscale performance on the adaptive behavior inventory for children

Statistics are presented to allow ipsative interpretation of the scaled scores for the six subscales of individual children on the Adaptive Behavior Inventory for Children. Included are the standard error of the difference between each part score and the mean of all scores and values required for statistical significance at the traditional significance levels of .05 and .01, with the Bonferroni adjustment for the number of comparisons included. The ready availability of this information should enhance application of the ABIC in clinical practice and facilitate research on its efficacy for educational planning and placement of children in various regular and special education programs.     

Interpretation of the PPVT-R: A pure measure of verbal comprehension?

The present study examined WISC-R scale, factor, and subtest scores in relationship to PPVT-R standard scores in order to test hypotheses regarding abilities measured by the PPVT-R. For a naturally occurring sample of rural children referred for assessment (N = 51), the results of direct and stepwise regression analyses indicated that, while verbal comprehension abilities may contribute most to successful performance on the PPVT-R, perceptual organization abilities also play a significant though less substantial role in the child's performance on the PPVT-R. While Vocabulary scaled scores accounted for 63% of the variance, addition of Object Assembly and Picture Arrangement scaled scores accounted for an additional 11% of the observed variance in PPVT-R performance. Students for whom the PPVT-R overestimated WISC-R Full Scale performance differed significantly from students for whom the PPVT-R underestimated their WISC-R performance only on the WISC-R Arithmetic subtest. Implications for interpretation of the PPVT-R are discussed.     

A comparison of the WISC information and arithmetic subtests with a multiple choice procedure using kindergarten,first-, and second-grade children

Fifty-nine children in kindergarten, first, and second grade were given the WISC information and arithmetic subtest. Approximately three weeks later, the subjects were presented with the same questions, and four multiple choice answers were shown and read to them. The number of correct responses on each subtest for each presentation method was recorded. The multiple choice method of presentation response yielded significantly higher scaled scores than did the standard WISC presentation with the free response mode of testing.     

The Wechsler Preschool and Primary Scale of Intelligence: Difficulty order of subtest questions

Theoretically and pragmatically the subtest questions of the Wechsler Pre-school and Primary Scale of Intelligence are assumed to be ordered from least to most difficult. The purpose of this study was to test whether or not the order was appropriate for a sample other than that used for standardization. Data consisted of test records of 89 females and 62 males tested at a private school over four years. Mean Full Scale IQ of the sample was 118. Calculation of proportion of the sample passing each item and Guttman Reproducibility Coefficients for each subtest suggested changes in the order of questions of the Vocabulary, Picture Completion, Similarities, and Comprehension Subtests. However, though questions were misordered for the present sample as a result of presenting them in the order prescribed in the test manual, the misordering was not great enough to seriously affect subtest scores or the interpretation of intratest scatter.     

The effect of omitting a limited number of subtests on the full scale reliability of the WISC-R

Changes in the full scale reliability of the WISC-R were computed at three age levels when each subtest was omitted by itself. Reliability was then determined when combinations of the two to five subtests which independently lowered the full scale reliability the most were omitted. The same procedure was followed with those subtests which independently had the smallest effect in lowering full scale reliability. The deletion of any one subtest had a negligible effect on reliability. Only when the combination of the five subtests having the greatest independent effect on full scale reliability was omitted did the reliability drop below.90. Cautions were rioted concerning the exclusion of sub-tests even when reliability remains acceptably high.     

The comparison of performance by sex of deaf children on the WISC-R

The Performance Scale of the WISC-R was administered to 60 female and 65 male hearing-impaired subjects. The only significant sex difference found was on the Coding subtest, with females outperforming males by a mean scaled score difference of 1.77 points (t = −3.087, p<.01). Subtest intercorrelational results suggest that deaf females possessed significantly better visual-motor coordination and speed, while males demonstrated better spatial analysis and synthesis skills. A principal factor analysis procedure yielded only one factor for each sex. The high degree of factorial similarity between the female and male samples indicated that the underlying construct being measured by the WISC-R Performance subtests does not differ by gender.     

Clinically and theoretically derived WISC-R subtest regroupings: Predicting academic achievement in a referral population

Attention continues to be directed toward the WISC-R as a tool for understanding children's learning problems. The formulation of WISC-R subtest regroupings (apart from the traditional Verbal, Performance, and Full Scale IQs, and the empirically derived factor scores) may provide a basis for score interpretation and the generation of hypotheses regarding children's cognitive strengths and weaknesses. The present investigation analyzed the predicitive utility of several WISC-R subtest recategorizations with regard to academic to achievement as measured by the WRAT. The sample consisted of 105 children who had been referred for psychoeducational evaluation because of classroom learning problems. Stepwise regression analyses indicated that many of the regroupings were significant predictors of academic achievement. Generated regression equations are presented.     

WAIS-R scores as predictors of employment success and failure among adults with learning disabilities

The transition of adults with learning disabilities to successful employment is contingent upon numerous factors. Eighty-six adults (55 males and 31 females), 18 to 59 years old (mean age 26.7 years), with learning disabilities were evaluated clinically using the Wechsler Adult Intelligence Scale-Revised (WAIS-R) (Wechsler, 1981) to determine the value of WAIS-R IQs and subtest scores in predicting successful employment. Significant relationships were identified between subjects' WAIS-R IQs and scaled scores and job success. Conclusions and recommendations were reported.     

The prediction of first-grade reading achievement from WPPSI scores of preschool children

The purpose of this study was to measure the relationship between the WPPSI IQs and subtest scaled scores in preschool children and their reading achievement in grade one. Twenty-eight suburban middle class children were given the WPPSI at ages three to five and retested with the Gray Oral Reading Test near the end of first grade. Significant correlations between WPPSI IQs and reading were found. These correlations were similar in magnitude to those obtained between WPPSI IQs of kindergarten children and grade one reading. Further study of the predictive power of the Geometric Designs and Arithmetic subtests was suggested on the basis of correlations obtained between these subtests and later reading scores.     

多元概化理论在高等教育自学考试命题质量控制中的应用——以北京市《英语水平考试（一）笔试》为例

概化理论作为新一代测量理论逐渐应用于大规模考试领域。文章运用多元概化理论对自学考试课程《英语水平考试（一）笔试》试卷的测量信度、试卷总分合成、及格线决策信度、试卷结构优化等问题进行探讨。研究发现：本次考试的测量信度较高;各分测验对全域总分的方差贡献比例与试卷赋分意图基本一致;该试卷以60分作为及格线具有较高的决策信度;将各分测验题量同时增至15题或单独将词汇分测验题量增至20题,可有效提高测量信度。     

A Comparison of Alternative Matching Strategies for DIF Detection in Tests That Are Multidimensional

Most currently accepted approaches for identifying differentially functioning test items compare performance across groups after first matching examinees on the ability of interest. The typical basis for this matching is the total test score. Previous research indicates that when the test is not approximately unidimensional, matching using the total test score may result in an inflated Type I error rate. This study compares the results of differential item functioning (DIF) analysis with matching based on the total test score, matching based on subtest scores, or multivariate matching using multiple subtest scores. Analysis of both actual and simulated data indicate that for the dimensionally complex test examined in this study, using the total test score as the matching criterion is inappropriate. The results suggest that matching on multiple subtest scores simultaneously may be superior to using either the total test score or individual relevant subtest scores.     

Elevated picture completion scores: a possible indicator of hypervigilance in maltreated preschoolers

OBJECTIVE: The Picture Completion subtest of the Wechsler Preschool and Primary Scales of Intelligence-Revised (WPPSI-R) measures visual alertness and the ability to differentiate essential from nonessential details. In children who are hypervigilant as a result of maltreatment, these skills may be over-functioning. It was hypothesized that the Picture Completion subtest scores of these children would be significantly elevated in comparison to their other nonverbal scores and their overall intellectual functioning. METHOD: Fourteen children from a therapeutic day treatment preschool program for maltreated children were administered the WPPSI-R. Standardized discrepancy scores between Picture Completion scores and Performance mean scores (PC-Performance Discrepancy) and the mean of all subscale scores (PC-Overall IQ Discrepancy) were formed and then analyzed. RESULTS: The abused preschoolers scored significantly lower than the population mean on four of the five WPPSI-R Performance subscales. Only on Picture Completion did they score significantly higher. Average PC-Performance Discrepancy and PC-Overall IQ Discrepancy scores were greater than one, indicating that the mean difference of children's Picture Completion score from either their Performance mean score or all of their mean scores was more than one standard deviation. CONCLUSION: Elevated Picture Completion score may serve as a marker for hypervigilance and/or PTSD in children with histories of maltreatment.     

Test reviews

The WISC‐III and WPPSI‐R are both recent additions to the assessment scene. Each revised battery is technically excellent, and has several features that enhance its usefulness for gifted children: a very representative standardization sample; successful efforts to provide adequate “top” on all subtests, except at the oldest ages for which each battery is intended; and elimination of biased items. However, both revised tests place an unusually high premium on speed of responding, which may substantially affect gifted children's IQs. In addition, subtest stability tends to be low for both tests, hindering profile interpretation. Overall, both tests should make useful contributions to gifted assessment.     

Oral language facility,verbal intelligence and performance on tests of psycholinguistic ability

The performance of 152 children in the age range 7 years 5 months to 7 years 11 months on a battery comprising the Illinois Test of Psycholinguistic Abilities (ITPA), the English Picture Vocabulary Test 2 (EPVT), a test of auditory discrimination, a sentence repetition test and an orally administered verbal intelligence test was compared with the complexity and fluency of spoken language recorded from each child. Only a moderate correlation was found between the ITPA total score and the length‐complexity index (LCI) from the language samples. Moderate correlations were found between the LCI and several auditory‐vocal channel subtests from the ITPA; however, with the influence of verbal intelligence partialled out most of these were reduced to low or nonsignificant levels. The scores from the Manual Expression subtest in the visual‐motor channel were found to correlate as highly with LCI as did the ITPA total score.

This relationship was maintained to two situations, (i) when the factor of verbal intelligence was controlled statistically, (ii) when a sub‐sample of subjects within a narrow IQ range was selected for separate analysis. The Verbal Expression subtest also showed moderate correlation with LCI in four out of five analyses, thus lending support to the “process” construct in the ITPA model. No connection was found between any of the psycholinguistic subtests and fluency of language production. The validity of the ITPA as a test of oral language performance was questioned.     

A comparison of the PPVT-R and WISC-R with rural children referred for assessment

The present study investigated the relationship between the Revised Peabody Picture Vocabulary Test (PPVT-R) and the WISC-R for a naturally occurring sample of rural children referred for assessment (N = 53). The results indicated that the PPVT-R was highly correlated with WISC-R scale and subtest scores. Examination of a sub-sample of developmentally handicapped students revealed substantial reduction in correlational relationships as a function of reduced sample size and restricted range of general ability. While the PPVT-R was found to underestimate all three WISC-R scale scores, the discrepancy between the PPVT-R standard scores and the WISC-R Performance Scale score was the only statistically significant underestimation. Results are discussed in terms of prior research findings and implications for interpretation.