The concept map as a research and evaluation tool: Further evidence of validity

This study sought further evidence of the concurrent validity of concept mapping as a research and evaluation tool in science education. Specifically, the study examined the extent to which differences exist in the concept maps of advanced college biology majors (N = 25) and beginning nonmajors (N = 25) in the domain of mammals. Furthermore, it explored whether these differences are reflected in the way subjects assign class membership as revealed in a card sorting task. The results indicate that concept maps of biology majors are structurally more complex than those of nonmajors and that differences in the structural complexity and organizational patterns depicted in concept maps are reflected in the underlying dimensions used to assign class membership. Together, these findings suggest that the concept map provides a theoretically powerful and psychometrically sound tool for assessing conceptual change in experimental and classroom settings.     

Factor structure of intellectual and achievement measures for learning disabled children

The purpose of this study was to explore the factor structure of intelligence and achievement for learning disabled children. WISC-R, PIAT, and WRAT scores of 183 male, learning disabled students were factor analyzed. A factor structure was obtained. The factors were identified as: (a) language achievement, (b) perceptual organization, (c) verbal educative, and (d) mathematical achievement. These findings suggest that intelligence and achievement are composed of similar traits and skills. Therefore, comparison of individual achievement test scores with traditional Verbal, Performance, or Full Scale intelligence for learning disabled children may not be logical, since analysis of these tests reveals factorially complex skills.     

Further evidence supporting the validity of both a multidimensional profile and an overall evaluation of teaching effectiveness

The purpose of this research is to provide additional empirical evidence supporting the use of both a multidimensional profile and an overall evaluation of teaching effectiveness as valid indicators of student perceptions of effective classroom instruction. A factor analytic teaching evaluation instrument was used that also included open‐ended comments on four questions. Numerical scores from 208 classes were matched with the average valence of the open‐ended comments. It was found that the average valences were highly positively correlated with the numerical factor scores that make up the multidimensional profile of teaching effectiveness and with the second‐order factor that serves as an overall evaluation of teaching effectiveness. The implications of these results for the usefulness of student evaluations are discussed.     

Individual differences in speed of mental processing and human cognitive abilities: Toward a taxonomic model

Extensive research within the field of learning and individual differences focuses upon the relationship between general intelligence and process measures derived from elementary cognitive tasks (ECTs). This emphasis has ignored data indicating that cognitive abilities are best described by three levels (or strata). It has also been suggested that mental speed is a unitary construct, although it is more likely to have a complex structure. To address shortcomings evident in this literature, a multivariate investigation (N = 179) was conducted. Factor analysis of 25 psychometric indices gave seven factors postulated under the theory of fluid (G_f) and crystallized (G_c) intelligence. Correlations between cognitive abilities and parameters derived from 11 ECTs indicated that G_f (alone) was related to processing speed. This relationship is seemingly dependent upon experimental manipulations of task complexity. Regarding the factorial structure of mental speed, the results were unequivocal: Broad second-order factors may be derived from both ECTs and psychometric tests. These constructs are independent from abilities defined by accuracy scores and collectively define a general cognitive speed factor. Implications of these findings are discussed. It would appear that mental speed is more intricate than proposed, and that cognitive complexity (reflected in stimulus-response compatibility effects) plays a crucial role in its ontogenesis. In addition, several explanatory models linking intelligence to processing speed are untenable. It is likely that the search for a basic process of intelligence by means of mental speed frameworks (alone) is misguided.Recently, within the field of individual differences, there has been “an explosion of experimental studies into the speed of mental processes” (H.J. Eysenck 1995, p. 225). Various tasks, ranging from those paradigms assessing simple, psychomotor movements and on up through to measures of complex problem solving and psychometric test performance, have been employed (Stankov & Roberts 1997). The present study was designed to explore speed of processing constructs within a structural model of human cognitive abilities. Utilizing the evidence presented in Carroll's (1993) extensive reanalysis of the main data sets collected within the psychometric discipline this century, the structural model of cognitive abilities adopted is that known as the theory of fluid and crystallized intelligence (see Horn & Noll 1994; Stankov et al. 1995). In contrast, the mental speed measures selected for investigation in this study were chosen on the basis of both experimental and psychometric findings that rely on disparate accounts (e.g., information theory). Notably, mental speed constructs are not presently encapsulated within a single unifying model. Another major aim of the present study was to redress this imbalance by establishing a rapprochement between conceptual models of mental speed and human cognitive abilities.     

Factor structure of psychoeducational and neuropsychological measures of learning-disabled children

This study investigated the factor structure of psychoeducational and neuropsychological measures used in the assessment of learning-disabled children. The Wechsler Intelligence Scale for Children-Revised, the Halstead-Reitan Neuropsychological Battery, the Peabody Picture Vocabulary Test, and the Wide Range Achievement Test were administered to 934 males and females between the ages of 8 and 16 years. A principal-components analysis with varimax rotation indicated the existence of seven factors: Verbal Reasoning, Academic Achievement, Visual-Perceptual Organization, Developmental, Visual-Motor Speed, Spatial Memory, and Attention and Concentration. Three factors provided new information about the functioning of learning-disabled children that may need to be considered before comprehensive identification and placement decisions can be offered. Results of this study lend support to the notion of utilizing neuropsychological measures as an adjunct to traditional psychoeducational assessment.     

Factor structure of character strengths in youth: Consistency across ages and measures

The VIA Classification of Strengths and Virtues attempts to provide a comprehensive model of character based on 24 character strengths. The present study is the largest study to date exploring the structure of the 24 strengths in youth. One sample (N = 23,850) completed the VIA-Youth, a teen measure of the VIA Classification. Based on a random subsample, it was determined the data were best modeled using four factors. The remainder of the sample was used to demonstrate measurement invariance for the four-factor model across ages 10–17 and country. Comparison with 471 English academy school students who completed two alternate measures of the VIA Classification also demonstrated measurement invariance. The results suggest a four-factor model that includes two primarily interpersonal factors, one reflecting general engagement, the second other-directedness. Other factors involved intellectual and self-control strengths. Implications for the understanding of character strengths in youth versus adults are discussed.     

Articulating the validity evidence for a science alternate assessment

Students with the most significant cognitive disabilities (SCD) are the 1% of the total student population who have a disability or multiple disabilities that significantly impact intellectual functioning and adaptive behaviors and who require individualized instruction and substantial supports. Historically, these students have received little instruction in science and the science assessments they have participated in have not included age‐appropriate science content. Guided by a theory of action for a new assessment system, an eight‐state consortium developed multidimensional alternate content standards and alternate assessments in science for students in three grade bands (3–5, 6–8, 9–12) that are linked to the Next Generation Science Standards (NGSS Lead States, 2013 ) and A Framework for K‐12 Science Education (Framework; National Research Council, 2012 ). The great variability within the population of students with SCD necessitates variability in the assessment content, which creates inherent challenges in establishing technical quality. To address this issue, a primary feature of this assessment system is the use of hypothetical cognitive models to provide a structure for variability in assessed content. System features and subsequent validity studies were guided by a theory of action that explains how the proposed claims about score interpretation and use depend on specific assumptions about the assessment, as well as precursors to the assessment. This paper describes evidence for the main claim that test scores represent what students know and can do. We present validity evidence for the assumptions about the assessment and its precursors, related to this main claim. The assessment was administered to over 21,000 students in eight states in 2015–2016. We present selected evidence from system components, procedural evidence, and validity studies. We evaluate the validity argument and demonstrate how it supports the claim about score interpretation and use.     

Factor structure,reliability and validity of the Parental Support for Learning Scale: Adolescent Short Form (PSLS-AS)

Parental involvement in children’s learning has been found to influence academic success. However, very few tools exist for measuring parental involvement, particularly ones that target adolescents’ self-report. The present study assessed the factor structure, reliability and convergent validity of a new scale to assess adolescents’ perceptions of their mothers’ and fathers’ educational involvement: the Parental Support for Learning Scale: Adolescent Short Form (PSLS-AS). The PSLS-AS, as well as a questionnaire measuring the risk of high school drop-out, was administered to a sample of 825 youth (aged 13–14 years). Exploratory factor analysis revealed a two-factor structure representing parental involvement: Controlling Involvement and Autonomy Supportive Involvement. Adolescents’ perceptions of their parents’ involvement correlated with a risk of high school drop-out. Implications and future directions for further validation of the PSLS-AS are discussed.     

Factor structure of the Wallach-Kogan Tests of Creativity and measures of intelligence and achievement

The Wallach-Kogan Tests of Creativity were administered to 129 second-graders and fluency and uniqueness scores were computed for each of five subtests. Also, each subject was given the Primary Mental Abilities Test and three subtests from the IOWA Tests of Basic Skills. Factor analysis by the principal components method yielded two creativity factors, verbal and figural, that were independent of those defined by the intelligence and achievement measures. Thus, evidence was obtained for the construct validity of the Wallach-Kogan measures of creative thinking.     

Reliability and validity evidence for the EARLI literacy probes

The purpose of this study was to examine the reliability and validity of scores from six early literacy probes developed for use with preschool‐age children. The literacy probes were administered to 84 preschoolers at three time points over a 6‐month period. Also, a criterion measure of early literacy skills was administered to a subset of students. Results indicated that the probes demonstrate adequate reliability for screening decisions, moderate to strong concurrent relationships with a criterion measure, and developmentally appropriate changes in children's early literacy skills over time. These results add to the growing body of evidence supporting the technical adequacy of general outcome measurement for use in monitoring the progress of preschoolers' academic skill development. © 2009 Wiley Periodicals, Inc.     

Factor structure evidence for developmental levels of perceptual processing on the developmental test of visual-motor integration

Beery's Developmental Test of Visual-Motor Integration was individually administered to 193 school-age children. Test protocols were factor analyzed by a principal component solution. Four factors were obtained, indicating that the test does not measure a unitary dimension of perceptual-motor development, but rather four distinct levels or stages for the age range of children investigated. The structural features of the designs that make up the test were used to define the factors. It is argued that a more useful interpretation of performance on this test would be one that designates visualmotor processing in terms of levels, not age equivalents.     

Concurrent validity of new and revised conceptual language measures

This study examined the concurrent validity of several new and revised conceptual language measures. The Bracken Basic Concept Scale (BBCS), Boehm Test of Basic Concepts-Preschool Version (Boehm-PV) or Boehm-Revised (Boehm-R), and PPVT-R were administered to 99 preschool children (mean age = 5–2). The K-ABC Achievement Scale Composite (K-ABC ACH) was utilized as a criterion measure of achievement. The BBCS correlated significantly with the PPVT-R, and both correlated significantly and comparably with the Boehm-PV and Boehm-R. The BBCS, Boehm-R, and PPVT-R correlated significantly with K-ABC ACH. The BBCS proved significantly more difficult for children than did the Boehm-R, and the authors suggested variables that may have contributed to the discrepancy. The BBCS appears to be a valuable new measure of basic concept acquisition and would seem to hold a distinct advantage of allowing for repeated measurement with the same instrument across the preschool-early elementary school years.     

Evaluating existing and new validity evidence for the Academic Motivation Scale

The current study evaluates existing and new validity evidence for the Academic Motivation Scale (AMS; Vallerand et al., 1992). We first provide a narrative review synthesizing past research, and then conduct a validity investigation of the scores from the measure. Data analysis using a sample of 1406 American college students provided construct validity evidence in the form of a well-fitting seven-factor model and adequate internal consistency of the item responses. Convergent and discriminant validity evidence provided insight into the distinctiveness of the seven subscales. However, support for the scale’s simplex structure, which would represent the self-determination theory continuum, was not fully substantiated. Implications for theory and the scale’s use in the current form are discussed.     

Hypervideo for educational purposes: a literature review on a multifaceted technological tool

The term ‘hypervideo’ has different interpretations in the scientific literature. The aim of this contribution is to define hypervideo as it is and can be (more optimally) used for teaching and learning purposes. Videos can promote learning by recreating real experiences and dynamic processes, although they do not necessarily enable students to interact with contents and to self-regulate their learning. Hypervideos technically overcome these limitations and add further benefits. However, even though some literature on the topic exists, the concept of hypervideo is not well represented in the scientific community and lends itself to different interpretations. Results show that hypervideo is defined as a dynamic artefact, it should allow navigation control and include additional material; it could also integrate individual or collaborative annotation and automated or manual feedback. So far, most studies have been conducted in artificial settings involving tertiary-level students. Finally, its use is beneficial for students’ learning.     

Educational Achievement and the Disadvantage Factor: Empirical evidence

This study examines the relationship between social background factors and educational achievements. It draws on unique data from London LEAs. The paper illustrates detail analysis on levels of disadvantage in schools and the complexities of judging school performance including discussion on the potential of z-score indicators to measure the levels of deprivation in urban area schools. Overall, the findings from the empirical evidence suggests that there is a strong relationship between disadvantage and examination success, with LEAs located in non-deprived areas tending to obtain higher percentages 5 + A*-C good GCSE passes. Further analysis of the relationship between pupils background and school achievement also confirmed, by and large, that schools with a higher number of disadvantaged families do less well than schools where, a small proportion of their pupils come from disadvantaged families. The paper concluded that uncontextualised performance table is fundamentally flawed and argued for the need to compare like with like and move beyond league table approaches of comparing schools. Policy implications are highlighted as well as practical suggestions.     

大学生心理素质三维结构模型探析

问卷调查收集的实证数据和对心理素质基本涵义进行的理论分析表明,大学生的心理素质是由认知特性、个性和适应性构成的三维立体结构。其中,认知特性和个性维度共同构成大学生心理素质的基本平台或基本面,适应性维度则是认知特性和个性在大学生的社会生活环境中的综合表现。     

Convergent and concurrent validity of two measures of phonological processing

The purposes of this study were to determine the degree to which two measures of phonological awareness/ability (Test of Phonological Awareness; Comprehensive Test of Phonological Processing) correlate with each other and with a measure of reading (Letter‐Word Identification), and to determine which of the individual measures of phonological ability best predict early reading skill in kindergarten children. With one exception, all correlations among measures of phonological awareness/ability were significant. In addition, all correlations among the phonological awareness measures and the reading measure were significant. Multiple regression analyses revealed that the combination of all predictor variables accounted for approximately 51% of the variability in scores on the Woodcock Letter‐Word Identification subtest. The Phonological Awareness and the Rapid Naming composites of the CTOPP were the best predictors of performance on the measures of word identification. © 2002 Wiley Periodicals, Inc.