The construct validity of the career decision-making system cross-culturally

These findings suggest that the cultures studied have present work models where-by crafts, scientific, artistic, social, business enterprise, and business detail interests can develop. If these six interest factors are valid within these cultures, it also suggests that vocational interests can be validly measured through Holland based scales and the Holland theory of vocational development can be a relevant cross-cultural theoretical orientation for career planning. The research supports the construct validity of the Career Decision-Making System.     

Note on the construct validity of the ITPA

Correlations with Binet IQ in the ITPA normative sample were corrected for restricted intelligence range. The corrected correlation for the Psycholinguistic Quotient is as high as that between the WISC and the Binet, a finding that raises a serious question about the construct validity of the ITPA.     

Predictive and construct validity of the developing cognitive abilities test: Relations with the iowa tests of basic skills

This study investigated the predictive and construct validity of the Developing Cognitive Abilities Test in a heterogeneous sample of 863 sixth grade students. Level H of the DCAT was administered during the student's sixth grade year and selected subtests of the Iowa Tests of Basic Skills were administered eight months later during their seventh grade year. Results showed that correlations between the DCAT and Iowa Tests of Basic Skills ranged from .50 (DCAT Spatial‐ITBS Language Usage) to .74 (DCAT Total‐ITBS Mathematics Problem Solving) with a median r= .635. Correlations also supported the construct (convergent) validity of the DCAT when compared to the ITBS with the DCAT Verbal subtest correlating significantly higher with the ITBS Vocabulary, Reading, and Language Usage than either the DCAT Quantitative or Spatial subtests which are not as verbally oriented. The DCAT Quantitative subtest was associated with the ITBS Mathematics Problem Solving to a greater extent than either the DCAT Verbal or Spatial subtests. © 2000 John Wiley & Sons, Inc.     

Structural and convergent validity of the homework performance questionnaire

Homework is a requirement for most school-age children, but research on the benefits and drawbacks of homework is limited by lack of psychometrically sound measurement of homework performance. This study examined the structural and convergent validity of scores from the newly developed Homework Performance Questionnaire – Teacher Scale (HPQ-T). Participants were 112 teachers of 224 students in six Illinois school districts. Common factor analysis with principal axis extraction and promax rotation was used for data analysis. Results revealed three salient factors: Parent support, student competence and homework completion. Subsequently, convergent validity of HPQ-T subscale scores with subscale scores from the Learning Behaviours Scale was examined. Findings suggest that the HPQ-T may potentially be a useful tool for improving research on homework and identifying strengths and weaknesses in student homework performance. However, modifications are recommended to optimise the utility of the scores.     

交际英语口语测试的结构效度

口语测试是交际测试的重要组成部分,其目的是为了测试出受试者的口语语用能力。交际英语口语测试的结构概念是受试者在真实语境下口语交际能力。根据有效的交际理论设计口语测试,并保证口语测试能体现结构效度是口语测试设计者要完成的首要课题。本文通过分析交际英语口语测试的理论基础,提出了一些基本的实现口语测试结构效度的途径。     

The reliability and construct validity of ratings for the autism behavior checklist

The reliability and construct validity of ratings for the Autism Behavior Checklist were examined with a sample of 198 children diagnosed with autistic disorder and conditions often confused with autism. Alpha coefficients for the five scales of the ABC as well as the Total Score were reported and the factor structure of the ABC was examined through confirmatory factor analysis. The results of the reliability analyses indicated that the Total Score alpha coefficient of the ABC was adequate for screening purposes, but the reliabilities of the scales were not. Confirmatory factor analyses indicated some support for alternate four‐ and five‐factor models. © 2006 Wiley Periodicals, Inc. Psychol Schs 43: 129–142, 2006.     

The construct validity of Institutional Commitment: A confirmatory factor analysis

The present study examined the underlying structure of the variable Institutional Commitment by testing for the convergence, or lack thereof, among different indicators of the construct as represented by three theoretical frameworks (Tinto, 1975, 1987; Bean, 1985; Huselid and Day, 1991). Confirmatory factor analyses revealed that Institutional Commitment could be decomposed into two multiple indicators of the same latent construct: a general factor that groups items related to institutional quality, practical value of an education, utility of an education, fit between student and institution, and loyalty to the institution and another factor represented by items indicating similarity of values (Affinity of Values). Moreover, the study established the predictive validity of each subcomponent on different outcomes related to student persistence. While Institutional Commitment was found to have a significant direct effect on both students' intents to persist and actual persistence behavior, Affinity of Values was not as equally predictive of measures of student retention.Paper presented before the 1991 ASHE Annual Meeting. Boston, Massachusetts.     

The construct validity and predictive validity of a self-efficacy measure for student teachers in competence-based education

This study intends to investigate the validity of a self-efficacy measure which is developed for predictive and diagnostic purposes concerning student teachers in competence-based education. CFA results delivered converging evidence for the multidimensionality of the student teacher self-efficacy construct and the bi-factor model as underlying structure, reflecting a teacher competence framework. Factor loadings of the bifactor model evidenced the theoretical assumption that incipient student teachers enter the programme with a global undifferentiated sense of teacher self-efficacy, having teaching experiences a further differentiation takes place to a partly differentiated sense of teacher self-efficacy. Logistic regression analysis revealed that the measure succeeds in predicting students’ first-year outcomes and delivered evidence for the diagnostic value of the scale.     

An empirical study of the construct validity of social creativity

Creativity can be broadly defined as a combination of interacting individual and environmental resources leading to the production of valuable solutions. This paper concentrates on the type of creativity that can be expressed in solving social problems. After reviewing the potentially relevant psychological and contextual variables intervening in social creativity, leading to individual differences in this capacity, we present results of a study testing the nomological validity of social creativity in a group of 70 pre-adolescents. The findings indicate that social creativity performance is linked with socially relevant variables such as social competencies, popularity, and parenting style. Finally, we discuss the relevance of a creativity approach in social domains such as violence prevention programs and education.     

Torrance Test of Creative Thinking: The question of its construct validity

Some cognitive dimensions are internationally considered by psychologists to describe and to assess creativity. For example, (Guilford, P. (1976). Creatividad y Educación. Buenos Aires. Ed. Paidos) and (Torrance, E. P. (1977). Discovery and nurturance of giftedness in the culturally different. Reston, VA: Council on Exceptional Children) suggested fluency, flexibility, originality and elaboration are the main cognitive processes used to define and assess creativity. However, data from several empirical studies did not confirm a factor structure in accordance with such cognitive functions, despite of the wide use of TTCT (Torrance Tests of Creative Thinking) in different countries. In this paper, we present new data collected in Spain and Portugal with TTCT. According to our data, those cognitive functions supposedly present on a subject's performance are not so strong as to explain the variance in scores. Elaboration factors assume some variance explanation, but the main factors are identified with the products in each subtest, suggesting the importance of format, content and demand on TTCT specific tasks. Consequently, we suggest some reflections to amplify the debate concerning the definition of creativity and its evaluation in psychology.     

Pathways to understanding mind: construct validity and predictive validity of maternal mind-mindedness

The construct validity of maternal mind-mindedness (MM) was investigated in the context of its relations with children's later understanding of mind. MM measures were obtained from infant-mother (N = 52) interactions at 6 months, and from maternal interviews at 48 months. Children's understanding of mind was assessed using theory of mind (ToM) tasks at 45 and 48 months, and a stream of consciousness (SoC) task at 55 months. One of the early MM measures--mothers' appropriate mind-related comments--was a positive independent predictor of: (a) MM at 48 months, and (b) ToM and SoC performance at 45 to 55 months. Path analyses suggested direct links between mothers' use of appropriate mind-related comments and children's later understanding of mind.     

Content,concurrent and construct validity of the leadership skills inventory

The Leadership Skills Inventory was designed to assist students at the upper‐elementary, secondary, and post‐secondary levels in analyzing the strength of their leadership skills. This study was a subsidiary analyses of the research of Edmunds & Yewchuk (1996) to examine the content, concurrent and construct validity of the LSI. The results of a critical semantic comparison indicate support for content validity. Concurrent validity was supported statistically significant positive correlations between the LSI and all other leadership indicators. Interestingly, all nine categories of the LSI had statistically significant positive correlations with each other. Factor analysis revealed that the LSI contained only one factor, not nine as the separate categories infer. This supports the construct validity of the LSI, but as having only one construct, not nine as the categories suggest. There appears to be merit in using the LSI as a leadership indicator. However, further research is needed to improve its psychometric qualities.     

An assessment of the construct validity of the CCSEQ Quality of Effort scales

A substantial body of research indicates that the greater the effort and time expended by students in the opportunities afforded by their colleges, the greater the likelihood of academic and personal growth, satisfaction with the institution, and persistence within the educational system. The most extensive effort exerted in operationalizing the concepts of involvement and integration was that of C. Robert Pace in his development of theCollege Student Experiences Questionnaire, which was the basis for the development of theCommunity College Student Experiences Questionnaire (CCSEQ). This study examines the construct validity of the eight Quality of Effort scales resulting from the CCSEQ for students involved in all administrations of the instrument from 1990 through 1994. Results indicate that the Quality of Effort measures can be used to make valid and reliable inferences regarding students' efforts and involvement, and that the validity of the inferences is not conditional on whether the students are in vocational or transfer programs, attending full-time or part-time, or of majority or minority ethnic status.     

Differences in memory retrieval: a construct validity investigation

Long-term memory retrieval efficiency was investigated as a potential underlying source of individual and developmental differences in cognitive functioning. Fourth-grade, eighth-grade, and college-aged subjects participated in a task using the Posner letter-matching paradigm. Letter pairs were presented simultaneously under physical-match and name-match instruction conditions. Reaction times were used to estimate parameters of long-term memory retrieval efficiency, basic encoding, decision, and response time, and name and physical output interference. Psychometric tests of verbal and spatial ability were included to assess convergent and discriminant validity of hypothesized relationships between aptitude test performance and basic cognitive processes. Developmental differences were observed in most but not all of the processing variables. Individual difference analyses indicated that less confounded estimates of processing parameters were not systematically related to verbal ability at any age level. Basic encoding and response speed was the most consistent correlate of spatial ability. The results suggest difficulties in previous interpretations of NIPI-verbal ability relationships. The study of cognitive processes in interaction and embedded in meaningful tasks is discussed.     

An investigation of the construct validity of the personality trait of self-directed learning

Based on samples of 398 middle school students, 568 high school students, and 1159 college students, self-directed learning was found to be related to cumulative grade-point-average at all levels as well as to Big Five personality traits (Openness, Conscientiousness, Emotional Stability, and Extraversion), narrow personality traits (Optimism, Career-Decidedness, Work Drive, and Self-Actualization), vocational interests (Realistic, Investigative, Artistic, and Conventional, as well as Science, Medicine, and Mathematics), cognitive aptitudes, and life as well as college satisfaction. Based on an additional sample of 4125 college students, a confirmatory factor analysis was used to verify a single factor structure for our 10-item measure of self-directed learning. Results were discussed in terms of personality characteristics of self-directed learners, the trans-situational validity of self-directed learning in academic settings, multiple forms of evidence of the construct validity of self-directed learning, and implications for future research and practice.     

Assessment of teacher competence using video portfolios: Reliability, construct validity, and consequential validity

The richness and complexity of video portfolios endanger both the reliability and validity of the assessment of teacher competencies. In a post-graduate teacher education program, the assessment of video portfolios was evaluated for its reliability, construct validity, and consequential validity. Although video portfolio facilitated a reliable and valid assessment of teacher competencies, procedures to improve assessment quality were also revealed and are therefore discussed: more explicit grounding of assessment results in the data, peer debriefing, prolonged engagement with the assessment data, cross-checking to find confirmatory or counter examples.     

An empirical examination of the construct validity of goal commitment in the persistence process

This study represents the first published investigation into the construct validity of goal commitment as it affects the persistence process. Confirmatory factor analyses revealed that goal commitment could be decomposed into multiple indicators of the same latent construct: a special factor called goal commitment that groups items related to goal importance, specificity of goals, and situational influence; a second factor represented by items indicating certainty of purpose; and a third factor consisting of items related to goals in general. The predictive validity of each subcomponent on different outcomes related to student persistence was established. While goal commitment was found to have a significant direct effect on both students' intents to persist and actual persistence behavior, neither of the other two factors were as equally predictive as measures of student retention.     

Applying methods to evaluate construct validity in the context of A level assessment

Validity is a central principle of assessment relating to the appropriateness of the uses and interpretations of test results. Usually, one of the inferences that we wish to make is that the score reflects the extent of a student’s learning in a given domain. Thus, it is important to establish that the assessment tasks elicit performances that reflect the intended constructs. This research explored the use of three methods for evaluating whether there are threats to validity in relation to the constructs elicited in international A level geography examinations: (a) Rasch analysis; (b) analysis of processes expected and apparent when students answer questions; and (c) qualitative analysis of responses to items identified as potentially problematic. The results provided strong evidence to support validity with regard to the elicitation of constructs although one question part was identified as a threat to validity. Strengths and weaknesses of the methods can be identified.