Erfassung von Schülerselbsteinschätzungen zum schulbezogenen Sozial- und Lernverhalten – Validierung der Schülereinschätzliste für Sozial- und Lernverhalten (SSL)

The Self-Report Checklist for Social and Learning Behaviour (SSL) is a student questionnaire comparable to the Teacher Report Checklist for Social and Learning Behaviour. The SSL assesses ten facets of social and learning behaviour using self-reports by students. The present study of 1267 students aged 9 to 19 years examines the factorial structure, psychometric properties and validity of this questionnaire. The reliabilities (Cronbach’s Alpha, retest) of all ten scales were sufficiently good and the postulated factorial structure was found in exploratory as well as in confirmatory factor analysis. Correlations of SSL-scales with scales of the Differencial Aggression Questionnaire and the Strengths and Difficulties Questionnaire as well as with grades in German and mathematics indicated mainly convergent and divergent validity. Furthermore, positive correlations were found to corresponding teacher ratings.     

Measuring procrastination: Psychometric properties of the Norwegian versions of the Irrational Procrastination Scale (IPS) and the Pure Procrastination Scale (PPS)

Procrastination has been defined in different ways. Two instruments—the Irrational Procrastination Scale (IPS) and the Pure Procrastination Scale (PPS)—focus on a core problem in procrastination—the irrational delay of intended behavior. The present paper examined the psychometric properties of the Norwegian translations of these scales. In five samples with students as well as non-students (aggregated n?=?1045), standard psychometric properties of the instruments were assessed and their factor structures were compared in replication analyses. In addition, correlations between the instruments as well as other instruments (i.e., the Susceptibility to Temptation Scale and the Satisfaction with Life Scale) were examined to determine convergent and divergent validity. Overall, the results indicated that both IPS and PPS are suitable for use as measures of procrastination.     

Convergent validity of the BASC and SSRS: Implications for social skills assessment

The present study examined the psychometric relationship between two new rating scales, the Behavior Assessment System for Children (BASC; Reynolds & Kamphaus, 1992) and the Social Skills Rating System (SSRS; Gresham & Elliott, 1990), for a sample (N = 53) of minority kindergarten children using both parent and teacher ratings. The similarities and differences between these instruments were investigated through correlational and content analyses. In general, the results provide preliminary convergent validity evidence for the BASC and SSRS. In regard to the Social Skills subscale of the BASC, convergent validity evidence was demonstrated for the parent form of this instrument, but not the teacher form, when the SSRS Social Skills scale was used as the criterion. In addition, the correlations between the various scales of the BASC and SSRS were in the expected direction. That is, the correlation between the BASC Adaptive Skills Composite and the SSRS Social Skills scale was moderate in the teacher group (r = .44) and high in the parent group (r = .54). Similarly, correlations between the BASC Hyperactivity, Aggression, and Externalizing scales and the SSRS Problem Behaviors scale ranged from .50 to .60 and .50 to .56 in the teacher and parent groups, respectively. Implications regarding the practical utility of the BASC and SSRS for assessing social skills functioning, in particular, were presented. © 1996 John Wiley & Sons, Inc.     

Development and Validation of an Instrument for Assessing Distance Education Learning Environments in Higher Education: The Distance Education Learning Environments Survey (DELES)

The purpose of this study was to develop and validate a new learning environments instrument designed to aid investigators and practitioners in measuring and researching the psychosocial learning environment in post-secondary distance education. Using a three-stage approach, the Distance Education Learning Environments Survey (DELES) was developed, field-tested with 680 distance education students, and then validated. The DELES has 34 items allocated to six scales: (1) Instructor Support; (2) Student Interaction and Collaboration; (3) Personal Relevance; (4) Authentic Learning; (5) Active Learning; and (6) Student Autonomy. An additional scale of Enjoyment was included in this study to explore associations between the psychosocial learning environment and student affective traits. Each learning environment item had a factor loading of at least 0.50 with its own scale, and less than 0.50 with all other scales. The alpha reliability coefficient for each scale ranged from 0.75 to 0.94. Simple correlations between Enjoyment and the DELES scales ranged from 0.12 to 0.31, with the scale of Personal Relevance having the strongest correlation with Enjoyment when all other scales were mutually controlled. The DELES, an online instrument that can be utilized by students at any location, eliminates data transfer errors and does not allow for non-responses, adding to the overall validity of the instrument. The development of DELES relied extensively on literature pertaining to high-quality distance education and expert content validation techniques. It treats distance learning as having a distinct social-psychological climate unlike those found in other post-secondary classroom environments.     

State and trait goals of achievement and well-being: structure,validity, and stability

Both school achievement goals (mastery, performance approach, performance avoidance goals) and well-being goals (work avoidance, affiliation goals) are important predictors of learning and achievement related outcomes. However, disagreement exists regarding the definition of goals as relatively stable traits versus situational states that react sensitive to contexts. This paper presents the development of an inventory for the assessment of students’ multiple state and trait goals. In Study 1, students (N?=?196) answered the trait items. The results of an exploratory factor analysis indicated the construct validity of the goals. In Study 2, students completed trait and state scales in different weeks (N?=?542) and repeatedly after 12 weeks each. Confirmatory factor analyses as well as correlations with state and trait reference constructs confirmed the convergent and differential validity of both the trait and the state goal factors. The instrument offers a brief, reliable, and valid measure of multiple state and trait goals. Latent state trait analyses revealed that some state goals are surprisingly robust against situational influences and equally stable across time as corresponding trait goals, whereas other goals are more dependent on the learning situation.     

Convergent and discriminant construct validity of the internalizing symptoms scale for children with the BASC‐SRP‐C

This brief report details a study of the construct validity of the Internalizing Symptoms Scale for Children (ISSC) in comparison with the Child Self‐Report Form of the Behavioral Assessment System for Children (BASC). Using self‐reports of 121 students ages 8–12 from general education classes, who were administered both measures, correlational data were obtained between the scores of the two instruments. ISSC factor and total scores were found to have weak associations with the BASC School Adjustment Scales, and negatively associations with the BASC personal adjustment scales, providing discriminant evidence of the construct validity of the ISSC. Moderate to strong correlations were found between ISSC scores and the BASC Clinical Maladjustment, Other Problems, and Emotional Symptoms Index scores, evidencing convergent construct validity between the two measures. These results support the validity and clinical use of the ISSC as a measure of internalizing symptoms and emotional problems. © 2003 Wiley Periodicals, Inc. Psychol Schs 40: 139–144, 2003.     

Development of the Transferable Learning Orientations tool: providing metacognitive opportunities and meaningful feedback for students and instructors

This study encapsulates the development and testing of the Transferable Learning Orientations (TLO) tool. It is a triangulated measure built on select scales from the Motivated Strategies for Learning Questionnaire (MSLQ), together with multiple-choice items adapted from the lifelong learning VALUE rubric, and an open-ended response for each dimension. Select scales from the MSLQ were tested in a range of undergraduate courses, and the TLO (version one) was developed and piloted in a first-year engineering course. Minor refinements were made, and the TLO (version two) was retested with second-year undergraduates. The TLO is designed to engage students in meta-cognitive processes and provide meaningful feedback to students. The dimensions are outcome motivation, learning belief, self-efficacy, transfer and organisation. Results from the second-year group were more consistent and reliable than the first-year group, suggesting that context is an important factor. The scales demonstrate acceptable reliability, and the moderate correlations between scale scores and rubric ratings provide support for concurrent validity. We recommend the TLO be tested with broader populations to confirm psychometric properties and that it be implemented longitudinally to investigate the development of learning skills and changes in orientations over time.     

Students' Evaluations of University Teaching: A China Perspective

This study investigates the applicability of two American instruments, designed to assess students' evaluations of teaching effectiveness, to university students in China. Based on the responses of 367 Chinese undergraduates, the results indicated that the scales had high internal consistency reliability coefficients and the items were generally considered appropriate and clearly distinguished between good and poor lecturers. Moreover, every item was deemed important by at least some of the students. Further analysis lent support to the convergent and discriminant validities of the scales hypothesised to measure similar or dissimilar components of teaching effectiveness. However, this analysis and factor analytic findings did indicate more overlap among aspects of Learning/Value, Organisation/Clarity, Enthusiasm, and Breadth of Coverage, than that found in Western studies. Hence, this study only provided partial support for the cross‐cultural validity of the two instruments and the multidimensional model of teaching effectiveness on which they were based.     

Felder and Silverman's Index of Learning Styles and Honey and Mumford's Learning Styles Questionnaire: How do they compare and do they predict academic performance?

Samples of engineering and business students at undergraduate, postgraduate and post-experience levels at two UK universities completed the Index of Learning Styles (ILS) (N = 284) or the (Learning Styles Questionnaire LSQ) (N = 182) and a biographical data questionnaire. Broad psychological aspects of the two learning style instruments are examined and compared. Psychometric properties of the instruments, including factor structure, internal reliability and inter-scale correlation are analysed. Potential limitations are commented on, in particular those related to the construct validity and relatively low internal reliability of the ILS scales (alpha = 0.41 to 0.65). These compare with alphas of 0.59 to 0.74 for the LSQ. Relationships between the scales are discussed and a circumplex arrangement of the LSQ is proposed. Proposals for augmenting the circumplex are made. Academic performance results and scores on each of the two instruments are compared. The general lack of significant correlations between learning style scores and performance in these samples is discussed. Conclusions are drawn about the disappointing psychometric robustness of the measures, the activity-centred nature of learning styles and the advantages of viewing styles as a circumplex.     

CONVERGENT AND DISCRIMINANT VALIDATION OF MEASURES OF PERSONAL NEEDS1

The criteria of convergent and discriminant validation proposed by Campbell & Fiske (1959) were applied to a multitrait-multimethod matrix constructed from the intercorrelations of 15 need scales found in the Adjective Check List (ACL), the Edwards Personal Preference Schedule (EPPS), and a normative modification of the EPPS (N-EPPS). The evidence, based upon 131 male and female college freshmen, supported the convergent and discriminant validity of the 15 needs when the two forms of the Edwards inventory were compared. When these two instruments were compared with the ACL, the criteria of convergent and discriminant validity were met, but only to a minimal extent.     

Validation of the Metacomprehension Scale

Evidence for the factorial, convergent and discriminant, and criterion-related validity of the Metacomprehension Scale (MCS) was examined in a sample of 237 young adults. The instrument was factorially heterogeneous but exhibited homogeneity within each of the seven subscales. Evidence for the convergent and discriminant validity of the MCS was examined by correlating the subscales from the MCS with subscales from metacognitive questionnaires measuring similar constructs from related domains. In general, correlations within constructs were larger than correlations between constructs, providing preliminary evidence of the convergent and discriminant validity of the MCS. The criterion-related validity of the MCS relative to other metacognitive measures was examined by using the metacognitive measures and the MCS to predict comprehension performance. The MCS predicted performance better than the other measures of metacognition and accounted for variance in performance not accounted for by the other measures. These results show promise for the value of self-assessments of metacomprehension.     

Teacher log of students’ opportunity to learn and classroom observation: an initial investigation of convergence

Educational Assessment, Evaluation and Accountability - The present study investigated the convergent validity of the Instructional Learning Opportunities Guidance System (MyiLOGS; Kurz and Elliott...     

How specific is specific self-efficacy? A construct validity study using Rasch measurement models

Self-efficacy is an important and much used construct in psychology and social science studies. The validity of the measurements used is not always sufficiently evaluated. The aim was to evaluate the psychometric properties of the Danish translation of the self-efficacy subscale of The Motivated Strategies for Learning Questionnaire (MSLQ-SE) within a higher education context. Rasch measurement models were employed focusing on measurement invariance and dimensionality. Results with one students sample showed the MSLQ-SE to be not one, but two separate unidimensional subscales, measuring specific academic learning self-efficacy (SAL-SE) and specific academic exam self-efficacy (SAE-SE), each scale being measurement invariant relative to age, Gender, admission method and specific course targeted. Furthermore, significant and relevant differences between the SAL-SE and SAE-SE scores dependent on university and admission method were found, and these results were replicated with two further samples. The SAL-SE and SAE-SE scales hold promise for more detailed studies of student self-efficacy.     

Validity of the home and community social behavior scales: Comparisons with five behavior‐rating scales

Three separate studies focusing on convergent and discriminant validity evidence for the Home and Community Social Behavior Scales are presented. The HCSBS is a 65‐item social behavior‐rating scale for use by parents and caretakers of children and youth ages 5–18. It is a parent‐rating version of the School Social Behavior Scales. Within these studies, relationships with five behavior‐rating scales were examined: the Social Skills Rating System, Conners Parent Rating Scale–Revised‐Short Form, Child Behavior Checklist, and the child and adolescent versions of the Behavior Assessment System for Children. HCSBS Scale A, Social Competence, evidenced strong positive correlations with measures of social skills and adaptability, strong negative correlations with measures of externalizing behavior problems, and modest negative correlations with measures of internalizing and atypical behavior problems. HCSBS Scale B, Antisocial Behavior, evidenced strong positive correlations with measures of externalizing behavior problems, modest positive correlations with measures of internalizing and atypical behavior problems, and strong negative correlations with measures of social skills and adaptability. These results support the HCSBS as a measure of social competence and antisocial behavior of children and youth. © 2001 John Wiley & Sons, Inc.     

Informing context and change in young children's sociobehavioral development – The national Adjustment Scales for Early Transition in Schooling (ASETS)

This article recounts the design and validity evidence for contextually-specific measures of early childhood social and behavioral adjustment within school using the Adjustment Scales for Early Transition in Schooling (ASETS). Through primary analyses of data from the Head Start Impact Study, a representative nationwide sample (N = 3077) of randomly selected children from low-income families was used to inform developmental-transitional stability and change in adjustment across numerous school contexts. Longitudinal exploratory and confirmatory factor analyses yielded reliable and temporally continuous behavioral dimensions assessing the pervasiveness of Peer, Learning, and Teacher Context Problems. Each context dimension was equated vertically through IRT, with Bayesian scoring across two years spanning prekindergarten through 1st grade. Multilevel modeling provided support for the concurrent validity of ASETS contextual scales and their ability to assess future risk of academic and behavioral problems. ASETS scales are also shown to reveal differential, contextually-based, change trajectories across four years of early school transition.     

Convergent and discriminant validity of the mental processing scales of the Kaufman Assessment Battery for Children

Convergent and discriminant validity of the Mental Processing Scales of the Kaufman Assessment Battery for Children (K-ABC) were examined using 51 first-grade children. Convergent validity was assessed using the Reading Recognition and Comprehension subtests of the Peabody Individual Achievement Test. Discriminant validity was assessed using a measure of anxiety/self-esteem, the Child Anxiety Scale, and a measure of hyperactive behavior, the Hyperactivity scale of the Achenbach Child Behavior Checklist. Results supported the convergent validity of the K-ABC; correlations with reading achievement were fairly large. The discriminant validity received only partial support. The K-ABC did not correlate with the Child Anxiety Scale, but did show rather large correlations with the measure of hyperactive behavior. Implications for understanding what the K-ABC Mental Processing Scales are measuring are discussed.     

Assessing Teachers’ Attitudes Towards Students with Mental Health Disorders in 16 Postsecondary Institutions in Quebec

The number of students with mental health disorders (MHDs) in postsecondary institutions is increasing. Teachers’ attitudes are among the main factors that influence these students’ academic success. Unfortunately, their attitudes are little studied, in part because of lack of validated scales. Therefore, this article has two purposes: (1) analyse the construct validity of new scales assessing teachers’ attitudes, as well as existing scales without an established construct validity; and (2) report the correlations between the variables assessed in these scales, with a special focus on two variables: (a) teachers’ negative attitudes; and (b) the measures offered to students by teachers. The participants are 232 teachers from 16 French and English CEGEPS in Quebec, Canada. The questionnaire includes three scales created by the research team and three scales from the Mental Illness Awareness Survey. Correlational and factor analyses were conducted. The scales present good construct validity. Four variables were associated with the two variables of interest: confidence in one’s ability to convince a student to seek help; familiarity with MHDs; knowledge and understanding of MHDs; favourable perception of the accommodations offered by adapted and psychosocial services. Based on these results, strategies are proposed to improve teachers’ attitudes.     

Convergent and Divergent Thinking,Test-Anxiety,and Curiosity

Interrelationships between two motivational variables, test-anxiety and curiosity, and two cognitive variables, convergent and divergent thinking were tested using the measures of convergent and divergent thinking of J. P. Guilford and two self-report true-false scales of test-anxiety and curiosity. Ss were 212 undergraduates, 175 female and thirty-seven male. Based on findings and implications from earlier research, negative relationships of convergent and divergent thinking with test-anxiety, and positive relationships with curiosity were predicted. All correlations for the total group were found to be significant at the .05 level, those with anxiety higher than those with curiosity. Thus, there was support for the view that test-anxiety is negatively related and curiosity positively related to both convergent and divergent thinking. The results were discussed in terms of previous research, and educational implications.     

Associations Between Classroom Environment and Academic Efficacy

Research was conducted on associations between classroom psychosocial environment and academic efficacy. A sample of 1055 mathematics students from Australian secondary schools responded to an instrument that assessed ten dimensions of mathematics classroom environment (viz. Student Cohesiveness, Teacher Support, Investigation, Task Orientation, Cooperation, Equity, Involvement, Personal Relevance, Shared Control, Student Negotiation). These scales were from two existing instruments, namely, What Is Happening In This Classroom? (WIHIC) and the Constructivist Learning Environment Survey (CLES). A seven-item scale assessed students' academic efficacy at mathematics-related tasks. Simple and multiple correlation analyses revealed statistically significant correlations between these classroom environment dimensions and academic efficacy. Results showed that classroom environment relates positively with academic efficacy. A commonality analysis showed that the three scales from the Constructivist Learning Environment Survey scales did not contribute greatly to explaining variance in academic efficacy beyond that attributed to the seven scales in the What Is Happening In This Classroom? questionnaire.     

Reliability and validity of the Learning Styles Questionnaire

The reliability and predictive validity of a short form of Honey and Mumford's Learning Styles Questionnaire were examined. Students' learning preferences were measured by self-report ratings on their degree of likings for 19 teaching and learning activities commonly used in higher and professional education. Subjects were 381 second-year undergraduates enrolled in accountancy, engineering and communication programmes at the Hong Kong Polytechnic. The alpha coefficients for the four learning styles scales were quite low, ranging from 0.311 for the Pragmatist scale to 0.421 for the Reflector scale. Factor analysis of the items did not reveal any coherent factor structure congruent with the underlying constructs. However, significant though weak correlations were found between the learning styles scores and the learning preferences of the students as hypothesised.