Sources of self-efficacy in mathematics: A validation study

The purpose of this study was to develop and validate items with which to assess A. Bandura’s (1997) theorized sources of self-efficacy among middle school mathematics students. Results from Phase 1 (N = 1111) were used to develop and refine items for subsequent use. In Phase 2 of the study (N = 824), a 39-item, four-factor exploratory model fit best. Items were revised to strengthen psychometric properties. In Phase 3 (N = 803), a 24-item, four-factor confirmatory factor model fit best. This final model was invariant across gender and ethnicity. Subscales correlated with self-efficacy, self-concept, mastery goals, and optimism. Results suggest that the sources scale is psychometrically sound and could be adapted for use in other domains.     

Validation of the Early Childhood Teacher Experiences Scale in Head Start

To address gaps in the availability of validated measures that assess early childhood teachers' workplace experiences, the current study examined the validity of the Early Childhood Teacher Experiences Scale (ECTES) for use in a diverse Head Start program. Mean differences in the ECTES dimensions of self-efficacy, job stress, and school support were examined across teachers' demographic characteristics and observed teacher–child interaction quality. Multilevel models examined associations between ECTES dimension scores and children's social-emotional and academic skills (N = 161 preschool teachers and N = 3,152 children). Findings support the reliability and validity of the three-factor structure of the ECTES in the diverse Head Start teacher sample. Higher teacher-reported self-efficacy and school support were associated with higher observed classroom emotional support, instructional support, and classroom organization. Higher teacher-reported self-efficacy was associated with fewer years of teaching experience. With respect to child outcomes, higher teacher self-efficacy and school support were associated with lower behavior problems and higher social-emotional skills but were not associated with academic skills. Implications of the findings, limitations, and future directions are discussed.     

Soft skills in higher education: importance and improvement ratings as a function of individual differences and academic performance

Three UK studies on the relationship between a purpose‐built instrument to assess the importance and development of 15 ‘soft skills’ are reported. Study 1 (N = 444) identified strong latent components underlying these soft skills, such that differences between‐skills were over‐shadowed by differences between‐students. Importance and improving ratings on these skills predicted academic performance and accounted for the effects of personality on academic performance. Study 2 replicated the structure of the soft skills inventory and associations with academic performance in a larger sample (N = 1309). Examination of mean differences across faculties (humanities, life sciences, hard sciences) revealed higher soft skills ratings in ‘softer’ courses. Study 3 (N = 87) incorporated an IQ measure, which was found to be negatively related to importance ratings on soft skills. Results highlight the cohesive structure of beliefs concerning various non‐academic skills and their significant links to educationally relevant individual differences. Theoretical, methodological and applied implications are considered.     

Test of the Three-Mathematical Minds (M3) for the Identification of Mathematically Gifted Students

In this study, psychometric properties of the test of the three-mathematical minds (M3) were investigated. The M3 test was developed based on a multidimensional conception of giftedness to identify mathematically talented students. Participants included 291 middle-school students. Data analysis indicated that the M3 had a .73 coefficient as a consistency of scores. Exploratory factor analysis yielded three separate factors explaining 55% of the total variance; however, one-factor solution seems to best fit the data. The convergent validity analysis showed that M3 scores had medium to high-medium correlations with teachers' ratings of students' mathematical ability and students' ratings of their own ability and their liking of mathematics. The findings provide partial evidence for the validity of M3 test scores for the identification of mathematically gifted students.     

Role of Study Skills in Graduate-Level Educational Research Courses

Abstract

Graduate students' predominant study skill strengths and weaknesses were examined, as well as the relationship between specific study skills and achievement in a research methodology course. Graduate students (N = 122) from various education disciplines who were enrolled in 3 sections of an educational research course at a southeast university were administered the Study Habits Inventory (Jones & Slate, 1992). Students responded appropriately to 57.8% of the statements measuring study skills. Although that proportion was significantly higher than that found for undergraduate students in previous studies, graduate students could benefit from study skills training. Study skill weaknesses were identified in the areas of note taking and reading skills. Regression and discriminant analyses led to the identification of specific study behaviors that discriminated higher and lower levels of course achievement. Implications for intervention programs are discussed.     

Teacher perception of professional skills in a project-led engineering semester

This study explores the perceptions of teachers with regard to professional skills in project-led engineering education experiences for first year engineering students at the University of Minho, Portugal. Their perception on which professional skills to include, how to develop these skills and how to assess them is studied through six semi-structured interviews with experienced teachers of the first year programme, who served as tutors as well as teachers in at least four projects. Analysis of their perceptions reveals a strong commitment to professional skills for engineering students, and also a lack of confidence in the support they can offer to help students develop these skills.     

In the eye of the beholder: The relationship between perceived peer language skills,provided peer feedback and peer grading in secondary education

Students involved in peer assessment have interpersonal relationships, partly consisting of reciprocal perceptions. In the domain of argumentative writing, little is known about the way peer assessment is affected by the assessor’s perception of the assessee’s language skills. Dutch 10th grade students (N = 176, age = 15–16) provided feedback and grades on two texts, being under the illusion that the texts had been written by two classmates whom the assessors perceived as a peer with either stronger or weaker language skills than their own (within-subjects design). In reality, students assessed similar texts, created by the researchers. Assessors did not provide different feedback to the two types of assessees. Simultaneously, they provided higher grades to peers perceived to have stronger language skills than their own than to peers perceived to have weaker language skills than their own. Future research should capture assessors’ rationale behind the composition of feedback and grades.     

Effectiveness of Short Term Dialectical Behavior Therapy Skills Training in College Students with Cluster B Personality Disorders

This pilot project investigates the efficacy of an 11-week dialectical behavior therapy skills training class in increasing adaptive skill use and emotion regulation in college students with cluster B personality disorders or traits. Subjects are students (N?=?19, mean age = 21.31, 1 male, 18 female) at a southeastern university counseling center. Students meeting criteria but not interested in attending the group were recruited to serve as control subjects who received treatment as usual. As compared to treatment as usual, dialectical behavior therapy participants had significant improvement in increasing skills use and decreasing maladaptive coping skills; there was a trend for improvement in difficulty regulating emotions.     

Learning analytics application to examine validity and generalizability of game-based assessment for spatial reasoning

Game-based assessment (GBA), a specific application of games for learning, has been recognized as an alternative form of assessment. While there is a substantive body of literature that supports the educational benefits of GBA, limited work investigates the validity and generalizability of such systems. In this paper, we describe applications of learning analytics methods to provide evidence for psychometric qualities of a digital GBA called Shadowspect, particularly to what extent Shadowspect is a robust assessment tool for middle school students' spatial reasoning skills. Our findings indicate that Shadowspect is a valid assessment for spatial reasoning skills, and it has comparable precision for both male and female students. In addition, students' enjoyment of the game is positively related to their overall competency as measured by the game regardless of the level of their existing spatial reasoning skills.

Practitioner notes

What is already known about this topic:

• Digital games can be a powerful context to support and assess student learning.
• Games as assessments need to meet certain psychometric qualities such as validity and generalizability.
• Learning analytics provide useful ways to establish assessment models for educational games, as well as to investigate their psychometric qualities.

What this paper adds:

• How a digital game can be coupled with learning analytics practices to assess spatial reasoning skills.
• How to evaluate psychometric qualities of game-based assessment using learning analytics techniques.
• Investigation of validity and generalizability of game-based assessment for spatial reasoning skills and the interplay of the game-based assessment with enjoyment.

Implications for practice and/or policy:

• Game-based assessments that incorporate learning analytics can be used as an alternative to pencil-and-paper tests to measure cognitive skills such as spatial reasoning.
• More training and assessment of spatial reasoning embedded in games can motivate students who might not be on the STEM tracks, thus broadening participation in STEM.
• Game-based learning and assessment researchers should consider possible factors that affect how certain populations of students enjoy educational games, so it does not further marginalize specific student populations.

     

Rubrics for developing students’ professional judgement: A study of sustainable assessment in arts education

The participation of students in assessment is known to generate higher-order learning outcomes. This study aims to determine the usefulness of rubrics in aiding the incorporation of undergraduate students into assessor teams for developing their professional judgement. A quasi-experimental study examined the effects of a brief training programme on the use of rubrics, and of the participation of students in rubric creation and moderation discussions. We calculated Cronbach’s alphas, and intraclass correlation coefficients in order to examine the intra- and inter-rater reliability between all the members of the assessor teams. The results demonstrate that only participation in the rubric design and in the moderation discussions regulating their use helped undergraduate students to develop sound assessment skills. We infer that rubrics can help to promote professional judgement if they are conceived as instructional resources for defining and supporting the processes of negotiation and agreement that characterize an assessment culture.     

How home gets to school: Parental control strategies predict children's school readiness

At-risk families’ control style (autonomy support and coercive control) was examined in relation to children's school readiness; children's social skills and mastery motivation were hypothesized mediating variables. In two different, low-income samples from diverse ethnic backgrounds, one preschool sample recruited from Head Start (N = 199) and a school transition sample composed of children entering elementary school (N = 344), parental control styles were related to children's academic readiness modestly but significantly in the preschool sample and weakly in the school transition sample. Children's social skills and mastery motivation skills (persistence and goal orientation) were significantly related to the academic measures of school readiness, and fully mediated the association between parents’ use of coercive behavioral control and academic readiness. Such mediation could not be tested for parental support of children's autonomy. The results indicate that a developmental cascade exists between parental control strategies and academic indices of school readiness, emphasizing the importance of family context models of school readiness. Furthermore, strong correlations between the domains of school readiness were found in both samples, reinforcing calls for a multidimensional approach to supporting school readiness in early childhood education programs.     

Development of an item bank for assessing generic competences in a higher-education institute: a Rasch modelling approach

This paper describes the development and validation of an item bank designed for students to assess their own achievements across an undergraduate-degree programme in seven generic competences (i.e., problem-solving skills, critical-thinking skills, creative-thinking skills, ethical decision-making skills, effective communication skills, social interaction skills and global perspective). The Rasch modelling approach was adopted for instrument development and validation. A total of 425 items were developed. The content validity of these items was examined via six focus group interviews with target students, and the construct validity was verified against data collected from a large student sample (N?=?1151). A matrix design was adopted to assemble the items in 26 test forms, which were distributed at random in each administration session. The results demonstrated that the item bank had high reliability and good construct validity. Cross-sectional comparisons of Years 1–4 students revealed patterns of changes over the years. Correlation analyses shed light on the relationships between the constructs. Implications are drawn to inform future efforts to develop the instrument, and suggestions are made regarding ways to use the instrument to enhance the teaching and learning of generic skills.     

Fostering and assessing student critical thinking: From theory to teaching practice

In an age of innovation and digitalisation, critical thinking has become one of the most valued skills in the labour market. This paper shows how teachers can empower students to develop their students' critical thinking. After recalling why critical thinking matters for democracy and the economy, a definition of critical thinking is outlined. Next, a demonstration is given of how the concept critical thinking can be translated and simplified using teacher-friendly rubrics that can support the design or redesign of lesson plans, teacher observations and formative assessment—as well as standardised assessments. In conclusion, the paper argues that critical thinking should be mainstreamed in all subjects in school curricula, and that it leads to deeper understanding of subject matter content.     

ADAPTATION AND PSYCHOMETRIC EVALUATION OF A RESILIENCE MEASURE IN GREEK ELEMENTARY SCHOOL STUDENTS

This study aimed to adapt the Resilience Youth Development Module (RYDM) and assess its psychometric properties in terms of internal consistency and convergent validity in Greek elementary students. Participants (N = 346) completed a battery of self‐report questionnaires, including the RYDM, School Connectedness Scale, and Strengths and Difficulties Questionnaire. Cronbach's alpha coefficients indicated that the reliability of the RYDM is satisfactory. The confirmatory factor analysis results demonstrated that the proposed structure, which derived from the explorative principal component analyses of the RYDM's internal and external assets, adequately fit the current data. Moreover, the canonical functions derived from the canonical correlation analysis provided evidence for the convergent validity of the RYDM. In conclusion, the RYDM is a psychometrically sound measure, and it can be applied to assess internal and external resilience assets in Greek school‐aged children.     

Examining the potential of web-based multimedia to support complex fine motor skill learning: An empirical study

Research on the utilization of the Web for complex fine motor skill learning that involves whole body movements is still scarce. The aim of this study was to evaluate the impact of the introduction of a multimedia web-based learning environment, which was targeted at a rhythmic gymnastics routine consisting of eight fine motor skills, into an undergraduate course in a physical education department, as a complementary tool to campus-based instruction. The impact was evaluated in terms of: acquisition of knowledge regarding the routine skills by students, improvement of students’ ability to execute the routine, and students’ responses to the environment. The study followed a pretest/posttest experimental design and involved 76 students randomly split into two groups: The Multimedia Web-based Learning Group (MWLG) students (N?=?38), who attended campus-based instruction on the routine and also used the environment in their own space and time, and the Traditional On-site Instruction Group (TOIG) students (N?=?38), who only attended campus-based instruction. The research data were gathered through student questionnaires and ratings of students’ performances. It was found that the use of the environment as a supplement to campus-based instruction increased the effectiveness of this instruction as regards the cognitive component of motor skill learning (i.e. acquisition of knowledge regarding the routine skills) and was well-accepted by the students, although it did not have any significant contribution to the physical component of motor skill learning (i.e. performance of the routine skills). These findings partially support the future wider adoption of multimedia web-based learning environments within physical education and other academic disciplines that involve complex fine motor skill learning. Relevant implications are discussed.     

Examining the link between preschool social-emotional competence and first grade academic achievement: The role of attention skills

Recently, research has begun to identify cognitive and social-emotional predictors of early academic success. Yet few studies have examined the mechanisms by which children's social-emotional skills are associated with later academic success. The present study examines the associations between preschool emotion knowledge, kindergarten attention skills, and first grade academic competence in a sample of mostly disadvantaged children. Results indicate that attention during kindergarten is a significant mediator of this association, even after accounting for the effects of maternal education, family income, and children's age, sex, and receptive vocabulary skills. The findings provide further support for the implementation of preventive curricula that focus on both social and emotional development as well as attentional development as one strategy for improving future academic success in young children.     

Social-Emotional Predictors of Postsecondary Enrollment for Students with Disabilities: Findings from a Nationally Representative Sample

Despite improvement in educational opportunity and outcomes, students with disabilities remain substantially less likely to participate in postsecondary education than individuals without disabilities. The purpose of this exploratory study was to examine the relations of teacher-rated social-emotional skills to postsecondary enrollment among students with disabilities. Using data from the National Longitudinal Transition Study-2, a classification tree analysis was conducted to ascertain which social-emotional skills were predictive of postsecondary enrollment in conjunction with student sociodemographic characteristics. Results indicate that compliance and, to a lesser extent, peer-relations skills, in addition to family income, predict postsecondary enrollment for students with high-incidence disabilities. This finding suggests that social-emotional skills play an important role in postsecondary enrollment for students with disabilities, providing support for the use of social-emotional skills interventions in improving postsecondary enrollment rates for students with disabilities.     

The relation between parent ratings and direct assessments of preschoolers’ numeracy skills

This study examines whether parent ratings of children's numeracy skills are more related to direct assessments of corresponding skills, broad numeracy, or other cognitive skills, to inform how to best utilize parent ratings in research. Children in the sample (N = 129) ranged from 3.07 to 5.95 years old and 52.3% were male. Most (81%) of the children were White. Parents rated their children's counting, arithmetic, and numeral identification skills. Children were directly assessed on these skills, broad numeracy, and other cognitive skills (i.e., expressive vocabulary, executive function). Parent ratings of children's numeracy abilities varied in terms of whether they were more related to directly assessed corresponding skills or broad numeracy abilities. Aggregated parent ratings predicted broad numeracy abilities more than other cognitive skills, providing evidence for discriminant validity. Findings inform how parent ratings may be used when children cannot be directly assessed, such as when large-scale parent surveys are used.