Foreign Language Attainment of Children/Adolescents with Poor Literacy Skills: a Systematic Review and Meta-analysis

Educational Psychology Review - This systematic review investigated how successful children/adolescents with poor literacy skills learn a foreign language compared with their peers with typical...     

Evaluating item response theory linking and model fit for data from PISA 2000–2012

ABSTRACT

Based on concerns about the item response theory (IRT) linking approach used in the Programme for International Student Assessment (PISA) until 2012 as well as the desire to include new, more complex, interactive items with the introduction of computer-based assessments, alternative IRT linking methods were implemented in the 2015 PISA round. The new linking method represents a concurrent calibration using all available data, enabling us to find item parameters that maximize fit across all groups and allowing us to investigate measurement invariance across groups. Apart from the Rasch model that historically has been used in PISA operational analyses, we compared our method against more general IRT models that can incorporate item-by-country interactions. The results suggest that our proposed method holds promise not only to provide a strong linkage across countries and cycles but also to serve as a tool for investigating measurement invariance.     

Psychometric defensibility of the Intervention Selection Profile‐Social Skills (ISP‐SS) with students at risk for behavioral concerns

The purpose of the current study was to examine the validity and diagnostic accuracy of the Intervention Selection Profile—Social Skills (ISP‐SS), a brief social skills assessment tool intended for use with students in need of Tier 2 intervention. Participants included 160 elementary and middle school students who had been identified through universal screening as at risk for behavioral concerns. Teacher participants ( n = 71) rated each of these students using both the ISP‐SS and the Social Skills Improvement System—Rating Scales (SSiS‐RS), with the latter measure serving as the criterion within validity and diagnostic accuracy analyses. Confirmatory factor analysis supported ISP‐SS structural validity, indicating ISP‐SS items broadly conformed to a single “Social Skills” factor. Follow‐up analyses suggested ISP‐SS broad scale scores demonstrated adequate internal consistency reliability, with hierarchical omega coefficient equal to 0.86. Correlational analyses supported the concurrent validity of ISP‐SS items, finding each ISP‐SS item to be moderately or highly related to its corresponding SSiS‐RS subscale. Finally, analyses indicated three of the seven ISP‐SS items that demonstrated sufficient diagnostic accuracy; however, findings suggest additional revisions are needed if the ISP‐SS is to be appropriate for use in schools. Implications for practice and future research are discussed.     

The influence of test-based accountability policies on teacher stress and instructional practices: a moderated mediation model

The present study examined the use of student test performance for merit pay and teacher evaluation as predictive of both educator stress and counterproductive teaching practices, and the moderating role of perceived test value. Structural equation modelling of data from a sample of 7281 educators in a South-eastern state in the United States supported the hypothesis that educators who perceived the test as an invalid measure of teaching effectiveness were more likely to report high levels of test stress and to use counterproductive teaching practices, including fear appeals, in an attempt to motivate students for test-taking. This study provides initial evidence for the hypothesised relationships of test-based accountability policy with teacher mental health and instructional practices. Implications for research and practice are discussed.     

Home and preschool learning environments and their relations to the development of early numeracy skills

This study examined the influence of the quality of home and preschool learning environments on the development of early numeracy skills in Germany, drawing on a sample of 532 children in 97 preschools. Latent growth curve models were used to investigate early numeracy skills and their development from the first (average age: 3 years) to the third year (average age: 5 years) of preschool. Several child and family background factors (e.g., gender, maternal education, socioeconomic status), measures of the home learning environment (e.g., literacy- and numeracy-related activities), and measures of preschool structural and process quality (e.g., ECERS-E, ECERS-R) were tested as predictors of numeracy skills and their development. The analyses identified child and family background factors that predicted numeracy skills in the first year of preschool and their development over the three points of measurement—particularly gender, parental native language status (German/other), socioeconomic status, and mother's educational level. The quality of the home learning environment was strongly associated with numeracy skills in the first year of preschool, and this advantage was maintained at later ages. In contrast, the process quality of the preschool was not related to numeracy skills at the first measurement, but was significantly related to development over the period observed. The results underline the differential impact of the two learning environments on the development of numeracy skills. Interaction effects are explored and discussed.     

The Accuracy and Consistency of a Series of IRT True Score Equatings

This study investigates a sequence of item response theory (IRT) true score equatings based on various scale transformation approaches and evaluates equating accuracy and consistency over time. The results show that the biases and sample variances for the IRT true score equating (both direct and indirect) are quite small (except for the mean/sigma method). The biases and sample variances for the equating functions based on the characteristic curve methods and concurrent calibrations for adjacent forms are smaller than the biases and variances for the equating functions based on the moment methods. In addition, the IRT true score equating is also compared to the chained equipercentile equating, and we observe that the sample variances for the chained equipercentile equating are much smaller than the variances for the IRT true score equating with an exception at the low scores.