The Multidimensionality of Measurement Bias in High-Stakes Testing: Using Machine Learning to Evaluate Complex Sources of Differential Item Functioning

Test developers and psychometricians have historically examined measurement bias and differential item functioning (DIF) across a single categorical variable (e.g., gender), independently of other variables (e.g., race, age, etc.). This is problematic when more complex forms of measurement bias may adversely affect test responses and, ultimately, bias test scores. Complex forms of measurement bias include conditional effects, interactions, and mediation of background information on test responses. I propose a multidimensional, person-specific perspective of measurement bias to explain how complex sources of bias can manifest in the assessment of human knowledge, skills, and abilities. I also describe a data-driven approach for identifying key sources of bias among many possibilities—namely, a machine learning method commonly known as regularization.     

Universal Design for Learning within an Integrated Multitiered System of Support

Comprehensive schoolwide initiatives like integrated multitiered systems of support (I-MTSS) and universal design for learning (UDL) present opportunities for large-scale impact on improving teacher instructional practices and, therefore, student outcomes. Specifically, implementing I-MTSS and UDL concurrently presents an opportunity to enhance and improve universal instruction for all students. This mixed-methods study explored current Tier 1 practices in elementary schools across the United States. Findings revealed that I-MTSS and UDL are perceived as being implemented concurrently. In addition, school personnel identified specific barriers to implementation.     

Do more hours in center-based care cause more externalizing problems? A cross-national replication study

Whether high quantities of center-based care cause behavior problems is a controversial question. Studies using covariate adjustment for selection factors have detected relations between center care and behavior problems, but studies with stronger internal validity less often find such evidence. We examined whether within-child changes in hours in center-based care predicted changes in externalizing problems in toddlers and preschoolers (N = 10,105; 49% female; data collection 1993–2012) in seven studies, including from Germany, Netherlands, Norway, two from Canada and two from the U.S. Race/ethnicity data were only collected in the United States (57% and 80% White; 42% and 13% African-American; 1.2% and 5% Latinx). Meta-analyses showed no association (r = .00, p = .88) between hours in center-based care and externalizing problems.     

Language and reading impairments are associated with increased prevalence of non-right-handedness

Handedness has been studied for association with language-related disorders because of its link with language hemispheric dominance. No clear pattern has emerged, possibly because of small samples, publication bias, and heterogeneous criteria across studies. Non-right-handedness (NRH) frequency was assessed in N = 2503 cases with reading and/or language impairment and N = 4316 sex-matched controls identified from 10 distinct cohorts (age range 6–19 years old; European ethnicity) using a priori set criteria. A meta-analysis (N_cases = 1994) showed elevated NRH % in individuals with language/reading impairment compared with controls (OR = 1.21, CI = 1.06–1.39, p = .01). The association between reading/language impairments and NRH could result from shared pathways underlying brain lateralization, handedness, and cognitive functions.     

Hands-On: Investigating the role of physical manipulatives in spatial training

Studies show that spatial interventions lead to improvements in mathematics. However, outcomes vary based on whether physical manipulatives (embodied action) are used during training. This study compares the effects of embodied and non-embodied spatial interventions on spatial and mathematics outcomes. The study has a randomized, controlled, pre-post, follow-up, training design (N = 182; mean age 8 years; 49% female; 83.5% White). We show that both embodied and non-embodied spatial training approaches improve spatial skills compared to control. However, we conclude that embodied spatial training using physical manipulatives leads to larger, more consistent gains in mathematics and greater depth of spatial processing than non-embodied training. These findings highlight the potential of spatial activities, particularly those that use physical materials, for improving children's mathematics skills.     

The assessment of creativity for people with autism spectrum disorder

The term “creativity” can conjure various ideas and meanings. It's no surprise that methods for measuring such a concept vary widely and are not without controversy. This is particularly true among people with autism spectrum disorder (ASD), who are a unique yet incredibly diverse group of individuals. This article provides an overview of the assessment of creativity among individuals with ASD. Findings among studies that have sought to determine whether individuals with ASD are more or less creative than their neurotypical peers are mixed, yet the authors propose that intentional development of creativity in all youth, including those with ASD, can be beneficial.     

Relationship of executive functioning and memory to autism symptomology and adaptive functioning: Implications for reducing future underemployment

Understanding the relationship between executive functioning and its connection to working memory and adaptive functioning can inform planning and employment efforts. This study explored the relationship between memory and adaptive functioning with a sample of Autistic youths/young adults. Participant mean age was 21.3 (SD = 3.0). Of the 22 participants, 17 were male, and 19 white, non-Hispanic/Latina/o/x. All but one lived with their parent(s). Participants were administered a full battery assessing cognitive ability (WAIS-IV), memory and executive functioning (WMS-IV and DKEFS), autism symptomatology (ADOS-II), and adaptive functioning (SIB-R). A multivariate lasso regression model was used. Memory, especially as measured on the WMS-IV, was found to be significantly related to adaptive functioning and autism symptomatology. There appears to be continuing evidence that memory is highly related to adaptive functioning and autism symptomatology. Interventions involving auditory and immediate memory could be helpful in promoting more mutually effective social interactions necessary for positive employment outcomes.     

Integration of addiction recovery and professional identities for counselor trainees

Counselor trainees in recovery from substance use often have a foundational recovery identity; they also develop a professional counselor identity through their training. This study utilized narrative inquiry to explore the integration of professional identity and recovery identity. Resonant threads and narrative tensions emerged from the storied experiences of participants.     

Counselor educator workload and burnout in the era of COVID-19

The COVID-19 pandemic brought disruption to teaching and other aspects of workload in higher education. The current study sampled 126 counselor educators about workload, compassion satisfaction, burnout, and job satisfaction. Results indicated that faculty workload and administrative responsibilities increased for counselor educators during the pandemic without adequate compensation or support.