The Issue of Range Restriction in Bookmark Standard Setting

This article uses data from a large‐scale assessment program to illustrate the potential issue of range restriction with the Bookmark method in the context of trying to set cut scores to closely align with a set of college and career readiness benchmarks. Analyses indicated that range restriction issues existed across different response probability (RP) values and item response theory (IRT) models if one were to apply the Bookmark procedure using intact test forms. Results also suggested that range restriction may still be present if one had access to additional data from an item bank. This demonstration critically highlights challenges that may exist in some practical applications of the Bookmark method due items not being designed to cover the full range of examinee abilities.     

A Critical Look into the Beuk Standard-Setting Method

One commonly used compromise standard-setting method is the Beuk (1984) method. A key assumption of the Beuk method is that the emphasis given to the pass rate and the percent correct ratings should be proportional to the extent that the panelists agree on their ratings. However, whether the slope of Beuk line reflects the emphasis that panelists believe should be assigned to the pass rate and the percentage correct ratings has not be fully tested. In this article, I evaluate this critical assumption of the Beuk method by asking panelists to assign importance weights to their percentage correct and pass rate judgments. I show that in several cases that the emphasis suggested by the Beuk slope is noticeably different from what one would expect and is inconsistent with importance weight ratings. I also suggest two ways that the importance weights can be used to calculate alternate cut scores, and I show that one of the ways of calculating cut scores using the importance weights leads to larger potential differences in cut score estimates. I suggest that practitioners should consider collecting importance weights when the Beuk method is used for determining cut scores.     

The Potential Impact of COVID-19 on Student Learning and How Schools Can Respond

There is no denying the impact that the coronravirus disease (COVID-19) outbreak has had on many aspects of our lives. This article looks at the potential impact of COVID-19 on student learning as schools abruptly morphed into virtual learning environments using data from several instructional, practice, and assessment solutions offered by Renaissance. First, three hypothetical learning scenarios are considered using normative data from Star assessments to explore the potential impact on reading and math test performace. Next, data on Focus Skills are used to highlight which grades may have missed the most foundational math and reading content if instruction was stopped or reduced. Last, data from two of Renaissance's practice tools are used to evaluate whether students were practicing key skills following school closures. The article concludes that academic decline will likely occur but may be tempered by the increased use of practice tools; effects may look different for math and reading; and may impact grades and schools differently. As such, schools may need to leverage decision-making frameworks, such as the Multi-tiered Systems of Support/Response-to-Intervention (MTSS/RTI) framework, more than ever to identify needs and target instruction where it matters most when school begins in fall 2020.     

Validation of the Microsoft Kinect® camera system for measurement of lower extremity jump landing and squatting kinematics

Cost effective, quantifiable assessment of lower extremity movement represents potential improvement over standard tools for evaluation of injury risk. Ten healthy participants completed three trials of a drop jump, overhead squat, and single leg squat task. Peak hip and knee kinematics were assessed using an 8 camera BTS Smart 7000DX motion analysis system and the Microsoft Kinect® camera system. The agreement and consistency between both uncorrected and correct Kinect kinematic variables and the BTS camera system were assessed using interclass correlations coefficients. Peak sagittal plane kinematics measured using the Microsoft Kinect® camera system explained a significant amount of variance [Range_hip = 43.5–62.8%; Range_knee = 67.5–89.6%] in peak kinematics measured using the BTS camera system. Across tasks, peak knee flexion angle and peak hip flexion were found to be consistent and in agreement when the Microsoft Kinect® camera system was directly compared to the BTS camera system but these values were improved following application of a corrective factor. The Microsoft Kinect® may not be an appropriate surrogate for traditional motion analysis technology, but it may have potential applications as a real-time feedback tool in pathological or high injury risk populations.     

News Habits Among Adolescents: The Influence of Family Communication on Adolescents’ News Media Use—Evidence From a Three-Wave Panel Study

Keeping up with what’s going on in the world of politics and current affairs through various news media is commonly seen as important for civic engagement and informed citizenship. Today, however, citizens face more opportunities than ever to select media content according to their personal preferences and interests—leading to what previous research has identified as a polarization between news-seekers and news-avoiders. Given heightened concerns regarding growing shares of news-avoiders in particular, this study analyzes the development, stability, and family influences on Swedish adolescents’ news habits over time. The findings, based on panel survey data among adolescents and their parents, show that (a) news habits are fairly stable at the individual level, (b) parents’ own news consumption is the most consistent predictor of adolescents’ development of news habits, and (c) these family effects are distinct from adolescents’ personal motivations for seeking out news.     

Observations on the temporal correlates of reading failure

The definitions of developmental dyslexia andtemporal processing are discussed and severalconstruals of what a temporal processingdeficit might entail are illustrated. Then,using a framework developed by Farmer & Klein(1995), the proposal that a temporal processingdeficit (in vision, audition, or both) might bethe root cause of some proportion of cases ofdevelopmental dyslexia is introduced andvarious research strategies for testing thisproposal are identified. The symposium paperswhich address this general question using arange of these strategies are then criticallyreviewed. It is noted that whereas reading isa recent artifact not yet subject to any directselection pressure, its normal performancerequires the use of, and connections between,the highly evolved modules for visual patternrecognition and language. Within vision andlanguage redundant coding, which permitsperformance in the face of injuries anddegraded input, also makes it difficult todetect subtle deficits (whether temporal, ornot) unless precise tests are used. Yet suchdeficits may degrade performance on tasks (suchas reading) which require the non-copiousconnections between vision and language. Theefficacy of this pathway, I suggest, ismeasured by performance on the rapidautomatized naming (RAN) test.     

The influence of discussion groups in a case-based learning environment

The common practice of using discussion groups during case-based learning makes the role of discussion important in these learning environments. However, little empirical research has been done to investigate the influence of discussion on performance and motivation in case-based learning. The purpose of this article is to present the results of a study conducted to examine the role of discussion groups in a case-based environment. College students completed two cases either individually or in small discussion groups. Measures included two case analyses, an attitude survey, time on task, and document analysis. Results revealed significant performance and time differences between instructional methods on the first case, but not on the second case. In addition, results indicated significant differences in student attitudes between treatments. Overall, participants who worked in groups liked their method significantly better than those who worked alone, felt they learned more working in a group than they would have working alone, and expressed a preference for working in a group if they had to do the class over again. Implications for implementing case-based learning and future research are discussed. Anna E. Flynn is Vice President and NAPM Associate Professor with the National Association of Purchasing Management.