The Issue of Range Restriction in Bookmark Standard Setting

This article uses data from a large‐scale assessment program to illustrate the potential issue of range restriction with the Bookmark method in the context of trying to set cut scores to closely align with a set of college and career readiness benchmarks. Analyses indicated that range restriction issues existed across different response probability (RP) values and item response theory (IRT) models if one were to apply the Bookmark procedure using intact test forms. Results also suggested that range restriction may still be present if one had access to additional data from an item bank. This demonstration critically highlights challenges that may exist in some practical applications of the Bookmark method due items not being designed to cover the full range of examinee abilities.     

Counseling With HEART: A Relationship Violence Prevention Program for College Students

Relationship violence is a salient concern on college campuses today, and psychoeducational groups may be an appropriate prevention format. This article describes a study measuring the impact of college student participation in the HEART (Help End Abusive Relationships Today) program, a series of group sessions designed to increase knowledge and awareness of relationship violence. Findings indicated significant changes for group participants postintervention. Implications and recommendations for college counselors are discussed.     

A Critical Look into the Beuk Standard-Setting Method

One commonly used compromise standard-setting method is the Beuk (1984) method. A key assumption of the Beuk method is that the emphasis given to the pass rate and the percent correct ratings should be proportional to the extent that the panelists agree on their ratings. However, whether the slope of Beuk line reflects the emphasis that panelists believe should be assigned to the pass rate and the percentage correct ratings has not be fully tested. In this article, I evaluate this critical assumption of the Beuk method by asking panelists to assign importance weights to their percentage correct and pass rate judgments. I show that in several cases that the emphasis suggested by the Beuk slope is noticeably different from what one would expect and is inconsistent with importance weight ratings. I also suggest two ways that the importance weights can be used to calculate alternate cut scores, and I show that one of the ways of calculating cut scores using the importance weights leads to larger potential differences in cut score estimates. I suggest that practitioners should consider collecting importance weights when the Beuk method is used for determining cut scores.     

The Potential Impact of COVID-19 on Student Learning and How Schools Can Respond

There is no denying the impact that the coronravirus disease (COVID-19) outbreak has had on many aspects of our lives. This article looks at the potential impact of COVID-19 on student learning as schools abruptly morphed into virtual learning environments using data from several instructional, practice, and assessment solutions offered by Renaissance. First, three hypothetical learning scenarios are considered using normative data from Star assessments to explore the potential impact on reading and math test performace. Next, data on Focus Skills are used to highlight which grades may have missed the most foundational math and reading content if instruction was stopped or reduced. Last, data from two of Renaissance's practice tools are used to evaluate whether students were practicing key skills following school closures. The article concludes that academic decline will likely occur but may be tempered by the increased use of practice tools; effects may look different for math and reading; and may impact grades and schools differently. As such, schools may need to leverage decision-making frameworks, such as the Multi-tiered Systems of Support/Response-to-Intervention (MTSS/RTI) framework, more than ever to identify needs and target instruction where it matters most when school begins in fall 2020.     

Strength,Weakness, Opportunity,Threat (SWOT) Analysis of the Adaptations to Anatomical Education in the United Kingdom and Republic of Ireland in Response to the Covid-19 Pandemic

The Covid-19 pandemic has driven the fastest changes to higher education across the globe, necessitated by social distancing measures preventing face-to-face teaching. This has led to an almost immediate switch to distance learning by higher education institutions. Anatomy faces some unique challenges. Intrinsically, anatomy is a three-dimensional subject that requires a sound understanding of the relationships between structures, often achieved by the study of human cadaveric material, models, and virtual resources. This study sought to identify the approaches taken in the United Kingdom and Republic of Ireland to deliver anatomical education through online means. Data were collected from 14 different universities in the United Kingdom and Republic of Ireland and compared adopting a thematic analysis approach. Once themes were generated, they were collectively brought together using a strength, weakness, opportunity, threat (SWOT) analysis. Key themes included the opportunity to develop new online resources and the chance to engage in new academic collaborations. Academics frequently mentioned the challenge that time constrains could place on the quality and effectiveness of these resources; especially as in many cases the aim of these resources was to compensate for a lack of exposure to cadaveric exposure. Comparisons of the actions taken by multiple higher education institutions reveal the ways that academics have tried to balance this demand. Discussions will facilitate decisions being made by higher education institutions regarding adapting the curriculum and assessment methods in anatomy.     

‘They think that if you're a teacher here … you're not clever enough to be a proper teacher’: the courtesy stigma experienced by teachers employed at schools for pupils with behavioural,emotional and social difficulties (BESD)

A wealth of literature has identified that children with behavioural, emotional and social difficulties (BESD) and their families are frequently stigmatised due to the perceived controllable and ‘invisible’ nature of this special educational need (SEN). Yet little research has considered the impact of this stigma on another group of individuals, educational practitioners employed in BESD schools. This is despite these professionals working in close contact with pupils with BESD, a heavily stigmatised group, on a regular basis. This paper therefore, details a study which explored perceptions of stigma specifically with educational professionals employed in schools for pupils with BESD. Semi‐structured interviews with nine practitioners (including head teachers and class teachers with additional responsibilities) were conducted, all of whom had worked within the BESD sector for at least 10 years, with data being analysed via Interpretative Phenomenological Analysis (IPA). Findings revealed how educational practitioners employed in BESD schools experienced courtesy stigma, with many not being perceived as ‘proper’ teachers due to a discourse of care surrounding BESD. Other professionals reported much confusion from their mainstream colleagues and other individuals about how they could want to work with such ‘challenging’ pupils. This courtesy stigma was linked to the wider stigma surrounding BESD schools, which were often ignorantly perceived to be full of ‘bad boys’ or ‘absolute horrors’. This paper concludes by considering the implications of these findings for policy and practice, and provides recommendations for addressing the identified stigma towards practitioners employed in BESD schools.     

Part 1. If We Frame It,They Will Respond: Undergraduate Student Responses to the Framework for Information Literacy for Higher Education

There remains significant confusion surrounding the purpose, audience, and proposed application of the Framework for Information Literacy for Higher Education. This exploratory study addresses the question of whether undergraduate students can understand the language and concepts in this document. By presenting student responses to pretest questions recorded at the beginning of a semester-long research methods course, this article shows that students can, even on first impression, begin to make sense of the complexity and richness found in the Framework for Information Literacy for Higher Education.     

Methodological Choices in the Content Analysis of Textbooks for Measuring Alignment With Standards

With the recent adoption of the Common Core standards in many states, there is a need for quality information about textbook alignment to standards. While there are many existing content analysis procedures, these generally have little, if any, validity or reliability evidence. One exception is the Surveys of Enacted Curriculum (SEC), which has been widely used to analyze the alignment among standards, assessments, and teachers’ instruction. However, the SEC can be time‐consuming and expensive when used for this purpose. This study extends the SEC to the analysis of entire mathematics textbooks and investigates whether the results of SEC alignment analyses are affected if the content analysis procedure is simplified. The results indicate that analyzing only every fifth item produces nearly identical alignment results with no effect on the reliability of content analyses.