The Issue of Range Restriction in Bookmark Standard Setting

This article uses data from a large‐scale assessment program to illustrate the potential issue of range restriction with the Bookmark method in the context of trying to set cut scores to closely align with a set of college and career readiness benchmarks. Analyses indicated that range restriction issues existed across different response probability (RP) values and item response theory (IRT) models if one were to apply the Bookmark procedure using intact test forms. Results also suggested that range restriction may still be present if one had access to additional data from an item bank. This demonstration critically highlights challenges that may exist in some practical applications of the Bookmark method due items not being designed to cover the full range of examinee abilities.     

Counseling With HEART: A Relationship Violence Prevention Program for College Students

Relationship violence is a salient concern on college campuses today, and psychoeducational groups may be an appropriate prevention format. This article describes a study measuring the impact of college student participation in the HEART (Help End Abusive Relationships Today) program, a series of group sessions designed to increase knowledge and awareness of relationship violence. Findings indicated significant changes for group participants postintervention. Implications and recommendations for college counselors are discussed.     

Quantitative Research Attitudes and Research Training Perceptions Among Master's‐Level Students

This study explored master's‐level counseling students' (N = 804) perceptions of training in the Council for Accreditation of Counseling and Related Educational Programs ( 2009 ) Research and Program Evaluation standard, and their attitudes toward quantitative research. Training perceptions and quantitative research attitudes were low to moderate, with no statistical differences across program accreditation or specialty area. Implications and possibilities for future research are discussed.     

A SYSTEMATIC FRAMEWORK FOR ADDRESSING TREATMENT INTEGRITY IN SCHOOL SETTINGS

School psychologists are tasked with ensuring treatment integrity because the level of intervention implementation affects decisions about student progress. Treatment integrity includes multiple dimensions that may impact the effectiveness of an intervention including adherence, dosage, quality, and engagement. Unfortunately, treatment integrity is not routinely monitored in consultation. A systematic framework is needed to better prepare practitioners to assess, analyze, and intervene when there are treatment integrity failures. A framework for monitoring and improving multiple dimensions of treatment integrity in natural settings is proposed to provide guidance to practitioners through two phases. The first phase focuses on improving initial treatment integrity and the second phase outlines a problem‐solving process for improving treatment integrity.     

A Critical Look into the Beuk Standard-Setting Method

One commonly used compromise standard-setting method is the Beuk (1984) method. A key assumption of the Beuk method is that the emphasis given to the pass rate and the percent correct ratings should be proportional to the extent that the panelists agree on their ratings. However, whether the slope of Beuk line reflects the emphasis that panelists believe should be assigned to the pass rate and the percentage correct ratings has not be fully tested. In this article, I evaluate this critical assumption of the Beuk method by asking panelists to assign importance weights to their percentage correct and pass rate judgments. I show that in several cases that the emphasis suggested by the Beuk slope is noticeably different from what one would expect and is inconsistent with importance weight ratings. I also suggest two ways that the importance weights can be used to calculate alternate cut scores, and I show that one of the ways of calculating cut scores using the importance weights leads to larger potential differences in cut score estimates. I suggest that practitioners should consider collecting importance weights when the Beuk method is used for determining cut scores.