A SYSTEMATIC FRAMEWORK FOR ADDRESSING TREATMENT INTEGRITY IN SCHOOL SETTINGS

School psychologists are tasked with ensuring treatment integrity because the level of intervention implementation affects decisions about student progress. Treatment integrity includes multiple dimensions that may impact the effectiveness of an intervention including adherence, dosage, quality, and engagement. Unfortunately, treatment integrity is not routinely monitored in consultation. A systematic framework is needed to better prepare practitioners to assess, analyze, and intervene when there are treatment integrity failures. A framework for monitoring and improving multiple dimensions of treatment integrity in natural settings is proposed to provide guidance to practitioners through two phases. The first phase focuses on improving initial treatment integrity and the second phase outlines a problem‐solving process for improving treatment integrity.     

A Process for Reviewing and Evaluating Generated Test Items

Testing organization needs large numbers of high‐quality items due to the proliferation of alternative test administration methods and modern test designs. But the current demand for items far exceeds the supply. Test items, as they are currently written, evoke a process that is both time‐consuming and expensive because each item is written, edited, and reviewed by a subject‐matter expert. One promising approach that may address this challenge is with automatic item generation. Automatic item generation combines cognitive and psychometric modeling practices to guide the production of items that are generated with the aid of computer technology. The purpose of this study is to describe and illustrate a process that can be used to review and evaluate the quality of the generated item by focusing on the content and logic specified within the item generation procedure. We illustrate our process using an item development example from mathematics drawn from the Common Core State Standards and from surgical education drawn from the health sciences domain.