Digital Module 11: Bayesian Psychometric Modeling https://ncme.elevate.commpartners.com

In this digital ITEMS module, Dr. Roy Levy describes Bayesian approaches to psychometric modeling. He discusses how Bayesian inference is a mechanism for reasoning in a probability-modeling framework and is well-suited to core problems in educational measurement: reasoning from student performances on an assessment to make inferences about their capabilities more broadly conceived, as well as fitting models to characterize the psychometric properties of tasks. The approach is first developed in the context of estimating a mean and variance of a normal distribution before turning to the context of unidimensional item response theory (IRT) models for dichotomously scored data. Dr. Levy illustrates the process of fitting Bayesian models using the JAGS software facilitated through the R statistical environment. The module is designed to be relevant for students, researchers, and data scientists in various disciplines such as education, psychology, sociology, political science, business, health, and other social sciences. It contains audio-narrated slides, diagnostic quiz questions, and data-based activities with video solutions as well as curated resources and a glossary.     

Content Validation of the Community College Student Success Program Inventory

This study reports on the content validation of the Community College Student Success Program Inventory (CCSSPI), a structured interview protocol for program personnel, designed to serve as a tool for researchers and practitioners alike to account for critical features of various types of student success programs in detailed and comparable ways across multiple sites. In all, 20 subject matter experts (SMEs) rated the relevancy and clarity of each item to ascertain essential program features. Content validity index (CVI) and scale-level index scores (S-CVI) were calculated. Results showed high to moderately high validity for items related to course goals, logistics, skills-focused curricular items, and academic and student services. Other contingent facets—collaborative and contextualized learning, co-curricular and community activities, ancillary instruction, and instructor role—were rated as less valid, depending on program goals. The instrument is recommended for use in multisite qualitative or mixed-methods research and institutional improvement.     

Criminal Justice Professionals’ Knowledge of Institutional Review Boards (IRBs) and Compliance with IRB Protocol

Institutional Review Boards (IRBs) perform an essential function in the protection of human participants. A survey was conducted on Academy of Criminal Justice Sciences members to determine their perceptions of IRBs as well as their knowledge of IRB principles and the extent to which they follow IRB protocol. Size of the researcher’s institution, number of research articles, number of years in active research, and number of external grants were also studied in relation to knowledge of IRB guidelines and number of IRB protocol infractions. Findings include significant correlations between involvement in research and engaging in research activities that are against IRB rules.