Evaluation Research: A Pragmatic,Program-Focused,Research Strategy for Decision-Makers

Human resource development (HRD) practitioners frequently need to gather and organize data to support decisions about programs. Unfortunately, in many work environments there is a short time available to gather data in support of the decision-making process. Yet the ability to develop or use data or to convince others to use data has become the prime concern of decisionmakers. The evaluation research strategy contains four primary features—utility, feasibility, proprietorship, and accuracy. With a philosophical foundation grounded in pragmatism, evaluation research follows a four-level decision-making hierarchy: purpose, techniques, plan, and implementation. In addition, there are nine major purposes. There are two primary participants in evaluation research: the researcher and the stakeholder group. The stakeholder group is included because of the belief that people who have a stake in an evaluation research outcome should be actively and meaningfully involved in shaping that research effort, thus increasing the likelihood of utilization. Evaluation research may be goal-driven; or it may focus on evaluation questions, concerns and issues, program rationales, decisions or problems, or organization (client) needs.     

Multimedia Science Kits: A Museum Project on Women Scientists and Their Research

The University of Nebraska State Museum (UNSM) is creating multimedia outreach kits on the research of women scientists. The collaborative effort has included Nebraska Educational Telecommunications, curricula developers, biographers, graphic designers, and evaluators. The goal of the project is to increase the number of girls interested in pursuing careers in science, and to this end, women scientists are presented as role models. Wonderwise kits target students in grades four through six through student-centered, inquiry-based activities, specimens and tools, videos of the scientists working in the field, resource-based CD-ROMs, and short biographies of the scientists. This project presents a model of how museums can collaborate with schools to improve science education on a statewide basis.     

Assessment of alcohol and other drug abuse with referred adolescents

Adolescents with alcohol or other drug problems may be referred to school psychologists for assessment and demonstrate symptoms similar to handicapping conditions such as learning disabilities or emotional disturbance. Therefore, school psychologists have a need for assessment techniques to determine the probablity that referred adolescents have alcohol or other drug problems. In this paper, prereferral questionnaires, initial interviews, behavioral observations, and assessment devices are discussed. Suggestions are made for referring substance-abusing adolescents.     

Digital Module 04: Diagnostic Measurement: Modeling Checklists for Practitioners https://ncme.elevate.commpartners.com

In this ITEMS module, we provide a didactic overview of the specification, estimation, evaluation, and interpretation steps for diagnostic measurement/classification models (DCMs), which are a promising psychometric modeling approach. These models can provide detailed skill‐ or attribute‐specific feedback to respondents along multiple latent dimensions and hold theoretical and practical appeal for a variety of fields. We use a current unified modeling framework—the log‐linear cognitive diagnosis model (LCDM)—as well as a series of quality‐control checklists for data analysts and scientific users to review the foundational concepts, practical steps, and interpretational principles for these models. We demonstrate how the models and checklists can be applied in real‐life data‐analysis contexts. A library of macros and supporting files for Excel, SAS, and Mplus are provided along with video tutorials for key practices.     

Doing a Jigsaw Without the Picture

This paper is one teacher's account of an attempt to confront his own professional concerns through a process of critical reflection and classroom‐based self‐evaluation. The writer examines his own motives, as well as the pedagogical issues he faces teaching English to a low‐ability class. The account chronicles the writer's exploration of these issues through an experimental all day workshop on Romeo and Juliet, and concludes with some insights Into the process of curriculum change and the culture of the Institutions within which it takes place.