THE VALIDITY AND RELIABILITY OF ORAL EXAMINATIONS IN ASSESSING COGNITIVE SKILLS IN MEDICINE1

In order to attempt to assess aspects of clinical competence, not adequately assessed by other means, the Center for the Study of Medical Education, University of Illinois College of Medicine together with the American Board of Orthopaedic Surgery developed oral examinations in formats specifically designed to yield information on high level cognitive functioning. The examinations were administered to 784 candidates for certification in January 1968. Reliability of the oral problem-solving component score pooled from four examiners was approximately .50. Assessment of content, construct, and concurrent validity made by questionnaire and factor analytic studies indicated that the oral tests identified factors not measured by multiple-choice tests and, therefore, significantly improved the relationship between supervisory evaluations and test scores.     

To answer questions from text,one has to understand what the question is asking: differential effects of question aids as a function of comprehension skill

Reading and Writing - The present study investigates the effectiveness of question paraphrases in supporting students’ understanding of a specific task. Secondary school students (i.e.,...     

ADAPT<Superscript>IT</Superscript>: Tools for training design and evaluation

This article describes a set of computerized tools that support the design and evaluation of competency-based training programs. The training of complex skills such as air traffic control and process control requires a competency-based approach that focuses on the integration and coordination of constituent skills and transfer of learning. At the heart of the training are authentic whole-task practice situations. The instructional design tools are based on van Merriënboer's 4C/ID^* methodology (1997). The article describes a training design tool (Core) that supports the analysis and design for competency-based training programs and an evaluation tool (Eval) that supports the subsequent revision of this training design.     

Wandel in der Fremdsprachenpolitik der DDR

Ohne Zusammenfassung     

Exploring Relationships Among Belief in Genetic Determinism,Genetics Knowledge,and Social Factors

Genetic determinism can be described as the attribution of the formation of traits to genes, where genes are ascribed more causal power than what scientific consensus suggests. Belief in genetic determinism is an educational problem because it contradicts scientific knowledge, and is a societal problem because it has the potential to foster intolerant attitudes such as racism and prejudice against sexual orientation. In this article, we begin by investigating the very nature of belief in genetic determinism. Then, we investigate whether knowledge of genetics and genomics is associated with beliefs in genetic determinism. Finally, we explore the extent to which social factors such as gender, education, and religiosity are associated with genetic determinism. Methodologically, we gathered and analyzed data on beliefs in genetic determinism, knowledge of genetics and genomics, and social variables using the “Public Understanding and Attitudes towards Genetics and Genomics” (PUGGS) instrument. Our analyses of PUGGS responses from a sample of Brazilian university freshmen undergraduates indicated that (1) belief in genetic determinism was best characterized as a construct built up by two dimensions or belief systems: beliefs concerning social traits and beliefs concerning biological traits; (2) levels of belief in genetic determination of social traits were low, which contradicts prior work; (3) associations between knowledge of genetics and genomics and levels of belief in genetic determinism were low; and (4) social factors such as age and religiosity had stronger associations with beliefs in genetic determinism than knowledge. Although our study design precludes causal inferences, our results raise questions about whether enhancing genetic literacy will decrease or prevent beliefs in genetic determinism.     

Multiple‐Choice Tests and Student Understanding: What Is the Connection?

Instructors can use both “multiple‐choice” (MC) and “constructed response” (CR) questions (such as short answer, essay, or problem‐solving questions) to evaluate student understanding of course materials and principles. This article begins by discussing the advantages and concerns of using these alternate test formats and reviews the studies conducted to test the hypothesis (or perhaps better described as the hope) that MC tests, by themselves, perform an adequate job of evaluating student understanding of course materials. Despite research from educational psychology demonstrating the potential for MC tests to measure the same levels of student mastery as CR tests, recent studies in specific educational domains find imperfect relationships between these two performance measures. We suggest that a significant confound in prior experiments has been the treatment of MC questions as homogeneous entities when in fact MC questions may test widely varying levels of student understanding. The primary contribution of the article is a modified research model for CR/MC research based on knowledge‐level analyses of MC test banks and CR question sets from basic computer language programming. The analyses are based on an operationalization of Bloom's Taxonomy of Learning Goals for the domain, which is used to develop a skills‐focused taxonomy of MC questions. However, we propose that their analyses readily generalize to similar teaching domains of interest to decision sciences educators such as modeling and simulation programming.     

Making values education everyone's business

Adults are typically required to make values‐based decisions multiple times each day.Why, then, should a discussion of values not be explicit across the college curriculum and intentionally integrated into the cocurriculum? The authors describe a place where the work of values education is widely shared.     

Do all roads really lead to Rome? The case of spelling acquisition

The French orthographic code is complex, and its acquisition is laborious (Catach, 2008; Fayol & Jaffré, 2008). Three hypotheses attempt to explain orthographic knowledge acquisition (OKA). For some, exposure to the code leads to OKA through a self-learning process (Share, 2004). For others, OKA benefits from graphophonological processes (Coltheart, Rastle, Perry, Langdon, & Ziegler, 2001). Finally, some authors suggest that OKA is possible thanks to visual specific processes (Ans, Carbonnel, & Valdois, 1998). The main goal of this study was to test these hypotheses in a classroom context with comparable samples. In total, 143 2nd-grade children participated in this quasi-experimental study with a pretest, immediate posttest, and delayed posttest design. We assigned participants to one of four conditions. For three conditions, we created three teaching procedures based on each of the hypotheses: frequency of contacts with target words; explicit teaching of graphophonological properties of words; explicit teaching of visual properties of words. The fourth served as a control group. ANOVA analyses indicated that all three experimental conditions favored OKA, showing that the different teaching procedures led to spelling development. However, the visual condition was the most favorable. Three main conclusions can be drawn from this study: (a) models of OKA should account for the different paths that can lead to spelling acquisition; (b) visual properties of words and their acquisition need additional research, and (c) applied research in real classroom contexts is not only relevant for informing teaching practices but also for better understanding how learning takes place.