Alignment of Mathematics State-Level Standards and Assessments: The Role of Reviewer Agreement

This article examines the role of reviewer agreement in judgments about alignment between tests and standards. We used case data from three state alignment studies to explore how different approaches to incorporating reviewer agreement changes alignment conclusions. The three case studies showed varying degrees of reviewer agreement about correspondences between objectives and test items. Moreover, taking into account reviewer agreement in the analyses sometimes had a marked effect on alignment conclusions. We discuss reasons for differences across case studies and alignment approaches, as well as implications for future alignment efforts.     

Instructional Tools in Educational Measurement and Statistics (ITEMS) for School Personnel: Evaluation of Three Web-Based Training Modules

In the current No Child Left Behind era, K‐12 teachers and principals are expected to have a sophisticated understanding of standardized test results, use them to improve instruction, and communicate them to others. The goal of our project, funded by the National Science Foundation, was to develop and evaluate three Web‐based instructional modules in educational measurement and statistics to help school personnel acquire the “assessment literacy” required for these roles. Our first module, “What's the Score?” was administered in 2005 to 113 educators who also completed an assessment literacy quiz. Viewing the module had a small but statistically significant positive effect on quiz scores. Our second module, “What Test Scores Do and Don't Tell Us,” administered in 2006 to 104 educators, was even more effective, primarily among teacher education students. In evaluating our third module, “What's the Difference?” we were able to recruit only 33 participants. Although those who saw the module before taking the quiz outperformed those who did not, results were not statistically significant. Now that the research phase is complete, all ITEMS instructional materials are freely available on our Website.     

Teachers' perspectives on competency-based testing

The study described in this article was designed to gather information about teachers' perspectives on achievement testing and to describe where the competency-based testing in Continuous Uniform Evaluation Systems (CUES) programs fits into teachers' overall plans for teaching and assessing students.The specific objectives of the research were (1) to develop a taxonomy of techniques that teachers use to assess students, (2) to describe teachers' uses and perceptions of various assessment techniques, and (3) to describe the implementation of various assessment activities in natural classroom settings. The results of the study have implications for the design and implementation of instructional systems in school settings.     

Comments made on the occasion of the dedication of the Samuel Torrey Orton Library college of physicians and surgeons,Columbia University

Annals of Dyslexia -     

The privacy of computerized records—The Swedish experience and possible U.S. policy impacts

The widespread use of the computer and the rapid growth of telecommunications technology have sparked debate on the privacy implications of computerized records. Regulations and government programs implemented in response to public pressure for greater protection of records could significantly affect the information system manager and any individual who has personal data recorded in a computerized file. This article considers the implications of possible privacy policy initiatives in the United States in light of Swedish experience.     

Thoughts on Engineering Education

Engineering curricula are in a process of dynamic change as a result of the rapidly accelerating rate of advance technology. The rapid accumulation of knowledge leads to a selection process of the materials to be included in the curriculum. If the emphasis in engineering education is on the imparting of facts even facts about "fundamentals" the engineer will soon be wallowing in the wake of the advancing technology. Major emphasis in engineering education should be placed on developing in the student the open-minded attitudes and the critical approach to the solving of problems be they technical, economic, political, or social problems-that is implicit in the phrase "method of science."