The Chain and Post-Stratification Methods for Observed-Score Equating: Their Relationship to Population Invariance

The Non-Equivalent-groups Anchor Test (NEAT) design has been in wide use since at least the early 1940s. It involves two populations of test takers, P and Q, and makes use of an anchor test to link them. Two linking methods used for NEAT designs are those (a) based on chain equating and (b) that use the anchor test to post-stratify the distributions of the two operational test scores to a common population (i.e., Tucker equating and frequency estimation). We show that, under different sets of assumptions, both methods are observed score equating methods and we give conditions under which the methods give identical results. In addition, we develop analogues of the Dorans and Holland (2000) RMSD measures of population invariance of equating methods for the NEAT design for both chain and post-stratification equating methods.     

Using Networks to Visualize and Analyze Process Data for Educational Assessment

New technology enables interactive and adaptive scenario‐based tasks (SBTs) to be adopted in educational measurement. At the same time, it is a challenging problem to build appropriate psychometric models to analyze data collected from these tasks, due to the complexity of the data. This study focuses on process data collected from SBTs. We explore the potential of using concepts and methods from social network analysis to represent and analyze process data. Empirical data were collected from the assessment of Technology and Engineering Literacy, conducted as part of the National Assessment of Educational Progress. For the activity sequences in the process data, we created a transition network using weighted directed networks, with nodes representing actions and directed links connecting two actions only if the first action is followed by the second action in the sequence. This study shows how visualization of the transition networks represents process data and provides insights for item design. This study also explores how network measures are related to existing scoring rubrics and how detailed network measures can be used to make intergroup comparisons.     

Evaluating Equating Results: Percent Relative Error for Chained Kernel Equating

This article presents a method for evaluating equating results. Within the kernel equating framework, the percent relative error (PRE) for chained equipercentile equating was computed under the nonequivalent groups with anchor test (NEAT) design. The method was applied to two data sets to obtain the PRE, which can be used to measure equating effectiveness. The study compared the PRE results for chained and poststratification equating. The results indicated that the chained method transformed the new form score distribution to the reference form scale more effectively than the poststratification method. In addition, the study found that in chained equating, the population weight had impact on score distributions over the target population but not on the equating and PRE results.     

Student Thought and Classroom Language: Examining the Mechanisms of Change in Dialogic Teaching

Dialogue, as a communication form characterized by its commitment to inclusiveness and rationality, has long been advocated by educators as a mechanism for helping students become better thinkers. Unfortunately, numerous claims about the educational potential of participating in dialogue have not resulted in substantial changes in classroom practices. Studies have consistently shown that in today's schools the dominant discourse remains largely monologic. In this article, we present a testable theory of change that suggests how sociocultural processes in a dialogic classroom influence students’ development. We identify and discuss three learning outcomes of dialogic teaching, including epistemological understanding, argument skills, and disciplinary knowledge. We then critically review empirical research related to the proposed theory, highlighting unsolved questions, inconsistencies, and directions for future studies. Finally, we focus on the implications of the proposed integrated theory and reviewed research for teachers and their language use in a classroom.     

Practical Application of a Synthetic Linking Function on Small-Sample Equating

The synthetic function is a weighted average of the identity (the linking function for forms that are known to be completely parallel) and a traditional equating method. The purpose of the present study was to investigate the benefits of the synthetic function on small-sample equating using various real data sets gathered from different administrations of tests from a licensure testing program. We investigated the chained linear, Tucker, Levine, and mean equating methods, along with the identity and the synthetic functions with small samples (N = 19 to 70). The synthetic function did not perform as well as did other linear equating methods because test forms differed markedly in difficulty; thus, the use of the identity function produced substantial bias. The effectiveness of the synthetic function depended on the forms' similarity in difficulty.     

The theoretical foundations of knowledge management

Knowledge management has emerged as an important field for practice and research in information systems. This field is building on theoretical foundations from information economics, strategic management, organizational culture, organizational behavior, organizational structure, artificial intelligence, quality management, and organizational performance measurement. These theories are being used as foundations for new concepts that provide a rationale for managing knowledge, define the process of managing knowledge, and enable us to evaluate the results of this process. Based on articles published between 1995 and 2005, new concepts are emerging, including knowledge economy, knowledge alliance, knowledge culture, knowledge organization, knowledge infrastructure, and knowledge equity. An analysis of the theoretical foundations of knowledge management reveals a healthy arena with a strong foundation and clear directions for future work.     

Local Observed‐Score Kernel Equating

Three local observed‐score kernel equating methods that integrate methods from the local equating and kernel equating frameworks are proposed. The new methods were compared with their earlier counterparts with respect to such measures as bias—as defined by Lord's criterion of equity—and percent relative error. The local kernel item response theory observed‐score equating method, which can be used for any of the common equating designs, had a small amount of bias, a low percent relative error, and a relatively low kernel standard error of equating, even when the accuracy of the test was reduced. The local kernel equating methods for the nonequivalent groups with anchor test generally had low bias and were quite stable against changes in the accuracy or length of the anchor test. Although all proposed methods showed small percent relative errors, the local kernel equating methods for the nonequivalent groups with anchor test design had somewhat larger standard error of equating than their kernel method counterparts.