| Abstract: | This study reexamines results reported by Angoff and Schrader (1981, 1984) regarding formula directions and rights directions for standardized tests. In that study, it was concluded that the two scoring directions were essentially equivalent. In this study, methodological concerns are discussed and additional data analyses undertaken. Among the methodological concerns discussed are the potential problems in using volunteers for the College Board phase of the study and the likelihood of treatment contamination in the Graduate Management Admissions Test (GMAT) phase. Estimates of success rates of the rights directions group on items omitted and not reached by the formula group, were beyond chance levels by 0.6 % to 13.0 % for the College Board tests and at or below chance levels for the GMAT. Alternative interpretations of the data and suggestions for additional research are proposed. |
