Violation of Selected Item Construction Principles in Educational Measurement

The effects of violating four item construction principles were examined to assess the validity of the principles and the importance of students’ test wiseness. While flawed items were significantly less difficult than sound items, differences in item discrimination, test reliability, and concurrent validity were not observed. These results are interpreted to suggest that variance attributable to test wiseness may be relatively small, and item-writing guidelines may be robust to violation.