An evaluation of papers submitted for APA's division of educational psychology 1974 annual program 1

Analyses of the rating data for papers submitted to the Division of Educational Psychology's program committee for inclusion in the 1974 APA convention are reported. Interjudge reliability was estimated, the rating scale scores were factor analyzed, and the judges’ reasons for non‐acceptance of papers were content analyzed. Results showed that the judges (a) were reliable, (b) tended to rely on an overall rating dimension, and (c) did not accept papers because data or results were lacking, research methods were in error, the topic was inappropriate for the Division of Educational Psychology, or the theory was weak. Avoiding such errors should increase the probability that a paper will be accepted.