Statistical Conclusions Validity Basics: Probability and How Type 1 and Type 2 Errors Obscure the Interpretation of Findings in Communication Research Literatures

Statistical conclusions validity refers to the degree to which we make correct statistical inferences from the analysis of data. The conventional use of null hypothesis significance tests to evaluate scientific hypotheses, coupled with the editorial practices of scholarly journals, lead to probabilistic error rates. The net result is “mixed support” in the literature for most hypotheses, regardless of the merit of the hypothesis. This article outlines the mechanisms at play and offers helpful solutions.