Correcting Biased Cohen’s Kappa in NVivo |
| |
Authors: | Sang-Yeon Kim Scott S Graham Seokhoon Ahn Michele K Olson Daniel J Card Molly M Kessler |
| |
Institution: | 1. University of Wisconsin-Milwaukee, Milwaukee, Wisconsin;2. University of Kentucky, Lexington, Kentucky |
| |
Abstract: | This study demonstrates that NVivo, a popular research tool for content analysis, produces biased Cohen’s kappa as it calculates the reliability statistic at the character level, which is unsuitable for most content-analytic studies adopting a higher unit of analysis (e.g., sentence, paragraph). Based on empirical data and a statistical simulation, this study proposes a method of bias correction applicable to situations where two independent raters conduct binary coding. |
| |
Keywords: | |
|
|