Examining Contextual Effects in a Practice Analysis: An Application of Dual Scaling

Practice analyses are routinely used in support of the development of occupational and professional certification and licensure examinations. These analyses usually survey incumbents to obtain importance ratings of (1) specific tasks and (2) knowledge, skill, and ability (KSA) statements deemed by subject matter experts as essential to safe and effective practice. Several researchers have made important criticisms of traditional practice analysis procedures, particularly the lack of attention to contextual constructs and the resulting problematic interpretation of mean importance ratings. The present study provides a framework for assessing the impact of context in practice analysis studies. It focuses on a practice analysis of a health profession that sought to enhance the meaning of incumbents' importance ratings by embedding the statements in the context of patient acuities. Results indicate that incumbents' importance ratings varied as a function of patient acuity. Dual scaling analysis was used to obtain a multidimensional visual representation of the associations between importance ratings and contextual content. The implications of the contextual component of the study design for future practice analysis studies are discussed as well as possible applications of this approach to professions in education.