Problem solving in schools and beyond: Transitions from the naive to the neophyte to the master

Techniques emerging from the considerable research on cognitive aspects of survey methodology include various forms of probing and cognitive interviewing. These techniques are used to examine whether respondents' interpretations of self-report items are consistent with researchers' assumptions and intended meanings given the constructs the items are designed to measure. However, although informal procedures are common, such developments have not been systematically applied in educational research. We describe how information derived from the systematic application of cognitive pretesting can contribute to determining the validity—designated cognitive validity—of self-report items. Examples are presented from prominent motivation-related instruments that assess real-world instructional practices, mastery classroom goal structure, and student self-efficacy. The implications and pragmatics of adopting this approach are discussed.     

“When I Grow Up I'd Like to Work in a Place Like This”: Museum Professionals' Narratives of Early Interest in Museums

As part of an exploratory research study, museum professionals were asked to share their stories about pivotal learning experiences in museums. Several offered personal narratives of how they first became interested in museums and started down the path toward careers in museum work, or had their imaginations opened to the possibility of broader life horizons. This group of stories seemed to be grounded in particularly vivid memories and frequently elicited strong emotions in the telling. The narratives are evidence of the impact of early museum experiences on people who later found their way into museum careers, and suggest avenues for further study of the roots of museum careers as well as other ways museums profoundly affect people's lives. The stories can also reveal to the teller, as well as to researchers and others, what stands out in their memories and the importance they assign to those memories. By attending to the thematic and emotional content of these narratives, both narrator and colleagues can find clues about where their beliefs and values really lie and, therefore, where their and the profession's time and resources might be most productively invested.