Performance of conceptual framework elements for the retrieval of qualitative health literature: a case study

Objective:A growing volume of studies address methods for performing systematic reviews of qualitative studies. One such methodological aspect is the conceptual framework used to structure the review question and plan the search strategy for locating relevant studies. The purpose of this case study was to evaluate the retrieval potential of each element of conceptual frameworks in qualitative systematic reviews in the health sciences.Methods:The presence of elements from conceptual frameworks in publication titles, abstracts, and controlled vocabulary in CINAHL and PubMed was analyzed using a set of qualitative reviews and their included studies as a gold standard. Using a sample of 101 publications, we determined whether particular publications could be retrieved if a specific element from the conceptual framework was used in the search strategy.Results:We found that the relative recall of conceptual framework elements varied considerably, with higher recall for patient/population (99%) and research type (97%) and lower recall for intervention/phenomenon of interest (74%), outcome (79%), and context (61%).Conclusion:The use of patient/population and research type elements had high relative recall for qualitative studies. However, other elements should be used with great care due to lower relative recall.     

Phonological skills and comprehension failure: A test of the phonological processing deficit hypothesis

Shankweiler and colleagues argue that text comprehensionproblems in young children arise from phonological processingdifficulties. Their work has focused on children with poor wordreading ability. We investigated this hypothesis for children whoexperience comprehension difficulties in the presence of age-appropriate word reading skills. We found that good and poorcomprehenders performed comparably on various measures ofphonological processing and differed on a task that made greaterdemands on working memory, Bradley and Bryant's odd-word-outtask. In a final study, hierarchical regression analyses supportedthis distinction: the odd-word-out task was a strong predictor ofreading comprehension performance even after IQ, vocabulary and single word reading had been controlled for, but a lessmemory-dependent phonological task was not. These studiessupport previous work which indicates that poor comprehenders'problems arise from higher-level processing difficulties.     

Investigating the causes of reading comprehension failure: The comprehension-age match design

The reading-level (or reading-age) match design has become a widely-used tool for investigating the possible direction of the relation between particular skills and word reading ability: Cause or consequence. This paper outlines an analogous method for identifying candidate causes of reading comprehension failure, the `comprehension-age match design' and discusses the strengths and limitations of this design.     

The cultural value of heritage: evidence from the Heritage Lottery Fund

The Heritage Lottery Fund has, over the past 13 years, given £4billion to heritage projects of all kinds. As the Fund has matured a greater emphasis has been placed on the evaluation of the social and economic outcomes of this funding. In 2004 we reported on progress with evaluation of the programmes targeted at particular types of heritage (Clark, 2004 Clark, K. 2004. Why fund heritage? The role of research in the Heritage Lottery Fund. Cultural Trends, 52: 65–85.  [Google Scholar]). The greater challenge has been to evaluate the outcomes from the Fund's generic programmes, which can fund any type of heritage and which between them account for over two-thirds of total funding. This article reviews the Fund's experience over the last 3 years in developing and implementing an evaluation system using the Public (or Cultural) Value framework. It presents some initial results from the research so far completed and reviews how far the framework has been useful in suggesting research priorities and organizing findings.