Making the Critical Appraisal for Summaries of Evidence (CASE) for evidence-based medicine (EBM): critical appraisal of summaries of evidence

Objectives:

Standards for evaluating evidence-based medicine (EBM) point-of-care (POC) summaries of research are lacking. The authors developed a “Critical Appraisal for Summaries of Evidence” (CASE) worksheet to help assess the evidence in these tools. The authors then evaluated the reliability of the worksheet.

Methods:

The CASE worksheet was developed with 10 questions covering specificity, authorship, reviewers, methods, grading, clarity, citations, currency, bias, and relevancy. Two reviewers independently assessed a random selection of 384 EBM POC summaries using the worksheet. The responses of the raters were then compared using a kappa score.

Results:

The kappa statistic demonstrated an overall moderate agreement (κ = 0.44) between the reviewers using the CASE worksheet for the 384 summaries. The 3 categories of evaluation questions in which the reviewers disagreed most often were citations (κ =  0), bias (κ = 0.11), and currency (κ = −0.18).

Conclusions:

The CASE worksheet provided an effective checklist for critically analyzing a treatment summary. While the reviewers agreed on worksheet responses for most questions, variation occurred in how the raters navigated the tool and interpreted some of the questions. Further validation of the form by other groups of users should be investigated.

Highlights

• Few critical appraisal tools have been evaluated with inter-rater reliability testing.
• The ways that users of evidence-based medicine (EBM) point-of-care (POC) tools interpret how to appraise an evidence summary—particularly when defining the grading of evidence, currency, and bias—may vary even when a standard evaluation sheet is used.
• The Critical Appraisal for Summaries of Evidence (CASE) worksheet had a moderate level of inter-rater reliability, similar to previous evaluative studies of critical appraisals tools.

Implications

• Medical librarians can develop tools useful for librarians, students, and clinicians to guide them in appraising clinical evidence summaries.
• The CASE worksheet can be a valuable tool to consider the quality of individual evidence summaries and to see patterns of overall quality in EBM POC tools.

     

Diet of disparagement: the racial experiences of black students in a predominantly white university

As an unintended consequence of the Civil Rights Movement and the integrationist vocabulary that it engendered, otherwise progressive thinkers have been unable to describe the adverse impact of actions, attitudes and policies that are not necessarily intended as racist, but function that way nonetheless. Because racism has come to be popularly understood as the product of individual irrationality—aberrant behavior that society abhors—supposedly race neutral actions, attitudes and policies that systematically and predictably benefit whites and adversely impact people of color escape effective critique. This has created a problem on college campuses, where many black students continue to feel alienated and mistreated because of their race. This article argues that issues of race and racism remain important considerations in the lives of black students on predominantly white campuses.     

The effectiveness of a learning disabilities inservice program

Forty-three regular classroom teachers were provided with four one-hour inservice sessions related to the field of learning disabilities. Pre- and posttest administrations of the Learning Disabilities Information Inventory were utilized to measure change resulting from these sessions. Twenty-four control subjects did not participate in these sessions but did complete the dependent measure. An analysis of covariance with pretest scores serving as the covariate indicated that the inservice treatment did result in improved performance on the dependent measure. Approximately 50% of the experimental subjects completed a follow-up questionnaire and most indicated that the sessions increased their knowledge of learning disabilities and provided them with techniques and materials useful in their classroom settings. It is concluded that such inservice sessions are a viable means of increasing classroom teachers' information concerning learning disabilities and the Learning Disabilities Information Inventory is sensitive to the effects of such inservice.     

Robots, jetpacks and time machines: children's ideas of English in the future

This article describes children's views of what English will be like in ten years time. Children from year 2 (6–7 year olds) and year 6 (10–11 year olds) took part in a study which involved discussion, writing activities and interviews. It was found that, on the whole, these children saw English in the future as being a balance between traditional methods of teaching and learning and technological innovations and advancements. For these children, technology will become an essential part of their education and their lives outside school.     

Play centers that encourage literacy development

Teachers are always searching for fresh ideas that address children's growth needs. Ideas that provide learning opportunities which are developmentally appropriate are particularly welcomed. using play as a medium for facilitating literacy growth is one such opportunity. We know from current theory, research and practice that sociodramatic play contributes to children's learning. Its importance in the development of literacy skills has also been investigated and affirmed. See Christie, 1991; Dodge & Frost, 1986; Fisher, 1991; Isenberg & Jacob, 1985; Morrow, 1989, 1990; Morrow & Rand, 1991; Pellegrini, 1980; Rogers & Sawyers, 1988; Schickendanz, 1986; Woodard, 1984.     

Portfolio analysis in the planning of higher education

It has recently been suggested that “portfolio analysis” has a role to play in the strategic planning of institutions of higher education. This article examines this proposition and finds it to be broadly correct. The article discusses the adaptation of the technique to the current context and then describes its application to data from a university.     

Reference books and computerized information services: partners in librarianship

As a basis for thoughts on the roles of reference books and computerized information services in general, a comparison is made of the value to medical libraries of a comprehensive reference tool (the new dual media publication Biomedical Research in Progress) and a comprehensive information center file (the Smithsonian Science Information Exchange, the national resource for information on research in progress). It is concluded that a detailed reference tool which is physically present for library users has several advantages, in particular the provision of both detailed and comprehensive retrieval of all biomedical research information at substantially less annual cost and with faster access time than is possible with comparable questions put to an information center. On the other hand, the information center is able to provide more up-to-date material in more flexible combinations. The recommendation is made that medical libraries avoid treating the comprehensive reference tool and the computerized information file as alternatives and instead view both as necessary and complementary to each other.