A validated search assessment tool: assessing practice-based learning and improvement in a residency program

Objective:

The objective of this study was to validate an assessment instrument for MEDLINE search strategies at an academic medical center.

Method:

Two approaches were used to investigate if the search assessment tool could capture performance differences in search strategy construction. First, data from an evaluation of MEDLINE searches from a pediatric resident''s longitudinal assessment were investigated. Second, a cross-section of search strategies from residents in one incoming class was compared with strategies of residents graduating a year later. MEDLINE search strategies formulated by faculty who had been identified as having search expertise were used as a gold standard comparison. Participants were presented with a clinical scenario and asked to identify the search question and conduct a MEDLINE search. Two librarians rated the blinded search strategies.

Results:

Search strategy scores were significantly higher for residents who received training than the comparison group with no training. There was no significant difference in search strategy scores between senior residents who received training and faculty experts.

Conclusion:

The results provide evidence for the validity of the instrument to evaluate MEDLINE search strategies. This assessment tool can measure improvements in information-seeking skills and provide data to fulfill Accreditation Council for Graduate Medical Education competencies.

Highlights

• The University of Michigan MEDLINE Search Assessment tool can be used to assess search skills in residency education.
• Five elements were identified as critical elements in the development of an effective MEDLINE search strategy: inclusion of all search concepts, appropriate use of Medical Subject Headings, appropriate use of search limits, successful combination of all concepts, and search efficiency.

Implications

• This validated assessment tool can serve as an effective means to measure improvements in residents'' information-seeking skills and provide data to fulfill Accreditation Council for Graduate Medical Education competencies.

     

A Survey of Opinion on Methods of Professional Development for Secondary Heads

This paper describes a school management development programme aimed at developing managerial skills and responsibilities across the whole school staff. The paper describes why there is possibly some antipathy to this topic for in‐service education and training (INSET). The approach chosen was to use teachers’ current managerial tasks as the focus for the development so that in conjunction with extant self‐study materials, teachers could design their own INSET appropriate to their current perceived needs.     

School Job Descriptions: Purpose and Preparation

This paper emerged following recent research into the causes and effects of occupational pressures on primary headteachers in West Berkshire. The heads concerned were grouped according to a measure of the Type A/Type B personality dichotomy and their reported vulnerability to particular pressures related to this variable. Some conclusions are noted as are reported effective coping devices. The paper concludes with a brief examination of the implications of the research findings for local authorities.