Kirkpatrick plus: Evaluation and continuous improvement with a community focus

For almost 40 years, Donald Kirkpatrick's framework for evaluation has been used as a basic model for the identification and targeting of training-specific interventions in business, government, military, and industry alike. By approaching evaluation from four different perspectives—reaction, learning, behavior, and results—the model has provided a solid basis for the examination of training's impact on the organization. Despite the current practice of measuring one's success according to the success of one's clients, proposed changes in the model have not been frequently adopted. It is therefore likely time for professionals to reevaluate the utility and responsiveness of the Kirk-patrick framework to meet the value-added requirements of today's organizations. This article identifies tools and concepts for being responsive to the new organizational realities not originally addressed by the Kirkpatrick model.     

A rapid evidence‐based service by librarians provided information to answer primary care clinical questions

Background: A librarian consultation service was offered to 88 primary care clinicians during office hours. This included a streamlined evidence‐based process to answer questions in fewer than 20 min. This included a contact centre accessed through a Web‐based platform and using hand‐held devices and computers with Web access. Librarians were given technical training in evidence‐based medicine, including how to summarise evidence. Objectives: To describe the process and lessons learned from developing and operating a rapid response librarian consultation service for primary care clinicians. Methods: Evaluation included librarian interviews and a clinician exit satisfaction survey. Results: Clinicians were positive about its impact on their clinical practice and decision making. The project revealed some important ‘lessons learned’ in the clinical use of hand‐held devices, knowledge translation and training for clinicians and librarians. Conclusions: The Just‐in‐Time Librarian Consultation Service showed that it was possible to provide evidence‐based answers to clinical questions in 15 min or less. The project overcame a number of barriers using innovative solutions. There are many opportunities to build on this experience for future joint projects of librarians and healthcare providers.     

Pedagogical influence of interaction with cooperating teachers on the efficacy beliefs of student teachers

Abstract

Cooperating teachers are often identified as some of the most important figures in the preparation of new teachers, and the reasons are not difficult to understand. Surprisingly, however, very little research has been conducted to quantify the effects of cooperating teachers on student teachers. This study examines the impact of student teachers' perceived interactions with their cooperating teachers and the influence that interaction has on student teachers' self‐efficacy for teaching. Results indicate a moderate correlation between perceptions of teaching efficacy and cooperating teacher‐student teacher interactions. Differences were found in the frequency of interaction based on the certification level of the student teacher, with elementary level student teachers perceiving a greater amount of interaction with their cooperating teachers. However, no differences based on certification level were detected in perceived efficacy. Student teachers' perceptions of the level of guidance offered by their cooperating teachers provided the most reliable predictor for their efficacy belief.     

Do innovation measures actually measure innovation? Obliteration,symbolic adoption,and other finicky challenges in tracking innovation diffusion

Although innovation diffusion is a central topic in policy and strategy, its measurement remains difficult – particularly in cases where the innovation is a complex and possibly ambiguous practice. In this paper, we develop four theoretical mechanisms that may bias diffusion markers by leading to the understatement and/or overstatement of diffusion at different points in time. Employing the case of “green chemistry,” we then compare three different diffusion markers – keywords, database index terms, and domain expert assessments – and we demonstrate how they lead to differing conclusions about the magnitude and timing of diffusion, organizational demography, publication outlets, and collaboration. We also provide suggestive evidence of extensive “greenwashing” by particular organization types and in particular countries. Building on these findings, we point to potential challenges with existing diffusion studies, and we make a case for the incorporation of practitioners in construct measurement and for the integration of comparative metrics in diffusion studies.     

The house that Hugh built: the Adelaide history department during the Stretton era, 1954–1966

In 1954, Hugh Stretton took charge of a threadbare history department at the University of Adelaide. By the end of his tenure as department chair in 1966, staff numbers had increased fivefold and the department was recognised as one of the best of its kind in Australia. Stretton wanted his department to ‘teach history interestingly’, which was his overriding criterion in making new appointments. He also ran a democratic department that went against prevailing notions of ‘God-Professor’ departmental governance. As well as highlighting the singular features of the Adelaide department, the present paper places the growth and the character of ‘The House that Hugh Built’ within wider Australian and global contexts. The ‘Stretton era’ straddled a period of rapid expansion of the university sector both locally and internationally, which entailed a move from a generalist to a more specialised curriculum, with a greater emphasis on research and publication, and a less male-dominated faculty.     

The Consortium and the Commissioner: A Grass Roots Tale of Fighting High Stakes Graduation Testing in New York

The following paper provides a case study of the resistance of the New York Performance Standards Consortium to the state’s unitary high stakes testing policy from 1998 to 2006. After detailing the history of the grass roots actions undertaken by the group of alternative high schools called ‘The Consortium’, the analysis seeks to apply sociological and philosophical theory of, among others, John Rawls and Charles Willie to explain: (1) the success of the subdominant people of power in fighting the implementation of the battery of high stakes graduation tests; and (2) the failures of the dominant state authority to uniformly enforce its policy, with particular regard to the decisions of New York’s Commissioner of Education. Implications of the case are then discussed to place this little known educational struggle in a broader social, political and historical context.

New Media

WIRED CITIES: SHAPING THE FUTURE OF COMMUNICATIONS edited by William H. Dutton, et al. (Boston: G.K. Hall, 1987—$45.00, with a paperback also available)

TOMORROW'S TVs: A REVIEW OF NEW TV SET TECHNOLOGY, RELATED VIDEO EQUIPMENT AND POTENTIAL MARKET IMPACTS, 1987–1995 by Gary H. Arlen (National Association of Broadcasters, 1771 N. St NW, Washington, DC 20036—$49.95 but $24.95 to NAB and BEA members, paper)

THE VIDEOTEX AND TELETEXT HANDBOOK: HOME AND OFFICE COMMUNICATIONS USING MICROCOMPUTERS AND TERMINALS by Paul Hurly, et al . (New York: Harper & Row, 1985—$21.95, paper)

TELEGUIDE: A HANDBOOK ON VIDEO-TELECONFERENCING by Doug Widner (Public Service Satellite Consortium, 600 Maryland Ave. SW, Suite 220, Washington, DC 20024—$49.95, paper; half that to PSSC members)

COMPUTERS IN VIDEO PRODUCTION by Lon McQuillin (White Plains, NY: Knowledge Industry Publications, 1986—$39.95)