Using Performance Indicators to Evaluate Training Effectiveness: Lessons Learned

There is always a general interest in the evaluation of the effects of training on the overall goals of an organization. This paper describes an approach being taken in the nuclear power industry concerning the effectiveness of training on safety. Several approaches to the development of performance indicators as means for monitoring this effectiveness are described. We conclude that the structured use of the opinions of subject–matter experts is virtually the only way to permit success.     

我国企业远程培训研究十年述评

企业远程培训正成为企业培训的主流模式,系统了解该领域的研究现状将有助于从理论和实践上促进企业远程培训发展。学术期刊论文和教育部研究课题是反映研究趋势的两个重要指标。从2000—2009年的研究文献和课题成果的统计分析中,显示出现阶段我国企业远程培训的研究特点和不足。我国企业远程培训研究主题主要集中在一般性理论探讨和培训模式等方面．对如何具体实施开展企业E—Learning培训的研究较少。企业远程培训未来研究趋向是：自身理论建设、个案研究、效益评估,特别是企业E—Leaming的实证研究和理论研究等。     

听力策略培训对大学英语听力焦虑的影响

本研究采用问卷调查和访谈的方法探讨了听力焦虑的根源,并且通过实证的方法验证了听力策略训练对缓解听力焦虑,提高听力水平的有效性。该研究为我们在普通高校开展听力策略培训提供了理论依据和具体操作方法,并且能帮助学生尽快了解听力理解的特点和听力焦虑形成的原因,掌握和运用听力理解策略。     

Training for Impact: Improving the Quality of Staffs Performance

The study reported in this article examines the effects of training, feedback, and on–the–job coaching on the quality of staff performance. Forty staff members in three units of a psychiatric hospital were trained in a new system for writing patient progress notes. Initial training (Training 1) included a) establishing the importance of progress notes, b) rules and format for good notes, and c) examples of properly written notes. Training 1 resulted in slight improvement in performance over baseline. A second training program (Training 2), including examples and non–examples of well–written notes, was followed by a substantial increase in quality of staff notes. The quality of notes reached desired levels only after a feedback component was added in which the trainer posted data showing overall quality of notes and provided individual coaching to staff members regarding quality of group notes. We conclude from these results that the quality of staff performance of an organizationally significant task can be improved by a combination of training, feedback, and on–the–job coaching. Training using both examples and non–examples of properly completed tasks is superior to training using examples only. Training followed by feedback and on–the–job coaching is superior to training alone. The results support our conclusion that omitting a basic element of performance technology will yield low quality performance.     

Training science teachers to utilize better teaching strategies: A research synthesis

This study is a synthesis of practice and research related to the use of behavior analysis to train science teachers. An idealized model (derived from practice) for training science teachers is presented first. Then research related to the categories of the model is reviewed and synthesized. To do this, all available studies on the topic were classified by the type of treatment used to influence the teaching behaviors. The results were meta-analyzed. The effectiveness of training procedures fell into the following order, from lowest to highest: (1) study of an analysis system and self analysis; (2) observing models; (3) analyzing models; and, (4) practice and analysis with feedback. Science educators are encouraged to use the procedures outlined in the model to train better teachers. These results support the idealized model.     

Building National Capacity for Research Mentor Training: An Evidence-Based Approach to Training the Trainers

Research mentor training (RMT), based on the published Entering Mentoring curricula series, has been shown to improve the knowledge and skills of research mentors across career stages, as self-reported by both the mentors engaged in training and their mentees. To promote widespread dissemination and empower others to implement this evidence-based training at their home institutions, we developed an extensive, interactive, multifaceted train-the-trainer workshop. The specific goals of these workshops are to 1) increase facilitator knowledge of an RMT curriculum, 2) increase facilitator confidence in implementing the curriculum, 3) provide a safe environment to practice facilitation of curricular activities, and 4) review implementation strategies and evaluation tools. Data indicate that our approach results in high satisfaction and significant confidence gains among attendees. Of the 195 diverse attendees trained in our workshops since Fall 2010, 44% report implementation at 39 different institutions, collectively training more than 500 mentors. Further, mentors who participated in the RMT sessions led by our trained facilitators report high facilitator effectiveness in guiding discussion. Implications and challenges to building the national capacity needed for improved research mentoring relationships are discussed.     

What Should High–Risk Operations Evaluate Relative To Safety And Safety Training

This article presents a concise argument for strategic planning for training effectiveness evaluation for high–risk operations including nuclear power training. The article looks at external criteria for such evaluation including considerations of: (1) the safety of the general population, (2) the safety of employees, and (3) the cost–effective delivery of the organization's products and services (e.g., the delivery of energy).     

Training school administrators to use information systems: A review of research

Much attention and research has been focused on administrator preparation and school information systems as separate topics. However, very little attention has been focused on training school leaders to use these systems as decision making tools. While research findings signify the importance of this training, scarcely any research has been focused on the effectiveness of training models or other training issues. Therefore, to provide a foundation for further study, the purpose of this chapter is to summarize the extant research on training administrators to use information systems.     

Evaluation of Corporate Training Programs: Perspectives and Issues for Further Research

Performance improvement interventions, including training, are investments that can yield identifiable payoffs for an organization in the form of better job performance. Evaluation is vital to continuous improvement of human performance in the workplace. Without measures of effectiveness, organizations do not know whether dollars are being spent wisely and, consequently, whether to continue, modify, or improve performance interventions. There are several approaches for the evaluation of training programs. Few adequately cover the broader perspective of performance improvement. Various schemes and terms are used to describe facets for evaluating training programs. However, sometimes different terms describe the same event. At other times, quite different training evaluation activities are discussed by different authors using the same terms. The present article reviews six overall evaluation perspectives of corporate training programs: Kirkpatrick's four‐level approach; the CIRO approach; Hamblin's five‐level approach; Florida State University approach; Indiana University approach; and Phillips' five‐level approach. And four research areas for further study are recommended: overall evaluation models, causal relationships between evaluation categories, systematic research on how to evaluate the various categories, and appropriate uses of the results of evaluations.     

The Effects of Trainee Characteristics on Training Effectiveness in Improving Organizational Performance

Despite the existence of many comprehensive and user‐friendly guides to evaluate training programs, most practitioners have had difficulty assessing training effects on corporate outcomes. Research revealed that trainees, organizational, and training‐related factors might influence the effectiveness of training in terms of organizational performance. The current study examines the effects of trainee characteristics among those factors, specifically what kind of trainee characteristics could affect training effectiveness in terms of job performance in a company. In addition, telephone surveys were conducted to aid in understanding of the reasons for leaving and high turnover of company personnel. The current and terminated employees who went through training programs in the company differed when considering previous sales experience in years and type of sales experience as trainee characteristics factors, with those still employed having a statistically higher average number of years and a higher rated type of sales experience. The current employees demonstrated higher job performance. The implications of these results on the attainment of training effectiveness as well as the selection decisions in the organization are discussed.     

提高中小学校长培训实效性的策略探究

影响中小学校长培训实效性的主要因素包括制度缺乏硬约束,培训内容陈旧,重理论轻实践,培训模式单调。提高中小学校长培训的实效性,需要做好培训前的需求调研工作,不断丰富和发展培训计划的内容,理论与实践并重,加强师资队伍建设,注重培训过程和训后跟踪管理。     

技工院校教师专业发展的培训策略探究

教师培训是促进教师专业发展的重要途径。选取广州市工贸技师学院的教师作为研究对象,通过调查技工院校教师的培训需求,确定教师培训的目标,制定相应的培训方案,采取分层式校本培训、项目式教研培训、引导式教学培训、实践式专技培训等策略实施教师培训促进教师专业发展,并在培训后运用柯克帕特里克四层次培训评估模型分析培训成效。     

Funding Government Training Schemes: Mechanisms and Consequences

Abstract

This paper follows the path of public funds allocated to private institutions‐‐Training and Enterprise Councils (TECs)‐‐which, in turn, fund the delivery of Youth Training (soon to be replaced by Youth Credits) and Training for Work. The paper argues that the terms on which funds are allocated to TECs offers little financial incentive for TECs to support high cost, high quality training since their success and cost effectiveness is measured by indicators which take no account of the type of training provided, to whom it is provided and by whom. A TECs performance rating can only be improved if it devotes more of its resources to support for the cheapest, easiest and quickest routes to the government's set of output measures. However, this will do little to cure Britain's well‐known deficiencies in intermediate skills in occupations in which it is costly and lengthy to train.     

Transfer Evaluation of Knowledge and Skill Development: A Case Study of an Instructional Systems Development Training Program

Program evaluation involves a systematic process to collect and convert data into information which is used to improve programs, measure their effects, track quality, act on results, and improve decision making. Beginning in 1992, the LG Group of Korea was involved in an instructional systems development (ISD) training program for its human resource development professionals in cooperation with Indiana University. The LG ISD training program stressed that learning instructional design theories and practices would make LG more effective in global competition. The purposes of the research reported in this article were to evaluate the effectiveness of the ISD training program in terms of transfer of training and to gain information on how to improve future training programs. The findings of the study support the goals that were established for the ISD training program. The program participants are more confident and competent in using the ISD process for analyzing needs for performance improvement and designing and developing quality training products. The article suggests ways of solving barriers to transfer training and evaluation and improving future programs.     

Methodology for Evaluating the Effectiveness of Human Performance in Safety–Oriented Industries: A Conceptual Design

The methodology described here provides an approach for evaluating safe human and organizational performance in nuclear power generating utilities and other high–risk, safety–oriented industries. Using existing indicators of desired organizational performance, internal and external evaluators can measure performance outcomes, as well as the effects of training on performance readiness. The performance outcomes “state of readiness” collectively impact on the safety of organizational operations. This proposed methodology is cost–efficient because it uses existing human and organizational resources; it is unobtrusive on the organization's time and manpower; it can be employed readily by external evaluators; and it can simultaneously be used to analyze an organization's effects on society's safety.     

Training to Improve New Product Sales Performance: The Case of Samsung in China

The authors report a case study conducted with over 8,000 Samsung salespeople in the Chinese market. Using research‐oriented, evidence‐based, and systematic approaches, training professionals contributed to Samsung's business outcomes at multiple levels. The case highlights the valuable impacts of training on salespeople's behaviors and new product sales performance and provides meaningful implications for trainers as they strive to be relevant to their business partners.     

高校教师教育技术培训模型的建立、修改与验证

高校教师的教育技术培训已经成为教育部门的一项常规性工作,但如何提高培训效果一直困扰着各级各类培训机构。该研究利用结构方程建模的统计学方法,建立了高校教师教育技术培训模型,并利用该模型揭示出了提高教育技术培训效果的思路。     

学习障碍学生归因训练研究综述

归因训练是帮助学习障碍学生增强学习动机,提高学习成绩的有效 干预手段。目前关于学习障碍学生的归因训练多以小学生和初中生为对象, 采用的训练方法为直接法和间接法。研究表明,个体和小组形式的归因训练 优于团体归因训练,实验情境中的归因训练优于课堂情境的效果,将策略教 学与归因训练结合比单独使用归因训练更为有效。提高团体形式和课堂情 境中归因训练的有效性是今后研究的重点。     

基于虚拟现实的动漫制作

从建立与现代企业生产需求相适应的培训及现场模拟体系出发,进行基于虚拟现实的安全培训动漫影片制作关键技术研究,开发出了安全培训动漫影片制作平台并进行了影片制作输出.实用制作及成片培训效果表明,该技术达到了预期研发目的,输出的培训影片提升了培训效率和效果.