Preferences of Training Performance Measurement: A Comparative Study of Training Professionals and Non‐training Managers

ABSTRACT This survey‐based study addressed a perceived gap between training performance evaluation practice and decision‐making criteria required in business. Training professionals and non‐training managers in North Carolina were surveyed. The study found that the groups differ in the performance measures that motivate them to act on training issues. Non‐training managers preferred measurements of productivity, organizational climate, product quality, cost, and customer service reports. Training professionals preferred measures of opinions of the trainee's supervisor, end‐of‐training exam scores, progress/work performance reports, and opinions of the trainee. The study concluded that (1) training professionals and non‐training managers react to different training performance measures; (2) training professionals are more likely to react to job/individual‐level performance measures; (3) non‐training managers are more likely to rely on organizational‐level measures; (4) non‐training managers are not primarily concerned with converting training benefits to dollar figures; (5) on‐the‐job tests and customer service reports are valued by both the training profession and business and industry; and (6) the low response suggests a potential lack of interest for the strategic position of the training function.     

A Self‐Management Strategy for Increasing Implementation of Behavioural Procedures by Residential Staff

Two preliminary studies explored the use of a self‐management strategy as a component of a training program for residential Child and Family Workers. The self‐management strategy comprised the Correspondence Training procedures of Risley (1977) and the formulation of specific implementation plans (Sanders & Glynn, 1981). Experiment 1 found that prompting staff to formulate plans of how they would implement target behaviour management skills and providing individual feedback on their performance in accordance with their plans resulted in gains in implementation of target skills; no gains in implementation resulted from Instruction and Group Feedback conditions alone. This experiment examined pooled data from 18 staff collected by regular time sampled observations. Experiment 2 introduced similar procedures in a multiple baseline design to four volunteer staff, each of whom selected two target behavioural skills from the training manual. The self‐management strategy resulted in clear gains in implementation of these self‐selected target skills by all four staff. Results are discussed in terms of the potential of the correspondence training paradigm and the formulation of specific implementation plans as an approach to on‐the‐job training of residential staff.     

Performance Management Applied at the Performer Level

According to Kissler (1991), performance management begins by determining why it should take place at all. He believes that performance management helps organizations sustain or improve performance, promote greater consistency in performance evaluation, and provide high‐quality feedback. Performance management helps organizations link evaluations to employee development and to a merit‐based compensation plan. Moreover, it forms a basis for coaching and mentoring, permits individual input during the evaluation process, and allows for a blend of qualitative and quantitative evaluations. Performance management is a process that helps manage employee expectations of job demands and factors that reveal how well the job is done.     

Manager Coaching Skills: Development and Application

The concept of “manager as coach” is increasingly popular in the management literature as a mechanism for improving employee involvement and performance. This paper summarizes a study to evaluate the effectiveness of a “coaching skills” program for sales managers. The program began with a five–day coaching skills course and was followed by on–the–job activities that called for application of the coaching skills covered in the course. The study used telephone interviews with managers' subordinates to collect data regarding managers' coaching effectiveness prior to the program. Follow–up interviews were conducted three months later. The interviews focused on the eight coaching behaviors identified by Schelling (1991). Quantitative analyses showed statistically significant increases on the follow–up ratings on five of the eight coaching behaviors. Further analysis revealed that subordinates who had not worked with their supervisors long tended to give lower ratings. Additionally, those managers with fewer subordinates often received higher scores on the eight coaching behaviors.     

Effects of Video Feedback on Social Behaviour of Young People with Mild Intellectual Disability and Staff Responses

The present study evaluates the effects of a multifaceted training procedure on the inappropriate and appropriate social behaviour of young people with mild intellectual disability and on staff responses. The training package included youth training with video feedback and self-management procedures and staff training with video and graphic feedback. The data were collected using a reversal baseline design. The results showed an increase in the occurrence of appropriate behaviour on the part of young people with mild intellectual disability. Inconsistent changes were found for inappropriate social behaviour. The provision of video and graphic feedback successfully modified the performance of direct-care staff members. Recommendations are made for further research on factors related to behaviour change in staff and young people with intellectual disability.     

非学历培训班考勤管理问题分析与对策研究

成人教育是我国高等教育的重要组成部分,也是终身教育体系中的重要组成部分,而非学历教育培训是高校成人教育工作的一项重要内容。培训班课堂考勤工作作为日常教学管理工作的重要环节,是保证成人教育非学历培训班开展正常的教学和各项活动的重要手段。具有良好的培训班出勤率,才能保证培训教学过程的顺利进行。这需要培训管理班人员、培训教师、培训学员以及培训学员的相关企业共同努力,了解、分析培训工作中考勤管理存在的问题和相关影响因素,采取有的放矢的措施解决问题,才能确保教育培训的质量。     

Implementation of Bug-in-Ear Coaching by Community-Based Professional Development Providers

Research Findings: Bug-in-ear coaching implemented under highly controlled situations has a promising research base. Yet few researchers have examined its effects when implemented within less controlled environments using authentic professional development conditions. The purpose of this study was to examine the implementation and effects of bug-in-ear coaching when staff from a community organization served as community coaches for early childhood educators. We found that community coaches implemented bug-in-ear methods, but additional supports may be necessary to increase the intensity and quality of feedback provided. Effects of the intervention were observed for 1 of the 6 targeted outcomes for educators. However, effects did not translate to children’s communication outcomes. Practice or Policy: Bug-in-ear coaching is 1 method of providing early childhood educators with performance-based feedback. One benefit is that while community coaches observe educators live, they provide feedback that educators can immediately use to improve practice. However, bug-in-ear coaching poses challenges with respect to reviewing goals and reflecting on one’s performance. Community coaches and educators should systematically plan for reflection so that educators can create new implementation goals to improve their practice. Changing educator practice is a complex endeavor, but bug-in-ear coaching is a promising tool for doing so in a supportive manner.     

Math Is Not a Universal Language: Supporting Middle School Students with Learning Disabilities Using Explicit Vocabulary Instruction in Mathematics Classrooms

Middle school students with learning disabilities often struggle with reading and literacy skills, including vocabulary, and require support in content-area classes such as mathematics where weak vocabulary knowledge can negatively affect learning, achievement, and deep understanding. However, in general, middle school mathematics teachers do not receive training in literacy instruction, much less in explicit vocabulary instruction. Additionally, relatively few studies have examined content-area vocabulary instruction at the middle or secondary school level. This study addressed these gaps in the research by examining the effect of a performance feedback and coaching intervention on middle school mathematics teachers’ use of explicit mathematics vocabulary instruction. Results of the study indicate that performance feedback and coaching had moderately positive effects on teachers’ use and quality of explicit mathematics vocabulary instruction.     

Validating written feedback in clinical formative assessment

Abstract

Formative assessment is widely accepted as being crucial to promoting student learning and, since 2010, the UK General Medical Council has mandated its use in workplace-based clinical training for all new doctors. As a result, the Royal College of Radiologists (RCR) instituted a range of formative workplace-based assessments including the Radiology Direct Observation of Procedural Skills (Rad-DOPS), in which supervisors appraise trainees’ performance in carrying out clinical procedures. This paper reports on the quality of the written feedback in 2,500?Rad-DOPS online feedback forms in addressing the aims of the new assessment approach. Random samples of 500 were selected from the first three years of the new assessment implementation, 2010–13, and from 2016 to 17. Using an appropriate coding frame, the feedback was analysed across the samples against key trainee attributes including stage of training and level of adjudged competence. Criteria for identifying high quality feedback were derived from the literature and a simplified form of qualitative comparative analysis was used to identify the conditions associated with high quality feedback. An average of 97% of the assessments contained written feedback but the number of instances of high quality feedback was found to be exceedingly small at around 5%. The paper offers suggestions for making the feedback process more purposeful in achieving the aims of formative assessment.     

“国培计划”实施十年:历程、经验与展望

2010年我国全面启动实施了"国培计划"。十年来,"国培计划"历经了起步与探索、反思与转型两个阶段,培训了超过1500万名教师,大大提高了教师队伍的综合素质。"国培计划"取得显著成效的基本经验包括:坚持促进教育公平的价值基础,坚持提升教师素质的目标导向,坚持及时反馈不断创新的顶层设计,坚持项目管理为主的推进方式,坚持输血不如造血的培训理念。展望未来,"国培计划"应促进多方联动,注重内在实效并深化专业化程度。     

晋城市民营企业员工培训的现状分析——晋城职业技术学院“校企合作”的案例分析

对当地民营企业的员工进行培训,是晋城职业技术学院＂校企合作＂的主要内容。为了能够满足企业的培训需求,为企业员工提供可行、合理的培训,课题组成员对晋城市20家民营企业进行了调查分析,发现了企业现有培训中存在的问题和不足,挖掘了员工的培训需求,为合理设计员工培训计划,实施有效培训提供了建议和意见。     

REI专业技术人员绩效管理方案设计

以REI专业技术人员为试点对象,在完成工作分析、形成岗位说明书的基础上,根据PDCA循环思想设计绩效管理体系,从分析战略目标、制定绩效计划开始,在绩效管理实施过程中,结合REI自身特点,在分科室和员工两个层次建立关键绩效指标的基础上,运用360度反馈考核法对绩效进行分析评价;最后对评价结果进行反馈面谈,并将其应用于员工发展计划、培训、人事变动等方面,以确保方案的顺利实施。通过动态循环的绩效管理方案的有效实施,为REI专业技术人员绩效管理的完善和提升以及战略目标的实现提供有力支持,以便有效提高REI的服务质量和工作效率,谋求更大发展。     

Use of Writing Samples on Standardized Tests: Susceptibility to Rule-Based Coaching and the Resulting Effects on Score Improvement

Despite the growing use of writing assessments in standardized tests, little is known about coaching effects on writing assessments. Therefore, this study tested the effects of short-term coaching on standardized writing tests, and the transfer of those effects to other writing genres. College freshmen were randomly assigned to either training (receiving nine hours of rule-based coaching) or a control group. Both groups completed pretest essays on the first day, and posttest and transfer essays (writing in a different genre) on the last day of the experiment. Group membership (training versus control) and an interaction between pretest scores and group membership were significant predictors of posttest scores after controlling for pretest performance. Training also produced higher transfer task scores after controlling for pretest and ACT scores. Implications are discussed.     

Portage Guide to Early Education,III: a rapid training and feedback system to teach and maintain mothers,teaching skills

This study reports an evaluation of a method of modifying the teaching skills of three parents of children with severe and profound learning difficulties using a Portage Service. The intervention consisted of a brief verbal and written presentation of the intervention of correct teaching methods. Modelling and brief verbal feedback were also used in the initial parent training session. Maintenance was carried out using systematic positive monitoring every week. Weekly written and verbal feedback were given to the parents. The feedback was based on scoring videotapes of the previous week's teaching session. A measure of far generalisation, the Home Visitors’ written notes on records of children not involved directly in this study, indicated some limited generalisation to families not directly participating in the study. The implication for training of Home Visitors and parents within Portage and similar services are discussed.     

“国培计划”与贵州农村初中历史课程改革

贵州农村初中历史教育存在种种问题,教师队伍整体素质偏低是一个重要因素。2010年实施的“国培计划——贵州农村中小学教师置换脱产研修”项目包括了历史学科,对来自40所农村中学的初中历史教师进行为期3个月的脱产培训,有助于进一步推进贵州农村初中历史课改和素质教育。     

Implementation Effects of a Program for the Training of Coaching Skills with School Principals∗

In this study, the implementation effects of a program for the training of coaching skills to Dutch primary school principals are described. Coaching is a form of in‐class support intended to provide teachers with feedback on their own functioning, and thereby to stimulate self‐reflection and self‐analysis in order to improve instructional effectiveness. To assist school principals in their attempts to coach teachers, a training program was designed and evaluated. Based on the pre‐ and post‐training ratings of coaching conferences, a significant treatment effect was found for the coaching skills concerned with the development of autonomy (empowerment), feedback, and agreement on classroom observational goals. The pre‐ and post‐training ratings from the coached teachers themselves showed a significant treatment effect for the coaching skills concerned with the development of improvement plans. Although the training provided for the school principals was directed at the coaching functions of consulting and confronting, the majority of the school principals conducted coaching conferences that emphasized predominantly the function of consulting.

     

Factors affecting turnover among family child care providers: A longitudinal study

The high turnover rates evident among family child care providers undermine the quality of care provided to children. In this study, we followed 57 family child care providers longitudinally to identify precursors of turnover. Job stress, education, and training directly affected turnover. Providers most likely to leave the profession were more educated, less trained, and reported higher levels of stress. Training and the presence of the provider's own young children indirectly affected turnover through their relationship to job stress. Providers who cared for their own preschool children experienced higher levels of job stress. In contrast, training was associated with lower job stress, but only for less educated providers. The presence of the provider's own young children and training also were associated with greater job satisfaction, but job satisfaction was unrelated to turnover. Finally, there was a curvilinear relationship between job tenure and job stress and, to a lesser extent, turnover. Providers who had been caring for children between 2 and 8 years reported the highest levels of job stress and turnover, although turnover rates were also high during the first 2 years of beginning family child care.     

Metacognition and Human Performance Improvement

An understanding of the uses of meta-cognition provides a powerful tool toward developing quality and efficiency in task learning and performance. Metacognition is the executive controller of cognitive processes responsible both for self regulated learning and work performance outcomes. Comprehension monitoring and motivation are two prime components of metacognition which are responsible for commitment to, and definition of, goals, monitoring progress toward goals, and activating the appropriate thinking skills to achieve goals. Specific thinking skill categories of attention, organization, and elaboration are described with examples of how specific techniques in each category can optimize learning and job performance. Research on training of metacognitive skills through both detached and embedded skill-development programs is reviewed. In addition, ways to compensate for metacognitive skills when training is not cost-effective are described. The relationship between metacognitive skills and effective management of work performance is stressed.     

Metacognition and Human Performance Improvement Originally published in 1988, PIQ 1.1

An understanding of the uses of metacognition provides a powerful tool toward developing quality and efficiency in task learning and performance. Metacognition is the executive controller of cognitive processes responsible both for self regulated learning and work performance outcomes. Comprehension monitoring and motivation are two prime components of metacognition which are responsible for commitment to, and definition of, goals, monitoring progress toward goals, and activating the appropriate thinking skills to achieve goals. Specific thinking skill categories of attention, organization, and elaboration are described with examples of how specific techniques in each category can optimize learning and job performance. Research on training of metacognitive skills through both detached and embedded skill-development programs is reviewed. In addition, ways to compensate for metacognitive skills when training is not cost-effective are described. The relationship between metacognitive skills and effective management of work performance is stressed.