Evaluating electronic resources: Personal Development Planning resources at the Open University,a case study

This paper discusses the evaluation of Web‐based tools to support Personal Development Planning (PDP) in order to illustrate issues associated with the introduction and assessment of the effectiveness of online resources. The aims of the evaluation were based on concerns about the very complex situation that offering online resources including PDP poses for part‐time off‐campus students. In this paper the authors utilize a modified RUFDATA framework (Saunders, 2000 Saunders, M. 2000. Beginning an evaluation with RUFDATA: theorising a practical approach to evaluation planning. Evaluation, 1: 7–21.  [Google Scholar]) and consider the benefits a range of methods, including surveys and observational studies, can offer evaluations of electronic resources. They found that students used and valued some aspects of the provision but that even with best efforts of instructional designers, and user testing at the draft stage, students do not always behave as intended. This evaluation highlighted the need for a range of strategies for evaluating online resources and that regardless of student attitude there are real worries about eLearning imposing extra workload burdens on ‘time poor’ adults.     

Impact of a statewide home visiting program to prevent child abuse

OBJECTIVES: To assess the impact of a voluntary, paraprofessional home visiting program in preventing child maltreatment and reducing the multiple, malleable psychosocial risks for maltreatment for which families had been targeted. METHODS: This collaborative, experimental study focused on 6 Healthy Families Alaska (HFAK) programs; 325 families were enrolled in 2000-2001, randomized to intervention and control groups, and interviewed to measure baseline attributes. Follow-up data were collected when children were 2 years old (85% follow-up rate). Outcomes included maltreatment reports, measures of potential maltreatment and parental risks, for example, poor mental health, substance use, and partner violence. HFAK records were reviewed to measure home visiting services. Home visitors were surveyed to measure perceived effectiveness and training adequacy. RESULTS: Parental risks were common at baseline, and one-sixth of families had a substantiated child protective services report in the child's first 2 years of life. There was no overall program effect on maltreatment reports, and most measures of potential maltreatment. Home visited mothers reported using mild forms of physical discipline less often than control mothers. The groups were similar in their use of more severe forms of physical discipline. There was no program impact on parental risks. There was no impact on outcomes for families with a 'high dose' of home visiting. Home visitors often failed to address parental risks and seldom linked families with community resources. Contradictions in the model compromised effectiveness. CONCLUSIONS: The program did not prevent child maltreatment, nor reduce the parental risks that had made families eligible for service. Research is needed to develop and test strategies to improve the effectiveness of home visiting.     

Action groups as a participative strategy for leading whole-school health promotion: Results on implementation from the INCLUSIVE trial in English secondary schools

Education policy increasingly promotes action groups as a key strategy for student and/or staff participation in school improvement and whole-school health promotion. Such groups can coordinate multi-component interventions, increase participation and engagement, and enable local adaptations, but few process evaluations have assessed this. We evaluated fidelity, feasibility and acceptability of action groups as part of a trial of a whole-school intervention to reduce bullying and aggression and promote health in English secondary schools, which reported multiple health and educational impacts. Action groups involved students and staff, supported by external facilitators, and drew on data on student needs. They aimed to: coordinate implementation of restorative practices and a social and emotional competencies curriculum; review policies and rules; and enact local decisions to modify school environments. Our process evaluation used interviews, focus groups, observations and questionnaires to assess action groups’ fidelity, role in coordination, role in local adaptation, support from external facilitators and data on student needs, and acceptability in engaging members. Fidelity was high in the first two years but lower in the third year when external facilitators withdrew. Student needs data were perceived as useful, but views on external facilitators were mixed. Groups successfully reviewed policies and rules, planned activities and coordinated restorative practices, but were less successful in implementing the curriculum. Success was facilitated by the involvement of school leaders. Members reported high satisfaction and empowerment. Action groups are a promising strategy for leading whole-school health promotion. Implementation is supported by external facilitation, local data and involvement of senior managers.     

Discourse forms in a classroom transitioning to student-centred scientific inquiry through co-teaching

Teacher–student discourse continues to be teacher-centred even though researchers and reform documents have recommended changes toward increased levels of student-centred discourse. In science education this situation is paralleled by effort to make scientific inquiry more student-centred. The purpose of this study was to investigate how discourse forms changed over time in a classroom where the regular teacher and his students were scaffolded in the transitioning to student-centred scientific inquiry. Video-recordings were collected at intervals over one academic year. Three prominent forms of discourse were identified: two teacher-authoritative forms and one more interactive, dialogic form. As the lessons increasingly turned into student-centred scientific inquiry, a shift to the dialogic discourse form was found. Co-teaching provided for (a) guidance towards an organisation of events in the classroom that included regular teacher–student dialogue (b) modelling of the more dialogic form of discourse.     

Managerial Practices and Organizational Conditions That Encourage Employee Growth and Development

This paper focuses on seven major managerial practices and three negative conditions that must be managed to enhance employee growth and development. These managerial practices and conditions have significant potential for human resource development practitioners and performance improvement technologists by providing new perspectives to improve employee performance through employee growth and development activities. Surveys measuring employee perceptions of manager behaviors were administered to 503 MBA and PhD students from the United States, resulting in 463 useable responses. The hypotheses were tested using linear regression and structural equation modeling. Based on the analysis, the researchers found that involving employees in decision making, motivating employees, treating employees as unique individuals, and making certain that managers are effective have the highest influence on employee growth and development.     

MeSH and text-word search strategies: precision,recall, and their implications for library instruction

Objective:This study compared the recall and precision of MeSH-term versus text-word searching to better understand psychosocial MeSH terms and to provide guidance on whether to include both strategies in an information literacy session or how much time should be spent on teaching each search strategy.Methods:Using the relevant recall method, a total of 3,162 resources were considered and evaluated to form a gold standard set of 1,521 relevant resources. We compared resources discussing psychosocial aspects of children and adolescents living with type 1 diabetes using two search strategies: text-word strategy versus MeSH-term strategy. The frequency of MeSH terms, the MeSH hierarchy, and elements of each search strategy were also examined.Results:Using the 1,521 relevant articles, we found that the text-word search strategy had 54% recall, while the MeSH-term strategy had 75% recall. Also, the precision of the text-word strategy was 34.4%, while the precision of the MeSH-term strategy was 47.7%. Therefore, the MeSH-term search strategy yielded both greater recall and greater precision. The MeSH strategy was also more complicated in design and usage than the text-word strategy.Conclusions:This study demonstrates the effectiveness of text-word and MeSH search strategies on precision and recall. The combination of text-word and MeSH strategies is recommended to achieve the most comprehensive results. These results support the idea that MeSH or a similar controlled vocabulary should be taught to experienced and knowledgeable students and practitioners who require a myriad of resources for their literature searches.