Evaluating academic development in the higher education sector: academic developers’ reflections on using a toolkit resource

The professionalisation of teaching is of increasing importance in UK higher education due to converging processes including the proliferation of managerialism, increasing quality agendas and changes to student fee structures. These have brought into sharp relief the need for greater understanding of how quality teaching evolves in university settings. One key element of this involves academic development and its impacts on teaching and learning. Current literature suggests that a plethora of ideas, frameworks and instruments claiming best practice exist but that take-up of these is inconsistent. This prompted a UK national research project which produced an evidence-based toolkit for evaluating academic development. As part of the toolkit augmentation, academic development representatives from across the sector were asked to create, review and test uniquely tailored evaluation instruments. These instruments were then piloted on university teachers who had participated in teaching-related continuing professional development activities. This paper reports on these individuals’ reflections of using the toolkit. It suggests that academic developers are interested in evaluating the impact of their work on teachers, students and on the wider institutional culture but that confidence and expertise varies. Using the toolkit generated ‘traditional’ evaluation data including satisfaction with the development activity and changes to lecturers’ conceptions and behaviours. However, it also prompted critical discussions around current evaluation practice. This included the need for transformational reform of institutional culture to support links between evaluation and good standing; and making explicit the thorny issue of evidencing student learning. This paper will be of interest to those with an interest or responsibility for evaluating teaching in higher education. The paper offers an important contribution to the international literature at a time when global higher education is faced with questions about teaching, learning and quality. Evaluation, and how to do it well, is timely and important business.     

Screening for problem parenting: preliminary evidence on a promising instrument

This paper reports on efforts aimed toward the development of more effective procedures for identifying mothers who are at elevated risk for problems in parenting. We present data from two independent samples of known maladaptors and corresponding comparison mothers and report on our attempts to cross-validate a promising screening instrument composed of items that index social support and parenting attitudes. The resultant 20-item scale correctly identified over 90% of maladaptive and comparison mothers. When this scale was cross-validated on a second independent sample of maladaptors and comparison mothers, it was again almost 90% accurate. Issues concerning the field application of this promising instrument are discussed and its possible limitations are considered.     

Becoming a mature student: How adult appplicants weigh the advantages and disadvantages of higher education

The data presented in this paper is taken fromthe results of two much larger studies ofmature student decision-making and HigherEducation (HE), which considerprocesses of agency from initial considerationof the possibility of becoming a studentto eventually becoming one. In thispaper, six categories of applicant to HE arediscussed: `Delayed traditional students', `Late starters' who have undergone alife-transforming event e.g. redundancy ordivorce and require `a new start'. `Single parents' `Careerists', who are currently in employment who seek a qualification to make progress in their existing careers, `Escapees' who are currently in employment who want a qualification as a way out of `dead-end' jobs, Finally, the `personal growers', a small number pursuing education for its own sake.These categories of applicants are discussed inlight of the factors that both catalyse andinhibit individuals' decision-making duringapplication to HE.     

“Circle of Friends”—An Exploration of Impact Over Time

This study investigated the impact of different aspects of the circle of friends (CoF) intervention. A naturalistic sample of 14 primary‐aged children with a range of special educational needs were involved, seven of whom were followed‐up a term later, to assess medium‐term impact. The whole‐class meeting was found to be effective in increasing the social inclusion of the focus children. However, with the exception of one child with an autistic spectrum disorder (ASD), the weekly CoF meetings produced no measurable further improvements. Possible explanations for the pattern of findings and implications for educational psychology practice are discussed.     

Interpersonal and psychological predictors of parasocial interaction with different television performers

The study examined the relationship of interpersonal homophily and self‐esteem with the development of parasocial interaction. “Attitude”; homophily was found to be the strongest predictor, among the independent variables, of parasocial interaction for all three groups of television performers. The results also indicated that certain dimensions of a person's self‐esteem helped to predict and to explain parasocial interaction. The study showed how an integration of interpersonal and mass communication theories contributes to our knowledge of parasocial interaction.     

Doing an effective job? Measuring the impact of casework

This article describes an initiative to evaluate the impact of educational psychologists’ (EPs’) casework. Previous studies have often focussed on evaluating processes or reducing outcomes to measurable units. The authors argue that qualitative research methods can be used to illuminate EP effectiveness. They describe a real world and proportionate methodology, crucially aimed at supporting self‐reflection and development. An evaluation of this initiative showed that it can demonstrate EP impact and has validity for individual and service improvement. Implications, including the need to face up to less than positive feedback, are discussed.     

TAKING ACCOUNT OF STUDENTS’ EMPLOYMENT EXPERIENCE IN A COURSE OF INITIAL TEACHER EDUCATION

This study focuses on an industrial, commercial and community experience programme within a full time, one year postgraduate teacher training course. Acknowledging the heterogeneous experiences brought to this course by the students, an attempt was made to detect links between the students’ prior experience and their experience of the industrial, commercial and community programme. The students completed questionnaires before and after a placement and the findings are described. These findings contribute to an evaluation of the programme and suggest a number of important questions for those responsible for designing teacher education courses.     

Effects of Ventilation on Segmental Bioimpedance Spectroscopy Measures Using Generalizability Theory

The purpose of this study was to examine the effect of three ventilation conditions (i.e., normal, regimented, and no-ventilation) on the reproducibility of bioimpedance scores in humans for the forearm and trunk segments. One hundred able-bodied North American men and women, from 18 to 71 years of age, volunteered as participants. The experimenters used a Xitron Bio-Impedance Analyzer System model 4200 instrument with Hydra software (Xitron Technologies, San Diego, California, USA) to collect bioimpedance data on extracellular fluid and intracellular fluid scores. The experimenters analyzed the data using the generalizability theory,with persons as the facet of differentiation and time as the facet of generalization. The major findings were (a) ventilation conditions did not have a significant impact on the reproducibility of the test scores, (b) the forearm segment produced consistently higher intracellular fluid generalizability coefficients across three ventilation conditions for both gender groups when compared to the trunk segment, (c) the trunk segment produced intracellular fluid generalizability coefficients that were higher for the male group, and (d) the measurement error affected extracellular fluid scores less than segmental intracellular fluid scores.