Evaluating academic development in the higher education sector: academic developers’ reflections on using a toolkit resource

The professionalisation of teaching is of increasing importance in UK higher education due to converging processes including the proliferation of managerialism, increasing quality agendas and changes to student fee structures. These have brought into sharp relief the need for greater understanding of how quality teaching evolves in university settings. One key element of this involves academic development and its impacts on teaching and learning. Current literature suggests that a plethora of ideas, frameworks and instruments claiming best practice exist but that take-up of these is inconsistent. This prompted a UK national research project which produced an evidence-based toolkit for evaluating academic development. As part of the toolkit augmentation, academic development representatives from across the sector were asked to create, review and test uniquely tailored evaluation instruments. These instruments were then piloted on university teachers who had participated in teaching-related continuing professional development activities. This paper reports on these individuals’ reflections of using the toolkit. It suggests that academic developers are interested in evaluating the impact of their work on teachers, students and on the wider institutional culture but that confidence and expertise varies. Using the toolkit generated ‘traditional’ evaluation data including satisfaction with the development activity and changes to lecturers’ conceptions and behaviours. However, it also prompted critical discussions around current evaluation practice. This included the need for transformational reform of institutional culture to support links between evaluation and good standing; and making explicit the thorny issue of evidencing student learning. This paper will be of interest to those with an interest or responsibility for evaluating teaching in higher education. The paper offers an important contribution to the international literature at a time when global higher education is faced with questions about teaching, learning and quality. Evaluation, and how to do it well, is timely and important business.     

Patterns of participation in year 9 academic testing and factors predicting absence on the day of test

Policies aiming to improve educational outcomes are typically based on academic testing data. However, such data only reflect the performance of students who completed the tests. It is possible that students who were absent have shared characteristics. The proportion of students absent out of all eligible school students and whether they have shared characteristics has not been investigated, as this is only possible through the use of linked administrative data. Participants were born in Western Australia in 1994 and 1995, and their birth records were linked to participation status in the Year 9 academic tests to determine the proportion of students who were absent. Logistic regression was conducted to investigate characteristics which predicted absence on test day. A proportion of non-Aboriginal (3.2 %) and Aboriginal students (21.9 %) were absent on test day. Risk factors which predicted the absence included contact with Child Protection and Family Services, history of maternal mental health problems, and fathers aged below 20 years at the time of their child’s birth. A significant proportion of students was absent and therefore not represented in academic achievement information. These students were more likely to have experienced adverse events and therefore are not randomly absent. As these data are typically used to inform policies which aim to improve educational outcomes, they may lack the necessary information to adequately address the complex needs of students who are absent on test day. However, findings suggest that service providers, as well as schools may play an important role in encouraging participation in school.     

Searching for Safety Online: Managing "Trolling" in a Feminist Forum

A common phenomenon in online discussion groups is the individual who baits and provokes other group members, often with the result of drawing them into fruitless argument and diverting attention from the stated purposes of the group. This study documents a case in which the members of an online community--a feminist web-based discussion forum--are targeted by a "troll" attempting to disrupt their discussion space. We analyze the strategies that make the troller successful and the targeted group largely ineffectual in responding to his attack, as a means to understand how such behavior might be minimized and managed in general. The analysis further suggests that feminist and other nonmainstream online forums are especially vulnerable, in that they must balance inclusive ideals against the need for protection and safety, a tension that can be exploited by disruptive elements to generate intragroup conflict.     

Screening for lead poisoning in urban school children of southern India using capillary and venous blood samples

Our study aimed at comparing lead and zinc protoporphyrin (ZPP) levels in capillary and venous blood samples in a small population and to employ an easier method of sample collection for a major screening program in school children in major Indian cities. An awareness program on lead and its effects was conducted in two different schools. A total of thirty urban school children from South India, with an age group between 4–12 years consented for dual blood sampling and reported for the study. Venous and capillary blood samples were obtained simultaneously. Blood lead and zinc protoporphyrin (ZPP) levels were estimated using ESA Lead Analyzer and Haematofluorometer respectively. A significant correlation between capillary and venous ZPP (r=0.98) and lead (r=0.99) was observed. Rank sum test showed that there is no statistically significant difference between capillary and venous ZPP (P=0.891) and lead (P=0.672) values. This pilot study recommends that screening for lead may be done using capillary blood samples since significant correlation is observed between capillary and venous blood measurements. Obtaining samples using this mode is a non-invasive, less expensive, quick and easy method in children. Appropriately performed capillary sampling may be considered as an acceptable alternative to venipuncture for screening of blood for lead poisoning both in children and adults.     

A RE-AIM evaluation of theory-based physical activity interventions

Although physical activity interventions have been shown to effectively modify behavior, little research has examined the potential of these interventions for adoption in real-world settings. The purpose of this literature review was to evaluate the external validity of 57 theory-based physical activity interventions using the RE-AIM framework. The physical activity interventions included were more likely to report on issues of internal, rather than external validity and on individual, rather than organizational components of the RE-AIM framework, making the translation of many interventions into practice difficult. Furthermore, most studies included motivated, healthy participants, thus reducing the generalizability of the interventions to real-world settings that provide services to more diverse populations. To determine if a given intervention is feasible and effective in translational research, more information should be reported about the factors that affect external validity.     

Peer Play Interactions and Learning for Low-Income Preschool Children: The Moderating Role of Classroom Quality

Research Findings: The present study examined the degree to which the association between interactive peer play and academic skills was dependent upon the level of classroom quality for a representative sample of culturally and linguistically diverse urban Head Start children (N = 304 children across 53 classrooms). Peer play interactions within the classroom were assessed by teacher assistants in the fall of the year; observations of the quality of classroom instructional, emotional, and organizational support were conducted in the middle of the year; and norm-referenced direct assessments of literacy, language, and mathematics skills were administered in the spring. Findings from multilevel models indicated that disruptive and disconnected peer play behaviors early in the preschool year were associated with lower literacy and language skills regardless of classroom quality. However, interactive peer play early in the year was associated with higher mathematics outcomes when children were enrolled in classrooms characterized by high instructional support. Practice or Policy: Implications for early childhood research, practice, and policy are discussed.     

Domestic abuse prevention education: listening to the views of young people

This paper reports on findings derived as part of a two-year project funded by the European Union's Daphne III scheme, involving collaboration between seven partner organisations across six European countries. The project involved an evaluation, using questionnaires and focus groups, of domestic abuse prevention education programmes delivered in schools in the UK, France and Spain. This paper presents the findings from the UK focus group discussions, conducted with young people aged 10–11 years, and 13–14 years to explore their opinions about the intervention delivered in their school. The focus groups revealed the following challenges for service providers in this area: young people can misunderstand issues related to domestic abuse, especially the role of power and control within relationships; there is a tension between educators giving young people free expression to share their opinions and challenging sexism and other prejudices; and boys can become disengaged with gender-based interventions. These issues point towards three key considerations when implementing a domestic abuse prevention education intervention: programme content (the what); the teaching methods used (the how); and whether teachers or external organisations should deliver the programme (the who).