Tracking New Directions in the Evaluation of Postgraduate Supervision

This article focuses on the evaluation of thesis supervision and highlights the vast range of problem areas presently documented as significant areas of concern for both graduate students and their supervisors. Additionally, the authors report on a study completed in 1995, which surveyed all Australian universities about current evaluative practices in postgraduate supervision. The conclusion of this study was that the conduct of such evaluations appears to be minimal and is primarily designed to obtain an indicator of the general health of a university's postgraduate supervision rather than to foster improved supervisory practices. As part of the same study, the authors conducted University faculty-based student and supervisor focus groups. Key issues emerging from these focus groups were: (1) the importance of relational aspects of supervision as the student communicates over the long term with one or more supervisors; (2) the importance of systematic feedback, monitoring, and evaluation to the supervisory process; and (3) the lack of strategies to facilitate this evaluative feedback process. On the basis of these findings, the authors designed evaluative strategies to facilitate regular ongoing feedback between students and supervisors.     

The role of reinforcement and nonreinforcement in an operant frustration effect

Male albino rats were run in a discrete-trial two-bar operant analog of the double alley. Completion of a FR 4 response chain on the first bar was rewarded 50% of the time for the 12 experimental Ss, but was never rewarded for the 12 control Ss. Both groups received consistent reward at the end of a FR 4 chain on the second bar. Eighty-four trials were given at a rate of four trials per day. A significantly faster rate of responding on the second bar was found following nonrewarded first-bar ratios than following rewarded first-bar ratios. This frustration effect was not attributable to response depression, since the nonrewarded performance of the experimental group exceeded that of the control group.     

Learning science through writing: associations with prior conceptions of writing and perceptions of a writing program

Students in a large undergraduate biology course were expected to write a scientific report as a key part of their course design. This study investigates the quality of learning arising from the writing experience and how it relates to the quality of students’ preconceptions of learning through writing and their perceptions of their writing program that led to their report. Closed‐ended questionnaires investigating student conceptions and perceptions of writing, and approaches to writing, were completed by 121 students. Significant associations were found amongst qualitatively different prior and post conceptions of writing, approaches to writing and achievement. The results of the analyses suggest that the effective support of student experiences of writing reports requires teachers to be aware of the type of conceptions that students bring to their course and the perceptions they hold about the purpose of the writing program in which they are engaged.     

Physiotherapy Student Clinical Education: the influence of subjective judgements on observational assessment

The process of assessing students on clinical placements has to date been under‐researched. In particular, while the involvement of subjective judgements in assessing students has been discussed in the literature, there has been no attempt to look for systematic evidence. This paper comprises the first attempt to relate judgement theory to the assessment of vocational education. Preliminary results demonstrate that physiotherapy assessors made subjective judgements of their students, that these contributed to the determination of assessment grades, and that in certain cases these judgements were erroneous. The relationship of these subjective judgements to the awarding of grades via a supposedly objective assessment instrument is not yet known. Given the widespread use of such assessment instruments across different professions, the question raised is whether all observational assessment systems suffer from similar problems. If students are being judged on criteria not included on assessment instruments, perhaps the other criteria being used need to be made more explicit.     

A CASE FOR SELF‐ASSESSMENT BASED ON RECENT STUDIES OF STUDENT LEARNING

An account of an experiment in self‐assessed learning where the lecturer used his authority to give his students responsibility for their own assessment. Students were expected to set their own goals, week‐by‐week, and prepare a self‐assessment, which was open to questioning and discussion by other members of the group, but which involved only the individual student in the final decision.

The difficulties encountered are clearly stated, but the final judgment is that only such methods can achieve deep processing in Higher Education. It is also argued that conventional methods of evaluation are inappropriate for this style of learning.     

Evaluating a computer‐based reading programme with children with Intellectual Disabilities: feasibility and pilot research

Increasing evidence indicates that individuals with Intellectual Disabilities (ID) might benefit from phonics‐based reading instruction. However, research and instruction in this field has predominantly focused on sight word reading. Models for complex interventions recommend that feasibility research be conducted prior to conducting randomised studies to assess efficacy of interventions (Thabane et al., 2010). The aim of the current paper is therefore to investigate feasibility questions relating to conducting a full‐scale randomised controlled trial (RCT) evaluation of an online, phonics‐based reading programme (Headsprout^? Early Reading; HER) with children with ID. Employing a randomised pre‐test post‐test group design, this study explores and trials important aspects of a RCT evaluation to inform a full‐scale RCT. We also found that HER had a significant effect on reading skills when compared with ‘education as usual’, with large effect sizes on the main outcome measure. This indicates that further, more robust evaluations using HER with children with ID are a worthwhile pursuit.     

Learning about the past: exploring the opportunities and challenges of using an outdoor learning approach

This paper examines the potential of outdoor learning for supporting children’s understanding of and attitude towards history. A class of primary school children participated in an intensive experiential, residential history programme. A range of data was collected before, during and after the residential programme, and the findings suggest that the experience had a positive impact on the children’s attitude towards history and enabled many of the children to be able to easily recall highly specific factual knowledge. However, the children’s understanding of history as a provisional construct was not developed, as it was not a strong feature of the programme. Nor was the experiential nature of the experience fully exploited. Overall the study suggests that such a programme has the potential to support children’s learning of the past, but a deeper understanding of history, drawing on the benefits of outdoor learning pedagogy, needs to be planned for more explicitly.