Characterising programme‐level assessment environments that support learning

This article outlines a methodology for characterising features of programme‐level assessment environments so that the relationship between features of the assessment environment and students’ learning response can be studied. The methodology was developed through the detailed case study of nine undergraduate degree programmes: one in each of three contrasting discipline areas in each of three contrasting universities. Each case study involved examination of course documentation, interviews with academics and interviews with students, following which each degree programme was coded in relation to a range of features of the assessment environment, such as the proportion of marks derived from examinations and the volume and timeliness of feedback on assignments. Programmes were found to differ profoundly in terms of variables that are known to have implications for student‐learning processes. They also differed widely in the extent to which they illustrated the application of conventional wisdom about curriculum design, embodied in national quality assurance guidelines and the Bologna Agreement. Programmes were found to have either a high volume of summative assessment or a high volume of formative‐only assessment, but never both at the same time. Programmes also differed in the mechanisms used to make goals and standards clear, having either highly explicit curriculum design or high volumes of written and oral feedback, but never both at the same time. The findings suggest that there are distinctive programme‐level assessment environments that operate in quite different ways despite all programmes studied being subject to the same quality assurance code of practice.     

The impact of a cryogenics‐based enrichment programme on attitude towards science and the learning of science concepts

This study explores the impact of a cryogenics‐based enrichment programme, which involves demonstrations that use liquid nitrogen, on attitudes towards science and the learning of science concepts. The findings presented in this paper are based on a sample of 214 fifth‐grade students from two schools in Singapore who had their enrichment lesson in a subzero‐temperature science centre. Overall, the students viewed science as more enjoyable and acquired more interest in wanting to pursue science careers after experiencing the cryogenics‐based enrichment programme, but no remarkable and conclusive change was detected in their perceptions of the social implications of science. Significant knowledge gains were also detected among the participants. The programme did not have any differential impact on students of either gender and from two learning streams, both cognitively and affectively.     

More than nickels and dimes: the health benefits of a community‐based lifelong learning programme for older adults

In Canada, as in many countries, public continuing education of the non‐vocational general interest type for people in post‐work languishes on the margins of political discourse. This case study of one such traditional program for seniors run by a school board in Ontario explores the experiences of older adults and the meanings they attach to their learning. The goal is to better understand the roles and effects later life learning has in promoting health and well‐being at both the individual and community levels. This study analyzes qualitative data collected through interviews, classroom observations and documents, referring to the micro, meso and macro levels of theory in adult education, psychology, health and social gerontology. The three main learning outcomes identified include: 1) the effects of enduring interest, 2) classrooms as social support networks, and 3) the awareness of the right to learn. The article examines how these outcomes function as health promoting mechanisms for individuals and communities. The results indicate the vital role played by affordable and accessible public continuing education program for retirees, especially seniors at risk. They also suggest the need for further quantitative research to measure the impact of learning on health and the quality of later life.     

Students’ experiences of clinic‐based learning during a final year veterinary internship programme

This study investigated veterinary students’ experiences of clinic‐based learning (CBL) during a comprehensive final year internship programme. Open‐ended surveys (n = 93) were used to gather qualitative data about students’ conceptions of what is learned during CBL and their approaches to learning in clinics. Phenomenography was used for detailed analysis of the variation evident in students’ responses. Relationships between qualitative differences in students’ conceptions and approaches were then evaluated using quantitative statistical analysis. Links to achievement during final year were examined. Close associations were found between the quality of students’ experiences of CBL and achievement during the internship programme.     

Talking up learning at work: Cautionary tales in co‐opting everyday learning

Learning in workplaces is always mediated through talk. It is tempting for management to seek to utilise everyday talk as part of learning and therefore enhance productivity. This paper examines the responses of workers to interventions that aim to formalise informal conversations at work as part of an explicit workplace learning strategy. It draws on interviews with managers and workers in a public sector organisation to examine their experience of these practices. The paper raises questions about whether interventions in the name of fostering informal learning may well be hindering what they seek to promote.     

The Psychology of Delivering a Psychological Service: Self‐organised learning as a model for consultation

The article describes how one Educational Psychology Service in the UK developed a service delivery based on self‐organised learning (SOL). This model is linked to the paradigms and discourses within which educational psychology and special educational needs work.

The work described here is dedicated to the memory of Brian Roberts, academic, close friend of Steve and a source of inspiration to both the authors.     

Critical friendship as a contribution to master’s‐level work in an international programme of study

This article reports on an action research project in which the value of critical friendship for students doing research and writing their dissertations within an international master’s course has been explored. This course is run jointly by Roehampton University (London, UK), Charles University (Prague, Czech Republic) together with Fontys OSO (Tilburg, the Netherlands). It describes the process and the results of working with the concept of critical friendship in this master’s course since its start in 2005. Data were collected by means of various qualitative instruments and data sources: evaluation forms after tutorial sessions, reflective logs and focus interviews. The results show that the process of engaging with the research they did was enhanced and supported by the development of critical friendship groups. A number of recommendations have been formulated, such as the importance of discussing the concept of critical friend and its philosophy with the participants and of defining roles and tasks as clearly as possible.     

Bridging the implementation gap: a teacher‐as‐learner approach to teaching and learning policy

A major dilemma facing higher educational institutions around the world is how to achieve quality outcomes for students in an increasingly internationalised and competitive environment. To effect change in teaching and learning, we advocate a teacher‐as‐learner approach to the implementation of teaching and learning policy. Our approach has been influenced by approaches to change management as well as contemporary educational theories, such as constructive alignment and deep and surface approaches to learning. In this paper we use these approaches to evaluate the success of a policy initiative designed to encourage subject coordinators to use a faculty‐endorsed template to embed graduate attributes into their subject outlines. The difficulties experienced by teachers at the disciplinary level in using the subject outline template illustrate how a seemingly positive and well‐intentioned initiative can have a potentially minimal effect on teaching and learning practice and, as a consequence, student learning. We suggest that the Course Experience Questionnaire provides a useful model for evaluating not only teaching but also the management of teaching. As teachers responsible for the implementation of teaching and learning policies, we hope our views will provide a more integrated approach to teaching and learning changes in the higher educational context.     

Enhancing learning at doctoral level through the use of reflection?

The EdD (Doctor in Education) is a professional doctorate that provides a framework for experienced professionals to examine and develop their practice through research and engagement with relevant theoretical perspectives and professional academic literature. This type of doctorate provides the opportunity for professionals to develop their capacity for critical, professional agency, often achieved through the use of reflection for the integration of academic and professional knowledge. This paper explores doctoral students’ perspectives on the nature and value of reflective statements in terms of a product of learning and a process of reflection. The analysis of EdD students’ responses from one university in the UK reveals a connection between the process of reflection and the development of professional knowledge and contribution to practice—major goals of professional doctorate programmes. This small‐scale study has highlighted implications for the role of reflection in EdD programmes for the development of critical, professional agency. At the metacognitive level of the EdD student clarity is lacking regarding the process of reflection—the nature, scope, object, purpose, value and development—which raises the very important question of ‘what counts as adequate reflection and on what grounds’. This study has identified the need to build capacity, first, in the reflective practice of EdD students and second, in the pedagogic demands of the tutors and supervisors and, third, the assessment demands required of examiners.     

Education and training for young people at risk of becoming NEET: findings from an ethnographic study of work‐based learning programmes

This report provides a summary of findings from an ethnographic study of work‐based learning provision for 16–18‐year‐olds who would otherwise fall into the UK Government category of not in education, employment or training (NEET). The research project took place in the north of England during 2008–2009, and investigated the biographies, experiences and aspirations of young people and practitioners working on Entry to Employment (E2E) programmes in four learning sites. The detailed research findings are reported in four papers covering the conceptual background to E2E, and the experiences of learners, tutors and Connexions personal advisers involved with the programme. This report highlights and synthesises some of the key issues raised by these papers and looks ahead to a three‐year longitudinal study of NEET young people which is intended to continue and extend this work, providing an opportunity to follow this group during a period of far‐reaching economic and political change.     

Online versus face‐to‐face learning: looking at modes of instruction in Master’s‐level courses

This study examined performance of Master’s‐level students in an online course in Cognition, Learning and Assessment and compared it with the performance of students in a face‐to‐face classroom setting of the same course (N = 70). Data were collected from six sections of the course over a two‐year period. The same professor taught all sections. Identical final exams plus two common assignments were used to determine whether there were differences in performance. An analysis of covariance, with graduate record exam scores as the covariate, was applied using each of the dependent variables. Students in the face‐to‐face class scored significantly higher on two out of the three measures.     

Web‐based learning environments: developing a framework for evaluation

With the widespread use of web‐based learning environments in the tertiary sector it is important to establish the usability of such environments for the target audience and their effectiveness in terms of meeting the educational objectives. However, a search of the literature has shown a scarcity of systematic evaluative studies of web‐based learning environments. Furthermore, the literature did not reveal a consistent starting position on appropriate methodologies with which to carry out such evaluations. This paper presents a general methodology for evaluating complex systems that is particularly appropriate for web‐based learning systems. Using what is called a trailing methodology (Finne et al., 1995 Finne, H, Levin, M and Nilssen, T. (1995). Trailing research: a model for useful program evaluation. Evaluation, 1(1): 11–31. [Crossref] [Google Scholar]), an evaluation was carried out of a web site that was used with student industrial experience projects. A key element in this evaluation was that the process was adaptive and collaborative; another was that it involved a team with expertise in evaluation, knowledge of the functional aspects of the web site and the educational purpose of the site. The evaluation process pointed to the importance of a flexible approach that utilizes the skills of the key stakeholders.     

‘They call me wonder woman’: the job jurisdictions and work‐related learning of higher level teaching assistants

This paper reports on an in‐depth interview study of the roles, job jurisdictions and associated learning of higher level teaching assistants (HLTAs). This role has the core purpose of covering classes to enable teacher release for planning, preparation and assessment. HLTAs’ individual job jurisdictions are described and discussed as are implications for their knowledge and practice. The HLTAs are found to have wide‐ranging job domains and, sometimes, unexpected involvements which mean they have to improvise practice. The study acknowledges that these HLTAs are being creatively managed and deployed by head teachers for the sake of teachers and schools. However, they are, at times, required to take on planning and cover duties which are beyond their knowledge and training with a likely impact on children’s learning. Given their training and experience it is asked if covering classes to release teachers is the most effective use of their abilities and time.     

Interdisciplinary In‐service at the University: a participatory case‐based model for professional development

Abstract

The Participatory Case‐Based Model for Professional Development is an in‐service model which is useful across the human service disciplines (social work, occupational therapy, public health, special education, early childhood and family education). In the model, participants enrolled in a graduate course engage in dialogue and perspective‐taking, through case analysis and case writing. Using grounded theory and inductive data analyses, the major effects of this professional development model were studied. These effects included: (1) gaining new knowledge; (2) ‘really seeing’ from multiple perspectives; and (3) developing a sense of support, renewal and networking across various professions. Connections to the selected professional development literature —; problem‐based learning, case process and effects, and the practical argument model — offered affirmations and challenges to the Participatory Case‐Based Model for Professional Development     

A computer‐based learning environment in the field of Newtonian mechanics

This paper describes a Computer‐based Learning Environment (CBLE) whose objective is to stimulate and support learning in the field of Newtonian mechanics through exploratory activities in various microworlds. The structure of the microworld TABLE is described in detail. A pilot study is presented: it concerns the modelling process of the learner knowledge in the topic involved and the evaluation of the impact of the exploratory activity on student learning. Some suggestions drawn from the results are discussed.     

The impact of national culture on e‐learning implementation: a comparative study of an Argentinean and a Swedish university

This paper analyses and suggests possible technological innovation strategies in higher educational institutions in Africa. The paper describes management issues in the implementation of eLearning with particular reference to its usage in higher education abroad and in Africa, and also suggests appropriate approaches for technological innovation of higher education in Africa. The major findings of the paper, which are based on three case studies, suggest that eLearning needs to be implemented within a strategically developed framework based on a clear and unified vision and a central educational rationale. The findings further highlight the importance of using a combination of strategies – top–down, bottom–up and inside–out – during the diffusion process to attain coherence, collegiality and ownership. The process of technological transformation is not a smooth translation process but one of dislocations, dilemmas and uncertainties and it is an art to effect change and sustainable technological transformation since people are central to this transformation process.

L'innovation technologique et les stratégies de management pour l'enseignement supérieur en Afrique: L'Harmonisation du réalisme et du l'idéalisme

Cet article analyse et suggére des stratégies d'innovation dans des établissements d'enseignement supérieur en Afrique. Il décrit les problèmes de management qui pose l'introduction du e‐Learning avec une référence particulière pour son usage dans l'enseignement supérieur à l'étranger et en Afrique et suggére les approches appropriées pour l'innovation technologique dans l'enseignement supérieur en Afrique. Les résultats principaux exposés dans cet article qui sont fondés sur trois études de cas suggérent que le e‐Learning doit être introduit dans un cadre stratégique fondé sur une vision clariment unifiée et une rationalisation centrale de l'éducation. De plus ces résultats mettent en évidence l'importance de l'utilisation combinée de plusieurs stratégies : stratégies autant en bas, de bas en haut, d'intérieur et d'extérieur pendant le processus de diffusion afin d'aboutir à la cohérence, la collégialité et la possession. Le processus de transformation technologique n'est pas un processus de translation sans à compris mais un de dislocation, de dilemmes, d'incertitudes et c'est un art de procéder au changement et à une transformation technologique soutenue puisque les hommes sont au c?ur de ce processus de transformation.

Technologische Innovations‐ und Umsetzungsstrategien für höhere Bildung in Afrika: Realität und Idealismus aufeinander abstimmen

Dieser Beitrag analysiert technologische Innovationstrategien und stellt Vorschläge für deren Einführung in höhereren Bildungsinstitutionen in Afrika zur Diskussion. Das Papier beschreibt Managementangelegenheiten bei der Umsetzung von eLearning unter besonderer Berücksichtigung seiner Anwendung in der höheren Bildung im Ausland und in Afrika und schlägt auch entsprechende Ansätze für die technologische Innovation im Bereich der höheren Bildung in Afrika vor. Das wesentliche Ergebmiss dieser Arbeit, die auf drei Fallstudien beruht, ist, dass eLearning innerhalb eines strategisch entwickelten Rahmens, basierend auf einer klaren und einheitlichen Sichtweise und einer zentralen bildungslogischen Grundlage eingeführt werden muß. Die Befunde heben weiter die Wichtigkeit hervor, eine Kombination von Strategien zu verwenden: Top‐Down, Bottom‐Up und Inside‐Out Strategien während des Ausbreitungsprozesses, um Kohärenz, Kollegialität und Eigentumsrechte zu erlangen. Der Prozeß technologischer Transformation ist nicht etwa eine sanfte Überleitung, sondern von Verfremdung, Dilemmata und Unsicherheit begleitet. Es ist eine Kunst, Änderung und nachhaltige technologische Transformation zu bewirken, da ja die Menschen das zentrale Element dieses Transformation-sprozesses sind.     

Why do learning goals (not) work: a reexamination of the hypothesized effectiveness of learning goals based on students’ behaviour and cognitive processes

Explicitly informing students about learning goals has been argued to foster intentional learning. This study tested three theoretical hypotheses regarding the facilitating effects of learning goals by investigating 72 students’ actual reading behaviour and cognitive processes (i.e., the use of learning goals). Participants studied a text presented on 15 separate computer screens with/without learning goals. In line with the three hypotheses, the analyses focused on three aspects: students’ interpretations of the learning goals, information selection processes and monitoring behaviour. Results indicated variability among students in their perceptions of the learning goals in terms of goal consistency and specificity. Students in the learning goal condition recorded more goal-relevant information in their notes. However, only few students deliberately used learning goals to monitor their goal-directed activities while studying the text. Analysis of students’ reading behaviour and cognitive processes suggests that the absence of significant performance differences between the conditions can be explained by referring to students’ actual use of learning goals.     

Variation in the conduct and the quality of self‐evaluations: a multi‐level path analysis

While self‐evaluation leads to valuable results in some schools, it appears that in other schools this is true only to a lesser extent or not at all. This raises the question of how differences in the results of self‐evaluations can be explained. This study looks at to what extent the results of self‐evaluation are determined by the way in which self‐evaluation is conducted, by characteristics relating to the general functioning of the school and by the support which schools enjoy. One thousand seven hundred and eighty‐six school principals and team members from 96 schools (primary and secondary) were surveyed by means of a written questionnaire. The data collected were then analysed using multi‐level structural equation modelling. The results provide strong empirical evidence that “attitude with regard to self‐evaluation”, “self‐evaluation as a policy action” and “self‐evaluation as an act of research” are powerful predictors of the quality of self‐evaluations.     

Peer‐assisted Student Support at the University of Glamorgan: innovating the learning process?

This article analyses the overall performance of the Peer‐Assisted Student Support (PASS) Scheme in the Business School at the University of Glamorgan. Observations were made over a seven‐week period to measure the effectiveness of the scheme in terms of enhancing the student learning process. Weekly attendance was measured to establish patterns of demand in terms of age, gender and mentored subject area. Further quantitative and qualitative research was undertaken to provide an insight into the perceived benefits of the scheme in relation to student social development and academic performance. The empirical findings of this article show that PASS attendance is female dominated. Moreover, the research suggests that contrary to previous research, the majority of benefactors reside in the under‐21 age group. The findings also highlight that academic and laboratory‐based subjects are a considerable strain on PASS resources and more significantly superior academic performance is positively correlated with regular PASS attendance.