Developing academics’ assessment practices in open,distance and e-learning: an institutional change agenda

Abstract

Universities across the globe are attempting to change assessment practice to address challenges in student engagement and achievement. Integral to this objective are strategies to develop academics’ assessment practice. These frequently focus on attendance at formal Continuous Professional Development events and/or implementation of institutional blueprints. This editorial article uses a case study from the Open University (UK) to explore an alternative ‘communities of practice’ approach to the improvement of assessment arguing that academics’ professional expertise is best deepened through participation in authentic activities of teaching and scholarship. The discussion identifies what is involved in such an approach including the role of an enabling principles-based framework, the constraints on implementation and the implications for HE leaders.     

Getting Inside Knowledge: the application of Entwistle's model of surface/deep processing in producing open learning materials

The work carried out in this study is the result of an Open Learning in Business Education (OLBE) project from 1990‐1995, in which business education students training as teachers and lecturers were required to produce open learning materials on intercultural communications for use in the classroom. Distinctive stages, designed to maximise the effectiveness of this challenging learning task, were refined over the course of the project period. An analysis of student responses at the different stages enabled the authors to distinguish features of ‘deep’ and ‘surface’ learning (Entwistle), a construct widely recognised in the field of learning psychology and particularly well suited to the objective of evaluating and enhancing the quality of learning in the project. A particular sequence of learning modes which included a considerable degree of learner autonomy, combined with regular group discussions and feedback, were considered to have produced some impressive learning outcomes. However, subject matter involving culture is inherently difficult to grasp as it can only be understood in relative, rather than objective, terms. Thus, an established model of the dimensions of culture, recognised in the social sciences (Hofstede), was recently used to analyse further, from collated responses, the depth of student understanding of the concept of cultural variation on each of five dimensions. An overview of the general transition from surface to deep learning which was evident for most students during the progress of the project stages is provided in this paper. The authors believe that the progressive and varied format of the project with the strongly motivational open learning production task, encouraging students themselves to view knowledge and concepts from a learner's perspective, has a wide range of potential applications.     

The teaching of literature in a Singapore secondary school: disciplinarity,curriculum coverage and the opportunity costs involved

Set against the backdrop of reinvigorating the study of literature and concerns about the adequate preparation of students for the world of work, this paper explores how a Singapore teacher presented a literary text in the classroom. Drawing on data from a large-scale representative sample of Singapore schools in instruction and assessment practices, we discuss some of the potential consequences of instructional choice-making from a disciplinary perspective. Our findings suggest, for example, that when teacher-dominated discourse and interpretations dominate, instructional flexibility and responsiveness are correspondingly limited and restricted. These courses of action, we contend, may occur contrary to teachers’ plans and expectations. The paper closes by making a call for further longitudinal research across multiple research sites into the nature of literature pedagogy that has a strong disciplinary focus.     

Differential Performance of Items in Mathematics Assessment Materials For 7-Year-Old Pupils in English-Medium and Welsh-Medium Versions

This paper draws on data from the development of annual national mathematics assessment materials for 7-year-old pupils in Wales for use during the period 2000–2002. The materials were developed in both English and Welsh and were designed to be matched. The paper reports on item analyses which sought items that exhibited differential performance in relation to whether the materials were English medium or Welsh medium. The items that exhibited consistent differential item functioning in relation to language during pre-testing are reviewed in order to discuss the linguistic factors that could affect such behaviour.     

Software to Promote Young Children’s Growth in Literacy: A Comparison of Online and Offline Formats

The primary goal of this research was to extend our understanding of the strengths and weaknesses inherent in online and offline early literacy software programs designed for young learners. A taxonomy of reading skills was used to contrast online software with offline closed system (compact disc) based programs with respect to number of skills taught, quality of instruction and scaffolding during instruction. Overall, online programs were more comprehensive and provided instruction for more skills than offline software at either the Kindergarten or Grade 1 level. However, offline programs demonstrated some developmentally appropriate selectivity in skills trained. Quality of instruction was variable within and across all programs. Scaffolding of instruction was also variable and surprisingly few programs, either online or offline, provided automatic movement across levels of difficulty. These outcomes have important implications for the selection of instructional materials by parents and educators involved in early literacy instruction and also for future software design.     

SCAN: A method of community collaboration

Recent research has highlighted the complexity of the battered child syndrome. Clinical experience suggests that treatment of troubled families is a long-term process, draining financial resources of agencies and emotional resources of professionals. The need to provide support and case consultation to professionals working in the area of child abuse and neglect evolved in the establishment, in 1968, of the Suspected Child Abuse and Neglect (SCAN) Program at Children's Hospital, Pittsburgh, Pennsylvania. This program provides an effective method of intervention through identification, consultation, referral and follow-up of at-risk families. Weekly meetings offer multi-disciplinary case coordination, treatment recommendations, and a channel of communication for representatives of community agencies. This paper traces the history and present status of the SCAN Program, as well as the role of SCAN as a force for change of community attitudes.     

Taking Control of Their Lives? A comparison of the experiences of unemployed young adults (18-25) in England and the new Germany

This paper explores the experiences and actions of young adults who have had difficulties in entering and sustaining a place in the labour market. The research was carried out in selected localities undergoing economic transformation in England and the new Germany, as part of the project 'Taking Control' in the ESRC's Youth Citizenship and Social Change Programme. The 18-25 age group has been newly 'targeted' for interventions through programmes such as 'New Deal' and 'JUMP'. Through a combination of questionnaire survey and group interviews the research has explored how, in different ways, choice and uncertainty can be important dimensions in young adults' biographies in the current moment. Their experiences and actions are not exclusively determined by socialising and structural influences, but also involve elements of subjectivity, choice and agency. The article discusses findings on the lives and perspectives of 300 young people affected by unemployment. The sample is drawn from a wider questionnaire survey ( n = 900) and a series of group discussions in the three cities of Derby (England), Hannover (Western Germany) and Leipzig (Eastern Germany). The research builds on and extends the authors' previous comparative research into the education and training experiences of younger age groups in the two countries.     

What makes for effective feedback: staff and student perspectives

Since the early 2010s the literature has shifted to view feedback as a process that students do where they make sense of information about work they have done, and use it to improve the quality of their subsequent work. In this view, effective feedback needs to demonstrate effects. However, it is unclear if educators and students share this understanding of feedback. This paper reports a qualitative investigation of what educators and students think the purpose of feedback is, and what they think makes feedback effective. We administered a survey on feedback that was completed by 406 staff and 4514 students from two Australian universities. Inductive thematic analysis was conducted on data from a sample of 323 staff with assessment responsibilities and 400 students. Staff and students largely thought the purpose of feedback was improvement. With respect to what makes feedback effective, staff mostly discussed feedback design matters like timing, modalities and connected tasks. In contrast, students mostly wrote that high-quality feedback comments make feedback effective – especially comments that are usable, detailed, considerate of affect and personalised to the student’s own work. This study may assist researchers, educators and academic developers in refocusing their efforts in improving feedback.