Formative assessment for all: a whole-school approach to pedagogic change

Scotland's Assessment is for Learning initiative (AifL) seeks to introduce a co-ordinated national system for assessment in schools. Formative assessment is a major plank in this. The initiative has moved beyond its pilot phase and it is intended that it will be adopted by all Scottish schools by 2007. This article draws upon the case-study of a primary school that has adopted a whole-school approach to enacting the formative assessment principles of AifL since 2004. It utilizes Margaret Archer's social theory to analyse and explain the processes of change that have underpinned the development of formative assessment in the school. The article argues that meaningful change in schools can be stimulated by encouraging socio-cultural interaction among practitioners, via the impetus provided by a central initiative combined with the creation of spaces for dialogue and the extension of professional trust and autonomy.     

Beyond method: assessment and learning practices and values

This article reports the findings of a survey of 558 teachers in England. It describes how conceptual and empirical insights from the literature informed the construction of questionnaire items to provide answers to questions about the way in which teachers value different classroom assessment practices and how congruent with these values they perceive their practices to be. Results from item, factor and cluster analyses reveal three underlying dimensions of assessment practice, sizeable values-practice gaps on two dimensions that appear to be in tension (promoting learning autonomy and performance orientation), and differences among teachers which show that over half of this sample report that they are unable to sustain practices across all dimensions in line with their values. We conclude that teachers are demonstrably committed to the values (not just the methods) of assessment for learning within a moral framework that gives importance to the quality of students' learning, yet they experience and need to resolve contradictions in order to realize their values.     

Feedback as a relational concept in the classroom

Abstract

This paper constructs a theoretical argument to frame feedback as a relational concept. It addresses contemporary concern that formative assessment, of which feedback is a part, is under theorised. The arguments presented link to existing theoretical and research evidence. The paper also challenges the dominant policy discourse in high stakes assessment contexts in which feedback is typically seen in technised ways to serve the need to raise measured pupil outcomes. Vygotsky’s notion of the zone of proximal development is explored as a relational space in which both teachers and learners understand differences between learning ‘now’ and learning ‘next’. Extending Vygotsky’s perspective, a socio-cultural perspective is offered, by considering the role of ‘others’, ‘language’, ‘activity’ and ‘identity’, as part of the process of sharing and understanding feedback in classrooms. The work of Holland et al. (1998), Bakhtin (1986) are central to the developing argument. The paper reveals feedback as a complex situated process, requiring mediated dynamic interaction, where feedback is appropriated as a cultural artefact by its participants. The implications of such an articulation demands a greater sense of understanding pupils’ roles in feedback and the importance of teachers enabling pupils to see themselves in new ways as future learners.     

Verbal reasoning test scores and their stability over time

As part of an extended study into school assessment practices the use of verbal reasoning tests and their possible contribution to measuring pupil progress is being investigated. One phase of the study has involved testing the stability of individual verbal reasoning scores over time. The findings of this phase are presented here and located within the broader context of intelligence testing. The discussion concludes with a number of questions relating to the use of pupils’ academic achievements as appropriate measures of school success. The ongoing work considers how pupil success could be measured fairly, taking into account individual pupil differences, including both genetic and socio-economic factors. The work being developed has potential for both formative and summative assessment procedures and also as a tool for reporting the achievements of individual pupils and educational establishments. The full work will be published in due course.     

Investigating students' beliefs about their preferred role as learners

Secondary school students were asked to state their preference for an objectivist or a constructivist learning environment and consider the consequent implications for their role as a learner. They did this by identifying with the dialogue depicted in two concept cartoons. Results indicate an overwhelming preference among students for a constructivist learning environment. This suggests not only that students would be receptive to moves by teachers towards more constructivist principles in the classroom, but also that a failure to promote such a transition may contribute to an epistemological gap between teaching and learning styles that will be an impediment to meaningful learning. Students anticipated constructivist learning environments would be more interesting, more effective at developing students' understanding and would permit them to take greater ownership of their learning. Some limitations of the study are described.     

Multilevel Modelling in Repeated Measures of the Quality of Finnish School Life

The main interest of the paper is methodological: to exploit multilevel modelling in analysing quality of school life data gathered in 1991 and 1995 in Finnish comprehensive schools, with the intention of investigating differences and related changes in the quality of school life over time. The specific methodological aim is to explore the advantages gained and problems encountered while applying multilevel models and the statistical program MLwiN in analysing large scale educational data with repeated measures. The quality of school life was assessed by a representative sample of all the Grade 8 pupils throughout the country with a 4 year interval in the same schools. The measurement of the quality of school life focused on general school satisfaction and on teacher-student relations. The validity of the instrument was confirmed by means of factor analysis. The findings of the multilevel statistical analysis are discussed both from an educational and a methodological point of view.     

The development,validation, and potential uses of the Student Interest-in-the-Arts Questionnaire

The Student Interest-in-the-Arts Questionnaire was designed to measure elementary school students’ interest in dance, drama, music, and the visual arts. We collected data providing evidence for reliability, content validity, construct validity, and convergent and discriminant validity. We describe the development of the method and the collection and analysis of the validity data. The brief instrument is easy to administer, fills a gap in the compendium of available instruments, and is useful in a variety of settings with a variety of research and evaluation designs.     

Students’ approaches to learning in problem-based learning: Taking into account professional behavior in the tutorial groups,self-study time,and different assessment aspects

Problem-based learning (PBL) represents a major development in higher educational practice and is believed to promote deep learning in students. However, empirical findings on the promotion of deep learning in PBL remain unclear. The aim of the present study is to investigate the relationships between students’ approaches to learning (SAL) and academic achievement in a PBL environment, taking into account the role of self-study time and students’ professional behavior in the PBL tutorial groups. In addition, different knowledge categories that determine achievement (i.e., understanding of concepts, understanding of the principles that link concepts, and the linking of concepts and principles to conditions and procedures for application) were taken into account. A hypothesized structural equation model including these variables was tested. Results showed that the PBL students in this study reported more use of a surface compared to a deep approach to learning. The hypothesized model demonstrated an excellent fit of the model with the data. The relationship between SAL and academic achievement was mediated by self-study time and professional behavior. These findings imply that self-study time and professional behavior are crucial variables to take into account when studying SAL.     

Evaluating leadership development using the Most Significant Change technique

Course evaluations are now a serious matter for universities trying to meet stakeholder needs and expectations, quality assurance, improvements and strategic decision making. Typically, students are invited to participate in surveys on how well the design and delivery aspects meet predetermined learning objectives, quality of teaching, and the types of improvements needed for future deliveries. We used the Most Significant Change technique to gather data on the impact of a leadership course on 18 Pacific Islanders who completed a Master of Education (Educational Leadership). Participants’ views highlighted impacts that were of significance to the students and their workplaces. The findings demonstrate that the Most Significant Change technique offers a more comprehensive understanding of the impact of leadership development courses.     

Interpretation of the score reports from the Computer Program LOVS by teachers,internal support teachers and principals

Data-driven decision making, such as the decision making that is conducted through the use of pupil monitoring systems, has become increasingly popular in the Netherlands, as it is considered to have promise as a means of increasing pupils’ learning outcomes. The reports generated by the pupil-monitoring Computer Program LOVS (Cito) provide educators with reliable and objective data feedback; however, research has suggested that many users struggle with interpreting these reports. This study aims to investigate the extent to which the reports are correctly interpreted by educators, and to identify various potential stumbling blocks with regards to the interpretation of the reports. The results suggest that users encounter many stumbling blocks in these reports and often cannot interpret them entirely correctly.