The effect of standardized test information on teachers’ assessment of ability in their classes

Abstract

The responses of three groups of teachers to a rating task in which they were asked to indicate how many of their pupils were “bright”, “above average”, “below average” and “dull” were compared. In two of the groups, teachers had been provided with test information based on performance on nationally standardized ability and attainment tests. In the third group tests had been administered but no results were provided.

No differences between the groups were found in terms of the extent to which teacher ratings of ability levels correspond with mean ability test scores. In addition, teachers, irrespective of the group to which they belonged, were found to display a tendency to place more pupils in the above average categories than the below average categories. Finally, no support was found for an hypothesis which suggested that test information would differentially affect the ratings of teachers of classes with pupils who were typical and untypical with respect to age.

The fact that the correlation between mean ratings and mean test scores were found to be fairly high in all three groups (they ranged from .51 to .60) suggests a reason for the failure of test information to impact on teachers’ judgements. The degree of agreement between teachers and tests that the correlations reveal means that there is less scope for a convergence of ratings on tests to occur than might otherwise be the case.     

Exchange of information about physical education to support the transition of pupils from primary and secondary school

The purpose of this study was to identify how information about physical education is exchanged between secondary schools and their respective feeder primary schools, what information is exchanged and how this information is used. A secondary purpose was to look at whether there is any relationship between schools engaging in liaison activities and exchanging information about physical education, and between exchanging information and the number of associated secondary schools to which pupils are sent or feeder primary schools from which pupils are received. Questionnaires were sent to 177 secondary and 538 feeder primary schools. Responses from 80 secondary schools and 299 primary schools showed that the highest percentage of teachers exchanged information through written documentation, followed by discussion at cross phase liaison meetings. The type of information exchanged by the highest percentage of teachers was identified as generic information about key stage 2 and 3 of the National Curriculum for Physical Education (NCPE) areas of activity and schemes of work, rather than information about the specific physical education content covered or information about individual pupils, such as levels of attainment or ability. Further, results suggest that information may be used for pastoral purposes and that only a small percentage of teachers used the information exchanged to plan for continuity and progression in the physical education curriculum. There was a significant positive relationship between engagement in liaison activities and information received about the physical education curriculum followed by pupils, but a significant negative relationship for primary teachers between the number of different secondary schools to which pupils' progress and knowledge about the key stage 3 schemes of work that Year 6 pupils will follow in their associated secondary schools. These results are discussed in relation to continuity and progression in physical education in the transfer of pupils from primary to secondary schools.     

Pupils’ perceptions of grades: a narrative analysis of stories about getting graded for the first time

The starting point for this article is changes in the Swedish assessment system which stated that pupils are to receive grade reports in school year 6 (12–13 years old) during the academic year 2012–2013. Since the 1970s, compulsory school pupils have received their first grade reports in grade 7 and/or 8. The issue here is to present pupils’ narratives about the possible future significance of grade reports in school year 6. Pupils were interviewed about their experiences of getting their first grade reports, and a narrative analysis was conducted. More specifically, we investigated pupils’ conceptions of themselves as pupils and of their future possibilities, as described in their stories of getting their first grade report. The findings show that pupils perceive grades in year 6 differently, showing both adaption and resistance to the new grading discourse. Our conclusion concerns pupils’ learning and well-being when national assessment policies are changed.     

彝族农村小学高年级学生数学问题解决观念的调查研究

通过对233名彝族农村小学4～6年级学生进行数学问题解决观念问卷的抽样调查,结果发现:学生数学问题解决观念归为数学问题、常规和非常规数学问题解决、数学问题解决动机和数学问题解决能力五方面的自我认识和看法;凉山彝族农村4～6年级学生数学问题解决观念总体上不理想,在数学教学中应给予充分重视;民族和性别因素在方差分析中主效应明显,可能与彝族学生思维方式、语言习惯等文化背景差异及当地小学数学教学现状有关;数学问题、常规和非常规数学问题解决、数学问题解决动机等观念显著影响数学问题解决观念。     

Special needs educators’ roles and work in relation to recently arrived immigrant pupils in need of special educational support

Migration to Europe in recent years has made the issue of educational support for recently arrived immigrant pupils critically important, and, especially for pupils who are in need of special educational support. Schools in Sweden have special needs educators (SNEs) supporting pupils in need of special education, but little is known about the work of SNEs in regard to special educational support for recently arrived immigrants. This article reports the results of 483 SNEs answering a survey on their views of their role and work tasks in relation to recently arrived immigrant pupils in need of special educational support in Swedish compulsory schools. SNEs report that their actual tasks include compiling individual educational plans (IEPs), developing learning environments, and supervising staff. Less than 50% of the participants responded that they work directly with the pupils, and around 19% of the SNEs wanted to do more of such work. Class and subject teachers and mother tongue tutors are the occupational groups seen as providing the most support for recently arrived immigrant pupils. The empirical results are discussed from different theoretical perspectives on special education (Emanuelsson, 2001; Persson, 1998), Hughes’ (1958) concept of ‘dirty work’ and Abbott’s theory of profession (1988).     

Preparing to transition to secondary education: perceptions of Dutch pupils with migrant backgrounds

Background: The transition from primary school to secondary school is a crucial period of time for children and this may be especially the case for pupils with migrant backgrounds. While there has been considerable research on the transition from primary to secondary school, more needs to be known specifically about the experiences of this group of pupils during their final year of primary school, as they prepare for their transition to secondary school.

Purpose: The study investigated how Dutch children with migrant backgrounds in their final year of primary school perceive the preparatory process for the transition to secondary school. In particular, we were interested in who the children felt were the important ‘actors’ (e.g. pupils, parents, teachers and others) in the preparatory process.

Sample: We collected data from 76 primary school pupils from three schools in an urban city in the Netherlands. The sample included pupils who, according to the Dutch system, were preparing to follow an academic pathway (i.e. the tracks known in this system as ‘HAVO’ or ‘VWO’) and those who were preparing to follow a vocational pathway (i.e. the track known as ‘VMBO’) in secondary education.

Design and methods: We used photo elicitation (N = 76) and also conducted semi-structured interviews with a subsample of the pupils (N = 25) to examine the roles of the important actors in the preparatory process. Data were analysed qualitatively; responses were coded and underwent pattern analysis in order to identify and describe repeating structures in the data. Data were grouped according to whether the pupils received school recommendations for an academic track or a vocational track.

Results: Findings suggested that the pupils perceived the most important actors to be the pupil, the classroom teacher and the parents. Both teachers and parents were considered valuable resources for pupils in the preparatory process. Patterns representing the participants’ perceptions of the roles of three actors – namely, (1) the child, (2) the classroom teacher and (3) the parents, were identified. Six patterns were identified with respect to the child, four with respect to the classroom teacher and two with respect to the parents. For some patterns, it was apparent that the responses of children in the vocational group and the academic group had different emphases.

Conclusions: The study highlights the importance for teachers and parents of children in their final year of primary school to be aware of the pupils’ perceptions of and feelings about their preparation for secondary school, so as to be in the best position to support them collaboratively.     

EXTRACURRICULAR ACTIVITIES OF HIGHLY GIFTED AND ‘NORMAL’ SECONDARY SCHOOL STUDENTS

About 9,000 West German students representing the whole range of academic aptitude were examined at the beginning of their 13th school year. A general scholastic aptitude test was administered, and school marks and information on the pupils’ extracurricular interests and activities recorded. A group of highly gifted students was defined in terms of exceptional performance both in school and on the scholastic aptitude test. The extracurricular activities of this group were compared with those of the representative group. The popular hypothesis that superior cognitive giftedness and outstanding achievement in school go with an ‘impoverishment’ of extracurricular activities was not supported: In most areas a larger percentage of the highly gifted than of the reference group were actively involved. Furthermore, the range of individual activities was somewhat broader among the top students than among the representative group.     

Examination Results of Pupils Offered Assisted Places: comparing GCE Advanced level results in independent and state schools

This paper reports the findings of a study comparing the public examination results at GCE advanced (A) and advanced supplementary (AS) levels of pupils with assisted places (APs) in the independent sector and pupils in the state sector of similar ability. The examination entries and results of pupils with APs were compared with those of pupils who had gained an AP at the same school but had not attended that school; they had, instead, taken their A levels in the state sector. After controlling for ability it was found that the AP pupils achieved a significantly higher total point score in their A/AS levels than the pupils in the state sector and that the average point score per examination entry was higher for AP than state pupils. The results suggest that there is an advantage in taking up an AP but the possibility cannot be ruled out that the advantage for AP pupils arises from factors other than their education in the independent sector (e.g. family background and parental involvement).     

Pupils’ self-perceptions: the role of teachers’ judgment controlling for big-fish-little-pond effect

This article aims to study the relationship between teachers’ judgment and pupils’ self-perceptions controlling for the big-fish-little-pond effect (BFLPE). Three studies were conducted among third-grade pupils. Study 1 (n?=?585) focused on pupils’ perceptions of their scholastic competence. Teachers’ judgment and BFLPE were found to have an independent relation with pupils’ self-perceived scholastic competence. Study 2 (n?=?660) replicated the same results of study 1. Study 3 (n?=?683) extended the analysis to other domains of self-perception identified by Harter (Child development, 53, 87–97, 1982). The results showed that the relation with the BFLPE was significant only for pupils’ self-perceived scholastic competence. They also showed that the teachers’ judgment was related to two other domains of self-perception (behavioral conduct and peer acceptance) but was not directly related to pupils’ global self-worth.     

Les élèves et l'histoire dans l'examen français du certificat d'études primaires entre 1918 et 1926

This article presents the method used to study examination papers written by young pupils. This sort of pupils’ work can give information on who are involved in examinations.

‐ The pupils: what they learn in history and how they produce answers;

‐ The teachers: what they teach in their class and how;

‐ The juries: how they assess by means of a grade the minimum knowledge of most of the pupils who are to leave school.

The problem here is to follow the route from laws and decrees to real teachers and real pupils. Therefore, this research relies on source material such as annual primary inspector reports, annual local teachers’ meetings with model lessons, and, above all, examination papers. For this last source, a popular examination in France at that time was used: the Certificat d'Etudes, which was given at the end of the primary curriculum for 13‐year‐old pupils. By chance, the Departmental Archives of the Somme region still has 4058 history test examination papers from 1918 to 1926.     

Learning from group work in science

Abstract

This paper addresses itself to the question of how effective group work is in promoting ‘learning from others’. It follows an earlier report in which verbal interactions between pupils engaged in group work were analysed. The tasks attended to during the group work were all concerned with the planning of scientific investigations.

The findings obtained indicate that a significant amount of ‘learning from others’ occurs as the result of pupils being involved in group work: in the present case, about 40% of information points included in pupils’ independent written accounts had previously been contributed to the group discussion by other pupils. However, the accounts also contained information points that had not been mentioned during the preceding group discussions.

The extent of pupils’ achievement and ‘learning from others’ in group work appeared unrelated to their actual group behaviours, which suggests that even seemingly ‘inactive’ group members benefit from their involvement in group learning experiences.     

Early communication strategies: using video analysis to support teachers working with preverbal pupils

Carolyn Anderson is a speech and language therapist who is currently working as a senior lecturer at the University of Strathclyde. In this article she provides an early account of her ongoing research into communication between teachers and pupils with severe and complex learning disabilities. Video recordings were made of teacher-pupil interactions. The recordings were then analysed in terms of the numbers of turns taken by pupils and teachers; the strategies teachers and pupils used to initiate and respond in interactions; and the numbers of information carrying words teachers used with pupils with different levels of language comprehension. Carolyn Anderson's findings will help teachers who want to develop their own awareness of the role they play in communicating with pupils. This research will also support staff who are trying to encourage pupils with learning difficulties to become more actively involved in interactions and teaching and learning opportunities.     

ACHIEVEMENT TEST RELIABILITY AS A FUNCTION OF PUPIL-RESPONSE PROCEDURES

Muller, Calhoun, and Orling (1972) conclude that test reliability is dependent on the type of answer document used by elementary pupils. The present study was designed in part to assess the differential effect of two pupil response procedures (answering directly in the test booklet versus on a separate answer folder) on Metropolitan Achievement Tests scores of grades 3 and 4 pupils.
Over 4000 pupils from nine school systems took the Metropolitan , half responding in their booklets and half using answer folders. The two groups were matched by grade in general scholastic aptitude.
Although the separate answer folder group received lower scores than did the group responding in the test booklets, the score reliabilities did not differ significantly for any test. Additionally, these reliabilities did not differ significantly from comparable Metropolitan normative reliabilities. For survey achievement tests such as Metropolitan , test reliability would not appear to depend on pupil response mode.     

Accessing the internet

Abstract

This paper reports the findings of an assessment program for children who were experiencing learning difficulties at school. The aim of the present study was to examine the patterns of (earning disabilities experienced by a group of students who viere referred by their parents and to look at the kinds of attributions these children held about their ability. The results provide evidence for the existence of at least two distinct patterns of learning disability similar to those described by Rourke and Del Dotto (1994). The results also suggest that a significant number of children with learning disabilities may hold negative attributions about themselves that may impact on their willingness to learn new information and also put them at risk of developing depression. It is concluded that interventions need to focus not only on content areas, but also take into account the individual attributions the child holds about his or her own ability and potential.     

Dutch non-affiliated pre-vocational pupils,their world view and religious education

Abstract

More and more, Dutch adolescents are no longer affiliated with or involved in institutionalised religious world views. This development raises questions on how religion is treated and taught in secondary schools in the Netherlands. In order to reconsider religious education within these schools, closer insights into this particular, growing, group of pupils is needed. Therefore, the aim of the current study was to gain knowledge on how pupils from third-grade pre-vocational secondary education [In Dutch: vmbo], who are not affiliated with or involved in an organised world view, perceive the way their world view is being shaped. Ten pupils (14–16 years old) were interviewed about their world view formation process and about potential influential factors. The results showed that pupils emphasised that they are in charge of their world view formation process. Based on trust, they choose their own norms and values and answers to life questions from various sources. Religious education in school seemed only influential if pupils can relate the content of lessons to questions and experiences they have in their own lives. Findings suggest rethinking the content and the role of teachers of religious education in school in light of what non-affiliated pupils learn about world view at from home and other sources.     

Speech and language therapy support for pupils with behavioural, emotional and social difficulties (BESD) – a pilot project

Current research highlights the prevalence of potentially undetected communication difficulties, often associated with major difficulties in literacy and learning, among pupils identified as having behavioural, emotional and social difficulties (BESD). In this article, Sarah Heneker, who is a speech and language therapist working mainly with adults with learning disabilities in a Primary Care Trust in Surrey, reports on a pilot project that provided speech and language therapy to a group of pupils in a pupil referral unit (PRU). The research involved formal assessment of 11 pupils aged between five and 11 years. These assessments confirmed that ten out of the 11 pupils experienced some degree of difficulty in communication. Six of these pupils, whose significant difficulties warranted the intervention, were offered speech and language therapy for one term. All these pupils made progress in the areas targeted for intervention and gained confidence generally in their communication. The pupils who worked on word knowledge made the greatest measurable progress. Sarah Heneker reports on these and other benefits to the pupils involved and reveals that the success of her pilot project has led directly to a sustained programme of speech and language therapy input for the pupils in this PRU. This may be a response that education providers in other localities will wish to emulate.     

'To trust or not to trust,…'-pupils' ways of judging information encountered in a socio-scientific issue

This article reports from a qualitative study of how 16-year-old Norwegian pupils dealt with a socioscientific issue. The pupils were interviewed on aspects of their decision-making concerning a local version of the well-known controversial issue: whether or not power transmission lines increase the risk for childhood leukaemia. The part of the study reported here has focused on their views on the trustworthiness of knowledge claims, arguments and opinions given to them prior to interview. It was found that many aspects of trustworthiness were experienced as problematic by the pupils. Using inductive analysis, four main kinds of 'resolution strategies' were identified that were used by the pupils to decide who and what to trust: 1) Acceptance of knowledge claim, 2) Evaluation of statements using 'reliability indicators' and through explicitly 'thinking for themselves', 3) Acceptance of researchers or other sources of information as authoritative, 4) Evaluation of sources of information in terms of 'interests', 'neutrality' or 'competence'. Some pupils used all these strategies, others used only one or two. The pupils' evaluations were nuanced and based partly on empirical evidence, but mostly on rather superficial contextual information. It is argued that some of the resolution strategies imply that autonomous evaluations were made. One main conclusion is that knowledge of different sources of scientific information needs to be more emphasized in science education for citizenship.     

The Needs of Secondary School Information Technology Co‐ordinators in the United Kingdom

ABSTRACT

This paper reports on a survey of secondary schools in the West Midlands, England, in 1991 and was conducted to measure the tasks required of information technology co‐ordinators and the training requirement of their schools. The main emphasis of information technology work was still on taught, examination courses and there was a perceived need for information technology awareness courses for all pupils. Many co‐ordinators had no clear perspective of the level of information technology permeation across the curriculum in their schools, and thus demonstrated an urgent need for audits of staff awareness and pupil access. Information technology co‐ordinators also saw a need for further in‐service training for many staff to enable delivery of their pupils’ information technology entitlement. Most staff training was school based and included collaborative teaching and courses run by the school staff. Little use was made of co‐operation with subject staff from other schools or outside specialists. The co‐ordinators defined their needs as being predominantly in the areas of time for co‐ordination duties, assessment of information technology across the curriculum, and training in new developments in the wider aspects of information technology.     

Causal structures and counter‐intuitive experiments in electricity

This study focuses on the similarities and differences in structure and meaning between pupils’ conceptions about steady state tasks and evolutionary tasks, in which the system under study undergoes changes over time. A nine‐item written questionnaire was given to 197 Greek secondary school pupils. Results showed that the majority of pupils employ causal structures for their predictions. Two models were identified: a ‘give’ model, applied by pupils in steady‐state tasks; and a ‘take’ model, applied in evolutionary tasks. Structural similarities and semantic differences were identified between these models. In the light of these results, the study also examined the types of experiments in introductory electricity that would or would not obtain a counter‐intuitive reaction in pupils.