Research On The Effects of Group Standardized Testing On Instruction,Pupils, and Teachers: New Directions for Policy

In response to an increasingly "test driven" approach to curriculum and instruction, a growing body of research is documenting the negative effects of standardized testing on instruction, pupils, and teachers. The curriculum has been narrowed to fit the tests, valuable instructional time is spent on test preparation, students are stressed by the preparation and the test-taking, and teachers are pressured to use unacceptable testing procedures which may even include blatant cheating. Students are subjected to instructional methods that provide them with test taking skills but no genuine understanding of the subject matter. Research supports that there is an urgent need for a change in testing policies. Massive standardized testing of young children must be eliminated. More authentic and performance based evaluation such as the development of student portfolios should be instituted. Attention to the negative effects of standardized testing and the elimination of such testing of young children is especially urgent in light of the current discussions centering on increasing the scope of national testing beginning with the administration of a school readiness instrument prior to school entry.     

Four Perspectives on Educational Assessment

Educational achievement testing is considered from four perspectives. First, the political concerns for accountability provide a powerful impetus for state‐wide testing of students. Second, parents want evidence about their children's accomplishments but often do not receive nor understand much information regarding testing. Third, in the USA, teachers often spend 2 to 8 weeks preparing their students for achievement tests and administering them. The “high‐stakes” nature of the tests undermines teachers’ curricula and instruction and, according to critics, may place too much emphasis on discrete skills, rote recall of facts, and esoteric test‐taking strategies. Students’ views of testing are the fourth perspective considered. A series of studies has revealed that the trust placed in testing by young children is gradually eroded until many adolescents are sceptical about the purpose and value of standardized achievement testing. Low achievers are especially prone to give token effort and to use counterproductive tactics. The cumulative, negative impact of standardized testing on many students and teachers threatens the validity of the test results and effective instruction. Seven suggestions are outlined to improve educational assessment for all participants.     

School climate and teacher beliefs in a school effectively serving poor South Carolina (USA) African-American students: A case study

This study examined the roles of school climate, teacher expectations, and instructional practices in one elementary school in South Carolina (USA) that produced effective achievement outcomes with poor and minority students. Survey data, teacher interviews, and classroom videotaping was used to identify school characteristics and instructional behaviors of six teachers nominated by colleagues as exemplary. The school was characterized by an emphasis on high student expectations, school staff cohesiveness, engaging instruction, high parent involvement, and multicultural instruction integrated with curriculum. The practices identified are consistent with literature on effective American schools; and the practices are key aspects of the sound instruction of poor and minority children. Teachers stated that teacher education programs did not prepare them to teach these students and that they had to learn this on the job.     

Curriculum spaces for connecting to children’s multiple mathematical knowledge bases

Elementary mathematics curriculum materials can serve as a lever for instructional change. In this paper, we promote a particular kind of instructional change: supporting teachers in learning to integrate children’s multiple mathematical knowledge bases (MMKB), including children’s mathematical thinking and children’s home and community-based mathematical funds of knowledge, in instruction. A powerful means of supporting pre-service teachers in integrating children’s MMKB in instruction may be to scaffold teachers’ noticing of potential spaces in elementary mathematics curriculum materials for connecting to children’s MMKB and then developing practices for leveraging these spaces during instruction. We focus on existing and potential spaces in written curriculum materials, or curriculum spaces, so as to better support teachers in enacting curriculum that opens spaces for connecting to children’s MMKB.     

高校管理“创新崇拜”倾向对教师的影响

当前,高校在课程与教学管理、科研管理和职称晋升管理方面的＂创新崇拜＂倾向对教师造成了严重的负面影响,教师面临着失去教育理想追求、相关权利得不到尊重与保护、教学和学术水平停滞等方面的危机。要消除高校管理＂创新崇拜＂对教师造成的不良影响,提升管理质量,可以从追问管理创新的本真目的、把握核心创新内容、建立教师参与的管理创新程序入手。     

Teaching to address diverse learning needs: development and validation of a Differentiated Instruction Scale

In the province of Quebec, Canada, a trend towards full inclusion has impelled teachers to adapt their instruction to meet the needs of both advanced and weaker learners in regular school settings. The main purpose of the present investigation was to develop and validate the Differentiated Instruction Scale (DIS), which assesses the use of instructional adaptations and academic progress monitoring strategies in general education classrooms. A total of 125 elementary school teachers participated in a cross-sectional study, allowing us to develop and validate the DIS. Overall our results show that the DIS is composed of two factors that are consistent with the predicted constructs (instructional adaptations and academic progress monitoring). Evidence of convergent validity is provided through correlations among DIS' subscales and two criteria: (1) teachers' autonomy support and (2) perceptions of school climate. Results also reveal that teachers tend to use instructional adaptations that do not require much preparation or tailored instruction. The DIS could thus be used in future research to investigate outcomes of differentiated instruction. Moreover, it could provide useful information on optimal strategies for promoting learning in children with different abilities in general education classrooms.     

Teaching strategies to create visual representations of key ideas in content area text materials: A longterm intervention inserted in school curriculum

This paper describes a long-term research in which middle-grade school children were taught how to represent visually text key ideas through idea-mapping techniques. It consists of three studies, one for each year of our research. Children were at sixth grade when the instruction began, and they were at eighth grade when it finished. Another group of children from a different public school served as control group. Instruction was very close to the real school conditions: instructors were ordinary teachers, instruction was inserted in the content area curriculum, and ordinary textbooks were regularly employed, though combined with specially elaborated materials. Results were positive in the case of the first and third year, depending on instructional conditions. Positive effects were found on recall, comprehension and learning, but they were different in the three studies. Theoretical and practical implications are discussed.     

Teachers’ administrative workload crowding out instructional activities

This study investigated the effects of teachers’ administrative workloads on their ability to undertake class instruction preparation and feedback on students’ homework. It is often mistakenly thought that teachers conduct administrative work efficiently and effectively. To investigate this misconception this study, using an instrumental variable method, demonstrates that teachers’ administrative workload carries an opportunity cost of instructional activities. Teachers with greater administrative workloads are less likely to spend time on instructional preparation and providing feedback on students’ assignments. The author’s findings are dependent upon whether the school is public or private, and are only significant for public schools. The author’s findings highlight that teachers’ demands for a reduction of their administrative workload to allow them to perform essential instructional duties are justified.     

The Effect of Training in Test Item Writing on Test Performance of Junior High Students

High stakes testing, a phenomena born out of intense accountability across the United States, produces instructional settings that marginalize both curriculum and instruction. Teachers and other school personnel have minimized instruction to drill and practice in an effort to raise standardized and criterion referenced test scores. This study presents an alternative to current practice that engages students in learning and increases their awareness of the internal aspects of standardized tests. The Test Item Construction Model (TICM) guides students through the process of studying test item stems and subsequently creating items using a 12 week process of incrementing from understanding to creating test items. Students grew in their understanding of the test item stems and the generation of these. An ANOVA did not yield significant differences between random groups of trained and untrained test writers. However, students in the experimental group demonstrated gains in understanding of test items.     

Effects of active‐learning experiences on achievement,attitudes, and behaviors in high school biology

Active‐learning labs for two topics in high school biology were developed through the collaboration of high school teachers and university faculty and staff and were administered to 408 high school students in six classrooms. The content of instruction and testing was guided by State of Texas science objectives. Detailed teacher records describing daily classroom activities were used to operationalize two types of instruction: active learning, which used the labs; and traditional, which used the teaching resources ordinarily available to the teacher. Teacher records indicated that they used less independent work and fewer worksheets, and more collaborative and lab‐based activities, with active‐learning labs compared to traditional instruction. In‐class test data show that students gained significantly more content knowledge and knowledge of process skills using the labs compared to traditional instruction. Questionnaire data revealed that students perceived greater learning gains after completing the labs compared to covering the same content through traditional methods. An independent questionnaire administered to a larger sample of teachers who used the lab‐based curriculum indicated that they perceived changing their behaviors as intended by the student‐centered principles of the labs. The major implication of this study is that active‐learning–based laboratory units designed and developed collaboratively by high school teachers and university faculty, and then used by high school teachers in their classrooms, can lead to increased use of student‐centered instructional practices as well as enhanced content knowledge and process learning for students. © 2007 Wiley Periodicals, Inc. J Res Sci Teach 44: 960–979, 2007     

Einstellungen,Motivation und Selbstwirksamkeit von Lehrkräften

Teachers’ attitudes, motivation and self-efficacy are aspects of their professional competence affecting students’ motivation and learning via instructional behavior. In the present study, school type-specific differences in these teacher competencies and their relation to instruction when teaching with texts and integrated pictures are analyzed, further focusing on effects of school subject and teaching experience. Teachers (N?=?265) of primary school, lower and upper track secondary school filled in questionnaires. Primary school teachers were less intrinsically motivated to teach text-picture integration than secondary school teachers. They showed more negative attitudes towards texts with pictures than upper track teachers and avoided discussing the picture to a higher degree. All teacher characteristics predicted instructional behavior, further school type-specific effects of the subject occurred. The results provide starting points for teacher training and the potential for further research concerning the support of students in class.     

The Pedagogical Orientations of South African Physical Sciences Teachers Towards Inquiry or Direct Instructional Approaches

In recent years, inquiry-based science instruction has become widely advocated in science education standards in many countries and, hence, in teacher preparation programmes. Nevertheless, in practice, one finds a wide variety of science instructional approaches. In South Africa, as in many countries, there is also a great disparity in school demographic situations, which can also affect teaching practices. This study investigated the pedagogical orientations of in-service physical sciences teachers at a diversity of schools in South Africa. Assessment items in a Pedagogy of Science Teaching Test (POSTT) were used to identify teachers’ science teaching orientations, and reasons for pedagogical choices were probed in interviews. The findings reveal remarkable differences between the orientations of teachers at disadvantaged township schools and teachers at more privileged suburban schools. We found that teachers at township schools have a strong ‘active direct’ teaching orientation overall, involving direct exposition of the science followed by confirmatory practical work, while teachers at suburban schools exhibit a guided inquiry orientation, with concepts being developed via a guided exploration phase. The study identified contextual factors such as class size, availability of resources, teacher competence and confidence, time constraints, student ability, school culture and parents’ expectations as influencing the methods adopted by teachers. In view of the recent imperative for inquiry-based learning in the new South African curriculum, this study affirms the context specificity of curriculum implementation (Bybee 1993) and suggests situational factors beyond the curriculum mandate that need to be addressed to achieve successful inquiry-based classroom instruction in science.     

The instructional audit in urban school settings: A descriptive policy analysis of instructional delivery using signal-receptor assessment theory and information referenced testing

High levels of student absenteeism, low SES home environments, and a general lack of experienced teachers to service the school curriculum all contribute to difficulties in insuring the delivery of apriori school district defined instructional programs. The importance of urban school site educational evaluation is underscored by recent studies which show that the effectiveness of instructional delivery is an important predictor of student antisocial behavior such as drug abuse, gang activity, vandalism. This study examines some of the problems associated with instructional evaluation in urban school settings using signal-receptor assessment theory analysis and a new type of test scoring procedure called Modified Confidence Weighted-Admissible Probability Measurement (MCW-APM). With MCW-APM, school administrative personnel can simultaneously evaluate and obtain policy relevant information for instructional leadership concerning the signal (instruction as delivered), the reception (student learning as received), and the assessment instrumentation itself (sensitivity of the test). Additionally, this method of scoring permits individual student performance on school district developed CRTs to be referenced to an information based standard (informed, partially informed, uninformed, and misinformed) of mastery as a selection standard instead of a percent correct score.     

The Impact of Every Classroom,Every Day on High School Student Achievement: Results From a School-Randomized Trial

Abstract

Every Classroom, Every Day (ECED) is a set of instructional improvement interventions designed to increase student achievement in math and English/language arts (ELA). ECED includes three primary components: (a) systematic classroom observations by school leaders, (b) intensive professional development and support for math teachers and instructional leaders to reorganize math instruction, assessment, and grading around mastery of benchmarks, and (c) a structured literacy curriculum that supplements traditional English courses, with accompanying professional development and support for teachers surrounding its use. The present study is a two-year trial, conducted by independent researchers, which employed a school-randomized design and included 20 high schools (10 treatment; 10 control) in five districts in four states. The students were ethnically diverse and most were eligible for free or reduced-price lunch. Results provided evidence that ECED improved scores on standardized tests of math achievement, but not standardized tests of ELA achievement. Findings are discussed in terms of differences between math and ELA and of implications for future large-scale school-randomized trials.     

A comparison of inter-professional education programs in preparing prospective teachers and speech and language pathologists for collaborative language–literacy instruction

Ensuring teacher and speech and language pathology graduates are prepared to work collaboratively together to meet the diverse language literacy learning needs of children is an important goal. This study investigated the efficacy of a 3-h inter-professional education program focused on explicit instruction in the language skills that underpin early reading and spelling acquisition. The combined program incorporated student teachers and student speech and language pathologists (SLPs) working together on case-based instructional planning supplemented with structured opportunities for the groups to share their respective expertise in curriculum and linguistic knowledge. Student teachers (n = 18) and student SLPs (n = 27) were randomly assigned to this combined intervention or a comparison intervention that replaced the structured opportunities to share curriculum and linguistic knowledge with spending time together focused on non-language/literacy based activities. Before-and-after comparisons indicated that only the students in the combined condition increased their linguistic/curricular knowledge (p < 0.05). However, neither of the interventions improved students’ case-based instructional planning for children’s literacy learning over and above what they could achieve working individually. Implications for the pre-service preparation of teachers and SLPs are discussed.     

An Examination of English Teachers' Opinions About the Ontario Grade 9 Reading and Writing Test

Interest in the use of large-scale achievement testing for accountability purposes and to drive instructional reform has been increasing in Canada. In the 1995 publications in Interchange, several researchers debated the merits and demerits of standardized achievement testing, including among the latter a tendency to reduce the curriculum and overemphasize routine learning (i.e., "teaching to the test"). Almost no studies have found empirical evidence for such testing's purported benefits. We set out to investigate these issues in Ontario: We present findings from a mail survey designed to find out, from Grade 9 and Grade 10 English teachers in Ontario, their perception of the quality of the Ontario Grade 9 literacy testing program and the effects it has had on the teaching and learning processes. Based on the responses of 107 teachers, our results paint a negative picture of teachers' opinions of the Grade 9 test in terms of its quality and its impact on teaching and learning. Three years after the Grade 9 test was first introduced, Grade 9 and 10 English teachers are still not convinced of its value. Our findings (and those from two other similar surveys) appear to suggest, at least based on teachers' self-reporting, that the purposes of the test — improving the quality of education and learning — as envisioned by the Ontario Ministry of Education and Training have not been met. These findings support those of other assessment impact studies in Canada, namely British Columbia and Alberta, regarding the adverse consequences of large-scale standardized testing (either multiple-choice test or performance-based assessment), and the lack of evidence for its purported positive educational influences. We recommend future research to investigate further the validity and the educational impact of the provincial tests and the reasons responsible for the observed impact or lack of it, and to determine resources, such as teacher training and materials, that are necessary to supplement the provincial testing program's effort to improve teaching and learning.     

Exercising a bounded autonomy: novice and experienced teachers’ adaptations to curriculum materials in an age of accountability

This study explores teachers’ first enactments of a set of theory-based curriculum materials designed to support academic language instruction. Specifically, this multiple case study looks at how six middle school English teachers in three US schools adapted the materials; each case includes a pair of teachers, one novice and one more experienced. All schools were located in the same district where a school performance measurement system was being used to publicly rank schools’ academic performance and growth. Multiple measures were used to look for evidence of adaptations and why teachers made adaptations. We found that all teachers adapted the curriculum, most often in response to either perceived student needs or district reform pressures. In two cases, patterns of adaptation differed by teacher experience; experienced teachers appeared better able to adapt curriculum materials to meet instructional goals. This pattern did not hold up at the third school, where teachers faced greater reform pressures. Taken together, these findings suggest that researchers should pay more attention to the role of school and district policy on teachers’ enactments of theory-based reforms. We conclude with guidance to researchers, instructional leaders and others interested in the potential of theory-based curricula as a lever for improving classroom instruction.     

Theoretical beliefs and instructional practices used for teaching spelling in elementary classrooms

The current study aimed to examine teachers’ reported spelling assessment and instruction practices. Analysis of the match between teachers’ theoretical beliefs about spelling and their reported pedagogy was conducted to elucidate factors that may support or impede the use of evidence-based teaching strategies in the classroom. An electronic survey was completed by 405 randomly selected (stratified by region and socioeconomic status) elementary school teachers in New Zealand. The survey examined the following areas: spelling assessment, spelling instruction, beliefs about spelling, preparing teachers to teach spelling, and teachers’ perceived strengths and weaknesses of their spelling program. There was large variability in spelling assessment and instructional practices across teachers. Most respondents reported implementing some aspects of a developmental approach to spelling instruction through analysis of children’s spelling errors (64 %) and/or individualization of the spelling program (60 %). There was a large dissociation between teachers’ beliefs about spelling and their frequency of use of specific instructional practices associated with those beliefs (e.g., phonological awareness, orthographic knowledge). The mismatch between beliefs and reported practice appeared to be due to lack of professional knowledge regarding implementing explicit spelling instruction and finding time to teach spelling within the curriculum. Increasing teachers’ knowledge about language structure, practical implementation of key assessment and instruction activities, and the links between spelling and other areas of the curriculum are important factors in improving spelling pedagogical practices.     

Standardized Testing + High-Stakes Decisions = Educational Inequity

Changes in assessment policy have increased standardized testing at provincial, national, and international levels, introduced testing at more grade levels, increased the reporting of test results, and attached more significance to those results. Advocates claim that testing will result in greater accountability in education. The research demonstrates that standardized testing has a negative impact on students, perpetuating and intensifying educational inequity through test bias and the misuse of test scores. Test results are increasingly being used to analyse policy, program, school, and teacher success, and they are being inappropriately used as "educational gatekeepers" to make important decisions about students, teachers, schools, and school systems. This paper focuses on how standardized testing is becoming the mechanism that facilitates many questionable education practices that contribute to educational inequity.     

On the testing of standards and standardized achievement testing: Panacea,placebo, or pandora's box?

Parents and educators concerned with the quality of education in Canadian schools have been subjected to a concerted campaign (through editorials, columns, and letters to the editor in major dailies and magazines, as well as a spate of books with alarmist titles) aimed at convincing them that the lack of adequate testing represents a major shortcoming and a stumbling block to educational reform. Provincewide and nationwide standardized achievement tests are offered as an indispensable tool to understand what works and what does not, to let parents know how schools are doing and how well their children are performing, and to make teachers and school boards accountable. Provincial education authorities are finding it increasingly difficult to resist the pressure, with Ontario the latest to jump on the testing bandwagon. However, although concerns about school curricula and about the best methods for testing student learning and performance are legitimate, the belief that standardized achievement tests are part of the solution to many ills allegedly afflicting our educational system does not stand up to the increasingly clear evidence of the many problems associated with the construction and administration of these tests, as well as the misuse and abuse of test scores. Far from being a panacea, this approach has proved to be fraught with dangers and adverse effects, from a narrowing of the curriculum to overemphasis of routine processes at the expense of higher learning skills, with virtually no empirical support for the purported benefits. With Canadian students facing the risk of being subjected to the same abuses as their U.S. counterparts, this paper reviews recent contributions and attempts to alert educators and policymakers to the serious deficiencies of this type of testing.