Conceptualising teachers’ assessment literacies in an era of curriculum and assessment reform

Teacher assessment literacy is a phrase that is often used but rarely defined. Yet understanding teacher assessment literacy is important in an international curriculum and assessment reform context that continues to challenge teachers’ assessment practices. In this article situated examples of classroom assessment literacies are analysed using Bernstein’s (Pedagogy, symbolic control and identity: Theory, research and critique, Taylor and Francis, London, 1996; Br J Sociol Educ 20(2):157–173, 1999) theoretical tools of vertical and horizontal discourses, classification and framing. Drawing on a sociocultural view of learning, the authors define teacher assessment literacies as dynamic social practices which are context dependent and which involve teachers in articulating and negotiating classroom and cultural knowledges with one another and with learners, in the initiation, development and practice of assessment to achieve the learning goals of students. This conceptualisation of assessment literacy aims to make explicit some underpinning theoretical constructs of assessment literacy to inform dialogue and decision making for policy and practice to benefit student learning and achievement.     

Teacher Candidates' Perceptions About Grading and Constructivist Teaching

The Survey of Assessment Beliefs (SAB) was developed to measure teacher candidates' perceptions about grading practices. After piloting, the SAB was administered to 222 teacher candidates at a large northeastern urban university, along with a measure of their beliefs about teaching. Candidates were found to support many grading practices not recommended by professional standards. Support for grading practices that deviate from professional recommendations was positively associated with support for constructivist approaches. Significant differences were found in grading and teaching attitudes between elementary and secondary education teacher candidates. Teacher candidates became more moderate in endorsing nonstandard grading practices following coursework in classroom assessment but on average maintained a tendency to approve academically enabling grading practices. This study provides empirical evidence about possible areas of tension between constructivist learning theory and principles of educational measurement, and it helps classroom assessment teachers understand the needs of their target audiences.     

Exploring tensions in developing assessment for learning

This paper is based on a study of classroom practice of primary school teachers who were engaged in a programme of professional development to implement formative assessment in their classrooms. The programme sought to develop the skills and expertise of teachers to enable formative assessment to be used to support and improve the learning of students. This study examined changes in practice in these teachers’ classrooms, their students’ learning experiences, pedagogical decision‐making, and the challenges experienced by teachers and students in developing assessment for learning. Activity theory was used as an analytical tool and enabled the identification of important contradictions in the changing system that produced tensions and difficulties but also provided driving forces for change. The development of formative assessment practices was of necessity accompanied by a culture change in the complex classroom systems. For teachers change was characterised as a process of expansive learning that was motivated by a contradiction between the teachers’ beliefs about learning and the existing culture in the classroom. The change in classroom practice was enabled by the formative assessment philosophy and a range of mediating artefacts.     

Approaches to Classroom Assessment Inventory: A New Instrument to Support Teacher Assessment Literacy

Teacher assessment literacy has become a central priority across many educational systems in North America and elsewhere in response to growing accountability demands. Although many scholars have aimed to measure teacher assessment literacy, recent research has identified that current assessment literacy instruments do not fully reflect current transformations in the assessment landscape and remain predicated on dated standards for teacher classroom assessment practice. Given significant shifts in classroom assessment over the past 20 years, the purpose of this article is to construct a reliable instrument reflective of contemporary assessment practices and contexts. Specifically, this article describes our instrument development process including construct validation and reliability testing with more than 400 teachers. The result of this research is the Approaches to Classroom Assessment Inventory, which can be used by researchers and practitioners to support teacher assessment literacy in relation to the current accountability framework evident across educational systems.     

Multi-informant assessment of treatment integrity in the classroom

Assessing the degree to which interventions are implemented in school settings is critical to making decisions about student outcomes. School psychologists may not be available to regularly conduct observations of intervention implementation, however, their data may be used alongside other methods for multi-informant assessment. Teacher self-report is a commonly used and feasible assessment method. Students have been trained to implement interventions with their peers in instances where traditional adult interventionists were unavailable. This exploratory study investigated the accuracy with which classroom teachers and middle and high school students assessed implementation of the Good Behavior Game and the impact of performance feedback on their accuracy. Results indicated that most students and teachers were able to provide accurate assessments of treatment integrity compared to researcher direct observation; however, some required performance feedback to do so. These findings suggest that multi-informant assessment may be a feasible and accurate way for school psychologists to collect formative treatment-integrity data in the classroom. Limitations and future directions are discussed.     

A “conditional” sense of fairness in assessment

Standardizing aspects of assessments has long been recognized as a tactic to help make evaluations of examinees fair. It reduces variation in irrelevant aspects of testing procedures that could advantage some examinees and disadvantage others. However, recent attention to making assessment accessible to a more diverse population of students highlights situations in which making tests identical for all examinees can make a testing procedure less fair: Equivalent surface conditions may not provide equivalent evidence about examinees. Although testing accommodations are by now standard practice in most large-scale testing programmes, for the most part these practices lie outside formal educational measurement theory. This article builds on recent research in universal design for learning (UDL), assessment design, and psychometrics to lay out the rationale for inference that is conditional on matching examinees with principled variations of an assessment so as to reduce construct-irrelevant demands. The present focus is assessment for special populations, but it is argued that the principles apply more broadly.     

Developing Measurement Theory for Classroom Assessment Purposes and Uses

In many fields of inquiry, the need for new theoretical developments is often best seen in areas of strain, and strain is apparent in several areas in which the conventions of measurement theory do not quite "fit" classroom assessment. Three areas of strain are analyzed in order to suggest how theoretical development might focus directly on information quality in the classroom assessment context. This article describes the context dependence of classroom assessment, its inextricable relationship with instruction, and its simultaneous formative and summative functions. Thus a case is made for new theoretical developments in the area of measurement in the classroom.     

教师认知研究的综述与展望

教师认知研究是教师教育研究的重要内容之一,体现了教学研究范式从关注教师行为到关注教师思维的重大转变。教师认知研究主要包括教师决策、教师知识和教师信念研究。这些研究的相关成果有助于提高教学效能,促进教师专业发展,推动教学改革。     

教师测评素养国外研究述评

教师测评素养是教师教育和教师发展的重要组成部分。通过对国外有关教师测评素养研究文献的梳理和分析,其研究内容主要包括教师测评素养的构成、现状及培训需求、测量工具的开发和验证、测评素养发展途径和影响因素等。这些研究对我国开展教师测评素养相关研究有一定的参考价值,同时也启示我们可以在研究对象、研究方法和研究内容上进一步拓展,要基于我国国情,开展教师测评素养及其测量测量工具的本土化研究。     

Differentiated instruction in a data-based decision-making context

In this study, the relationship between differentiated instruction, as an element of data-based decision making, and student achievement was examined. Classroom observations (n = 144) were used to measure teachers’ differentiated instruction practices and to predict the mathematical achievement of 2nd- and 5th-grade students (n = 953). The analysis of classroom observation data was based on a combination of generalizability theory and item response theory, and student achievement effects were determined by means of multilevel analysis. No significant positive effects were found for differentiated instruction practices. Furthermore, findings showed that students in low-ability groups profited less from differentiated instruction than students in average or high-ability groups. Nevertheless, the findings, data collection, and data-analysis procedures of this study contribute to the study of classroom observation and the measurement of differentiated instruction.     

Who are Most,Average, or High‐Functioning Adults?

The growing number of high‐functioning adults seeking accommodations from testing agencies and postsecondary institutions presents an urgent need to ensure reliable and valid diagnostic decision making. The potential for this population to make significant contributions to society will be greater if we provide the learning and testing accommodations to allow them access to knowledge, as well as the means to demonstrate their extraordinary abilities. The criteria and decision making used to identify high‐functioning adults with learning disabilities (LD) must be robust yet flexible enough to account for individual differences, measurement fallibility, and examiner expertise. The purpose of this article is to explore legal, measurement, and clinical issues surrounding the provision of accommodations to high‐functioning individuals with LD.     

Beyond the comfort zone: A curriculum and assessment “immersion” experience in graduate early childhood teacher education

Abstract

A graduate course in Early Childhood Education assessment which combines coursework and a practicum with young children is designed and implemented using constructivist principles and practice. Teacher education is more effective when field work and coursework are combined, and when students are able to apply what they learn in class to real life experiences with young children [Journal of Early Childhood Teacher Education 21 (1) (2000) 65], learning is enhanced. This course was constructed in a way that incorporated theory, application, reflection, and reconstruction, allowing students an opportunity to rethink their teaching practice through the experience of an early childhood practicum. The key components of the model — the components that are thought to most effectively help students to apply theory to practice, change some of their ways of thinking about teaching and learning are the following: the relationship of the coursework to the setting, continuity from previous courses, the laboratory school environment, the intensive faculty involvement, the co‐constructivist, collaborative nature of the faculty team, the collaborative nature of student work, the use of the three curriculum models, the use of embedded assessment, formative nature of the assessment, informed teaching (on‐going use of student feedback), the tools provided to student that assist in the process, and the practical hands‐on assessment techniques.

Changing students’ ways of thinking about the teaching, learning and assessment process is considered a vital part of the course. [Journal of Early Childhood Teacher Education 17(1) (Marshall, 1996) 43] has identified constructivist principles to guide teacher education. She believes that students must experience first‐hand those behaviors that she hopes they would exhibit in their own teaching (Rand, 1999, p. 126). It is through the processes of the course that graduate students are challenged to experience the implementation of emergent curriculum, examine their own beliefs in relation to their practice, articulate why they do what they do and see how classroom assessment strategies help to support meaningful teaching and learning. Furthermore, collaborative practice is considered an important factor that encourages and facilitates reflection, supports a more multi‐dimensional view of teaching and assessing young children, and enables students to listen and observe more effectively and look for the impact of children making choices. Through participation in this course, students became more aware of the impact their view of children and respect for children has on their ability to implement effective and appropriate assessment practices in the classroom. Students gained more of a conceptual understanding of the role of assessment in informed teaching, and were better able to meet individual children's instructional needs.

Finlly, students learned how to use tools inquiry, collaboration and reflection that are likely to assist them in future personal professional growth.     

Selbstwirksamkeitserwartungen und Pädagogisches Professionswissen im Verlauf des Lehramtsstudiums

Teacher Self-Efficacy and General Pedagogical Knowledge During Teacher Education. The present study investigates how teacher self-efficacy beliefs develop during teacher education and how self-efficacy beliefs and general pedagogical knowledge of student-teachers are related. In a cross-sectional study, 257 student-teachers were investigated (173 first year students, 27 advanced students, 35 examination candidates, 19 preservice teachers). The data show that self-efficacy beliefs for the subscales classroom management and assessment increase between the start and the end of training (preservice teachers). Concerning diagnostic competency, self-efficacy beliefs do not change during studies and even decrease for the preservice teachers. For the subscales communication and conflicts as well as coping little difference is noticeable. Professional knowledge, in contrast, increases during studies. Self-efficacy beliefs for classroom management and assessment are linked to professional knowledge. Finally, the usefulness of the multidimensional measuring of self-efficacy beliefs is discussed and implications for future research approaches are presented.     

Patterns in how pre-service elementary teachers formulate evidence-based claims about student cognition

Large-scale, robust implementation of teacher data-driven decision making (DDDM) is a challenging endeavor, impeded by numerous organizational, and teacher, factors. One well-documented barrier to teacher DDDM is underdevelopment of teacher data literacy. This study examines common errors made by pre-service elementary teachers in the formulation of evidence-based claims about student cognition (e.g. student strengths and weaknesses relative to content mastery) in a United States of America context. Teachers in the sample commonly made several errors in the articulation of evidence-based claims based on classroom assessments, including providing nonspecific, irrelevant evidence for claims, and misinterpreting statistical evidence. Specific implications for pre-service teacher education and future research are discussed.     

Basil Bernstein's Theory of the Pedagogic Device and Formal Music Schooling: Putting the Theory Into Practice

This article describes Basil Bernstein's theory of the pedagogic device as applied to school music instruction. Showing that educational practices are not personal choices alone, but the result of socio-political mandates, the article traces how education functions as a vehicle for social reproduction. Bernstein called this process the recontextualization of knowledge: From its point of inception, originally conceived knowledge undergoes changes through selection and filtration processes, eventually becoming curriculum—a relay for certain social and cultural values. Gaps in the recontextualization process allow teachers to place their own individual stamp upon the learning and teaching that occur in their classroom. Teacher–pupil interactions, guided by school-internal processes, lead to school knowledge that is further reproduced by the pupils in particular ways. A teacher's awareness of socially conditioned and habitual patterns of preference and behavior (habitus) may be key to making socially inclusive and emancipatory instructional choices.     

决策分析的发展和应用

在回顾决策分析理论发展历史的基础上,给出了决策分析的研究领域和研究方向。决策分析的几个基本研究分支为主观概率估计、效用理论、群决策、多目标决策、竞争性决策等,通过对各分支的发展简史、应用状况和方向的回顾和分析,强调决策分析在决策科学和管理科学发展中的基础性作用。     

Assessment policy in post-apartheid South Africa: challenges for improving education quality and learning

The South African education system has witnessed significant changes since 1994 when the democratically elected government began the process of dismantling the inherited apartheid order. The primary focus of the transformation process was to address the twin imperative of equity and quality in education, particularly for the historically marginalised black population. A key aspect of this transformation process remains the development of alternative assessment policies. This paper reviews the changes focusing on the stated rationale as well as their underlying assumptions and implications for practice. It argues that the changes have in many respects addressed the most obvious effects of the previous apartheid systems. However, it notes that, notwithstanding the policy intentions, assessment policy since 1994 has favoured a measurement focused-approach in the classroom, which has hindered a shift towards an assessment for learning approach. This, it argues, is partly fuelled by the abiding belief in and commitment to classroom testing and examinations as well as external national assessments as the key criterion for reforming learning and teaching practices in the classroom.     

Comparative analysis of expectancies of efficacy in in-service and prospective teachers

This study examines the beliefs about effective teaching in student teachers and inservice teachers. We constructed a measurement composed of an adaptation in Spanish of the Gibson and Dembo's (1984. Teacher efficacy: A construct validation. Journal of Educational Psychology, 76, 569–582). Teacher Efficacy Scale and of the items included in Emmer and Hickman's (1991. Teacher efficacy in classroom management and discipline. Educational and Psychological Measurement, 51, 755–765) “classroom management/discipline efficacy” dimension. A total of 339 participants took part in the study. The factor analysis carried out of the results obtained showed three principal factors: classroom management/discipline efficacy, personal teaching efficacy and general teaching efficacy. Analyses which compared efficacy expectancies showed significant differences in the management and discipline dimension in favour of the group of working teachers, whereas an opposite pattern emerged in the general teaching dimension. In addition, there were differences in the management/discipline dimension in terms of the number of years’ experience in the group of inservice teachers. The interpretation of the results is expressed in terms of the Bandura's perceived self-efficacy theory. We also indicate some implications that the analysis of these expectancies may have for the training and professional development of teachers, and we suggest lines for future research.     

Reconsidering Reliability in Classroom Assessment and Grading

It is argued that classroom assessment evolves from a different set of issues and demands from more traditional measurement concerns and that approaches to reliability developed from traditional concerns are not appropriate for most classroom settings. The assessment and grading issues for high school instruction are examined from the perspective of reliability. An alternative conceptualization of reliability, sufficiency of information, is proposed and explored. This conceptualization is based on the argument that at a rudimentary level, reliability theory is based on the notion of having enough information to make decisions or draw inferences.