Estimating teacher effectiveness from two-year changes in students’ test scores

Using a dataset covering over 10,000 Australian school teachers and over 90,000 pupils, I estimate how effective teachers are in raising students’ test scores. Since the exams are biennial, it is necessary to take account of the teacher's work in the intervening year. Even adjusting for measurement error, the teacher fixed effects are widely dispersed, and there is a strong positive correlation between a teacher's gains in literacy and numeracy. Teacher fixed effects show a significant association with some, though not all, observable teacher characteristics. Experience has the strongest impact, particularly in the early years of a teacher's career. Female teachers do better at teaching literacy. Teachers with a master's degree or some other form of further qualification do not appear to achieve significantly larger test score gains. Overall, teacher characteristics found in the departmental payroll database explain only a small fraction of the variance in teacher performance.     

How to cope with stress in special needs education? Stress-inducing dysfunctional cognitions of teacher students: the perspective of professionalisation

The goal of the present study is to identify prospective special education teachers (SETs) who may have difficulties in coping with occupational stresses and burdens. International comparative studies show that SETs have a higher level of stress than their colleagues who work in the general school system. Compared with teachers in regular schools, SETs leave their profession at a higher rate. For this reason, the study focuses on so-called dysfunctional cognitions, which might increase stress in strenuous occupational situations and which have long-term harmful effects on health. The construct of dysfunctional cognitions is supposed to be a basis for developing supportive measures for teacher students with low stress tolerance. In the framework of the present study located in the German educational system, teacher students (N = 333) from the special needs areas, including learning disability, mental disability, emotional/social disorders and sensory disabilities (hearing impairment, or speech or language disorders), are taken into account. A hierarchical cluster analysis and a discriminant analysis were used to identify four different clusters: Cluster 1 shows the lowest attitude level of equally all dysfunctional cognitions. Clusters 2 and 3 are characterised by higher degrees, especially of ‘dependency’, ‘internalisation of failure’ and ‘personal standards (perfectionism)’. The fourth profile indicates the highest degree of the dysfunctional cognitions. Lower levels of dysfunctional cognitions (with the exception of perfectionism) occur together with a higher expectation of self-efficacy. No cluster applies for all teacher students of one specific special needs area. Prospective teachers in the area of mental disability are overrepresented in cluster 3, with a high level of internalisation of failure and dependency. Teacher students in the area of emotional/social disorders belong, to a considerable degree, to the ‘risk’ cluster. The profiles are used to develop measures for those teacher students who may experience difficulties in stressful occupational situations. Therefore, these student teachers need to be closely supported through additional intensive training elements and balanced career counselling.     

“Don’t sweat the small stuff:” Understanding teacher resilience at the chalkface

This study investigates how graduating and early career teachers perceive resilient teachers. Informed by survey data from 200 graduating and early career teachers, the study’s results indicate that graduating and early career teachers perceive that resilience for teachers comprises characteristics that are multi-dimensional and overlapping, and that views of resilience may develop according to teachers’ career stage. To further conceptualise teacher resilience, four possible dimensions of teacher resilience (profession-related, emotional, motivational and social) are suggested and the aspects within these dimensions are described. Some implications of this view of teacher resilience for preservice teacher education and future research are discussed.     

Measuring teaching quality in higher education: assessing selection bias in course evaluations

Student evaluations of teaching (SETs) are widely used to measure teaching quality in higher education and compare it across different courses, teachers, departments and institutions. Indeed, SETs are of increasing importance for teacher promotion decisions, student course selection, as well as for auditing practices demonstrating institutional performance. However, survey response is typically low, rendering these uses unwarranted if students who respond to the evaluation are not randomly selected along observed and unobserved dimensions. This paper is the first to fully quantify this problem by analyzing the direction and size of selection bias resulting from both observed and unobserved characteristics for over 3000 courses taught in a large European university. We find that course evaluations are upward biased, and that correcting for selection bias has non-negligible effects on the average evaluation score and on the evaluation-based ranking of courses. Moreover, this bias mostly derives from selection on unobserved characteristics, implying that correcting evaluation scores for observed factors such as student grades does not solve the problem. However, we find that adjusting for selection only has small impacts on the measured effects of observables on SETs, validating a large related literature which considers the observable determinants of evaluation scores without correcting for selection bias.     

Variability in Demand for Special Education Teachers: Indicators,Explanations, and Impacts

After decades of growth, the number of special education teachers (SETs) has begun to decline. In 2009, U.S. schools employed 13% fewer SETs than in 2006. The number of annual new hires of SETs also dropped dramatically in some states. The onset of these declines predated the economic downturn of 2008 and resulted in part from a steady decline since 2005 in the number of students with disabilities (SWD) served. We consider factors that may be contributing to declining demand for SETs, among them the number of SWD, service delivery, the economic downturn, and present supporting evidence. We also consider the potential impact of reduced demand on SET supply, teacher education, equitable distribution of teachers, and, most importantly, outcomes for SWD. We call for vigilance and monitoring of SET employment data to assure that all students receive the appropriate education to which they are entitled.     

What can teachers do to raise pupil achievement?

Improving weak teaching may be one of the most effective means of raising pupil achievement. However, teachers’ classroom practices and the teaching ‘process’ may matter more to student learning than teachers’ observed résumé characteristics (such as certification and experience). There may also be important differences in teacher characteristics across government and private schools which may help explain the large documented public-private achievement differences often found in studies. This paper delves into the black-box representing ‘teaching’ to uncover the teacher characteristics and teaching practices that matter most to pupil achievement. This is done using unique school-based data, collected in 2002-2003 from government and private schools from one district in Punjab province in Pakistan. The data allow exploitation of an identification strategy that permits the matching of students’ test scores in language and mathematics to the characteristics of teachers that teach those subjects. Within pupil (across subject rather than across time) variation is used to examine whether the characteristics of different subject teachers are related to a students’ mark across subjects. The data are also unique in asking all subject teachers questions pertaining to their teaching practices and these, often unobserved, ‘process’ variables are included in achievement function estimates. Our pupil fixed-effects findings reveal that the standard résumé characteristics of teachers do not significantly matter to pupil achievement. Perversely, however, teachers are found to be rewarded with higher pay for possessing these characteristics, highlighting the highly inefficient nature of teacher pay schedules. Our findings also show that teaching ‘process’ variables matter significantly to student achievement. There are important differences across school-types.     

Does the use of end of semester evaluation forms represent teachers’ views of teaching in a tertiary education context in Japan?

This paper considers both how the mandatory introduction of student evaluation of teaching surveys (SETs) fits into the social and political context of tertiary education in Japan, and the assumptions about teaching underlying SETs. Through interviews with English teachers, a technical–rational perspective whereby teaching is a profession only to the extent that it involves applying theoretical knowledge to the pursuit of educational ends is discussed. Teachers’ capacities to make complex judgments are not recognized so that teaching becomes indistinguishable from technical expertise. Quantitative evaluation as a measurement of effectiveness and efficiency leads to teacher exclusion from dialogue on how teaching might be improved.     

Multiple dimensions of university teacher self-concept

Despite the recognised importance of positive self-concepts inmany settings, surprisingly little attention has been paid to teacherself-concepts – teachers' self-perceptions of their own teachingeffectiveness. We integrate research literatures on self-concept and onstudents' evaluations of teaching effectiveness (SETs), develop amultidimensional university teacher self-concept instrument, andevaluate its psychometric properties (factor structure, reliability,validity). A multitrait-multimethod analysis of relations betweenmultiple dimensions of teacher self-concept and corresponding SET ratingdimensions provides good support for the construct validity of teacherself-concept responses. In support of a priori hypotheses based onself-concept theory, agreement between teacher self-concepts and SETswas moderate (median r = 0.20) for teachers who had notpreviously received SET feedback, but substantially higher (median r= 0.40) for teachers who had previously received SET feedback.Implications for further research on teacher self-reflection and forimproving teaching effectiveness in higher education arediscussed.     

Values, virtues and professional development in education and teaching

This paper addresses conceptual issues concerning values in teaching and the professional education of teachers. Proceeding from rejection of a common (empiricist) account of values as subjective tastes, the paper distinguishes three common (more and less restrictive) concepts or senses of value, here referred to under the labels ‘principled preference’, ‘principled commitment’ and ‘principled disposition’. The paper proceeds to argue that, in light of certain distinctive features of teaching as a profession, the key values of teaching should be regarded as ‘principled dispositions’ (or, in another term, virtues). It is further argued that such professional teacher values are best appreciated under the three aspects of ‘intellectual virtues’, ‘procedural virtues’ and ‘moral virtues’ and the paper concludes with a brief exploration of the implications of this analysis for professional teacher education.     

Teacher education for World English speaking pre-service teachers: Making transnational knowledge exchange for mutual learning

Pre-service teachers are taught that the funds of knowledge their students bring to school provide intellectual resources to be engaged through productive pedagogies. Teacher education may assist and/or hinder World English Speaking (WES) pre-service teachers in gaining access to the teaching profession by doing likewise. The interpretative case study presented in this paper involves exploring possibilities for teacher education programs to make transnational knowledge connections through WES pre-service teachers. Evidence from interviews with WES pre-service teachers and their Anglophone teacher educators are analysed to elaborate issues confronting teacher education programs involving World English Speakers. The findings indicate that teamwork which is constructed to privilege the knowledge of Anglophone pre-service teachers over their WES peers is questionable. Further, WES pre-service teachers are not only structurally disadvantaged by teamwork practices that privilege local knowledge, they are also challenged by teacher educators’ assessment procedures. The pressures created on teacher educators’ workloads, may lead to ‘lean and mean’ assessment procedures which serve to contain excessive demands on their labour, but do not necessarily resolve the dilemma of how to use assessment practices that minimise WES pre-service teachers’ learning.     

Do teacher characteristics matter? New results on the effects of teacher preparation on student achievement

Research fairly consistently demonstrates that teachers are an important measurable factor in student learning, yet few teacher characteristics are shown to be consistently related to student achievement. Using a state administrative dataset that matches individual students to their teachers over time, I find that math teachers’ undergraduate performance, as measured by GPA (overall, math, and math education) and course hours (math and math education), is predictive of 5th grade math achievement. The effects of the teacher characteristics are mediated by years of experience and vary according to student types.     

Teaching for understanding and/or self-regulated learning? A video-based analysis of reform-oriented mathematics instruction in Switzerland

In mathematics instruction, can a teacher implement surface features of instruction that foster self-regulated learning as well as achieve quality at the deeper level of instruction, that is, focus on higher-order thinking, problem-solving, and mathematical modeling? An educational reform effort in Switzerland, which is based on constructivist and sociocultural theories of mathematics learning, targets both these dimensions: self-regulated learning and conceptual understanding. We examined the realization of the two dimensions in classroom instruction in a video-based study of 79 eighth-grade math classes using three kinds of data: videotapes of mathematics lessons, student and teacher questionnaires, and achievement tests. As to the surface level of instruction, teachers reported how frequently they provided opportunities for self-regulated learning. With regard to the deeper level of instruction, teachers reported how frequently they provided opportunities for independent problem solving. In addition, we examined the extent to which teachers’ pedagogical beliefs reflected a constructivist orientation. The results showed that teachers implemented the two dimensions relatively independently of one another. Teachers’ constructivist-oriented beliefs influenced only opportunities provided for independent problem solving and did not affect opportunities for self-regulated learning. Opportunities for self-regulated learning had a positive effect on students’ learning experience. Professional development should encourage teachers to take greater account of both surface-level and deeper-level (quality) features of instruction.     

Advancing text-analysis to tap into the student voice: a proof-of-concept study

Abstract

Student evaluations of teaching and courses (SETs) are part of the fabric of tertiary education and quantitative ratings derived from SETs are highly valued by tertiary institutions. However, many staff do not engage meaningfully with SETs, especially if the process of analysing student feedback is cumbersome or time-consuming. To address this issue, we describe a proof-of-concept study to automate aspects of analysing student free text responses to questions. Using Quantext text analysis software, we summarise and categorise student free text responses to two questions posed as part of a larger research project which explored student perceptions of SETs. We compare human analysis of student responses with automated methods and identify some key reasons why students do not complete SETs. We conclude that the text analytic tools in Quantext have an important role in assisting teaching staff with the rigorous analysis and interpretation of SETs and that keeping teachers and students at the centre of the evaluation process is key.     

Educational production and the distribution of teachers in Uruguay

In this paper we discuss results from an analysis of a large dataset that includes virtually all sixth-grade students in Uruguay in 1996. We analyze the relationship between teacher attributes and student achievement scores and we explore the distribution of teachers according to characteristics identified as important by this analysis. We find that teachers with “important” attributes are distributed in a way that systematically favors schools with higher average achievement and socioeconomic context. Policy-related factors that may explain these patterns include Uruguay's system of teacher compensation, teachers’ working conditions, the level and locus of educational decision making in Uruguay, and teacher recruitment and assignment policies. The results are particularly interesting because Uruguay is a relatively equal society in Latin American terms, so the unequal distribution of teacher attributes is probably more accentuated in other Latin American societies.     

Special Education Teachers’ Self-Efficacy in Implementing Social–Emotional Learning to Support Students with Learning Disabilities

This study was designed to determine how special education teachers (SETs) in Saudi Arabia perceive their self-efficacy in implementing social–emotional learning (SEL) practices to support students with learning disabilities (LD). The data were collected by surveying 109 SETs of students with LD who teach at elementary and middle schools in Riyadh. The findings demonstrate that SETs had low to moderate self-efficacy in putting SEL into practice, and the participants highlighted the importance of receiving support that can enhance their self-efficacy in SEL. Moreover, the study's findings show some statistically significant variations in the responses of the teachers, as those who attended more professional development programs reported higher levels of self-efficacy. Additionally, middle school teachers and teachers with fewer years of experience showed a higher need for receiving support to enhance their implementation of SEL. Recommendations for future studies and practices are provided.     

Understanding how a case-based assessment instrument influences student teachers’ learning approaches

In order to stimulate student teachers to thoroughly comprehend the main variables influencing their work, teaching and assessment strategies in teacher education have changed significantly. One of the changes in the assessment of student teachers in teacher education programs is the use of case-based assessment instruments. Such instruments evaluate the extent to which student teachers are able to handle authentic problems. It is expected that implementing this mode of assessment will stimulate student teachers to adopt a deep approach to learning. In this study we examine student teachers’ learning approaches in the context of case-based assessment. Hereto, we investigated the direct effects of the student teachers’ general beliefs on the cognitive demands of assessment on their learning approaches. Also the student teachers’ perceptions of the cognitive demands of the case-based assessment instrument were considered as a mediating variable. The present study is conducted in the Netherlands, in the third year of a 4-year initial teacher training program for primary education. A case-based assessment instrument, called the OverAll Test, was implemented as the major determinate of the third-year final examination grade of the student teachers.     

Exploring teacher trust in technical/vocational secondary schools: Male teachers’ preference for girls

This article explores whether teachers’ trust in pupils in technical/vocational schools is associated with teachers’ and pupils’ gender. As for the teachers, besides gender, age, socioeconomic origin, and subject taught are considered and, as for the pupils, the gender composition of the school (proportion of girls at school), the socioeconomic context of the school and the grades teachers instruct. Multilevel analyses of data of 391 teachers in a sample of 19 technical/vocational schools demonstrate that initially none of the teacher features relates to teacher trust. Adding gender composition to the model yields an effect of teachers’ gender: Female teachers have less trust in their pupils than male teachers have. Also, teachers’ trust increases with the proportion of girls at school. Finally, a significant interaction effect indicates that male teachers seem to prefer female pupils.     

Creating and facilitating a teacher education curriculum using preservice teachers’ autobiographical stories

Preservice teachers’ autobiographical stories can serve as a personal, powerful, and poignant curriculum for teacher education. This research examines what and how preservice teachers learned through sharing their own and witnessing others’ autobiographical narratives in a literacy methods course. The teacher educator’s key role is examined in facilitating a public context of vulnerability in which preservice teachers shared painful stories revealing their sociocultural inequalities and personal struggles as literacy learners. Roles of the teacher educator are discussed in the transformation of autobiographies into deep understandings, universal connections and substantive strategies for preservice teachers to teach literacy effectively with diverse students.     

Development of student–teacher relationships in rural early elementary classrooms

An increasing body of literature documents associations between student–teacher relationships, children's academic success, and children's social competence in school. Less is known about characteristics and processes involved in the quality of relationships between students and teachers, and little research has examined these issues with populations of young students and teachers living in rural communities. The current study examined the relationships between rural kindergarten and first-grade students and their teachers in spring of the school year, predicted by child demographic factors, child process factors, and teacher characteristics. Using a multi-level model to account for clustering of children in classrooms, children's behavior and literacy skills were examined as contributors to the teachers’ perceptions of the developing teacher–student relationship, focusing on their potential to mediate associations between more distal characteristics and teacher–student relationships. Controlling for relationship conflict in fall, boys and African American students were more likely to have relationships with teachers that were higher in conflict in spring. When behavior and literacy skills measures were added to the model, children's behavior mediated the effect of gender, such that behavior problems accounted for much of the variance in student–teacher conflict associated with gender. However, neither behavior problems nor literacy skills mediated the effects of minority status on conflict; African American students had poorer relationships with teachers regardless of behavior or literacy skills.