What’s in a score? Problematizing interpretations of observation scores

Several recent, large-scale observations of naturally occurring classroom instruction have found consistent patterns in how teaching quality systematically varies across domains of instruction, patterns not found in student survey measures. Teaching quality is highest when examining aspects of classroom management; moderately high when examining aspects of student support; and low when focusing on the quality of the instructional support provided to students. This paper problematizes this interpretation, arguing that observed data patterns could result from dilemmas inherent in measuring teaching quality through observation. In problematizing these conclusions, we highlight the complexity of trying to measure instruction at scale, arguing for the need for caution and consideration of the complexity of measurement when interpreting scores from observation systems.     

The apprenticeship of observation in career contexts: a typology for the role of modeling in teachers’ career paths

This article extends the literature on teachers’ career paths by attending to the experiences of educators when they were students in secondary classrooms. Grounded in the perspective that biography is central to teaching, we investigate undergraduate pre-service teachers’ educational experiences, views on teaching and learning, and professional plans. We draw upon life history interviews with 40 prospective teachers at three institutions across Pennsylvania, USA. We find that past educational experiences are intricately connected with career choice, intended professional path, and pedagogical focus. This paper identifies and discusses three forms of modeling – disciplinary, mentoring, and empowering – which influence pre-service teachers in powerful and enduring ways. These forms of modeling expand our understanding of teachers’ career intentions and apply the apprenticeship of observation to planned career paths.     

Reflective journals: making constructive use of the “apprenticeship of observation” in preservice teacher education

Many scholars have characterized the “apprenticeship of observation” as a “pitfall” to be avoided or a barrier to be overcome in preservice teacher education, but directly challenging students’ experience-based beliefs often leads to resistance, making students feel discounted or disrespected. In my introductory educational psychology course, students write biweekly journals reflecting on their own lived experiences in light of course concepts and ideas. These reflections are then shared in a variety of ways, serving as a vital context for further investigation and discussion of how these concepts and ideas translate into the classroom. In this paper, I share typical journal questions and excerpts from the responses of two recent classes to show how students can engage journal questions at differing levels; how even the experiences of my mostly privileged and successful students have at some points echoed, and thus can illuminate, the struggles of the less privileged, the rebellious, and the failed students who most need good teaching; and how students’ own shared reflections can be used nonthreateningly to help them confront their unconsidered assumptions about teaching and learning. Finally, I discuss choice, respect, and agency as three essential conditions for effective use of student journals in preservice teacher education.     

Experimental observation on a small-scale thermoacoustic prime mover

INTRODUCTION In the past 30 years, much progress has been achieved in thermoacoustic research (Backhaus and Swift, 1999; Garrett et al., 1993; Zhou and Matsubara,1998). However, most of them were still at laboratory scale. Aiming for industrial applications, recent re-searches began to pay attention to larger or smaller scale systems. The problem of heat dissipation from miniature high-tech products (say ICs, MEMS) at-tracts more attention due to the higher heat flux ac-companying th…     

The role of involvement and emotional well-being for preschool children’s scientific observation competency in biology

ABSTRACT

Observation is one of the basic methods in science. It is not only an epistemological method itself, but also an important competence for other methods like experimenting or comparing. However, there is little knowledge about the relation with affective factors of this inquiry method. In our study, we would like to find out about the relations of emotional well-being and involvement with children’s observation competency. Seventy preschool children participated in our test observing a living mouse, a snail and a fish. From their behaviour in the test situation, we coded their observation competency as well as their emotional well-being and involvement. The data show that both emotional well-being and involvement are significant predictors of children’s observation competency. Further analyses confirm our hypothesis of a mediating role of involvement between well-being and the performance in the observation task. In conclusion, theoretical and practical implications of these results are discussed.     

Learning Stories – crossing borders: introducing qualitative early childhood observation techniques to early childhood practitioners in Saudi Arabia

Early childhood education has become a focus of government policy across the world. Part of the present increased interest in early childhood education has been a focus on curriculum frameworks and socio/cultural methods of assessment. Currently, New Zealand has emerged as a world leader in early childhood education, and observation and assessment techniques, developed in New Zealand, have become an international focus of research and pedagogic practice. One exemplar practice to have emerged from research in New Zealand is the assessment of children's learning. An assessment project, conducted at the instigation of the New Zealand Ministry of Education, was designed to recognise key outcomes from the New Zealand curriculum, Te Whāriki, and to provide practitioners with a tool that would assist in the development of assessment ideas and procedures. The result was Learning Stories. This present research explored the introduction of Learning Stories into Australia and investigated the potential of Learning Stories as an assessment tool for early childhood practitioners in the context of Saudi Arabia.     

Early childhood assessment: observation,teacher ‘knowledge’ and the production of attainment data in early years settings

Since 2003 children in England have been formally assessed at the age of 5 after their first year in school, and their numerical scores reported to parents and analysed at school and national levels. The use of statutory assessment for this age group is unique in the UK, where other regions use less formal methods of assessment. It is also unusual internationally. This paper examines the peculiarity of this assessment system, the Early Years Foundation Stage Profile, using data from two ethnographic case studies of classrooms of four- and five-year-old children in London. The study revealed tensions between the construction of teachers' knowledge, their ambivalence in relation to the numerical data they report, and the use of the data for school accountability purposes. Alternative methods of assessing this age group in other parts of the UK are used to consider the implications of the production of numerical assessment data in early childhood education.     

Resistance to classroom observation in the context of teacher evaluation: teachers’ and department heads’ experiences and perspectives

This paper reports the main findings of a study that sought to understand how teachers and department heads perceived and experienced the implementation of a classroom observation system in a teacher evaluation context. The data was collected through a teacher and department head survey and interviews with department heads who were responsible for classroom observation. The findings show that respondents regarded classroom observation as an inadequate teacher evaluation instrument. It was also viewed as one of the features of the teacher evaluation system that least contributed to the teachers’ professional development. Department heads felt torn between their intermediate management role as teacher observers and their professional role as teacher peers. Cultural norms of individual professional autonomy that regulated relations among colleagues prevented department heads from using information, gathered through classroom observation, to nourish in-depth professional discussions about concrete educational practices.     

Modelling and close observation: ways of teaching and learning between third‐generation Bangladeshi British children and their grandparents in London

Studies on child development in cross‐cultural contexts generally contrast child‐rearing practices in traditional or non‐Western with those of Western societies. Thus, they show how non‐Western communities tend to emphasise the importance of interdependence and collectivism between family and group members; Western communities focus rather on the role of the individual and achievement within a competitive milieu. Similarly, close observation by younger siblings of older children and caregivers who ‘model’ tasks to be learned are usually concepts referring to non‐Western groups, whilst those detailing ‘scaffolding’ tend to focus on the caregiver/child dyad in the West. This paper questions the value of such binary divisions when studying the learning taking place in the homes of third‐generation migrants to the UK. Using examples of children, their younger siblings and their grandmothers in London, it shows ways in which the older generation skilfully syncretises traditional and Western teaching practices and how each child responds appropriately to the tasks in hand.     

‘Loveable’ mammals and ‘lifeless’ plants: how children's interest in common local organisms can be enhanced through observation of nature

This study investigated which plants and animals Swiss children found most attractive and evaluated the effect of an educational programme on children's preferences for species. More than 4000 pupils (8–16 years old) from 248 classes participated in the study. Possible effects of the programme were studied with the help of questionnaires using a pretest/post‐test design with an experimental group that participated in the programme and a control group that did not. Before the start of the programme most children found decorative or garden species among plants, and pets and exotic species among animals, most attractive. However, the more wild plants and animals children noticed in their local environment and could name, the more did they appreciate these organisms. Moreover, the more additional wild plants the children noticed due to the programme, the higher was the increase in their appreciation of these species. This supports the hypothesis that children may appreciate animals other than pets and exotic species and even inconspicuous wild plants if they know them.     

Social‐emotional well‐being and resilience of children in early childhood settings – PERIK: an empirically based observation scale for practitioners

Compared with the traditional focus on developmental problems, research on positive development is relatively new. Empirical research in children's well‐being has been scarce. The aim of this study was to develop a theoretically and empirically based instrument for practitioners to observe and assess preschool children's well‐being in early childhood settings. The analysis of preschool teachers' ratings yields six dimensions of social‐emotional well‐being: (1) making contact/social performance, (2) self control/thoughtfulness, (3) self‐assertiveness, (4) emotional stability/coping with stress, (5) task orientation, (6) pleasure in exploration. Composite scales were constructed. PERIK consists of six scales of six items each. The scales differentiate in both the upper and lower range and despite their brevity have good psychometric qualities. The instrument was published together with a booklet containing examples of how PERIK observations can be employed in practical work with children.     

Does a teacher’s classroom observation rating vary across multiple classrooms?

Classroom observations have been increasingly used for teacher evaluations, and it is important to examine the measurement quality and the use of observation ratings. When a teacher is observed in multiple classrooms, his or her observation ratings may vary across classrooms. In that case, using ratings from one classroom per teacher may not be adequate to represent a teacher’s instructional quality. Drawing on the Measures of Effective Teaching (MET) dataset, this study examined the variation of a teacher’s classroom observation ratings across his or her multiple classrooms. The results indicate that the math classrooms accounted for 4.9 to 14.7% of the variance in the classroom observation ratings and English language arts (ELA) classrooms accounted for 6.7 to 15.5% of the variance in the ratings. The results of this study suggest that teachers’ multiple classrooms should be taken into consideration when classroom observation ratings are used to evaluate teachers in high-stakes settings.     

Formative observation of teaching: focusing peer assistance on teachers’ developmental goals

Peer observation of teaching can provide valuable insights into effective educational practices. By adopting a developmental focus, peer observation can also provide insights into how practices might be enhanced and, importantly, how enhancements in practices might be aligned to teachers’ development goals. However, a review of peer observation of teaching undertaken at Australian universities demonstrates that observation instruments and protocols typically do not explicitly afford alignment of peers’ observations with teachers’ developmental goals. Analysis of observers’ uses of popular peer observation instruments through the deployment of the Peer Assisted Teaching Scheme through multiple institutions across Australia has informed the development and trial of a novel observation instrument and protocol design that is aligned with observer use characteristics, and provides a focus on development goals. This study will be of interest to teachers and academic developers researching and implementing goal-oriented curricular and pedagogical development through peer observation.     

Educators’ opinions on classroom observation as a practice of staff development and appraisal

This study examines educators’ perceptions of classroom observation as a practice of staff development and appraisal. A questionnaire survey was conducted on 2400 educators in Hong Kong. The reported frequency and patterns of classroom observation suggested that the current practice was primarily for the purpose of appraisal. Compared to secondary and special school educators, primary school educators were less likely to welcome observers. Teachers were more likely than principals to perceive that classroom observation was more for appraisal than for staff development. All respondents indicated that they wished for a model of peer observation and coaching. The results are discussed with reference to the need to develop a model of observation that is solely for staff development.     

Chaotic phenomenon and the maximum predictable time scale of observation series of urban hourly water consumption

The chaotic characteristics and maximum predictable time scale of the observation series of hourly water consumption in Hangzhou were investigated using the advanced algorithm presented here is based on the conventional Wolf's algorithm for the largest Lyapunov exponent. For comparison, the largest Lyapunov exponents of water consumption series with one-hour and 24-hour intervals were calculated respectively. The results indicated that chaotic characteristics obviously exist in the hourly water consumption system; and that observation series with 24-hour interval have longer maximum predictable scale than hourly series. These findings could have significant practical application for better prediction of urban hourly water consumption.     

Analysis of student’s responses to contradictory results obtained by simple observation or controlling variables

This study investigated students’ responses to presentations of experimental results that conflicted with their preconceptions regarding electric circuits, and how those responses varied according to the type of inquiry skills required to obtain the results. One hundred and twenty students of both sexes were randomly selected from a science high school in Korea. They were questioned about their preconceptions regarding an electric circuit and forty-two students with relevant misconceptions were selected. The students were randomly assigned to two groups, and presented with one of two sheets of paper presenting results obtained by a fictional investigator. The first group was presented with results that were obtained by simple observation and asked for their evaluation of them. The second group was presented with a set of results that were obtained by controlling variables, and asked to draw a conclusion and to evaluate it. Students’ responses were classified into two categories. Some students rejected their own preconceptions and introduced a new explanatory model when contradictory results were presented, and others denied the results for the simple reason that they conflicted with their preconceptions, or only modified a protective belt without changing their core of preconceptions. We found that this distribution of responses varied considerably by inquiry skill type. For the results obtained by controlling variables, almost all students accepted them and changed their preconceptions, but for the results obtained by simple observation, fifty-five percent of students preserved their own preconceptions by denying the contradictory results or modifying the protective belt.     

Are there differences between children’s display of self-regulation and metacognition when engaged in an activity and when later reflecting on it? The complementary roles of observation and reflective dialogue

Recent years have seen considerable growth of evidence that young children possess metacognitive and self-regulatory skills, alongside a view that some research tools, including observation and video-stimulated interviews, may provide better opportunities to see them. This paper examines possible differences in the evidence these two tools may afford. Data from 29 children aged 4–5 years in a London Reception class were analysed using a behavioural coding scheme. Overall, children were significantly more likely to display self-regulation and metacognition in post hoc interviews about an activity rather than during the activity. This was particularly so for metacognitive knowledge. Children were more likely to show regulatory aspects such as planning and monitoring during an activity, whilst evaluation was more evident in later discussion. Observations and video-stimulated interviews are suggested as valuable tools when combined with one another, offering complementary insights, and helping make children’s learning more visible to both themselves and to adults.     

Profile of South African secondary-school teachers’ teaching quality: evaluation of teaching practices using an observation instrument

The need for quality teaching is reflected in the poor performance of students in international tests. Teachers’ practices and contextual factors could contribute to substandard quality of teaching in South Africa. Several studies indicate that successful learning is largely dependent on the teachers’ practices in class. The focus of the present research was to profile the effective teaching practices of 424 secondary-school teachers in the Gauteng Province, South Africa. Teachers were observed by trained observers using a valid and reliable observation instrument measuring six domains of effective teaching practices. Results showed that teachers find it difficult to differentiate in class and to activate learning. Additionally, teachers with more than 15 years of teaching experience scored lower than teachers with less experience, in all six teaching domains. Presumably, experienced teachers may lack motivation and/or insufficient training in implementing interactive and differentiated teaching methods that are needed for effective teaching practices.     

Integration of technical vocabulary into peer observation of teaching for Taiwanese elementary school English teachers’ professional learning

This study explored the integration of technical vocabulary into pre-observation conferences and its influence on English teachers’ professional learning and discussion in their post-observation conferences. The conceptual framework based on Harvey [2011. “A Sociocultural-Theory-Based Study of the Impact of Mediation During Post-observation Conferences on Language Teacher Learning.” Unpublished doctoral diss., University of South Florida] and Goe, Biggers, and Croft [2012. Linking Teacher Evaluation to Professional Development: Focusing on Improving Teaching and Learning. Denver, CO: National Comprehensive Center for Teacher Quality] was used to analyse the questionnaire, audio recordings, and documents collected in seven peer observations of teaching in Taiwan. This study has two major findings. First, English teachers regarded the technical vocabulary as stimuli for their professional learning; however, the range of technical vocabulary used during the post-observation conferences was limited. Second, three major factors affected their use of technical vocabulary. A new model was proposed in order to effectively integrate technical vocabulary into peer observations of teaching for elementary school English teachers’ professional learning.