Increasing evaluation sensitivity to diversity

Many queries have multiple interpretations; they are ambiguous or underspecified. This is especially true in the context of Web search. To account for this, much recent research has focused on creating systems that produce diverse ranked lists. In order to validate these systems, several new evaluation measures have been created to quantify diversity. Ideally, diversity evaluation measures would distinguish between systems by the amount of diversity in the ranked lists they produce. Unfortunately, diversity is also a function of the collection over which the system is run and a system’s performance at ad-hoc retrieval. A ranked list built from a collection that does not cover multiple subtopics cannot be diversified; neither can a ranked list that contains no relevant documents. To ensure that we are assessing systems by their diversity, we develop (1) a family of evaluation measures that take into account the diversity of the collection and (2) a meta-evaluation measure that explicitly controls for performance. We demonstrate experimentally that our new measures can achieve substantial improvements in sensitivity to diversity without reducing discriminative power.     

Understanding the Language Demands on Science Students from an Integrated Science and Language Perspective

This case study of a science lesson, on the topic thermal expansion, examines the language demands on students from an integrated science and language perspective. The data were generated during a sequence of 9 lessons on the topic of ‘States of Matter’ in a Grade 7 classroom (12–13 years old students). We identify the language demands by comparing students' writings with the scientific account of expansion that the teacher intended the students to learn. The comparison involved both content analysis and lexicogrammatical (LG) analysis. The framework of Systemic Functional Linguistics was adopted for the LG analysis. Our analysis reveals differences in the meaning and the way LG resources were employed between the students' writings and the scientific account. From these differences, we found the notion of condition-of-use for LG resources to be a significant aspect of the language that students need to appropriate in order to employ the language of school science appropriately. This notion potentially provides a means by which teachers could concurrently address the conceptual and representational demands of science learning. Finally, we reflect on how the complementary use of content analysis and LG analysis provides a way for integrating the science and language perspectives in order to understand the demands of learning science through language.     

What is ‘Agency’? Perspectives in Science Education Research

The contemporary interest in researching student agency in science education reflects concerns about the relevance of schooling and a shift in science education towards understanding learning in science as a complex social activity. The purpose of this article is to identify problems confronting the science education community in the development of this new research agenda and to argue that there is a need for research in science education that attends to agency as a social practice. Despite increasing interest in student agency in educational research, the term ‘agency’ has lacked explicit operationalisation and, across the varied approaches, such as critical ethnography, ethnographies of communication, discourse analysis and symbolic interactionism, there has been a lack of coherence in its research usage. There has also been argument concerning the validity of the use of the term ‘agency’ in science education research. This article attempts to structure the variety of definitions of ‘student agency’ in science education research, identifies problems in the research related to assigning intentionality to research participants and argues that agency is a kind of discursive practice. The article also draws attention to the need for researchers to be explicit in the assumptions they rely upon in their interpretations of social worlds. Drawing upon the discursive turn in the social sciences, a definition of agency is provided, that accommodates the discursive practices of both individuals and the various functional social groups from whose activities classroom practice is constituted. The article contributes to building a focused research agenda concerned with understanding and promoting student agency in science.     

Creating case studies of practice through Appreciative Inquiry

Taking a positive view is a fruitful way to prompt educators to reflect on and to develop their practice. Teachers, teacher educators and children bring a wide range of ideas that provide a powerful basis for developing understanding of the complexities of classroom practice. Using appreciate inquiry the authors show how they developed their understanding of professional development as they worked with groups of teachers who investigated their science teaching practice with young children and produced case studies of practice. The authors also show how the roles and ideas of themselves as university tutors were challenged and emerged to suit the range of contexts involved. Their view of Continuing Professional Development was influenced by the lived experiences of the teachers and themselves. They worked to systematise learning through identifying commonalities of experience and reflection along four dimensions: creating spaces for growth; working with emergent purposes; action research as rhizomatic growth; and collaborative and collective action. The rich variety of outcomes shows the value of creating space for growth for children and for adults. The energy and enthusiasm liberated motivated the participants to explore their worlds in ways that were difficult to predict at the start of the project.     

Adult education between the wars: the curious case of the Selborne Lecture Bureau

‘Independent’ lecture agencies are a neglected element in the history of education. Between 1918 and 1939, the Selborne Lecture Bureau was a significant national provider of adult education in Britain, both in its own right and as a supplier of lecture(r)s to Women's Institutes and other bodies, and it pioneered the use of films in schools. For a brief period, it was an ‘educational’ vehicle for the Empire Marketing Board with a programme of over 2400 lectures in 1929. The Bureau originated in the early twentieth century split between the conservative (and male) traditions of natural history and the radical (and female) campaigning (anti‐) plumage movement that produced the RSPB. The interwar history of the Selborne Lecture Bureau provides a counterpoint to conventional accounts of adult education between the two world wars, part of an influential ‘third stream’ alongside the ‘liberal tradition’ and growing state and local authority provision.     

A Self-Study of a Thai Teacher Educator Developing a Better Understanding of PCK for Teaching about Teaching Science

In this study, I, the first author as a Thai teacher educator employed self-study as a research methodology to investigate my own understandings, questions, and curiosities about pedagogical content knowledge (PCK) for teaching science student teachers and the ways I engaged student teachers in a field-based science methods course designed to help them to develop their PCK. Qualitative data gathered included: the syllabi, handouts, work submitted by student teachers, student teachers’ journal entries, my journal entries, and video recordings of my classroom teaching. Data were analysed using an inductive process to identify ways in which I attempted to enhance student teachers’ PCK. The contributions of this study are insights generated to help teacher educators think about how to support and develop student teachers’ PCK. Some of these contributions are enhancing teacher educators’ PCK for teaching science teachers, developing PCK for teaching science, and designing a science methods course in science teacher preparation programmes.     

Using Motivational Interviewing Techniques to Address Parallel Process in Supervision

Supervision offers a distinct opportunity to experience the interconnection of counselor–client and counselor–supervisor interactions. One product of this network of interactions is parallel process, a phenomenon by which counselors unconsciously identify with their clients and subsequently present to their supervisors in a similar fashion ( Searles, 1955 ). Addressing parallel process has the potential to be valuable in the advancement of counselor development, but few strategies exist in the literature for working with the phenomenon. The authors describe the use of motivational interviewing as one method for effectively addressing parallel process in supervision.     

Retrospective on educational testing and assessment in the 20th century

Over the last 100 years, the ever-increasing demand for testing as a measure of educational reform has created a very profitable market for the US testing industry. We follow the growth of this market since the 1900s in two different, but related, ways. First, we discuss some of the technical developments that have encouraged the use of standardized testing in general and contributed to the growth of the commercial testing industry. Second, we attempt to quantify the expansion of the testing marketplace during the 20th century by tracking several indirect indices of growth over time. We conclude that although technical innovations may have contributed to the growth of the US testing marketplace, they do not necessarily lead to better tests or better outcomes for those who use them. There is a need to more carefully monitor the effects of these tests on teaching and learning in general, particularly when the tests are used in high-stakes contexts.     

Acknowledgements

We sought to examine empirically the prevailing assumption that changing assessment can leverage curricular reform. This assumption has been significantly confirmed by our research for the case of mandated high-stakes assessment. Two studies were conducted in the two most populous Australian states, New South Wales and Victoria. In the final two years of secondary school in both states, courses of study and assessment arrangements are mandated for all schools, including the private sector, by the state's Board of Studies. Congruence between mandated assessment and schoolwide instructional practice was found in two states whose high-stakes assessment embodied quite contrasting values.     

Chinese whispers? Investigating the consistency of the language of assessment between a distance education institution,its tutors and students

Ensuring the fairness of assessment is important in all areas of higher education. It is particularly so in distance education, where the communication around assessment and feedback is a principal method of supporting learning, and even more so when the students are at the entry point into higher education. This research explores the nature of the language used in explaining the purpose and process of assessment on an access programme at The Open University, UK, from the perspective of the module team, the tutors and the students. It takes a qualitative approach to examine the clarity and consistency of assessment tasks, assessment guidance and TMGs. Analysis revealed inconsistencies in the language used in relation to assessment, which has led to a revision of how assessment tasks and guidance are communicated to students and tutors.