Teacher beliefs about the cognitive diagnostic information of classroom‐ versus large‐scale tests: implications for assessment literacy

Classroom teachers are in the front line of introducing students to formal learning, including assessments, which can be assumed to continue for students should they extend their schooling past the expected mandatory 12 years. The purpose of the present investigation was to survey secondary teachers’ beliefs of classroom and large‐scale tests for (a) providing information about students’ learning processes, (b) influencing meaningful student learning, and (c) eliciting learning or test‐taking strategies for successful test performance. Secondary teachers were surveyed because a majority of large‐scale tests are developed for secondary students (e.g., PISA, TIMSS). Results suggested that in comparison to large‐scale tests teachers believe classroom tests provide more information about student learning processes, are more likely to influence meaningful student learning, and are more likely to require learning over test‐taking strategies. The implications of these results for assessment literacy are explored.     

Rubric Rating with MFRM versus Randomly Distributed Comparative Judgment: A Comparison of Two Approaches to Second-Language Writing Assessment

The purpose of this study is to explore the reliability of a potentially more practical approach to direct writing assessment in the context of ESL writing. Traditional rubric rating (RR) is a common yet resource-intensive evaluation practice when performed reliably. This study compared the traditional rubric model of ESL writing assessment and many-facet Rasch modeling (MFRM) to comparative judgment (CJ), the new approach, which shows promising results in terms of reliability. We employed two groups of raters—novice and experienced—and used essays that had been previously double-rated, analyzed with MFRM, and selected with fit statistics. We compared the results of the novice and experienced groups against the initial ratings using raw scores, MFRM, and a modern form of CJ—randomly distributed comparative judgment (RDCJ). Results showed that the CJ approach, though not appropriate for all contexts, can be as reliable as RR while showing promise as a more practical approach. Additionally, CJ is easily transferable to novel assessment tasks while still providing context-specific scores. Results from this study will not only inform future studies but can help guide ESL programs in selecting a rating model best suited to their specific needs.     

Patterns of informal reasoning in the context of socioscientific decision making

The purpose of this study is to contribute to a theoretical knowledge base through research by examining factors salient to science education reform and practice in the context of socioscientific issues. The study explores how individuals negotiate and resolve genetic engineering dilemmas. A qualitative approach was used to examine patterns of informal reasoning and the role of morality in these processes. Thirty college students participated individually in two semistructured interviews designed to explore their informal reasoning in response to six genetic engineering scenarios. Students demonstrated evidence of rationalistic, emotive, and intuitive forms of informal reasoning. Rationalistic informal reasoning described reason‐based considerations; emotive informal reasoning described care‐based considerations; and intuitive reasoning described considerations based on immediate reactions to the context of a scenario. Participants frequently relied on combinations of these reasoning patterns as they worked to resolve individual socioscientific scenarios. Most of the participants appreciated at least some of the moral implications of their decisions, and these considerations were typically interwoven within an overall pattern of informal reasoning. These results highlight the need to ensure that science classrooms are environments in which intuition and emotion in addition to reason are valued. Implications and recommendations for future research are discussed. © 2004 Wiley Periodicals, Inc. J Res Sci Teach 42: 112–138, 2005     

Selecting Socio-scientific Issues for Teaching

Science & Education - Currently there is little guidance given to teachers in selecting focal issues for socio-scientific issues (SSI)-based teaching and learning. As a majority of teachers...     

Reading and spelling in adults: are there lexical and sub‐lexical subtypes?

The dual‐route model of reading proposes distinct lexical and sub‐lexical procedures for word reading and spelling. Lexically reliant and sub‐lexically reliant reader subgroups were selected from 78 university students on the basis of their performance on lexical (orthographic) and sub‐lexical (phonological) choice tests, and on irregular and nonword naming. In spelling of irregular words and nonwords to dictation, the group comparisons failed to support the dissociative predictions for lexical and sub‐lexical reliance that were derived from the dual‐route model: lexical readers were not superior to sub‐lexical readers on spelling irregular words as well as inferior to sub‐lexical readers on spelling regular letter strings (nonwords). In line with a single‐route view, print exposure and phonological coding (nonword naming accuracy) appear to be key factors in the effective learning of both regular and irregular words.     

Science Teachers’ Use of Mass Media to Address Socio-Scientific and Sustainability Issues

The currency, relevancy and changing nature of science makes it a natural topic of focus for mass media outlets. Science teachers and students can capitalize on this wealth of scientific information to explore socio-scientific and sustainability issues; however, without a lens on how those media are created and how representations of science are constructed through media, the use of mass media in the science classroom may be risky. Limited research has explored how science teachers naturally use mass media to explore scientific issues in the classroom or how mass media is used to address potential overlaps between socio-scientific-issue based instruction and education for sustainability. This naturalistic study investigated the reported and actual classroom uses of mass media by secondary science teachers’ to explore socio-scientific and sustainability issues as well as the extent to which their instructional approaches did or did not overlap with frameworks for SSI-based instruction, education for sustainability, and media literacy education. The results of this study suggest that secondary science teachers use mass media to explore socio-scientific and sustainability issues, but their use of frameworks aligned with SSI-based, education for sustainability, and media literacy education was limited. This paper provides suggestions for how we, as science educators and researchers, can advance a teaching and learning agenda for encouraging instruction that more fully utilizes the potential of mass media to explore socio-scientific issues in line with perspectives from education for sustainability.     

Design and Formative Evaluation of an Information Kiosk on Cattle Health for Landless Cattle Owners

Abstract

This paper describes and analyses the experience of designing, installing and evaluating a farmer-usable touch screen information kiosk on cattle health in a veterinary institution in Pondicherry. The contents of the kiosk were prepared based on identified demands for information on cattle health, arrived at through various stakeholders meetings. Information on these cattle diseases and conditions affecting the livelihoods of the poor was provided through graphics, text and audio back-up, keeping in mind the needs of landless and illiterate poor cattle owners. A methodology for kiosk evaluation based on the feedback obtained from kiosk facilitator, critical group reflection and individual users was formulated. The formative evaluation reveals the potential strength this ICT has in transferring information to the cattle owners in a service delivery centre. Such information is vital in preventing diseases and helps cattle owners to present and treat their animals at an early stage of disease condition. This in turn helps prevent direct and indirect losses to the cattle owners. The study reveals how an information kiosk installed at a government institution as a freely accessible source of information to all farmers irrespective of their class and caste can help in transfer of information among poor cattle owners, provided periodic updating, interactivity and communication variability are taken care of. Being in the veterinary centre, the kiosk helps stimulate dialogue, and facilitates demand of services based on the information provided by the kiosk screens.