Evaluating Instrument Quality in Science Education: Rasch‐based analyses of a Nature of Science test

Given the central importance of the Nature of Science (NOS) and Scientific Inquiry (SI) in national and international science standards and science learning, empirical support for the theoretical delineation of these constructs is of considerable significance. Furthermore, tests of the effects of varying magnitudes of NOS knowledge on domain‐specific science understanding and belief require the application of instruments validated in accordance with AERA, APA, and NCME assessment standards. Our study explores three interrelated aspects of a recently developed NOS instrument: (1) validity and reliability; (2) instrument dimensionality; and (3) item scales, properties, and qualities within the context of Classical Test Theory and Item Response Theory (Rasch modeling). A construct analysis revealed that the instrument did not match published operationalizations of NOS concepts. Rasch analysis of the original instrument—as well as a reduced item set—indicated that a two‐dimensional Rasch model fit significantly better than a one‐dimensional model in both cases. Thus, our study revealed that NOS and SI are supported as two separate dimensions, corroborating theoretical distinctions in the literature. To identify items with unacceptable fit values, item quality analyses were used. A Wright Map revealed that few items sufficiently distinguished high performers in the sample and excessive numbers of items were present at the low end of the performance scale. Overall, our study outlines an approach for how Rasch modeling may be used to evaluate and improve Likert‐type instruments in science education.     

Children’s Drawings About “Radiation”—Before and After Fukushima

Although the term “radiation” has a fixed place in everyday life as well as in the media, there is very little empirical research on students’ conceptions about this topic. In our study we wanted to find out what students associate with this term. In 2009, we asked 509 students (between grade 4 and grade 6) from seven different schools to draw pictures related to “radiation”. This method of children’s drawings was supported by short interviews (n?=?74). The motifs appearing in the drawings were analysed, and we investigated whether or not the age and the sex of the children had any influence on the choice of motifs. One major result was that the older the students were, the more likely they were to choose sources of invisible radiation (nuclear power plants, mobile phones) as their motifs. Nine months after the tragic events in Fukushima (and at the same time 2 years after the 2009 data collection), we replicated the study. This time, we received 516 drawings from the same schools as in the 2009 study (supported by 33 interviews). This replicative trend study made it possible to compare the choice of motifs and discover possible differences. The results of this analysis showed that the drawings of 2011 included significantly more motifs related to radioactivity. This difference was prevalent in the drawings regardless of sex or age differences. Direct references to the Fukushima accident could be found in both the drawings and interviews.     

Communicating Student Evaluation of Teaching Results: Rating Interpretation Guides (RIGs)

In the past decade student evaluation of teaching has expanded within Australian universities, with the results of evaluations increasingly being used to make judgements about teaching quality, career advancement and the funding of teaching. An important component of any student evaluation of teaching system is, therefore, the communication of rating results in a manner that enables fair and meaningful interpretations and comparisons of results by the wide range of evaluation users. This paper describes the development in one Australian university of Rating Interpretation Guides (RIGs) which take into account the influence of different teaching contexts on ratings and encourage evaluation users to explore ratings in terms of a range of scores rather than focusing on a single mean score. RIGs represent an important innovation in the communication of evaluation results for both formative and summative evaluation purposes. They are designed to enable meaningful interpretations of ratings which in turn will encourage appropriate use of results.     

News and Islamist Radicalization Processes: Investigating Muslims’ Perceptions of Negative News Coverage of Islam

This study investigated how Muslims perceive negative news coverage of Islam and how these perceptions possibly contribute to radicalization processes. Utilizing qualitative interviews with former Islamists, Study 1 indicated that radicalized Muslims perceive a governmental infiltration of the media resulting in negative content. Analyses indicate that perceptual phenomena (hostile media, third person), negation, and anger play an important role in radicalization processes. We built on these findings in Study 2, utilizing a laboratory experiment in which Muslims were exposed to negative news content. Indeed, Muslims engaged in negation, perceived news as hostile, and perceived strong effects on non-Muslim Germans. These effects were stronger among Muslims with religious fundamentalist beliefs. Interestingly, negative news elicited anger, independent of such fundamentalist beliefs.     

CRITICAL PEDAGOGY AND FAITH

Critical pedagogy has often been linked in the literature to faith traditions such as liberation theology, usually with the intent of improving or redirecting it. While recognizing and drawing from those previous linkages, Jacob Neumann goes further in this essay and develops the thesis that critical pedagogy can not just benefit from a connection with faith traditions, but is actually, in and of itself, a practice of faith. In this analysis, he juxtaposes critical pedagogy against three conceptualizations of faith: John Caputo's blurring of the modernist division between faith and reason, Paul Tillich's argument that faith is “ultimate concern,” and Paulo Freire's theology and early Christian influences. Using this three‐pronged approach, Neumann argues that regardless of how it is seen, critical pedagogy manifests as a practice of faith “all the way down.”     

Touch Screen Tablets and Emergent Literacy

The use of touch screen tablets by young children is increasing in the home and in early childhood settings. The simple tactile interface and finger-based operating features of tablets may facilitate preschoolers’ use of tablet application software and support their educational development in domains such as literacy. This article reviews current findings on using touch screen tablets in supporting early literacy development within a theoretical framework. The evidence suggests that tablets have the potential to enhance children’s emergent literacy skills (e.g., alphabet knowledge, print concepts, and emergent writing). However, the optimal use of tablets for early literacy learning may be dependent upon the type of scaffolding used by parent or teacher and the availability and quality of literacy tablet applications. Practical implications and suggestions for future research are discussed.     

Soziale Ungleichheiten beim Übergang von der Grundschule in die Sekundarstufe I: Theorie,Forschungsstand, Interventions- und Fördermöglichkeiten

Based on a theoretical model, which distinguishes between primary and secondary effects following Boudon, the present paper summarizes empirical evidence regarding the impact of family background on the transition from elementary into secondary school. In doing so, three types of secondary effects are distinguished: secondary effects of school grades, teacher recommendations, and the transition itself. The empirical literature suggests that both primary and secondary effects exist in the German school system: In addition to having lower achievement, children from disadvantaged backgrounds receive lower grades and fewer recommendations for higher tracks and are less likely to attend a high track even when controlling for their achievement. The paper closes by presenting findings from studies analyzing the relative importance of primary and secondary effects and a discussion on how effects of family background on the transition into secondary school can be reduced.