Communicating Student Evaluation of Teaching Results: Rating Interpretation Guides (RIGs)

In the past decade student evaluation of teaching has expanded within Australian universities, with the results of evaluations increasingly being used to make judgements about teaching quality, career advancement and the funding of teaching. An important component of any student evaluation of teaching system is, therefore, the communication of rating results in a manner that enables fair and meaningful interpretations and comparisons of results by the wide range of evaluation users. This paper describes the development in one Australian university of Rating Interpretation Guides (RIGs) which take into account the influence of different teaching contexts on ratings and encourage evaluation users to explore ratings in terms of a range of scores rather than focusing on a single mean score. RIGs represent an important innovation in the communication of evaluation results for both formative and summative evaluation purposes. They are designed to enable meaningful interpretations of ratings which in turn will encourage appropriate use of results.     

Evaluating Instrument Quality in Science Education: Rasch‐based analyses of a Nature of Science test

Given the central importance of the Nature of Science (NOS) and Scientific Inquiry (SI) in national and international science standards and science learning, empirical support for the theoretical delineation of these constructs is of considerable significance. Furthermore, tests of the effects of varying magnitudes of NOS knowledge on domain‐specific science understanding and belief require the application of instruments validated in accordance with AERA, APA, and NCME assessment standards. Our study explores three interrelated aspects of a recently developed NOS instrument: (1) validity and reliability; (2) instrument dimensionality; and (3) item scales, properties, and qualities within the context of Classical Test Theory and Item Response Theory (Rasch modeling). A construct analysis revealed that the instrument did not match published operationalizations of NOS concepts. Rasch analysis of the original instrument—as well as a reduced item set—indicated that a two‐dimensional Rasch model fit significantly better than a one‐dimensional model in both cases. Thus, our study revealed that NOS and SI are supported as two separate dimensions, corroborating theoretical distinctions in the literature. To identify items with unacceptable fit values, item quality analyses were used. A Wright Map revealed that few items sufficiently distinguished high performers in the sample and excessive numbers of items were present at the low end of the performance scale. Overall, our study outlines an approach for how Rasch modeling may be used to evaluate and improve Likert‐type instruments in science education.     

The Scaffolding of Emergent Literacy Skills in the Home Environment: A Case Study

The ways in which parent-child interactions can encourage the development of emergent literacy skills in young children remains to be fully explored. The present report describes how one parent scaffolded her young child’s emergent writing and letter knowledge in the home. Environmental print provided many rich and meaningful examples for the parent to show that print conveys meaning and is constructed with letters that have names and make sounds. The parent used idiomorphs, a multisensory approach incorporating the tracing of letters and whole body movements, and common household objects to guide the child’s learning of letter names, sounds, and shapes. Emergent writing skills were scaffolded by using directional language and by the child copying environmental print. The strategies and examples that are described may give guidance to parents and teachers on how to provide engaging opportunities for literacy learning in the home environment or in an early educational context.     

Paradigm development and leadership style of university department chairpersons

This article develops and tests the argument that leadership behavior in organizations can best be understood within a contingency technology-environment model. The major premise of this model is that one of the most influential intervening factors between organizational performance and leadership behavior is either the technology that the organization utilizes or the environment with which the organization interacts. Building upon this premise and the work of Kuhn (1970), four hypotheses are tested concerning the relationship between the effectiveness of natural science and social science departments in American universities using factor analysis. The data supports the conclusion that differential leadership styles are predictable in different scientific fields.     

News and Islamist Radicalization Processes: Investigating Muslims’ Perceptions of Negative News Coverage of Islam

This study investigated how Muslims perceive negative news coverage of Islam and how these perceptions possibly contribute to radicalization processes. Utilizing qualitative interviews with former Islamists, Study 1 indicated that radicalized Muslims perceive a governmental infiltration of the media resulting in negative content. Analyses indicate that perceptual phenomena (hostile media, third person), negation, and anger play an important role in radicalization processes. We built on these findings in Study 2, utilizing a laboratory experiment in which Muslims were exposed to negative news content. Indeed, Muslims engaged in negation, perceived news as hostile, and perceived strong effects on non-Muslim Germans. These effects were stronger among Muslims with religious fundamentalist beliefs. Interestingly, negative news elicited anger, independent of such fundamentalist beliefs.     

Geschlechtsspezifische Leistungsunterschiede in Abhängigkeit der sozialen Herkunft. Eine Untersuchung zur Interaktion zweier sozialer Kategorien

Gender differences in educational outcomes are often reported. However, some evidence suggests that these differences are not consistent but vary with social background. In quantitative research, however, the interaction between gender and social background has been underinvestigated. The present study investigates whether the effect of gender on achievement is moderated by socio-economic status (SES). The sample consists of N = 3935 primary school-children in Berlin (6th grade). The results show that the effect of gender on achievement varies with SES, with a stronger correlation between the achievement of boys and their SES. Taken together, the results of the study suggest a differentiated consideration of the achievement of boys and girls and the importance of considering multiple group identities.     

CRITICAL PEDAGOGY AND FAITH

Critical pedagogy has often been linked in the literature to faith traditions such as liberation theology, usually with the intent of improving or redirecting it. While recognizing and drawing from those previous linkages, Jacob Neumann goes further in this essay and develops the thesis that critical pedagogy can not just benefit from a connection with faith traditions, but is actually, in and of itself, a practice of faith. In this analysis, he juxtaposes critical pedagogy against three conceptualizations of faith: John Caputo's blurring of the modernist division between faith and reason, Paul Tillich's argument that faith is “ultimate concern,” and Paulo Freire's theology and early Christian influences. Using this three‐pronged approach, Neumann argues that regardless of how it is seen, critical pedagogy manifests as a practice of faith “all the way down.”     

Chameleon effects in homework research: The homework–achievement association depends on the measures used and the level of analysis chosen

Using a data set specifically tailored to homework research, with a sample of 1275 students from 70 classes in Switzerland, the association between homework and achievement in French as a second language was tested at three levels (class level, between-student level, and within-student level). The strength and direction of the homework–achievement association depended on the homework indicator chosen and differed to some degree across analytical levels. At the class level, achievement was higher in classes set frequent homework assignments and in classes where students reported low overall levels of negative emotions when doing homework. At the between-student level, high individual homework effort and low levels of negative homework emotions predicted favorable developments in French achievement, whereas high homework time predicted lower achievement. At the intraindividual level, high homework effort, high homework time, and low levels of negative homework emotions were statistically significantly associated with positive student evaluations of the learning gains from the specific assignment.