The centrality of teachers’ judgement practice in assessment: a study of standards in moderation

There is a strong quest in several countries including Australia for greater national consistency in education and intensifying interest in standards for reporting. Given this, it is important to make explicit the intended and unintended consequences of assessment reform strategies and the pressures to pervert and conform. In a policy context that values standardisation, the great danger is that the technical, rationalist approaches that generalise and make superficial assessment practices, will emerge. In this article, the authors contend that the centrality and complexity of teacher judgement practice in such a policy context need to be understood. To this end, we discuss and analyse recorded talk in teacher moderation meetings showing the processes that teachers use as they work with stated standards to award grades (A to E). We show how they move to and fro between (1) supplied textual artefacts, including stated standards and samples of student responses, (2) tacit knowledge of different types, drawing into the moderation, and (3) social processes of dialogue and negotiation. While the stated standards play a part in judgement processes, in and of themselves they are shown to be insufficient to account for how the teachers ascribe value and award a grade to student work in moderation. At issue is the nature of judgement as cognitive and social practice in moderation and the legitimacy (or otherwise) of the mix of factors that shape how judgement occurs.     

A Conditional Joint Modeling Approach for Locally Dependent Item Responses and Response Times

The assumption of conditional independence between the responses and the response times (RTs) for a given person is common in RT modeling. However, when the speed of a test taker is not constant, this assumption will be violated. In this article we propose a conditional joint model for item responses and RTs, which incorporates a covariance structure to explain the local dependency between speed and accuracy. To obtain information about the population of test takers, the new model was embedded in the hierarchical framework proposed by van der Linden ( 2007 ). A fully Bayesian approach using a straightforward Markov chain Monte Carlo (MCMC) sampler was developed to estimate all parameters in the model. The deviance information criterion (DIC) and the Bayes factor (BF) were employed to compare the goodness of fit between the models with two different parameter structures. The Bayesian residual analysis method was also employed to evaluate the fit of the RT model. Based on the simulations, we conclude that (1) the new model noticeably improves the parameter recovery for both the item parameters and the examinees’ latent traits when the assumptions of conditional independence between the item responses and the RTs are relaxed and (2) the proposed MCMC sampler adequately estimates the model parameters. The applicability of our approach is illustrated with an empirical example, and the model fit indices indicated a preference for the new model.     

Scientific communication – on the brink of the next evolution?

Key points

• Publishing is fixated on the format of the scholarly article, and this is stifling innovation.
• Content should be presented in a way that adapts dynamically to the reader's needs.
• A lot of interdisciplinary research is needed to transform reading, writing, and publishing processes.

     

How Will They Understand if We Don’t Teach Them? The Status of Criminal Justice Education on Gay and Lesbian Issues

Inclusion of race and gender in criminal justice education has, to some degree, been prompted as a result of perceived bias by criminal justice system professionals. Utilizing the race and gender experience as a template, interactions between the gay, lesbian, bisexual and transgendered (GLBT) community and the criminal justice system are explored. This study surveyed criminal justice undergraduate degree programs to ascertain course content on gay and lesbian issues. Results indicate that an extremely small number of programs have such a course or alternatively incorporate GLBT issues within existing race and gender courses. Implications for criminal justice education are discussed.