Using Multidimensional Item Response Theory to Evaluate Educational and Psychological Tests

Many educational and psychological tests are inherently multidimensional, meaning these tests measure two or more dimensions or constructs. The purpose of this module is to illustrate how test practitioners and researchers can apply multidimensional item response theory (MIRT) to understand better what their tests are measuring, how accurately the different composites of ability are being assessed, and how this information can be cycled back into the test development process. Procedures for conducting MIRT analyses–from obtaining evidence that the test is multidimensional, to modeling the test as multidimensional, to illustrating the properties of multidimensional items graphically-are described from both a theoretical and a substantive basis. This module also illustrates these procedures using data from a ninth-grade mathematics achievement test. It concludes with a discussion of future directions in MIRT research.     

Documenting the world’s sociological literature:Sociological abstracts

Since its founding in 1953,Sociological Abstracts has abstracted and indexed the worldwide literature of sociology and the related social sciences. Growth and specialization within the field are reflected in the number of publications screened, the addition of new document types, the range of languages covered, and the increased specificity of indexing and classication.     

Australian PhDs by LIS educators, researchers and practitioners: Depicting diversity and demise

Analyses of more than 73,000 PhD thesis records in a comprehensive database of bibliographic records from all Australian universities from 1948 to 2006 demonstrate that PhDs on LIS-related topics reveal not only diversity of content, but also the diverse nature of the researcher's academic disciplines. This diversity includes researchers from within and outside LIS who bring to LIS–or take away–a variety of methods, approaches, theories and understandings. With 27 of Australia's 39 universities having produced LIS-related PhD graduates, the distribution through the Australian university system is evident and emphasizes the transferability of skills and knowledge which graduates bring to their work. It is possible that the diversity of researcher's disciplines, combined with the dangerously low numbers of LIS graduations, may also threaten the future of LIS research and education in Australia. Based on the findings of this study, the sustainability of LIS research and research training for the next generation in Australia is under threat.     

Assessing students' ability to trace matter in dynamic systems in cell biology

College-level biology courses contain many complex processes that are often taught and learned as detailed narratives. These processes can be better understood by perceiving them as dynamic systems that are governed by common fundamental principles. Conservation of matter is such a principle, and thus tracing matter is an essential step in learning to reason about biological processes. We present here multiple-choice questions that measure students' ability and inclination to trace matter through photosynthesis and cellular respiration. Data associated with each question come from students in a large undergraduate biology course that was undergoing a shift in instructional strategy toward making fundamental principles (such as tracing matter) a central theme. We also present findings from interviews with students in the course. Our data indicate that 1) many students are not using tracing matter as a tool to reason about biological processes, 2) students have particular difficulties tracing matter between systems and have a persistent tendency to interconvert matter and energy, and 3) instructional changes seem to be effective in promoting application of the tracing matter principle. Using these items as diagnostic tools allows instructors to be proactive in addressing students' misconceptions and ineffective reasoning.     

Reconceptualising the curriculum: from commodification to transformation

This article inveighs against the prevalent commodified discourse in Higher Education especially as it impacts on curriculum planning, quality assurance and learner typologies. It expresses a concern that educational research, in offering models drawn, but now divorced from, practice, may contribute to this negative impact. As an example, a polarised model distinguishing features of ‘traditional’ from ‘emerging’ curricula is criticised as contributing to this commodification; as diminishing the status of university teachers, as offering an instrument to reductive quality assurance systems and as militating against the disciplines operating as communities of practice. In contradistinction to this dichotomizing model, but extrapolating from the same article, a ‘both/and’ model outlining elements of process- and discipline community-based ‘transformational curricula’ is offered. It is perhaps impossible to write about the evils of externalised models and reductively abstract discourse without contribut ing to that very effect. The article therefore ends with two voices which are not those of educational researchers.     

Overcoming problems in doctoral writing through the use of visualisations: telling our stories

Doctoral students experience many challenges on the long journey towards completion. Common problems include: synthesising data, working at a conceptual level, clarifying the relationship of the parts of the thesis to the whole, finding a voice and completing a viva successfully. Few authors have addressed the use of visualisations to meet these challenges. This paper focuses on the use of visualisations in doctoral writing. It presents narratives about seven ways that visualisations can help students to make breakthroughs in their writing, namely, as an organiser of the relationships of the parts of the thesis to the whole, a trigger for peer discourse, a vehicle for conceptual work, a metaphor to express key concepts, a trigger for professional development, a visual aid for the viva and as a prompt for freedrawing and freewriting.