The Impact of Multidirectional Item Parameter Drift on IRT Scaling Coefficients and Proficiency Estimates

Item parameter drift (IPD) occurs when item parameter values change from their original value over time. IPD may pose a serious threat to the fairness and validity of test score interpretations, especially when the goal of the assessment is to measure growth or improvement. In this study, we examined the effect of multidirectional IPD (i.e., some items become harder while other items become easier) on the linking procedure and rescaled proficiency estimates. The impact of different combinations of linking items with various multidirectional IPD on the test equating procedure was investigated for three scaling methods (mean-mean, mean-sigma, and TCC method) via a series of simulation studies. It was observed that multidirectional IPD had a substantive effect on examinees' scores and achievement level classifications under some of the studied conditions. Choice of linking method had a direct effect on the results, as did the pattern of IPD.     

Evaluating Assistive Technology in Early Childhood Education: The Use of a Concurrent Time Series Probe Approach

As assistive technology applications are increasingly implemented in early childhood settings for children who are at risk or who have disabilities, it is critical that teachers utilize observational approaches to determine whether targeted assistive technology-supported interventions make a difference in children’s learning. One structured strategy that employs observations and which has powerful child progress monitoring implications is the concurrent time series probe approach. Requiring multiple performance measures of a child engaged in a targeted task over time—both with and without a specific assistive technology device—the concurrent time series probe approach can be used to evaluate the effectiveness of assistive technology tools in supporting skill acquisition in the classroom. This approach is described in the context of a case study, with accompanying explanations of how to interpret data and make decisions regarding the effectiveness of the technology.     

Prior degree and student assessment performance: how can evidence guide decisions on assessment policy?

This study aimed to provide evidence to guide decisions on the type and timing of assessments in a graduate medical programme, by identifying whether students from particular degree backgrounds face greater difficulty in satisfying the current assessment requirements. We examined the performance rank of students in three types of assessments and also calculated the relative risk of failure in the summative assessments for four cohorts over all four years of a four‐year graduate medical programme. Our findings suggest that early summative assessment may disadvantage the very students who create the diversity that the faculty values, particularly if methods such as Single Best Answer questions are used, unless students are provided with additional support in bridging their knowledge gap. Use of assessment methods such as Modified Essay Questions and Objective Structured Clinical Examinations appears to be more justifiable on educational grounds.     

Creating research culture in Caribbean universities

Recent expansion of tertiary education in the Caribbean via the creation of two new universities invites reflection on what impedes the creation of research culture, and what enables it. We contend that research culture in the Caribbean comes up against the strictures of post-colonial dependence, university education in the region being largely a one-way traffic of ideas from metropolitan centers to island peripheries. To offset this, we call for change both in the external environments in which the universities are set, and their internal environments, within which the ethos of inquiry must become commonplace. Demand for research knowledge has to be cultivated throughout the Caribbean. Accordingly, we call for collaborative approaches between university communities and the various publics they serve, to find and solve problems that can lead to the improvement of well being.     

Book reviews

Clinical sports medicine, Robert C. Cantu, (ed.), The Collamore Press, Lexington, Massachusetts, Toronto, 1984. 219 pp, £19.95 (hb), ISBN 0 669 06842 X

Sports injuries, a self‐help guide, Vivian Grisogono, John Murray Ltd, London, 1984. 293 pp, £7.95 (hb), ISBN 0 7195 4111 5

Athletes’ guide to mental training, Robert N. Nideffer, Human Kinetics, Champaign, Illinois (distributed in the UK by Eddington Hook & Co.) 1985. vii +156 pp, $9.95 (pb), ISBN 0 931250 96 X

Scientific foundations of coaching, R.R. Pate, B. McClenaghan and R. Rotella, Saunders College Publishing, Philadelphia, 1984. xii + 344 pp, £21.95(hb), ISBN 0 03 057961 9

Mathematics in sport, M. Stewart Townend, Ellis Horwood, Chichester, 1984. 202 pp (hb), ISBN 0 85312 717 4

Frontiers of exercise biology, ’Big Ten Body of Knowledge’ symposium series, Vol. 13 K.T. Borer, D.W. Edington and T.P. White (eds), Human Kinetics Publishers Inc., Champaign, Illinois, (distributed in the UK by Edington Hook & Co.), 1983. vii + 295 pp, $31.95(hb), ISBN 0 931250 49 8

The knee, Philippe Segal and Marcel Jacob, Wolfe Medical Publications, Frome, Somerset, 1984. 143 pp (hb), £15, ISBN 2 224 00887 2

Psychological foundations of sport, J.M. Silva and R.S. Weinberg (eds), Human Kinetics, Champaign, Illinois, (distributed in the UK by Eddington Hook & Co), 1984. xxiv + 528 pp, £22.50 (hb), ISBN 0 93 1250 59 5

Physical activity and the social sciences, W. Neil Widmeyer, Mouvement Publications Inc., Ithaca, 1983. 472 pp, £9.00 (pb), ISBN 0 932392 13 X     

Reliability and validity of field-based measures of leg stiffness and reactive strength index in youths

Abstract

The aim of the study was to assess the reliability of a mobile contact mat in measuring a range of stretch–shortening cycle parameters in young adolescents. Additionally, vertical leg stiffness using contact mat data was validated against a criterion method using force–time data. The reliability study involved 18 youths completing a habituation and three separate test sessions, while 20 youths completed a single test session for the validity study. Participants completed three trials of a squat jump, countermovement jump, and maximal hopping test and a single trial of repeated sub-maximal hopping at 2.0 Hz and 2.5 Hz. All tests were performed on the contact mat. Reliability statistics included repeated-measures analysis of variance, intraclass correlation coefficient, and coefficient of variation (CV), while the correlation coefficient (r) and typical error of estimate (TEE) were reported for the validity study. Squat jump height was the most reliable measure (CV = 8.64%), while leg stiffness during sub-maximal hopping, and reactive strength index produced moderate reliability (CV = 10.17–13.93% and 13.98% respectively). Measures of leg stiffness obtained from contact mat data during sub-maximal hopping were in agreement with the criterion measure (r = 0.92–0.95; TEE = 6.5–7.5%), but not during maximal hopping (r = 0.59; TEE = 41.9%). The contact mat was deemed a valid tool for measuring stretch–shortening cycle ability in sub-maximal but not maximal hopping. Although reliability of performance was generally moderate, the tests offer a replicable assessment method for use with paediatric populations.     

Response Timing Accuracy of Long-Distance Movements

Abstract

The purpose of the study was to compare the effectiveness of the Red Cross and Silvia methods of teaching beginning swimming. College women (N = 76), who were beginners in swimming, served as subjects. Pretests indicated no differences among the four classes prior to instruction. Reliability coefficients of the post-tests for distance and survival time (test-retest method) ranged from .70 to .98. ANOVA procedures utilizing front crawl distance, back crawl distance, survival time, and length of time required to pass the Red Cross combined tests as dependent variables resulted in superiority of the Silvia method over the Red Cross method in each analysis.     

What spurs curriculum making in physical education? Four narratives of experienced teachers

Anchored in the narrative inquiry tradition, this paper examines commonly held motives about curriculum making from the perspectives of four experienced physical education teachers in Korea. Field texts were collected throughout by employing narrative research tools such as in-depth interviews, focus groups, class observations and documents analyses, and transformed into research texts using broadening, burrowing, and storying and restorying as suggested by Connelly and Clandinin. For experienced physical educators, this paper illuminates what motivates curriculum making as a narrative phenomenon storied and restoried over time. Different stories produced different motives of curriculum making, and a number of issues related to teacher development for curriculum making emerged.     

Departmental morale as a function of the perceived performance of department heads

The object of this paper is to analyze some of the factors underlying differing levels of morale in university departments. Morale is conceived to be primarily a product of perceived department-head performance, although it is also suggested that environmental and satisfaction variables may be important. Morale is seen as a potential symptomatic attribute which might be used in diagnosing organizational difficulties. The authors did indeed find, using multiple discriminant analysis on departmentally aggregated data, that the perceived performance of department heads was more important in predicting levels of morale. In addition, department size was also found to be useful. The conclusions drawn were that morale could be used as a symptom of departmental (or organizational) well being and that such data could be useful to those managing department heads both in the selection of department heads and in their ongoing supervision.The authors were designated by Western Kentucky University to supervise the collection and analysis of the data described. The data were used with the permission of the Office of the President, Western Kentucky University.