An administrative mess: A case study from the officiating community

This case is written for instructors of classes focused on strategic management, organisational behaviour, human resource management, and/or an officiating course. The case highlights the numerous administrative processes a new employee in a sport organisation would face. Although the case is fictional it is based on the authors’ personal and professional experiences in athletics administration and officiating, and further draws upon the authors’ research in the area of officiating. Consequently, this case study was constructed based on first-hand observation, interviews and conversation with numerous officials and administrators, and through the examination of documents frequently used to manage officials. As a result, the case provides an opportunity for students to critically evaluate and address: (1) a sport organisation's policies and procedures; (2) issues related to human resource management within a sport setting; (3) the managerial response after an organisational failure.     

Conceptions of quality in four different disciplines

Abstract

The paper is based on a book (written by the author and his colleague Markku Lehikoinen) dealing with definitions of quality and views on the applicability of different methods of quality assessment to four different disciplinary fields: physics, biology, sociology and history. The paper focuses on conceptions and definitions of quality voiced by scholars representing the different disciplines. The study involved semi‐structured in depth interviews with 33 experienced scholars. The disciplines under study were chosen to represent diverse disciplinary cultures, with the aim of finding out about the potential impact of (social and cognitive) cultural characteristics of the disciplines on conceptions of quality. The findings show both common views across disciplinary fields and disciplinary differences.     

Metacognitive activities in text-studying and problem-solving: Development of a taxonomy

This article describes the construction of a hierarchical taxonomy of metacognitive activities for the interpretation of thinking-aloud protocols of students in secondary education, who studied texts on history and physics. After testing an initial elaborate taxonomy on a restricted number of protocols by multiple raters, it appeared that the interrater correspondence was well below par. The categories in the taxonomy were too highly specified. Categories were combined and tested on new protocols in a cyclic fashion. The revised taxonomy was then used for coding 16 history protocols and 16 physics protocols. Frequencies of occurrence of metacognitive activities were obtained, as well as judgements of the quality of the metacognitive activities of the participants. There is a reasonable correlation between the frequency method and the quality method for coding thinking-aloud protocols. Also, there is a substantial covariation of the number of metacognitive activities across both tasks.     

Graphical Analysis of Test Items

Graphical Item Analysis (GIA) visually displays the relationship between the total score on a test and the response proportions of the correct and false alternatives of a multiple-choice item. The GIA method provides essential and easily interpretable information about item characteristics (difficulty, discrimination and guessing rate). Low quality items are easily detected with the GIA method because they show response proportions on the correct alternative which decrease with an increase of the total score, or display response proportions of one or more false alternatives which do not decrease with an increase of the total score. The GIA method has two main applications. Firstly, it can be used by researchers in the process of identifying items that need to be excluded from further analysis. Secondly, it can be used by test constructors in the process of improving the quality of the item bank. GIA enables a better understanding of test theory and test construction, especially for those without a background in psychometrics. In this sense, the GIA method might contribute to reducing the gap between the world of psychometrists and the practical world of constructors of achievement tests.