Harnessing technology to improve formative assessment of student conceptions in STEM: forging a national network

Concept inventories, consisting of multiple-choice questions designed around common student misconceptions, are designed to reveal student thinking. However, students often have complex, heterogeneous ideas about scientific concepts. Constructed-response assessments, in which students must create their own answer, may better reveal students' thinking, but are time- and resource-intensive to evaluate. This report describes the initial meeting of a National Science Foundation-funded cross-institutional collaboration of interdisciplinary science, technology, engineering, and mathematics (STEM) education researchers interested in exploring the use of automated text analysis to evaluate constructed-response assessments. Participants at the meeting shared existing work on lexical analysis and concept inventories, participated in technology demonstrations and workshops, and discussed research goals. We are seeking interested collaborators to join our research community.     

The National Advisory Body Planning Exercise 1987–88: A Shot in the Foot

The National Advisory Body was established to advise the Secretary of State for Education and Science on the allocation of money to support advanced work in polytechnics and colleges. The committee system of NAB was representative of local authority and college interests and there was always a tension between NAB and the Department of Education and Science. The paper charts the decisions that were taken by NAB in progressing the 1987–88 planning exercise. The policy context of these decisions is analysed and the political consequences are discussed. The paper argues that the 1987–88 exercise was the wrong approach to the planning problems and that the resulting conflict with the Government destroyed the credibility of NAB.     

Development of the Nine-Ball Skills Test to discriminate elite and high-level amateur golfers

Currently, there is a lack of appropriate skill assessments available for use in golf. The aim of this study was to examine the discriminative validity and the test-retest reliability of the newly developed "Nine-Ball Skills Test". Participants of two ability levels (elite, n = 14; high-level amateur, n = 16) each hit nine golf shots of differing combinations of trajectory (straight, fade, draw) and height (normal, high, low) at an individually determined target area. Each shot was scored on its percent error index from the target and whether it achieved the maximum height as required. Participants completed the test twice using a 5-iron club. The elite group scored significantly higher (P < 0.05) than the amateur group for both the first and second rounds of the test as well as the combined scores. The between-round test-retest reliability was deemed to be not acceptable, thus we propose that the test's protocol should include use of the two rounds as standard. Due to the importance of ball striking and flight control to performance in golf, the Nine-Ball Skills Test is appropriate for providing a measure of this skill component in elite and high-level amateur golfers.     

Complexity and Curriculum: A process approach to curriculum-making

It is argued that the complex learning with which higher education institutions are concerned is best promoted by coherent curricula. However, curriculum coherence is not widespread. Outcomes-led rational curriculum planning offers one way of creating coherent curricula, but it is argued that, despite its appeal, it is a poor approach to adopt. An alternative, process model of curriculum creation is described and claims are made about the advantages it can have as an approach to planning coherent learning programmes.     

Teacher Verbal Feedback Directed Towards Secondary Pupils with Challenging Behaviour and its Relationship to their Behaviour

There is a body of evidence that has linked teachers’ verbal feedback to pupils with pupil behaviour. In this study teacher verbal behaviour that was directed towards those pupils that the teachers had nominated as being especially difficult to teach was examined. A series of lessons was observed in a secondary school. The quality and quantity of teacher verbal feedback directed to the class as a whole and to the designated pupils was recorded, as was the on‐task behaviour of the pupils. It was found that the designated pupils were less on‐task than their peers and were more likely to ‘shout‐out’ in lessons. However, they were found to behave appropriately in well run lessons, where on‐task rates were high for all pupils. Teachers tended to give more attention to the designated pupils in the form of positive feedback directed towards their work, but also negative attention directed towards their behaviour. A positive relationship was found between teachers’ use of positive feedback and on‐task rates of the designated pupils. The results are discussed both in terms of the strategies used by teachers but also the effect that labelling of the pupils might have on the behaviour of the teachers and the pupils themselves.     

The effects of contingency avoidance on programmed student achievement

If it is assumed that student failure in the classroom situation is the result of inadequate performance skills rather than a lack of ability, then the attention of the educator should more properly be directed at teaching the student to develop effective methods of studying. The present experiment employed a Programmed Student Achievement (PA) procedure which required that the student evidence 100% mastery of discrete units of material. Two PA contingencies which differed in the intensity of the consequence of failing to evidence mastery were used, testing the hypothesis that the PA effect is analogous to avoidance conditioning. In addition, generalization of the effect of PA on performance in courses taken concurrently was evaluated. The performance of PA students was found to be significantly superior to that of control students on both weekly quizzes and major exams; however, performance under the two experimental contingencies did not differ. Additionally, the PA effect did not generalize to performance in other courses. The implication of these data for an avoidance hypothesis account of the PA effect is discussed.