The Development of Process Indicators to Estimate Student Gains Associated with Good Practices in Undergraduate Education

The purpose of this paper is twofold. First, the development of psychometrically sound process indicators of student performance is described. Second, the results are reported of a test of the utility of these indicators with six samples of men and women students (n = 911 in each group) from 19 baccalaureate, 27 master's, and 29 doctoral-granting institutions. Process indicators represent behaviors associated with desired outcomes of college and estimate the extent to which students are engaged in these activities. Selected items from the College Student Experiences Questionnaire were used to create measures of three good educational practices: faculty-student contact, cooperation among students, and active learning. Active learning and cooperation among students in that order were the best predictors of gains for both women and men at all three types of institutions. Student background characteristics had only trivial influences on educational gains. Implications are discussed for institutional policy and further research.     

For whom does “what works” work? The political economy of evidence-based education

ABSTRACT

What role does scientific evidence play in educational practice? Supporters of evidence-based education (EBE) see it as a powerful way of improving the quality of public services which is readily applicable to the education sector. Academic scholarship, however, points out important limits to this applicability. I offer an account inspired by Tullock’s theory of bureaucracy that helps explain EBE’s influence despite these limits. Recent configurations of EBE are an imperfect solution to 2 imperatives where policymakers are at an informational disadvantage: (a) guiding professionals working in the field and (b) evaluating evidence from academic researchers. EBE, especially in the form of RCTs and systematic reviews, offers a way of filtering a complex range of research to produce a determinate result that is transparent to policymakers. However, this impression of research transparency is misleading as it omits theoretical background that is critical for successfully interpreting the results of particular interventions. This comes at a cost of relevance to the frontline professionals whom this research evidence is supposed to inform and help.     

Problematising the ‘Career Academic’ in UK construction and engineering education: does the system want what the system gets?

‘Career Academics’ are principally research-led, entering academia with limited or no industrial or practical experience. UK Higher Education Institutions welcome them for their potential to attain research grant funding and publish world-leading journal papers, ultimately enhancing institutional reputation. This polemical paper problematises the Career Academic around three areas: their institutional appeal; their impact on the student experience, team dynamics and broader academic functions; and current strategic policy to employ them. We also argue that recent UK Government teaching-focused initiatives will not address needs to employ practical academics, or ‘Pracademics’ in predominantly vocational Construction and Engineering Education. We generate questions for policy-makers, institutions and those implementing strategy. We argue that research is key, but partial rebalancing will achieve a diverse academic skill base to achieve contextualised construction and engineering education. In wider European contexts, the paper resonates with issues of academic ‘drift’ and provides reflection for others on the UK context.     

The influence of occupational socialisation upon the teaching of pupils experiencing social and emotional behavioural difficulties (SEBD) in physical education

Research within physical education (PE) utilising the occupational socialisation framework indicates that the childhood phase of socialisation is the most powerful phase of socialisation. However, for most teachers working with pupils experiencing special educational needs (SEN), the childhood phase often lacks direct experience of SEN and thus ceases to exist as a socialising force. Consequently, the higher education and workplace phases form a ‘salvaged’ phase upon which to base pedagogical approaches (Pugach). In light of this dichotomy, the aims of this case study were to (1) examine how one PE head of department (HOD) in a specialist social and emotional behavioural difficulties (SEBD) school taught year 9 pupils games; (2) identify factors that led to such instruction and (3) consider the influence of the three phases of occupational socialisation on her pedagogical approaches. Data collection methods consisted of formal and informal interviews and lesson observations. The data were inductively analysed, and themes were drawn from this process. Using a systematic learning approach, lessons were game orientated based around pupil decision‐making and limited technical practice. Factors influencing this practice were her exploratory outdoor activity experiences and the nature of the pupils. In contrast to Pugach, this research indicates that the childhood phase of socialisation can provide an ‘apprenticeship of observation’ for those teaching PE to pupils experiencing SEBD. That such perceptions can be strongly held suggests that prior examination of the childhood biographies of those recruited to PE teacher training and/or PE teachers teaching pupils who experience SEBD appears warranted.     

The Effect of Guidance in Problem-Based Learning of Statistics

Contrary to classical problem-based learning, in guided problem-based learning, the learning goals are predetermined by the instructor—on the basis of a detailed decomposition of the subject matter to be studied—to activate prior knowledge and to structure self-study and subsequent group discussion. This study investigated the effects of classical problem-based learning and guided problem-based learning, for different prior knowledge levels, on perceived value and usefulness of the learning activity and on conceptual understanding of statistics. Participants randomly assigned 110 students to 10 problem-based learning groups, and subsequently, the 10 groups were allocated randomly to classical problem-based learning or guided problem-based learning. The results indicate that guided problem-based learning tends to enhance conceptual understanding of statistics more thanbreak; classical problem-based learning once students have some prior knowledge of the subject. Furthermore, guided problem-based learning tends to increase students’ awareness of the value and usefulness of the learning activity.     

Online problem-based and enquiry-based learning in the training of educational psychologists

Over the past 40 years, problem-based learning (PBL) and enquiry-based learning (EBL) approaches have been used in a variety of professional training courses. More recently online versions of these pedagogies have been developed. This paper explains how online PBL and EBL activities have been incorporated into the professional training of educational psychologists, at the University of Birmingham, UK. Three examples of such activities are presented, together with data gathered during implementation which has helped to evaluate this work. There is a discussion of some of the emerging themes that have been generated and implications for the future use of online PBL/EBL in the training and continuing professional development of educational psychologists.     

Equality and Education: Fact and Fiction

This paper reports on a series of statistical analyses carried out on some of the National Curriculum tests in mathematics for 11-year-olds in England. In England all 7-, 11- and 14-year-olds are tested in English, mathematics and science (11- and 14-year-olds only). The tests for 11-year-olds are very high stakes, in that the results are published in a school-by-school basis in newspapers etc. The analyses were prompted by the suggestion (from governmental organisations) that the balance of the curriculum content in the mathematics tests should be changed to accommodate better the require ments of the government-initiated National Numeracy Strategy. The analyses were carried out on two datasets, involving nationally representative samples of 11-year-old pupils. The analyses reveal some interesting patterns of change in the overall outcomes when Handling Data questions were statistically replaced by Number items of various kinds and also some interesting changes at the individual level, which could potentially affect the Level outcomes of a significant number of children nationally. However, the final conclusion reached is that, given an appropriately sized and structured pool of items across the curriculum content areas, tests can be constructed which are of an appropriate level of difficulty and discrimination power and which still allow year-on-year calibration of the national standards in mathematics.