HEFCE,QAA, TQA,IA, SARTOR ... and (possibly) Dearing

Abstract

The Science and Engineering Foundation Programme at Loughborough University has been running since October 1991. It has a heterogeneous intake of approximately 100 students. The author is responsible for the physics input to the Programme. This provides 25% of the Programme for almost all the students. The varied educational profile of students entering this course necessitated a radical rethink of course design for the author. She chose to concentrate initially on one aspect of her teaching — that of running tutorials — and used Mackinnon's cycle of reflection to assist in these deliberations. The result was both an improvement in the learning environment for students and a growing awareness on her part of the necessity to persist with the reflective process to ensure continued enhancement of the student learning experience. Reflection was found to be an important technique with wide application both within and outside the educational sphere.     

Taking Human Capital Investment Seriously: Reflections on Educational Reform

This paper presents the 2002 Junior College/Upper Secondary Review in Singapore in the context of the nation-states commitment to human capital investment. It discusses how these changes have led to a radically altered upper secondary educational landscape through the implementation of the Integrated Programme, the establishment of Specialized Schools in Sports, Maths and Science, and the Arts, and the introduction of Privately Funded Schools. These rapid changes have greatly diversified the educational opportunities available to students in this relatively centralized educational system in a short period of time. The concluding thoughts section concludes with implications of such educational change for parents, students and teachers and issues to be considered while they negotiate such educational change.     

Excluding students with disabilities from the culture of achievement: the case of the TIMSS,PIRLS, and PISA

International tests of achievement narrowly measure specific academic subjects, but have larger educational policy implications. These tests come to summarize national education systems and are used in national and international discourse. However, students with disabilities are being entirely excluded from participation in the discourse of achievement. The Trends in International Mathematics and Science Study, Progress in International Reading Literacy Study, and Programme for International Student Assessment all actively exclude students with disabilities from being measured when the testing agencies set up ‘desired target populations’ and report out on testing participation. This exclusionary discourse establishes that students with disabilities do not belong in a culture of achievement and educational evaluation, which has an impact on policies concerning educational equity and maintains the oppression of low expectations. US policy requires that 95% of all students take achievement tests and be given reasonable accommodations. This paper concludes that international achievement tests should follow the same standard.     

THE RELATIONSHIP BETWEEN ICT USE AND SCIENCE KNOWLEDGE FOR CZECH STUDENTS: A SECONDARY ANALYSIS OF PISA 2006

The 2006 Programme for International Student Assessment focussed on students’ scientific competencies, measured their knowledge and provided questionnaires focussed on different aspects of life. One aspect was students’ experience with information and communication technology (ICT). A secondary analysis of variance of the Czech Republic data (N?=?5,932 students) was conducted using the science knowledge test score and ICT familiarity items. The science knowledge items explored different thematic areas, such as evolution, mousepox, genetics and acid rain. The main result was that students who were connected in some way with ICT achieved better scores on the science knowledge test in comparison with students who were not. Furthermore, students whose ICT activity was connected with the educational process achieved a higher score in comparison with students whose ICT activity was not connected with the educational process.     

Who expects to become a teacher? The role of educational accountability policies in international perspective

In this study, I examine between-country differences in students' expectations of becoming teachers. I use data from 365,298 students from 50 countries participating in the Programme for International Student Assessment (PISA) 2015. The results reveal that high-achieving students in countries that implement test-based educational accountability policies are less likely to expect to work as teachers than students in systems that do not use such policies. This suggests that test-based accountability policies may discourage highly skilled candidates from entering the teaching profession and these policies may act as barriers to attracting high-quality teacher candidates.     

How not to reason with PISA data: an ironic investigation

International comparative testing, such as the OECD Programme for International Student Assessment (PISA), has considerable impact on policy-makers, the media and the general public. A central assumption underlying PISA is that global variation in students’ academic performance is attributable to national educational structures and policies. The aim of this article is to demonstrate the problematic nature of this assumption. Rather than critiquing it from the outside, we turn the tools, data and presumptions of the current discourse of international comparisons upon themselves, showing that this assumption is refuted by analysis of immigrant student test scores. Data from the PISA 2009 tests show that Chinese immigrant students in New Zealand and Australia achieve math scores that are more similar to those of students in Shanghai than to their non-immigrant Australian and New Zealand peers. Thus, cultural background appears to be more consequential for the educational attainment of Chinese immigrant students than exposure to the educational systems of Australia or New Zealand. We discuss limitations of our analysis, using them as basis to discuss the shortcomings of PISA more generally.     

How individualised are the Individualised Education Programmes (IEPs): an analysis of the contents and quality of the IEPs goals

The Individualised Education Programme (IEP) is a fundamental document that describes all educational responses to the additional support needs of students, setting up the guideline for their learning and developmental experiences. Specifically, the IEP goals represent the personal destination translated into desirable behaviours and skills that will enable students with additional support needs to meet their educational and functional needs. This paper analysis the quality of the 2497 IEP goals established for 135 Portuguese students with additional support needs and their fit to the students’ level of severity and educational level. The quality of IEP goals was measured using the Revised IFSP/IEP Goals and Objectives Rating Instrument and the content was categorised in reference to the International Classification of Functioning, Disability and Health, version for Children and Youth. Findings showed that goals are generally poorly written, particularly in terms of their measurability and that their quality decreases as students’ progress in education. Results also showed that IEP goals for students with a highly individualised curriculum do not attend to their needs of more functional contents. The results are discussed in terms of their implications for teacher training.     

A new perspective on memorization practices among East Asian students based on PISA 2012

Abstract

This study examined learning strategy use in mathematics among East Asian students in East Asian educational systems. By employing latent class analysis on the Programme for International Student Assessment (PISA) 2012 data, we found four classes of learning strategy types, namely memorization with metacognitive strategies (17.49%), metacognitive strategies with memorization (50.70%), elaboration only (10.33%), and metacognitive strategies with elaboration (16.47%). The results showed that the majority of the students in all seven East Asian educational systems belonged to the ‘metacognitive strategies with memorization’ class, and most students adopted more than one type of learning strategy when learning mathematics. Additionally, students who reported the use of metacognitive strategies along with either memorization or elaboration showed higher mathematics achievement. We conclude that the cognitive processes employed by students of East Asian backgrounds are more complex and nuanced than the previous perception that they relied heavily on memorization.     

Standards-based external exams and students’ science-related career expectations: an international perspective

Students’ science-related career expectations are important for predicting their future science, technology, engineering, and mathematics (STEM)-related educational and occupational attainments. This study examines the degree to which standards-based external examinations are associated with a student’s propensity for pursuing science-related professional occupations. The science-related fields included in the analysis are mathematics, physical and life science, and engineering/computing. Three-level hierarchical generalized linear models are employed to analyse international survey and student achievement data from the Programme for International Student Assessment (PISA). The analyses show that students in national education systems that require standards-based external examinations have lower expectations for science-related professional careers than students in the systems that do not use such examinations. This negative association remained constant by gender as well as across levels of science performance. From an educational policy point of view, the results suggest the negative consequence of standards-based external exams in fostering students’ interests in pursuing science-related careers.     

Students with special educational needs within PISA

Abstract

Since 2003, the Programme for International Student Assessment (PISA) has included students with special educational needs (SEN), identified as those with functional disabilities, those with cognitive/behavioural/emotional disabilities and those with limited test language proficiency. While the number of countries and included students has increased with each test administration, the percentage of students with SEN remains extremely low. The inclusion of these students is not an intentional PISA design parameter but rather a response to the interaction between the need to maintain strict sampling criteria and country-level educational mandates to include SEN students in standardised testing. Based on the analysis of student participation and performance across four cycles of PISA (2003–2012), this paper examines the challenges that exist in current PISA procedures related to: student sampling, eligibility and identification; assessment methodology; and reporting results. PISA practices, their limitations for scientific inferences and recommendations for design improvements are given.     

International education: the transformative potential of experiential learning

Academic outcomes of post-16 education can be understood in terms of their value for gaining access to university and, at a time when global educational mobility is growing, internationally recognised university entrance qualifications may be considered a form of personal capital. However, narrowly measured outcomes may not reflect the breadth of the school experience nor the extent to which this breadth contributes to the development of the young person. One curriculum which aims to prepare students in ways that extend beyond the academic is the International Baccalaureate Diploma Programme, which incorporates an experiential element at its core. Creativity, Activity, Service attaches a transformative purpose to education, where students’ experiences in each of the three strands can support personal learning that is not confined to subject areas of an academic curriculum. This paper describes the evolution of CAS in the academically rigorous Diploma Programme and presents the findings from a review of literature which contribute towards developing an understanding of the transformative potential of this component.     

Self‐assessment and the disadvantaged student: potential for encouraging self‐regulated learning?

The Science Foundation Programme (SFP) at the University of KwaZulu Natal, Pietermaritzburg attempts to address past educational inequalities by providing disadvantaged matriculants with the skills, resources and self‐confidence needed to embark on their tertiary studies. Students entering the Programme typically adopt a surface approach to learning with emphasis being placed on high score achievement which results in a mark‐driven attitude towards assessment. Students also lack the metacognitive skills associated with a deep approach to learning. Within this mark‐driven culture, it is important to attempt to move students away from such a superficial approach to learning and assessment. Worldwide, self‐assessment practice has been gaining recognition, and it has been linked to the adoption of a deep approach to learning; self‐regulated learning and the development of metacognitive skills. In the biology module of the Programme, students are given two essay assignments, tasks that are routinely performed very poorly. In attempt to improve SFP students’ essay writing abilities, a self‐assessment scheme to accompany the essay tasks was instituted, hoping that this would get the students to engage with the assessment criteria. It was intended that students would not only fulfil the requirements of the task better, but also achieve the valuable skill of self‐assessment. The results provide overwhelming evidence that SFP students cannot accurately self‐assess. Their naivety and inexperience in fulfilling assessment criteria was also revealed. Overall, marks awarded by staff were significantly lower than those awarded by students, and there was no evidence to suggest that any one category of students based on academic ability were better able to self‐assess than another. Marker inconsistencies were revealed, but this was shown to have no effect on findings. In spite of these results, a case for pursuing self‐assessment is made and proposals for improving student self‐assessment practice in the SFP are suggested.     

Comparability of educational achievement and learning attitudes across nations

We estimated the invariance of educational achievement (EA) and learning attitudes (LA) measures across nations. A multi-group confirmatory factor analysis was used to estimate the invariance of educational achievement and learning attitudes across 55 nations (Programme for International Student Assessment [PISA] 2006 data, N?=?354,203). The constructs had the same meaning (factor loadings) but different scales (intercepts). Our conclusion is that comparisons of the relationships between educational achievement and learning attitudes across countries need to take into consideration two sources of variability: individual differences of students and group differences of educational systems. The lack of scalar invariance in EA and LA measures means that the relationships between EA and LA may have a different meaning at the level of nations and at the student level within countries. In other words, as PISA measures are not invariant in scalar sense, the comparisons across countries with nationally aggregated scores are not justified.     

Learning motivation from a cross-cultural perspective: a moving target?

This paper investigates the relationship between educational achievement and the motivation to learn. We used the 2006 Programme for International Student Assessment (PISA) that contains representative samples from 55 nations. A strong negative correlation between educational achievement and motivation toward science learning emerged at the national level. We found that differences in the socioeconomic levels of nations are associated with this unexpected negative correlation. Children from developed societies achieve higher educational results but may tend to be rather critical in describing their learning motivation, and vice versa, students from developing countries do not attain very high educational outcomes, but their motivation, as stated on the self-report questionnaires, is high. We offer different explanations for this phenomenon. The motivation to learn in relation to the level of development of countries is a moving target, and this should be taken into account at all levels of education policymaking, from schools to national governments.     

Reading subskill differences between students in Shanghai-China and the US: evidence from PISA 2009

Based on different language systems and educational practices of their respective countries, hypotheses were made regarding how 15-year-old students from Shanghai-China and the US might differ in the 5 reading subskills designated in the Programme for International Student Assessment (PISA) when they have the same overall reading ability (i.e., when their overall reading ability is controlled for). A multilevel analysis was conducted to test the hypotheses using the PISA 2009 reading dataset. When we controlled for students' overall reading ability, individual socioeconomic status (SES), and school mean SES, Shanghai-Chinese students performed significantly better in integrating and interpreting than US students. Further, when we controlled for students' overall reading ability and school mean SES, US students showed significantly higher performance in reading non-continuous texts than Shanghai-Chinese students, whereas US students showed significantly lower performance in reading continuous texts. The results of this study can inform reading instruction and learning in the 2 countries.     

Towards a Language of Possibility: critical reflection and mentorship in initial teacher education

Abstract

This paper examines a programme which aimed at creating alternative school‐based experiences for postgraduate students following a 1‐year higher diploma of education course at the University of Natal in Pietermaritzburg. The programme was premised on the belief that critical reflection is necessary for educational transformation, and that teacher educators increasingly will be expected to raise the quality of teaching in schools. The background to the Mentor Programme is described and the underlying rationale is discussed. Whilst the evidence from the study reflects mentor satisfaction at the quality and range of teaching skills developed by students during the programme, the investigators express disappointment at their lack of success in attaining critical reflection by their students. Students generally did not look critically, as they had been encouraged to do, at the institutional or societal context of their teaching. The discussion identifies three possible reasons for this, but concludes that any approach to teacher education which does not encourage teachers to reflect critically on their own educational views and on the nature of education as it is realised in the institutional setting of schools will be inherently flawed.     

Alleviating or exacerbating disadvantage: does school attended mediate the association between family background and educational attainment?

ABSTRACT

Opportunities for social mobility are generated by education systems designed to alleviate the effects of social origin by providing equality of opportunities and resources. The persistence of the strong association between socioeconomic status (SES) and child’s educational achievement and attainment suggests that social origin continues to play an integral role in the educational outcomes of successive generations of Australians. Sociologists draw on a range of theoretical perspectives to explain this association including Bourdieu’s cultural and social capital theories. Using data collected by the Longitudinal Survey of Australian Youth 2009 (LSAY09) project, I examine the associations between student SES, school SES and two outcome variables: Programme for International Student Assessment (PISA) score and university enrolment. The results indicate that low SES students attending high SES schools perform better on PISA tests than low SES students attending low SES schools. After controlling for PISA score, low SES students were less likely than their high SES peers to enrol at university. Furthermore, students attending low SES schools were less likely than their peers attending high SES schools to enrol at university, net of their individual SES and their PISA scores.     

The unintended and intended academic consequences of educational reforms: the cases of Post-Soviet Estonia,Latvia and Russia

In this paper, we try to unravel some of the unintended and intended academic effects associated with post-Soviet educational reforms by focusing on three cases: Estonia, Latvia and Russia. We have chosen this comparison because a unique ‘natural experiment’ in the three countries allows us to compare the changing academic performance on an international test of a largely similar population in the three countries—Russian origin students attending Russian-medium schools—subjected to three variations of post-Soviet reforms. We find that relative to students in Russia, Russian-medium students in the Baltics made significant gains in the Programme for International Student Assessment (PISA) test. In Latvia, these appear to be an unintended effect of somewhat ‘softened’ state language policies, the conditions surrounding minority rights, and the general context of maintaining social cohesion. In Estonia, the (later) relative gains of Russian students appear to an intended effect of locally grown educational (and language) policies and increased, more effective cooperation with Russian medium schools to further improve PISA performance in a relatively high scoring, PISA-focused country.     

What's in their baggage? The cultural and social capital of Australian students preparing to study abroad

Governments and educational institutions promote study abroad in the belief that it offers valuable learning experiences for all students. Yet studies suggest that equitable access to study abroad is more myth than reality. This study took a narrative approach supported by survey data to explore this issue at one Australian university. The survey indicated that the majority of students are effectively excluded from the university's Student Exchange Programme, and that those included generally have high cultural, social and economic capital. Interviews revealed how multiple dimensions of privilege typically work to make study abroad imaginable, affordable and do-able for some. These findings are complicated by one student's atypical narrative, which serves to raise further questions for research.     

Re/producing the global middle class: International Baccalaureate alumni at ‘world-class’ universities in Hong Kong

ABSTRACT

This research investigated educational pathways into a Global Middle Class characterised by professional or managerial careers and cosmopolitan sensibilities. The focus was International Baccalaureate Diploma Programme (IBDP) alumni with upper-middle-class backgrounds at ‘world-class’ universities in Hong Kong. The first objective was to investigate if and how the education of IBDP alumni at Hong Kong universities shapes self-perceptions of cosmopolitan sensibilities, university experiences, and economic futures. The second objective was to investigate how the IBDP and Hong Kong universities offer an educational pathway for the existing Global Middle Class to reproduce their social position and for local families to enter the Global Middle Class. Interview findings illuminated how cosmopolitan sensibilities meant that the students may be well-positioned for careers and lifestyles of the Global Middle Class. Nevertheless, there were paradoxes of cosmopolitan sensibilities as the students perceived a lack of belonging to their universities and a disconnection with the local society.