Early tracking and different types of inequalities in achievement: difference-in-differences evidence from 20 years of large-scale assessments

Educational Assessment, Evaluation and Accountability - Research to date on the effects of between-school tracking on inequalities in achievement and on performance has been inconclusive. A...     

Studying the expertise reversal of the multimedia signaling effect at a process level: evidence from eye tracking

Instructional Science - The purpose of this study was to shed light on the cognitive processes underlying the expertise reversal effect related to multimedia signaling. Multimedia signals highlight...     

Making sense out of measurement non-invariance: how to explore differences among educational systems in international large-scale assessments

International large-scale assessment in education aims to compare educational achievement across many countries. Differences between countries in language, culture, and education give rise to differential item functioning (DIF). For many decades, DIF has been regarded as a nuisance and a threat to validity. In this paper, we take a different stance and argue that DIF holds essential information about the differences between countries. To uncover this information, we explore the use of multivariate analysis techniques as ways to analyze DIF emphasizing visualization. PISA 2012 data are used for illustration.

     

Prosody in skilled silent reading: evidence from eye movements

Recent eye movement experiments offer preliminary evidence that skilled readers activate word‐level prosodic information when silently reading sentences. This paper reviews the role of eye movements during reading as well as the preliminary evidence for prosodic processing. A new experiment examines whether prosodic processing differs for high and low frequency words. Readers' eye movements were monitored while reading target words presented in sentences preceded by parafoveal previews that either contained the exact initial syllable of the target (i.e. the congruent preview condition) or the initial syllable plus the next letter (i.e. the incongruent preview condition). Reading times on high frequency words did not differ in the congruent and incongruent preview conditions, but reading times on low frequency words were faster in the congruent condition. The implications of the present result and previous studies are discussed in terms of phonological hub theory, which is a production‐based theory of word recognition during skilled silent reading.     

Promoting teaching,learning and informed decision-making through the lenses of international large-scale assessment: looking beyond numbers

Public discussion on the quality of education in different corners of the world very much relies on the data provided by the international large-scale assessment (ILSA) studies. While aware of different methodological keystones and technicalities embedded in these, the idea behind this special issue is to contribute to the understanding of how students solve ILSA items and the kinds of literacy skills they rely on. A shared element of reported studies is that they seek to document and analyse test-taking as a concrete practice using different theoretical and methodological perspectives. We find such scrutiny to be important and significant at this point in time as it offers some new lenses through which ILSA items could be inspected and further discussed.     

Boys do not benefit from male teachers in their reading and mathematics skills: empirical evidence from 21 European Union and OECD countries

The prevalence of women in the teaching profession has been claimed by various scholars to be responsible for the low school performance among boys. Based on this claim there have been widespread calls for increasing the share of male teachers as a means of improving boys' school performance. There is, however, very little empirical evidence supporting the claim that boys do in fact benefit from being taught by male teachers. Drawing on data from the 2007 Trends in International Mathematics and Science Study and the 2006 Progress in International Reading Literacy Study, this paper examines the relationship between teacher gender and boys' and girls' respective school performance in a sample of 146,315 elementary school students from 21 countries. It finds that boys do not benefit from being taught by male teachers, neither in mathematics nor in reading. In some countries, however, girls seem to profit from being taught by female teachers.     

Investigating validity from teachers' perspectives through their engagement in large-scale assessment: The Emergent Literacy Baseline Assessment project

This paper argues for an expanded conception of test validity, in which teachers, as end-users of tests, contribute a distinctive perspective on validity, referred to as inferential validity. It also offers a methodology that could be adopted in order to subject this dimension of validity to scrutiny. An investigation conducted into the meanings constructed by teachers of a literacy test, the Emergent Literacy Baseline Assessment (ELBA), is reported to illustrate the methodology. In the first section of the paper, current conceptions of validity are discussed. It is argued that the validation process for tests should include the clarification and justification of the interpretations and uses of observed scores. This argument is illustrated from the methodology for investigating the validity of the ELBA. Self-assessment questionnaires and focus-group interviews provided data on teachers' views about the validity of the ELBA. Arguments in favour of investigating the validity of large-scale tests by taking into account teachers' perspectives are provided.     

Cost economies in the provision of higher education for international students: Australian evidence

In the past few decades, the additional revenues available via higher education exports (through both relatively higher prices and increased enrolments) have attracted the attention of providers in many developed countries, not least in Anglophone countries like the USA, the UK, Canada and Australia. However, while the revenue case is strong, the institutional cost structures underlying the provision of higher education services for international students remain relatively unknown at the sector level. Accordingly, we offer a comprehensive analysis of the cost economies underlying higher education provision for international students using a sample of 37 Australian public universities over the period from 2003 to 2012. The findings suggest that it is appealing to enrol additional overseas students given their lower average and marginal costs and the significant economies of scale prevailing in higher education generally. Further, while we find evidence of economies of scope for overseas students only in smaller institutions, there is no evidence of diseconomies of scope, implying the current number of overseas students and their joint production with domestic students at the least does not lead to unnecessarily higher overall costs.     

Reading in print versus digital media uses different cognitive strategies: evidence from eye movements during science-text reading

Reading and Writing - Comparing comprehension outcomes in print and digital reading is an active area of research but little is known about the reading processes that these media entail. This study...     

Challenges for schools in communities with internal migration flows: evidence from Turkey

Turkey is a country that has experienced and continues to experience a dramatic degree of both rural-to-urban and inter-regional internal migration. Migrants tend to settle in gecekondu areas in either established inner-city neighborhoods or in newer squatter settlements built on undeveloped land bordering rural areas on the urban periphery. Schools in these areas are invariably impacted by this extensive and unplanned internal migration. This study aimed to examine the challenges facing schools located in migrant communities in Turkey. The findings show that such schools are likely to be resource-poor, overcrowded urban facilities that face challenges related to poor school quality, low academic achievement of students, intercultural issues related to the diverse student population and a lack of parental awareness regarding education and child development. Students were also reported to suffer from malnutrition and a lack of adequate physiological and emotional support. Furthermore, teachers attributed the physiological, psycho-social and academic shortcomings of children mainly to their poor language skills, the low socio-economic status of families and household poverty.     

Promoting the greater involvement of pupils with special needs in the management of their own assessment and learning processes

Richard Rose, General Inspector (Special Educational Needs), Northants Inspection and Advisory Service, Sylvia McNamara, Lecturer in Education, the University of Leicester and John O'Neil, Lecturer in Education Management, Massey University, Palmerstone, New Zealand discuss the initial findings of the QUEST Project.     

Viability of construct validity of the speaking modules of international language examinations (IELTS vs. TOEFL iBT): evidence from Iranian test-takers

The aim of the present research is to examine the viability of the construct validity of the speaking modules of two internationally recognized language proficiency examinations, namely IELTS and TOEFL iBT. High-stake standardized tests play a crucial and decisive role in determining the future academic life of many people. Overall obtained scores of candidates are believed to reflect their general proficiency level. Appropriate interpretation and use of test scores depend on the extent to which items measuring a particular skill (here speaking) can meet the criteria to examine the intended construct. Speaking, amongst the other four skills, has a central place in assessing general proficiency of the candidates. This research seeks to scrutinize how IELTS and TOEFL iBT tap on the speaking proficiency of their candidates. Moreover, this study investigates whether obtained speaking scores of candidates in these two international high-stake tests show an acceptable degree of consistency in measuring the skill being examined. The chosen sample of the study consisted of 60 students who successfully completed TOEFL iBT and IELTS preparation courses in Tehran. The results of the statistical analysis show that there is a meaningful discrepancy between the two exams in assessing the speaking abilities of the exam-takers and therefore challenge the construct validity of the exams in question. Findings are then used to discuss the repercussions for language proficiency measurement and assessment.     

Lexical-semantic reading in a shallow orthography: evidence from a girl with Williams Syndrome

The reading skills of a girl with Williams Syndrome are assessed by a timed word-naming task. To test the efficiency of lexical and nonlexical reading, we considered four marker effects: Lexicality (better reading of words than nonwords), frequency (better reading of high than low frequency words), length (better reading of short than long words), and contextuality (better reading of words with one-to-one grapheme-to-phoneme mapping than words with context-sensitive graphemes). Results suggested that this girl has failed to develop efficient orthography-to-phonology mappings and is dependent upon a lexical-semantic reading procedure in which a word’s pronunciation is activated after its meaning is obtained.     

The role of orthographic analogies in reading for meaning: evidence from readers with dyslexia

The aim of this experiment was to investigate the use of orthographic analogies in conditions that involved making sense of print (picture‐word matching) and pronouncing print (reading aloud) for readers with dyslexia. An adapted version of the classic clue‐word paradigm developed by Goswami was used. Participants were 40 readers with dyslexia and 40 reading‐age‐matched comparison readers. Based on previous theory and research in this area, we predicted that readers with dyslexia would read significantly fewer analogous words than their reading‐age‐matched counterparts. In light of the supposition that word‐picture matching does not require the synthesised pronunciation of a word, we also predicted that readers with dyslexia might be less impaired at analogy use in the picture‐word matching than in the reading aloud condition. However, we found that the dyslexic group read significantly fewer analogous words at post‐test than their reading‐age‐matched peers in both conditions. Also, performance in overall word reading was better for both groups in the word‐picture matching condition. The implications of these results for theory and practice in reading development are discussed, and methodological limitations are noted.     

Context matters in educational research and international development: Learning from the small states experience

The article argues that greater attention should be paid to contextual factors in educational research and international development cooperation. The analysis draws upon principles that underpin socio-cultural approaches to comparative education, a critical analysis of the political economy of contemporary educational research, and recent research experience in small states worldwide.     

Qualitative sampling in research on international student mobility: insights from the field in Germany1

ABSTRACT

Although over the past decades the numbers of studies investigating international student mobility and migration (ISM) increased, methodological challenges in empirical research on the topic have remained mainly unaddressed. This is particularly the case for sampling, which is a crucial but often less considered part of qualitative research designs. In this article, we identify three main challenges in qualitative sampling for research into ISM: time, space and international students’ heterogeneities. In addressing those challenges, we theoretically discuss their implications and give empirical examples drawing on our research experiences. We argue for a more reflexive research procedure in studying educational mobility.     

Examining the evidence from TIMSS: Gender differences in Year 8 science achievement in Australia

Australia's continuing participation in international science studies such as TIMSS provides a useful lens through which to monitor achievement in science over time. Gender differences in science were not evident in the early years of TIMSS but appear to be growing. This article examines gender differences in science achievement in early secondary schooling in Australia using data from the TIMSS 2003 study. The aim is to explore the cultural, social, structural and institutional factors that may differentially influence science achievement, with the aim of identifying which are more important for males and for females.