An Exploratory Analysis of Differential Item Functioning and Its Possible Sources in a Higher Education Admissions Context

We analyzed a pool of items from an admissions test for differential item functioning (DIF) for groups based on age, socioeconomic status, citizenship, or English language status using Mantel-Haenszel and item response theory. DIF items were systematically examined to identify its possible sources by item type, content, and wording. DIF was primarily found in the citizenship group. As suggested by expert reviewers, possible sources of DIF in the direction of U.S. citizens was often in Quantitative Reasoning in items containing figures, charts, tables depicting real-world (as opposed to abstract) contexts. DIF items in the direction of non-U.S. citizens included “mathematical” items containing few words. DIF for the Verbal Reasoning items included geocultural references and proper names that may be differentially familiar for non-U.S. citizens. This study is responsive to foundational changes in the fairness section of the Standards for Educational and Psychological Testing, which now consider additional groups in sensitivity analyses, given the increasing demographic diversity in test-taker populations.     

Social exclusion in EU lifelong learning policies: prevalence and definitions

ABSTRACT

The aim of the article is to analyse the concept of social exclusion in EU lifelong learning policies: how the concept has evolved from the 1990s in terms of meaning, definitions and closely connected concepts, what are the implications of this evolution, and whether there is coherence between the conceptual evolution and lifelong learning policy. Using a qualitative methodology, this article focuses on policy documents that form the European Union’s legal and political framework of reference in the lifelong learning area in the last two and a half decades. A total of 59 documents issued between 1992 and 2017 have been analysed using content analysis. The analysis of the documents has been complemented by 6 semi-structured interviews with EU lifelong learning experts. The results show that the concept is narrowly defined in terms of specific groups at risk of being socially excluded and in terms of employability, thus individualising the problem of exclusion and distracting attention from structural factors.     

Bilingual Education Candidates’ Challenges Meeting the Spanish Language/Bilingual Certification Exam and the Impact on Teacher Shortages in the State of Texas,USA

Recruiting certified bilingual teachers have been difficult since 2010 as new testing policies and exams are implemented. Advanced high levels of writing and speaking language proficiency are required from the bilingual education candidate to perform his or her job. This essay examines the impact of Texas language policy for bilingual education teachers, testing requirements, and passing rates on state certification tests previously explored by Guerrero (1997, 1999, 2000), and discusses the topic of teacher shortages that has been addressed for the past two decades. Suggestions to assist bilingual education candidates to improve their passing rates are provided.     

The educational use of social annotation tools in higher education: A literature review

This paper presents a literature review of empirical research related to the use and effect of online social annotation (SA) tools in higher education settings. SA technology is an emerging educational technology that has not yet been extensively used and examined in education. As such, the research focusing on this technology is still very limited. The literature review has aimed at presenting a comprehensive list of SA empirical studies not limited to a particular research method or study domain. Out of more than 90 articles that were initially found, only 16 studies met the inclusion criteria. Among the included studies were eight experimental or quasi-experimental studies and eight evaluation/survey studies. The SA empirical research has provided some evidence regarding the potential effectiveness of integrating social annotation tools into learning activities. Findings from the gathered literature were synthesized to provide recommendations for using SA technology in educational settings.     

Programme theory,programme documents and state standards in evaluating teacher education

Across the USA as well as worldwide, numerous universities offer teacher preparation programmes and award such degrees. However, there are no consistent valid or reliable indicators for determining the coherence and quality of these programmes. An effective way of starting to evaluate these programmes is by looking at their standards and their documents. The combination of both could be considered the basis on which all major decisions about the programme are based. Using the example of a Midwestern university in the USA, the purpose of this paper is to demonstrate a method of examining the coherence between the various sets of standards that university programmes have to adhere to (e.g. whether the teacher education standards of the university correspond to the standards for the state that the university is in, as well as to the programme documents). This article ends with some suggestions that could lead to a higher level of coherence within such programmes.     

Measuring quality in inclusive preschool classrooms: Development and validation of the Inclusive Classroom Profile (ICP)

The purpose of this study was to develop and validate an observation measure designed to assess classroom quality in inclusive preschool programs, the Inclusive Classroom Profile (ICP). Developing the rating scale entailed systematic fieldwork in inclusive settings and review of the literature on preschool inclusion. Results from the validation study showed that the measure has good inter-rater agreement, is internally consistent, and shows a good factor structure. Correlations with other measures of classroom quality provided initial evidence for construct validity. This paper argues that traditional measures used to assess quality in early childhood classrooms are useful but may not be sufficient in capturing dimensions of quality that pertain particularly to the support for children with disabilities included in preschool programs.     

Investigating Linguistic Sources of Differential Item Functioning Using Expert Think-Aloud Protocols in Science Achievement Tests

Even if national and international assessments are designed to be comparable, subsequent psychometric analyses often reveal differential item functioning (DIF). Central to achieving comparability is to examine the presence of DIF, and if DIF is found, to investigate its sources to ensure differentially functioning items that do not lead to bias. In this study, sources of DIF were examined using think-aloud protocols. The think-aloud protocols of expert reviewers were conducted for comparing the English and French versions of 40 items previously identified as DIF (N?=?20) and non-DIF (N?=?20). Three highly trained and experienced experts in verifying and accepting/rejecting multi-lingual versions of curriculum and testing materials for government purposes participated in this study. Although there is a considerable amount of agreement in the identification of differentially functioning items, experts do not consistently identify and distinguish DIF and non-DIF items. Our analyses of the think-aloud protocols identified particular linguistic, general pedagogical, content-related, and cognitive factors related to sources of DIF. Implications are provided for the process of arriving at the identification of DIF, prior to the actual administration of tests at national and international levels.