Accounting for Rater Effects With the Hierarchical Rater Model Framework When Scoring Simple Structured Constructed Response Tests

Many large‐scale assessments are designed to yield two or more scores for an individual by administering multiple sections measuring different but related skills. Multidimensional tests, or more specifically, simple structured tests, such as these rely on multiple multiple‐choice and/or constructed responses sections of items to generate multiple scores. In the current article, we propose an extension of the hierarchical rater model (HRM) to be applied with simple structured tests with constructed response items. In addition to modeling the appropriate trait structure, the multidimensional HRM (M‐HRM) presented here also accounts for rater severity bias and rater variability or inconsistency. We introduce the model formulation, test parameter recovery with a focus on latent traits, and compare the M‐HRM to other scoring approaches (unidimensional HRMs and a traditional multidimensional item response theory model) using simulated and empirical data. Results show more precise scores under the M‐HRM, with a major improvement in scores when incorporating rater effects versus ignoring them in the traditional multidimensional item response theory model.     

The state and higher education in Colombia

The development of higher education in Colombia is discussed in terms of its recent quantitative expansion and the accompanying qualitative differentiation. Beginning in 1980 with the University Reform of that year, the state sought to give shape to the system by policies intended (i) to improve its organization (ii) to expand it on more democratic lines and (iii) to improve its quality. The authors discuss the developments which marked attempts to implement these aims. Two critical policy areas emerged—the funding of the system and the administration of the public sector part of it. Current debates are analysed and the authors provide pointers to possible future developments including the development of a highly stratified system with little interaction between the top and the bottom.     

Infant Attention and Early Childhood Executive Function

Individual differences in infant attention are theorized to reflect the speed of information processing and are related to later cognitive abilities (i.e., memory, language, and intelligence). This study provides the first systematic longitudinal analysis of infant attention and early childhood executive function (EF; e.g., working memory, inhibitory control, cognitive flexibility). A group of 5‐month‐olds (n = 201) were classified as short or long lookers. At 24, 36, and 48 months of age, children completed age‐appropriate EF tasks. Infant short lookers (i.e., more efficient information processors) exhibited higher EF throughout early childhood as compared to infant long lookers, even after controlling for verbal ability (a potential indicator of intelligence). These findings are discussed in relation to the emergence of executive attention.     

Are teachers’ approaches to teaching responsive to individual student variation? A two-level structural equation modeling

In the framework of teacher’s approaches to teaching, this study investigates the relationship between student-related variables (i.e., study time, class absence, domain knowledge, and homework completion), students’ approaches to learning, and teachers’ approaches to teaching using structural equation modeling (SEM) with two independent data samples. The participants were 61 biology teachers and their corresponding 1,518 high school students (12th grade). The first sample was used to fit the model, and the second sample was used to analyze the consistency of the data derived from the first sample. Using a two-level SEM analysis, we established whether the effects found at the individual level varied significantly at class level. The students’ approaches to learning were related to the teachers’ approaches to teaching as a function of the hypotheses established in the model, although the effect size was smaller than expected. However, approximately 48 % of the variance of the surface approach and 46 % of the deep approach sat at class level. At the individual level, the results of this study suggest that students’ approaches to learning significantly explain their teachers’ approaches to teaching and, thus, constitute important contextual variables. At the class level, the way students learn appears to be closely associated with class-related variables. Our data stresses the importance of promoting educational opportunities (e.g., school-based courses) for teachers to reflect upon the teaching methodologies used in class.     

Could HPS Improve Problem-Solving?

It is generally accepted nowadays that History and Philosophy of Science (HPS) is useful in understanding scientific concepts, theories and even some experiments. Problem-solving strategies are a significant topic, since students’ careers depend on their skill to solve problems. These are the reasons for addressing the question of whether problem solving could be improved by means of HPS. Three typical problems in introductory courses of mechanics—the inclined plane, the simple pendulum and the Atwood machine—are taken as the object of the present study. The solving strategies of these problems in the eighteenth and nineteenth century constitute the historical component of the study. Its philosophical component stems from the foundations of mechanics research literature. The use of HPS leads us to see those problems in a different way. These different ways can be tested, for which experiments are proposed. The traditional solving strategies for the incline and pendulum problems are adequate for some situations but not in general. The recourse to apparent weights in the Atwood machine problem leads us to a new insight and a solving strategy for composed Atwood machines. Educational implications also concern the development of logical thinking by means of the variety of lines of thought provided by HPS.     

Maternal schooling and children’s relative inequalities in developmental outcomes: evidence from the 1947 school leaving age reform in Britain

This paper investigates whether mothers’ participation in post‐compulsory education impacts on children’s relative inequalities across four developmental outcomes. The empirical analysis uses information from children born in 1958 in Britain. Mothers of the 1958 British cohort were affected by the 1947 school leaving age reform, which increased the age of compulsory schooling from 14 to 15 years. We selected the first‐born cohort members whose mothers were born in 1933 and 1934 and whose mothers completed compulsory schooling only. We found that the additional year of maternal schooling was significantly associated with relative improvements in mathematics attainment for their children, but no significant differences for reading or behavioural outcomes. The impact on mathematics was mainly for boys. These results suggest wider dispersion in mathematics attainment between sons whose mothers benefited from the additional year of schooling in 1947 and those whose mothers did not.     

The reform of curricula

The framing of school curricula and syllabi is a basic stage in the complex process of educational development. It may be said to be the clearest and most concrete ‘scholastic’ and ‘didactic’ expression of a task that begins with the taxing problem of defining objectives, continues with the establishment of the structures appropriate to aims and such objectives considered desirable and practicable, and ends with the evaluation of their present efficacity and possibilities for the future.     

Identifying top relevant dates for implicit time sensitive queries

Despite a clear improvement of search and retrieval temporal applications, current search engines are still mostly unaware of the temporal dimension. Indeed, in most cases, systems are limited to offering the user the chance to restrict the search to a particular time period or to simply rely on an explicitly specified time span. If the user is not explicit in his/her search intents (e.g., “philip seymour hoffman”) search engines may likely fail to present an overall historic perspective of the topic. In most such cases, they are limited to retrieving the most recent results. One possible solution to this shortcoming is to understand the different time periods of the query. In this context, most state-of-the-art methodologies consider any occurrence of temporal expressions in web documents and other web data as equally relevant to an implicit time sensitive query. To approach this problem in a more adequate manner, we propose in this paper the detection of relevant temporal expressions to the query. Unlike previous metadata and query log-based approaches, we show how to achieve this goal based on information extracted from document content. However, instead of simply focusing on the detection of the most obvious date we are also interested in retrieving the set of dates that are relevant to the query. Towards this goal, we define a general similarity measure that makes use of co-occurrences of words and years based on corpus statistics and a classification methodology that is able to identify the set of top relevant dates for a given implicit time sensitive query, while filtering out the non-relevant ones. Through extensive experimental evaluation, we mean to demonstrate that our approach offers promising results in the field of temporal information retrieval (T-IR), as demonstrated by the experiments conducted over several baselines on web corpora collections.     

A Bibliometric Analysis of High Impact Research in the Middle East Using Champion Works

Increasing political and financial support for scientific research in the Middle East requires academic and research communities in the region to demonstrate the visibility and impact of their scientific output. However, for countries with smaller scientific communities or lack of detailed information on their scientific production, the use of common metrics of scientific impact (e.g., number of papers, impact factor, h-index, etc.) may fail to reveal their true ability to produce high quality research, and thus guarantee the wanted societal support. In such cases, identifying and highlighting outstanding papers produced by national institutions or scientists may be another way to demonstrate scientific capacity and impact. In this context, this work aims to provide an overview of champion works (papers that have received over 1,000 citations) produced by Middle East countries. This analysis focuses on science, medicine, and technology papers featured in the Science Citation Index Expanded of Web of Science. The authors identified 213 champion works authored by Middle East scientists published since the 1970s. Israel is currently the leading nation in the Middle East in terms of published champion works, but at least one such work was identified for the majority of countries in the region. Middle East champion works were published on a diverse range of subject categories and often featured in the top journals worldwide (e.g., Science, Nature, etc.). The top institutions in the Middle East authoring champion works and their leading collaborating countries worldwide are listed, and the role of international scientific collaborations in achieving these highly cited papers is highlighted.