Observing response processes with eye tracking in international large-scale assessments: evidence from the OECD PIAAC assessment

This paper reports on a pilot study that used eye tracking techniques to make detailed observations of item response processes in the OECD Programme for the International Assessment of Adult Competencies (PIAAC). The lab-based study also recorded physiological responses using measures of pupil diameter and electrodermal activity. The study tested 14 adult respondents as they individually completed the PIAAC computer-based assessment. The eye tracking observations help to fill an ‘explanatory gap’ by providing data on variation in item response processes that are not captured by other sources of process data such as think aloud protocols or computer-generated log files. The data on fixations and saccades provided detailed information on test item response strategies, enabling profiling of respondent engagement and response processes associated with successful performance. Much of that activity does not include the use of the keyboard and mouse, and involves ‘off-screen’ use of pen and paper (and calculator) that are not captured by assessment log-files. In conclusion, this paper points toward an important application of eye tracking in large-scale assessments. This includes insights into response processes in new domains such as adaptive problem-solving that aim to identify individuals’ ability to select and combine resources from the digital and physical environment.     

Teacher Competence Frameworks in Europe: policy-as-discourse and policy-as-practice

This article analyses the growing focus on teacher competences in European policy discourse against the backdrop of global convergences in education reforms. It traces key ideas, policy recommendations, peer learning and documents which underscore the relevance of teacher quality for education improvement, as recently stressed in the European Commission Communication and Staff Working Documents Rethinking Education. The intertwining of teacher competence frameworks with other areas of education policy is outlined — key competences in school education, the quality of initial teacher education, and the continuous professional development of teachers — teasing out reasons for their central role. Some insights from research and peer learning then explore key implications in the defining and implementing of teacher competence frameworks in national education systems. A comparative viewpoint further analyses current policy trends about teacher competences across European national contexts, in discourse and practice. In order to do so, a framework of analysis takes into account system features as key variables affecting national policy — roles and responsibilities of stakeholders, governance and education cultures, and the status of the teaching profession. Across the variety of policy practices, the analysis endeavours to trace some emerging patterns and trends, highlighting paradigmatic national examples, with some food for thought.     

How the New Web Generations are Changing Library and Information Services

The new Web generations are influencing the minds and changing the habits of software developers and end users. Users, librarians, and information services professionals can interact more efficiently, creating additional information and content and generating knowledge. This new scenario is also changing the behavior of information providers and users in health sciences libraries. This article reviews the new Web environments and tools that give librarians opportunities to tailor their services better, and gives some examples of the advantages and disadvantages for them and their users. Librarians need to adapt to the new mindset of users, linking new technologies, information, and people.     

Introducing History (and Philosophy) of Science in the Classroom: A Field Research Experience in Italy

For quite some time, many EU and Italian Ministry of Education official documents have warmly suggested the introduction of the history and the philosophy of science in the teaching of science disciplines at school. Accordingly, there is a shared agreement between pedagogists and science historians about the efficacy of this approach towards an understanding of the current curriculum content and the Nature of Science. What is missing, at least in Italy, is a concrete fieldwork in the classroom to show the validity of these declarations. This essay is a report of the experience of introducing history and philosophy of science into junior and senior high school classrooms in Apulia (Italy). The aims of this project are: (a) to build a model of research involving high school teachers and university lecturers in the design and construction of teaching units that use the story of science and epistemology for teaching science and (b) produce evidence that this approach is effective in getting more interest from students in science. We relied on many schools for carrying out the historical-scientific teaching modules. The modules were carried out through the case study approach. In the first phase, the participating teachers were trained by University tutors on the modalities of this particular teaching approach. In the second phase, the teachers carried out the modules in their classes and finally these modules were presented in a conclusive conference. Moreover, we evaluated the efficacy of the intervention through specifically created agreement questionnaires.     

Linking via Pseudo-Equivalent Group Design: Methodological Considerations and an Application to the PISA and PIAAC Assessments

This article presents the pseudo-equivalent group approach and discusses how it can enhance the quality of linking in the presence of nonequivalent groups. The pseudo-equivalent group approach allows to achieve pseudo-equivalence using propensity score reweighting techniques. We use it to perform linking to establish scale concordance between two assessments. The article presents Monte-Carlo simulations and a real data application based on data from the Survey of Adult Skills (PIAAC) and the Programme for International Student Assessment (PISA). Monte-Carlo simulations suggest that the pseudo-equivalent group design is particularly useful whenever there is a large overlap across the two groups with respect to balancing variables and when the correlation between such variables and ability is medium or high. The example based on PISA and PIAAC data indicates that the approach can provide reasonable accurate linking that can be used for group-level comparisons.     

Who Publishes More Books in U.S. English Departments,Men or Women?

The “gender gap” in the U.S. publication of English language and literature scholarly books has not been fully investigated. In order to investigate gender disparity, we collected, aggregated, and analyzed data on 1633 faculty members who authored or edited 4835 scholarly books at the top 50 U.S. English Ph.D. departments. Despite the fact that more women than men have received Ph.D.s in English since 1987, the top 50 departments are predominantly male, and male faculty members publish more books on a per capita basis. However, who publishes more books in these departments varies: (1) with the department that the faculty member is in (with grater parity in the middle 30 departments); and (2) when the faculty member published their first book, with female faculty who published their first book after 1998 publishing as many books on a per person basis as male faculty. This paper also offers recommendations on how marketing strategies can be used to ameliorate the “gender gap” in this academic field.     

Environmental Learning of Social Cues: Evidence From Enhanced Gaze Cueing in Deaf Children

The susceptibility to gaze cueing in deaf children aged 7–14 years old (N = 16) was tested using a nonlinguistic task. Participants performed a peripheral shape-discrimination task, whereas uninformative central gaze cues validly or invalidly cued the location of the target. To assess the role of sign language experience and bilingualism in deaf participants, three groups of age-matched hearing children were recruited: bimodal bilinguals (vocal and sign-language, N = 19), unimodal bilinguals (two vocal languages, N = 17), and monolinguals (N = 14). Although all groups showed a gaze-cueing effect and were faster to respond to validly than invalidly cued targets, this effect was twice as large in deaf participants. This result shows that atypical sensory experience can tune the saliency of a fundamental social cue.     

Effects of Priming Social Goals on Personal Interest in Television News

Research indicates that personal interests drive news consumption, such that individuals neglect news items that are not of obvious personal relevance. This study tested whether an extrinsic social goal might increase personal interest in news through increased acquisition of, and perceived attention to news information, irrespective of pre-existing interest in the given topic. Results showed the prime increased information acquisition, as well as perceived attention to news. The prime also worked directly and indirectly through perceived attention to influence news interest in the predicted direction. Applications of findings for news teases and other promotional messages are considered.     

科学、技艺、技术:中国农业从物质到知识的穿越

中国农业在中国农政管理系统中是治国之本,该系统兼容地方文化多样性,扎根社会网络,对科学、技艺、技术的知识与实践产生了积极作用。在19世纪之前,几乎没有任何西方国家在促进农业生产和传播农业知识方面有所作为,中国却从宋代开始已经全面着手,政府发挥各级官员、文人学士、地主作者、农民和工匠的综合作用,鼓励官民合作,发展先秦以来的儒家伦理政治、伦理社会秩序和伦理道德民俗,更新了中国农业国家的知识系统与宇宙观。发展这一方向的研究成果,能够增加我们对科学与规律的理解,而它不仅存在于中国,也普遍地存在于人类社会的前现代时期之中。     

Beyond genetics in Mental Rotation Test performance: The power of effort attribution

This study compares the effects on Mental Rotation Test (MRT) performance of instructions that stress the importance of (a) personal effort, and (b) genetically driven ability. A total of 120 high-school students were assigned to three groups, and administered two sub-tests of the MRT. Between the first and second sub-tests, the groups received one of the following instructions: effort (“anyone can succeed in this task by putting in effort”), ability (“performance on the test depends on genetic determinants”), and neutral for control (“this is an important test used in many countries”). We predicted that effort but not ability instructions would affect performance. Results confirmed the prediction and showed that, after controlling for baseline performance, the effort group outperformed the ability and control groups, which did not differ from each other. Discussion focuses on the mechanisms implied in believing ability to be genetically determined or experientially driven.