Investigating the medium effect in computer-aided assessment of school Chemistry and college Computing national examinations

This article presents results of a comparison between paper and computer tests of ability in Chemistry and Computing. A statistical model is employed to analyse the experimental data from almost 200 candidates. It is shown that there is no medium effect when specific traditional paper examinations in Chemistry and Computing are transferred into electronic format. The effect of rewording for computer‐delivered test questions is also investigated and again the conclusion is that no evidence of a difference could be found. These results were obtained as part of the Project for Assessments in Scotland using Information Technology (PASS‐IT).     

The Impact of a Goal-Setting Intervention for Engineering Students on Academic Probation

Research in Higher Education - Many degree-seeking college students struggle academically and ultimately never graduate. Academic challenges and persistence within the major are especially salient...     

Is it all memory recall? An empirical investigation of intellectual skill requirements in Leaving Certificate examination papers in Ireland

The terminal examination of post-primary education in Ireland, the Leaving Certificate, is often criticised for the reliance on memory recall over higher order thinking skills in the assessment process. In order to examine the evidence base for these critiques, this article presents an empirical investigation of the intellectual skills and knowledge domains implicit in the tasks in the written examination papers of 23 subjects in the Leaving Certificate in Ireland from 2005 to 2010. Data were collected from two sources: examination papers and student interviews. In an in-depth document analysis of the examination papers, 14,910 occurrences of command verbs were coded for the intellectual skill and knowledge domains required by the assessment task. As the same verb can require different intellectual skills in different subjects and in different tasks, each occurrence of every verb was assigned a specific value depending on its context. The article presents the frequencies and distributions of intellectual skills and knowledge domains within and across subjects. In light of key points in the literature search, the findings indicate concern regarding the level of challenge and stimulation for the development of students of the Leaving Certificate.     

Educational research that has an impact: ‘Be realistic,demand the impossible’

This AARE Presidential Address examines what it means to be an educational researcher in the current Australian, and global, political climate. The presentation draws heavily on the work of Levitas (Utopia as Method 2013). The address, using her notions of Utopia as archaeology, as ontology and as architecture, suggests that in the process of promoting a more socially just agenda there is no alternative but to look for alternative ways of doing educational research and being an educational researcher. It concludes by suggesting that associations such as AARE provide opportunities to envisage what academic life could look like for educational researchers in a ‘Realistic Utopia’—one in which they are realistic and demand the impossible.     

Higher Education in a Global Market: The Case of British Overseas Provision in Israel

In recent years there has been a major expansion by higher education institutions in setting up ‘for-profit’, offshore programmes and campuses. It has been claimed that for-profit provision in a free, or unregulated market, responds to student demand and acts as a catalyst for innovation, thus fuelling arguments for a global ‘free market’ in higher education. There are few opportunities to test these claims since higher education is overwhelmingly provided within national systems of education and is generally subject to strong local regulation. Israel, in the 1990s, offered a rare case of an unregulated market in higher education for foreign providers, albeit one which contained significant distortions: British institutions took the leading part in developments. This article examines that experience in the light of documentation in the public domain and of practitioner research and argues, contrary to unsubstantiated claims, that provision fell below acceptable standards. The article concludes that, in this field, consumer demand did not operate on the basis of quality and that the market-place cannot assure standards of higher education in overseas provision. Furthermore, until international standards are agreed, governments have a responsibility to regulate provision which directly affects the lives of their citizens.     

Time pressure in scenario-based online construction safety quizzes and its effect on students’ performance

Online quizzes have been shown to be effective learning and assessment approaches. However, if scenario-based online construction safety quizzes do not include time pressure similar to real-world situations, they reflect situations too ideally. The purpose of this paper is to compare engineering students’ performance when carrying out an online construction safety quiz with time pressure versus an online construction safety quiz without time pressure. Two versions of an online construction safety quiz are developed and administered to randomly assigned engineering students based on a quasi-experimental post-test design. The findings contribute to scenario-based learning and assessment of construction safety in four ways. First, the results confirm earlier findings that ‘intrinsic stress’ does not seem to impair students’ performance. Second, students who carry out the online construction safety quiz with time pressure are less likely to ‘learn by trial and error'. Third, students exposed to time pressure appreciate that they become better prepared for real life. Finally, preparing students to work under time pressure is an important industry requirement. The results of this study should encourage engineering educators to explore and implement ways to include time pressure in scenario-based online quizzes and learning.     

What Happens When a Teacher’s Science Belief Structure Is in Disequilibrium? Entangled Nature of Beliefs and Practice

Research in Science Education - This qualitative case study examined the process of change in an experienced elementary teacher’s belief structure during implementation of an inquiry-based...     

Rethinking approaches to research: the importance of considering contextually mitigating factors in promoting equitable practices in science education research

Cultural Studies of Science Education - In this paper, we explore themes that emerged while reading “How does one recognize contextual mitigating factors (CMFs) as a basis to understand and...