Examining the Exam: A Critical Look at The California Critical Thinking Skills Test

This paper examines the content of The California Critical Thinking Skills Test (1990). This report is not a statistical review. Instead it brings under scrutiny the content of the exam. This content will be of interest to the general reader, because the issues range from logic to ethics to pedagogy, and to questions of evidential and epistemological support. Anyone interested in clear thought and expression will find these issues of significance. Although the exam has a number of strengths and has the clearest instructions of all the presently available Critical Thinking exams, the content of 9 of the exams 34 questions is defective, namely the content of questions 6, 7, 8, 19, 21, 23, 24, 29, and 33. These questions make errors in critical thinking. Hence, no statistical results pertaining to the administration of these questions to students can be acceptable. The remaining questions are acceptable as to content. But until the problems are corrected, those who may use the exam should remove the defective questions from test administration or from data collection and reporting.The scope of the exam also is quite limited, but this may be unavoidable for any instrument designed to be completed in about an hour. Further, the scores resulting from any such testing can be understood only as a measure of minimal competency (below which remediation likely is needed) for the skills tested, but not as an adequate measure of critical thinking.Disclosure: Three of the authors are engaged in producing and marketing a critical thinking test. Though this paper was written before any of us considered developing such a test, the reader should be informed. Each of the writers has exercised considerable care to avoid any bias, and we thank our independent reviewers for helping us in this regard as well.     

Changing balances in Dutch higher education

Like many other higher education systems in the Western world, Dutch higher education underwent profound changes during the last decade. In this article we will present an overview of these changes, and try to formulate an analytical framework that might be suited to analyze this process. In order to set the stage, we will begin with an overview of the Dutch higher education system, in which the broad structure is described, and some trends are presented. Next, an overview is given of the retrenchment and restructuring operations with which Dutch higher education was confronted during the last decade. Drawing, mainly, on public administration and political theory, we then attempt to formulate a framework for analysis. In this we focus on the Dutch higher education system as a policy network, and address the relationships that exist between the various key actors in the network: between government and higher education, among higher education institutions themselves, and among the different actors within the institutions, especially administrators and academics. In doing so, we hope to demonstrate that at all these levels some identical basic processes operate which to a large extent determine the outcomes of governmental policies aimed at changing the higher education system. Time and again the modern state stumbles over the academic system (Clark 1983: 137)     

Impact of accreditation on improvement of operational inputs after two cycles of assessments in some Ghanaian universities

The study assesses the influence of accreditation, after two cycles of evaluation on some selected Ghanaian universities. This was done by examining the changes that had occurred in specified indicators, mainly because of the implementation of suggestions for improvement made by the previous cycle’s evaluators. The study employed quantitative research methods in analysing the changes (for better or for worse) that had occurred in the selected indicators from one cycle of assessments to the other and as observed in the reports of the evaluators. The results showed varying degrees of improvements in the selected indicators at the subsequent assessments over the previous ones.     

The Effects of Financial Aid on College Success of Two-Year Beginning Nontraditional Students

This study aims to understand the role of financial aid in college success of two-year beginning nontraditional students. By applying discrete time event history models with propensity score covariate adjustment to a nationally representative sample from BPS: 04/09, this study answers research questions centering around the effects of Pell Grants, subsidized student loans and unsubsidized student loans on six-year college outcomes of nontraditional students (i.e. degree attainment, system departure, and continuous enrollment without a degree). The results of this study suggest that these nontraditional students were most likely to drop out in the third college year and that all three types of financial aid appeared effective for reducing dropout risks, but not for encouraging timely degree completion. These findings have significant implications for policy and practice including the necessity for considering the complexity of nontraditional student pathways, backgrounds and unique needs when designing and implementing financial aid policy. The findings also contribute to discussions on ways to fund nontraditional students and provide recommendations for institutions serving large populations of nontraditional students to promote persistence to graduation.     

Computer science <Emphasis>(CS)</Emphasis> in the compulsory education curriculum<Emphasis>:</Emphasis> Implications for future research

The subject of computer science (CS) and computer science education (CSE) has relatively recently arisen as a subject for inclusion within the compulsory school curriculum. Up to this present time, a major focus of technologies in the school curriculum has in many countries been on applications of existing technologies into subject practice (both software such as office applications, and hardware such as robots and sensors). Through uses of these applications, information and communications technologies (ICT) have focused on activities to support subject and topic learning (across wide age and subject ranges). Very recently, discussions for including computers in the curriculum have shifted to a much greater focus on computing and CS, more concerned with uses of and development of programming, together with fundamental principles of problem-solving and creativity. This paper takes a policy analysis approach; it considers evidence of current implementation of CSE in school curricula, the six main arguments for wider-scale introduction of the subject, the implications for researchers, schools, teachers and learners, the state of current discussions in a range of countries, and evidence of outcomes of CSE in compulsory curricula. The paper concludes by raising key questions for the future from a policy analysis perspective.     

Conceptualizing and Measuring the Optimal Experience of the eLearning Environment*

Online learning (eLearning) has become a global phenomenon as many organizations and educational institutions worldwide have entered the field in an attempt to enhance the students' experience of learning. While numerous studies have focused on the effectiveness and benefits of eLearning, few have focused on understanding and measuring the user experience and relating this to the actual student usage of the eLearning system. This study addresses this gap by conceptualizing and measuring the eLearners' experience from two integrated perspectives: (1) the learners' affective perceptions using the flow model and (2) the learners' technology acceptance using the Technology Acceptance Model. The integrated perspective proposes that the users' acceptance and the affective responses toward a particular system are two important factors in determining the users' intentional and actual behaviors, which in turn, influence user participation and engagement with the system. The data was collected in 2004 directly from 964 students using a Web‐based eLearning system called CECIL ( http://www.cecil.edu ) at the University of Auckland. The conclusions drawn from the results of the study using a structural equation model support the use of the integrated model for investigating eLearner behavior. The research implications of our findings are discussed.     

University teacher preparation programmes as a quality enhancement mechanism: evaluating impact beyond individual teachers’ practice

Conceptually, practically and rhetorically teaching is at the core of quality in higher education. University teaching preparation programmes (TPPs) are regularly advocated to foster enhancement of teaching but there remains limited evidence to demonstrate their effectiveness or impact as a quality improvement mechanism. Support for such programmes is largely a matter of faith amongst their advocates. This paper presents an analysis of the impact of one initial TPP to add to the body of evidence on the efficacy of such programmes. The results reinforce other research indicating that such programmes do have beneficial effects on individual academics. The benefits extend to work groups and have value to the institution. However, the transfer of learning by academics to practice takes time and is mediated by many factors. Nevertheless, where institutional and local departmental cultures value teaching, TPPs provide a useful strategy for quality enhancement in higher education.