Moving PISA Results into the Policy Arena: Perspectives on Knowledge Transfer for Future Considerations and Preparations

Evidence-based policies, decisions, and practices are highly valued and underachieved in the international mathematics and science education reforms. Many in the mathematics and science education research communities lament the lack of influence that research results have on the education profession, schools, and teaching. Academic research done in isolation of end-users—with the faint hope that teachers, politicians, and bureaucrats will access and utilise these results to inform curriculum, assessment, and instruction and to influence public policy—has not worked. Some funding agencies require dissemination of research and development results to the broader political and education communities; therefore, applicants agree to these requirements without fully realizing the breadth of these demands. However, to achieve such knowledge transfer requirements, researchers need to become more (a) aware of the needs, players, and processes of ‘speaking truth to power’; (b) active in knowledge transfer and influencing public policy; and (c) alert to values and normative premises of the policy makers. This article outlines the essential principles, barriers within the academic community, international efforts, and future considerations for knowledge transfer regarding international assessments. Specific articles on PISA 2000, 2003, and 2006 included in this special issue are used to illustrate these insights into verification of curricular influences, educational opportunity and equality, regional comparisons, and direct influence on policy.     

FIRST CYCLE OF PISA (2000–2006)—INTERNATIONAL PERSPECTIVES ON SUCCESSES AND CHALLENGES: RESEARCH AND POLICY DIRECTIONS

This special edition of IJMSE focuses on the Programme of International Student Assessment (PISA) project now that it has completed a full cycle of administration—reading, mathematics, and science—to look at ways in which PISA has been used in participating countries and with what consequences, and to identify potential research and policy directions emanating from this initiative. Articles were invited to (a) reflect international perspectives on the uses and consequences of PISA to date and (b) speculate on future directions for research, curriculum, and policy using the PISA datasets. The introductory article provides a brief overview of common aspects of PISA: Evolving definitions of reading literacy, mathematics literacy, and science literacy; technical design of the instruments and data analysis procedures; the changing emphasis of administrations; and recent research using the datasets. PISA, unlike other international assessments in reading, mathematics, and science, has provided a fresh perspective on ‘what might be’ by decoupling the assessment from mandated curricula to focus on literacies needed for a 21st century economy. This unique feature of PISA brings with it possibilities and cautions for policy makers.     

Using National Education Longitudinal Data Sets in School Counseling Research

National longitudinal databases hold much promise for school counseling researchers. Several of the more frequently used data sets, possible professional implications, and strategies for acquiring training in the use of large‐scale national data sets are described. A 6‐step process for conducting research with the data sets is explicated: determining research questions, accessing the data set, understanding the study's sample design, determining an analytic sample, considering pertinent data analysis issues, and understanding the limitations of using the data sets. Suggestions for preparing school counseling researchers and potential themes for future research are outlined.     

An empirical study of using history as a ‘goal’

This article discusses an empirical study on the use of history as a goal. A historical module is designed and implemented in a Danish upper secondary class in order to study the students’ capabilities at engaging in meta-issue discussions and reflections on mathematics and its history. Based on videos of the implementation, students’ hand-in essay assignments, questionnaires, and follow-up interviews, the conditions, sense, and extent to which the students are able to perform such discussions and reflections are analyzed using a described theoretical framework.     

Educating for the real world: an illustration of John Dewey’s principles of continuity and interaction

The principles of interaction and continuity (intersection between experience and education) form a major part of John Dewey’s philosophical discourse. According to Dewey, these principles determine the quality of educative experience for meaningful life‐long learning. In this article, I argue that nowhere is the relationship between experience and education better illustrated than in Carter G. Woodson’s work, The mis‐education of the Negro, and in Malcolm X’s intrinsic life experiences.     

Referral,enrollment, and completion in developmental education sequences in community colleges

After being assessed, many students entering community colleges are referred to one or more levels of developmental education. While the need to assist students with weak academic skills is well known, little research has examined student progression through multiple levels of developmental education and into entry-level college courses. The purpose of this paper is to analyze the patterns and determinants of student progression through sequences of developmental education starting from initial referral. Our results indicate that fewer than one half of the students who are referred to remediation actually complete the entire sequence to which they are referred. About 30 percent of students referred to developmental education do not enroll in any remedial course, and only about 60 percent of referred students actually enroll in the remedial course to which they were referred. The results also show that more students exit their developmental sequences because they did not enroll in the first or a subsequent course than because they failed or withdrew from a course in which they were enrolled. We also show that men, older students, African American students, part-time students, and students in vocational programs are less likely to progress through their full remedial sequences.     

The educational value of visual cues and 3D-representational format in a computer animation under restricted and realistic conditions

Within the framework of cognitive learning theories, instructional design manipulations have primarily been investigated under tightly controlled laboratory conditions. We carried out two experiments, where the first experiment was conducted in a restricted system-paced setting and is therefore in line with the majority of empirical studies in the learning sciences. However, the second experiment was done in an ecologically more valid classroom setting, with students working at their own pace with the instructional material embedded in a professional hypermedia learning environment. Both dealt with the same topic in the domain of biological education, namely the structure and functioning of the enzyme ATP-Synthase. In both experiments, the educational value of three- versus two-dimensional animations as well as of visual cues was investigated in a 2 × 2 factorial design. Students’ understanding was facilitated by the presence of a 3D-representation format under tightly controlled conditions only. Regarding the ecologically more valid classroom setting, the 2D format tended to foster understanding more efficiently than the 3D format. The implementation of visual cues enhanced the amount students remembered in both experiments. Our results indicate that the results of tightly controlled laboratory conditions may not be easily generalized to naturalistic classroom settings.     

Academic self-concept and emotion relations: Domain specificity and age effects

The present study investigated the relations between academic self-concepts and the emotions of enjoyment, pride, anxiety, anger, and boredom as experienced in mathematics, physics, German, and English classes (N = 1710; grades 8 and 11). In line with our hypotheses derived from appraisal-based emotion theories and self-efficacy research, within-domain relations between self-concepts and emotions were relatively strong and notably stronger within quantitative domains (mathematics and physics) than verbal domains (German and English). Also consistent with our hypotheses, stronger relations between self-concepts and emotions were observed among older students. Self-concept and emotion relations further differed as a function of the specific emotion assessed, with pride showing the strongest and boredom the weakest relations with academic self-concepts in the four domains assessed. Methodological and educational implications as well as directions for future research are discussed.     

THE MIND AT EVERY STAGE HAS ITS OWN LOGIC: JOHN DEWEY AS GENETIC PSYCHOLOGIST

In this essay Thomas Fallace argues that John Dewey can best be described as a pragmatic historicist and a genetic psychologist. This means that Dewey believed that the best way to understand any idea, phenomenon, or entity is to trace its history, that the history of the individual and race pass through distinct stages of development, and that the most effective way to educate was to coordinate the form and content of these phylogenetic and ontogenetic stages to one another. Fallace demonstrates how these ideas informed both theory and practice at the University of Chicago Laboratory School.