Current Concerns in Validity Theory

We are at the end of the first century of work on models of educational and psychological measurement and into a new millennium. This certainly seems like an appropriate time for looking backward and looking forward in assessment. Furthermore, a new edition of the Standards for Educational and Psychological Testing (AERA, APA, & NCME, 1999) has been published, and the previous editions of the Standards have served as benchmarks in the development of measurement theory.
This backward glance will be just that, a glance. After a brief historical review focusing mainly on construct validity, the current state of validity theory will be summarized, with an emphasis on the role of arguments in validation. Then how an argument-based approach might be applied will be examined in regards to two issues in validity theory: the distinction between performance-based and theory-based interpretations, and the role of consequences in validation.     

Entering and exiting a teacher preparation program: What happens in between?

In determining whether graduates of the Master of Arts in Teaching (MAT) Program at Southern Oregon University were developing the necessary knowledge, skills, and dispositions to teach, faculty members found themselves examining their own practice. This is just what Goodlad (1988) suggested we do: clarify our own beliefs in order to better understand our teacher preparation program. We discovered that the development of the MAT program is primarily shaped by the people who teach within the program. Who we are as people, influences who we are as teachers and, who we are as teachers influences the nature of the teacher preparation program. This discovery underscored the importance of our efforts to steward the development of our students’ personhood as well as their knowledge and skills.     

Students’ Mental Models of the Internet and Their Didactical Exploitation in Informatics Education

The Internet constitutes a relatively new teaching subject for the Informatics curriculum. Within secondary education, students should develop an understanding of basic Internet concepts as well as Internet skills. For the attainment of these goals it is necessary that they develop adequate mental models of the Internet. That development should be based on the assessment of their initial mental models of the Internet. The purpose of this study was the investigation of the mental models that high school students form of the Internet in the beginning of the Informatics curriculum. The study involved 340 Greek high school students who completed a written questionnaire and a drawing task. The results suggest that students form simplistic, utilitarian rather than structural mental models of the Internet, which would provide them with an adequate explanatory system of what the Internet actually is and the processes underlying its use. The students’ mental models also involve particular misconceptions. The didactical implications of the findings for Informatics education at high school level are considered.     

Conditions that enable effective feedback

ABSTRACT

Despite an increasing focus on assessment feedback, educators continue to find that simply replicating an effective feedback practice from one context does not guarantee success in the next. There is a growing recognition that the contextual factors surrounding successful practices need to be considered. This article reports on a large-scale mixed methods project and proposes 12 conditions that enable successful feedback in higher education. The conditions were distilled from seven rich case studies through multiple stages of thematic analysis, case comparison and reliability checking. The conditions were also evaluated by surveying senior leaders of Australian universities. These conditions highlight the importance of carefully designing feedback processes, along with the need for addressing capacity and culture for feedback. This helps to explain why there are such variances in effective feedback across contexts, and offers insight into how it may be achieved.     

Connecting Teacher Beliefs to the Use of Children’s Literature in the Teaching of Mathematics

This article presents examples that illustrate how teachers use childrens literature in the teaching of mathematics. The examples are related to four curriculum ideologies that have influenced mathematics education in the USA for the last 75 years. It discusses why it is relevant to help teachers understand the ideological positions that influence their use of childrens literature during mathematics instruction, summarizes the four ideological positions, and presents results of a study of how teachers ideological positions relate to their use of childrens literature in the teaching of mathematics. The study examines two research questionsCan an instructional tool be developed that will highlight for teachers the different ways in which they and others use childrens literature to teach mathematics? and Can that instructional tool stimulate teacher discussion and reflection about their own beliefs and the ideological nature of the instructional environment in which they learned (as students) and teach (as teachers)? Study results indicate that both questions can be answered in the affirmative.     

Benefits of computer-presented speed training for poor readers

The effects of computer-presented automatization exercises in a group of 14 poor readers were assessed in comparison to a matched control group of 14 poor readers that received computer-presented exercises aimed at the use of context for word identification and comprehension. Training took place three sessions a week for 15 minutes per session and lasted about two months in each group. Results showed that the automatization or “speed” group progressed more than the context group in word and text reading efficiency, and the effect transferred to more complex word types than the CVC word type that was presented in the exercises. Both groups progressed to the same extent in accuracy, but the speed group made more progress in speed. No effects were found for reading comprehension. The findings make clear that computer-supported automatization exercises can be effective in reducing reading problems of poor readers in a short period of time. Implications for practice are discussed.     

How university teaching changes teachers: Affective as well as cognitive challenges

This paper argues that the teaching of a subject can change our understanding of what it means to know, to teach and learn that subject. It also argues that when our understanding is questioned and changes then academic work can become an emotionally charged endeavour. This paper reports on a study where, over a semesters teaching, around two thirds of teachers changed some aspect of their scholarly thinking or practice. These teachers were teaching a range of first and second year classes, they were not new to teaching, nor were they unfamiliar with the teaching of the subject. For approximately one third, the change in understanding was not major. It involved a change in teaching practice but it did not involve the questioning of their existing understanding of subject matter. For another third, however, the change was substantial. These teachers, in some way, questioned previously taken for granted assumptions, they re-thought aspects of the structure of the discipline or the relationship of the subject to the discipline. They also revised their ideas about how to best teach that subject and what learning the subject involved. This change invariably involved anxiety and uncertainty and in some cases this was extreme. Little attention has been paid to change in teachers understanding of subject matter and little, or no, research has focused on the emotional impact of this change. This initial exploration of these neglected aspects of university teaching suggests a rich vein for further exploration. This paper builds on previous work that has used phenomenography to examine changes in university teachers understanding of subject matter taught. An analysis of metaphor is used to explore change and to tap into the rich and complex emotional experiences that accompany this change.