How do people read the passages during a reading comprehension test? The effect of reading purpose on text processing behavior

In this study, we investigate the effect of reading purpose on students’ processing behavior during a reading comprehension test. In a repeated measures design, sixty undergraduates answered multiple-choice (MC) reading comprehension questions in a condition with no overarching goal for reading and in an alternate condition where the same students were first provided with the goal of summarizing the text before answering MC questions. Results from eye tracking analysis showed that when students read and answered questions without an overarching goal, they spent much less time reading the passages before answering the questions, more time re-reading the texts while answering the questions, and more time on parts of the text that were not necessary to answer the questions. We conclude that providing examinees without an explicit goal for reading may inadvertently encourage a “search for the answer” reading process, rather than on building a coherent mental model of text content.     

Designing Reading Comprehension Assessments for Reading Interventions: How a Theoretically Motivated Assessment Can Serve as an Outcome Measure

When designing a reading intervention, researchers and educators face a number of challenges related to the focus, intensity, and duration of the intervention. In this paper, we argue there is another fundamental challenge—the nature of the reading outcome measures used to evaluate the intervention. Many interventions fail to demonstrate significant improvements on standardized measures of reading comprehension. Although there are a number of reasons to explain this phenomenon, an important one to consider is misalignment between the nature of the outcome assessment and the targets of the intervention. In this study, we present data on three theoretically driven summative reading assessments that were developed in consultation with a research and evaluation team conducting an intervention study. The reading intervention, Reading Apprenticeship, involved instructing teachers to use disciplinary strategies in three domains: literature, history, and science. Factor analyses and other psychometric analyses on data from over 12,000 high school students revealed the assessments had adequate reliability, moderate correlations with state reading test scores and measures of background knowledge, a large general reading factor, and some preliminary evidence for separate, smaller factors specific to each form. In this paper, we describe the empirical work that motivated the assessments, the aims of the intervention, and the process used to develop the new assessments. Implications for intervention and assessment are discussed.     

Making Science Relevant: The Experiences of Prospective Elementary School Teachers in an Innovative Science Content Course

Journal of Science Teacher Education -     

Prospective teachers’ perceptions of development during fieldwork: Tutoring as a vehicle for professional growth

Abstract

This study examines elementary and secondary prospective teachers’ perceptions of the ways in which their experiences as tutors in school‐based tutoring programs influenced their professional development. Data collected from a survey questionnaire, reflective papers, and individual and focus group interviews revealed five main ways that these undergraduate and graduate education students perceived the tutoring experiences contributed to their professional growth. They described development in the following understandings: school students, pedagogical strategies, relationships with colleagues in school settings, the teaching/learning process, and reflective practice. All of these understandings were reported as increasing their self‐confidence as developing educators.     

The case for scenario-based assessment of written argumentation

Reading and Writing - This paper presents a theoretical and empirical case for the value of scenario-based assessment (SBA) in the measurement of students’ written argumentation skills....     

Integrating Scenario‐Based and Component Reading Skill Measures to Understand the Reading Behavior of Struggling Readers

In recent years, researchers, educators, and policy makers have called for a new generation of reading comprehension assessments (e.g., Partnership for 21st Century Skills, 2008). Advocates of this movement argue for a deeper type of reading assessment, one that captures students’ ability to not only understand single texts in isolation but also to engage in purposeful, multisource integration of sources. While this shift in how we define and measure reading comprehension is laudable, assessments must also measure the fundamental reading skills that may impede higher‐level comprehension processes. This article presents data from two assessments that were designed to work in tandem to provide a more complete picture of reading comprehension. Middle school students were given a component skills battery which measured core reading skills such as word recognition, decoding, vocabulary, and morphology, as well a second assessment designed to measure reading comprehension. Reading comprehension was measured using a scenario‐based assessment approach, which required students to read a range of sources to fulfill a particular reading goal. The results indicate that students, including struggling readers, were able to read, understand, and problem solve in complex learning environments, but students’ ability to do so was often tempered by their basic reading skills. We argue that including a measure of component skills alongside a measure of higher‐level comprehension is beneficial in interpreting student performance. Accordingly, we present the results on the scenario‐based measure as a function of reading component skills and argue for the value of using this approach for struggling readers.     

Relative Effectiveness of Reading Intervention Programs for Adults with Low Literacy

To compare the efficacy of instructional programs for adult learners with basic reading skills below the seventh grade level, 300 adults were randomly assigned to one of three supplementary tutoring programs designed to strengthen decoding and fluency skills, and gains were examined for the 148 adult students who completed the program. The three intervention programs were based on or adapted from instructional programs that have been shown to benefit children with reading levels similar to those of the adult sample. Each program varied in its relative emphasis on basic decoding versus reading fluency instruction. A repeated measures MANOVA confirmed small to moderate reading gains from pre- to post-testing across a battery of targeted reading measures, but no significant relative differences across interventions. An additional 152 participants who failed to complete the intervention differed initially from those who persisted. Implications for future research and adult literacy instruction are discussed.     

Meaningful reading gains by adult literacy learners

To obtain a fuller picture of the efficacy of reading instruction programs for adult literacy learners, gains by individual students were examined in a sample (n = 148) in which weak to moderate gains at the group level had been obtained in response to tutoring interventions that focused on strengthening basic decoding and fluency skills of low literate adults (Sabatini, Shore, Holtzman, & Scarborough, 2011). Learners were randomly assigned to receive one of three tutoring programs for an average of 44 h of instruction. We used within-individual gains replicated over tests (WIGROT) as the method for identifying gainers, who were defined as students whose reading levels increased from pretest to posttest by a half year or more on at least two of four measured aspects of reading proficiency. The 46 % of the sample who met the criterion had higher pretest scores than non-gainers on measures of reading (d = .42, p < .01) and phonological awareness (d = .47, p < .01), and included fewer adults with a history of special education (43 vs. 61 %, phi = .19, p < .05), regardless of which instructional condition had been received. The findings suggest that basic skills instruction can lead to a meaningful degree of benefit for many adult learners who persist in reading programs for several months. Supplementing group level results with analyses of individual growth, such as WIGROT, appears to be useful in evaluating the efficacy of literacy interventions.