Multisite Randomized Controlled Trial Examining Intelligent Tutoring of Structure Strategy for Fifth-Grade Readers

Abstract

This article reports on a large scale randomized controlled trial to study the efficacy of a web-based intelligent tutoring system for the structure strategy designed to improve content area reading comprehension. The research was conducted with 128 fifth-grade classrooms within 12 school districts in rural and suburban settings. Classrooms within each school were randomly assigned to intervention or control groups. The intervention group used the intelligent web-based tutoring system for the structure strategy (ITSS) for 30 to 45 min each week as a partial substitute for the language arts curriculum for the entire school year. The structure strategy teaches students how to read and comprehend expository texts by identifying the text structure and creating strategic mental representations of the text. The web-based tutoring system delivered the structure strategy training with modeling, practice tasks, assessment, and feedback. The control classrooms used the school's language arts curriculum for the full language-arts time. Results show that the ITSS delivered structure strategy training improved reading comprehension measured by a standardized test and researcher designed measures.     

Improving content area reading comprehension of Spanish speaking English learners in Grades 4 and 5 using web-based text structure instruction

Reading and comprehending content area texts is important for academic and professional success as well as life skills necessary to maintain good health and quality lifestyle. Spanish speaking English language learners have shown poor performance on high-stakes assessments in reading comprehension. The number of Spanish speaking English learners (ELs) in our schools continues to increase at a fast pace, and therefore it is imperative that we address their reading comprehension needs swiftly and effectively. The text structure strategy has shown positive results on comprehension outcomes in many research studies with students at Grades 2, 4, 5, and 7. This study is the first implementation of instruction about the text structure strategy expressly designed to accommodate the linguistic and comprehension needs of Spanish speaking ELs in Grades 4 and 5. Strategy instruction on the web for English learners (SWELL) was designed to deliver instruction about the text structure strategy to Spanish speaker English learners. A randomized controlled study with pre and post-tests was conducted with 14 classrooms at fourth-grade and 17 classrooms at fifth-grade in high poverty schools where over 85% of students were Spanish speaking bilinguals or ELs. Analysis of data using multi-level models show moderate to large-effects favoring the students in the SWELL classrooms over the business as usual control classrooms on important measures such as a standardized reading comprehension test and main idea and cloze tasks. This research has practical implications for the use of web-based tools to provide high-quality and supportive instruction to improve Spanish speaking ELs reading comprehension skills.     

英语阅读教学中语篇信息词的作用

文章作者以教学研究者和反思者的双重身份,以自己的课堂教学为试验基地,通过两年的实践,在英语阅读教学中有意识地强调语篇信息词在英语阅读课文中的作用。研究试验数据、教师的实际教学、问卷调查和随后的访谈都表明有意识地培养学生在英语阅读课文中关注语篇信息词,不仅可以提高学生阅读理解的效率,还可改进教师英语阅读课的教学方法和提高授课技巧。     

Toward a typology of integration: Examining the documents model framework

Drawing on the Documents Model Framework, in two studies we investigate the types of multiple text models (e.g., mush model, separate representations model, documents model) reflected in students’ written responses, composed based on multiple texts. In among the first studies to holistically code written responses for the type of multiple text models they reflect, we find evidence for all of the multiple text representations specified in the Documents Model. We further examine the types of integration, or cross-textual connections, featured in students’ responses, including evidentiary (i.e., corroborating evidence), thematic (i.e., comparing main ideas across texts), and contextual (i.e., comparing meta-textual information, like author expertise) connections. Finally, we associate the types of multiple text models reflected in students’ written responses with various measures of integration, including the number of discourse connectives and citations included and self-reports of strategy use (Study 1), as well as with integrative utterances reported during a cued think-aloud (Study 2).     

Expository text comprehension in secondary school: for which readers does knowledge of connectives contribute the most?

The present study examined whether knowledge of connectives contributes uniquely to expository text comprehension above and beyond reading fluency, general vocabulary knowledge and metacognitive knowledge. Furthermore, it was examined whether this contribution differs for readers with different language backgrounds or readers who vary in reading fluency, general vocabulary knowledge or metacognitive knowledge levels. Multilevel regression analyses revealed that knowledge of connectives explained individual differences in eighth graders' text comprehension (n = 171) on top of the variance accounted for by the control variables. Moreover, the contribution of knowledge of connectives to text comprehension depended on a reader's level of metacognitive knowledge: more metacognitive knowledge resulted in a larger association between knowledge of connectives and text comprehension. Reading fluency, vocabulary knowledge and language background did not interact with knowledge of connectives. Findings are interpreted in the context of the strategic use of connectives during expository text reading.

What is already known about this topic?

• Connectives (words such as moreover, because and although) help the reader in establishing coherence between text parts.
• In primary school, for fifth graders, knowledge of connectives has been shown to be uniquely related to English text comprehension controlling for reading fluency and general vocabulary knowledge.
• For fifth graders, the relationship between knowledge of connectives and English text comprehension was higher for English‐only students than for their peers who learned English as a second language.

What this paper adds:

• The present study found that knowledge of connectives also has a unique relation with Dutch expository text comprehension for eighth graders above and beyond reading fluency, general vocabulary knowledge and metacognitive knowledge (about text structure and reading and writing strategies).
• The relationship between knowledge of connectives and text comprehension was not moderated by reading fluency, general vocabulary knowledge and language background (monolingual versus bilingual Dutch).
• Metacognitive knowledge did impact the relationship between knowledge of connectives and text comprehension: the higher the metacognitive knowledge, the higher the association between knowledge of connectives and text comprehension.

Implications for theory, policy or practice

• Secondary school readers are assumed to benefit from knowing connectives because these words are frequent in expository texts and signal relationships that students may often not infer without the help of these devices (i.e., with the use of background knowledge). This seems to apply in particular for expository texts that are intended to convey new information and relationships to students (see also Singer & O'Connell, 2003 ).
• We found a significant interaction between knowledge of connectives and metacognitive knowledge, which seems to indicate that knowing more connectives does not help much in improving expository text comprehension when metacognitive knowledge about text structure and reading strategies is low. This result suggests that it may be wise to couple instruction on the meaning of connectives with instruction about the structure of expository texts and ways to strategically deal with these texts.
• More specifically, besides instruction on the meaning of connectives, we advise teachers in secondary school to get students to understand the importance of connectives as markers of local and global coherence in texts, and to teach them how to strategically use connectives during reading.

     

An evaluation of two approaches for teaching reading comprehension strategies in the primary years using science information texts

There are few research studies on the effects of teaching comprehension strategies to young children in the primary grades. Using a Dominant–Less Dominant Mixed Model design employing both qualitative and quantitative data collection, we evaluated two approaches for teaching comprehension strategies to 7- and 8-year-old children in four second-grade classrooms using science information texts. The first approach focused upon explicitly teaching a series of single comprehension strategies, one-at-a-time (SSI). The second approach focused on teaching a “set” or “family” of transacted comprehension strategies within a collaborative, interactive and engaging routine (TSI). Results showed no difference between teaching young children a “set” of comprehension strategies and teaching comprehension strategies explicitly, one-at-a-time on their reading comprehension performance as measured by a standardized test of reading comprehension, recall of main ideas from reading two 200 word passages from information texts, a reading motivation survey and a strategy use survey. Results showed significant differences between students taught a set of comprehension strategies on measures of elaborated knowledge acquisition from reading science books (detail idea units recalled), retention of science content knowledge, and significantly improved criterion or curriculum-based reading comprehension test scores. These benefits favoring TSI over SSI are important because the learning curve is relatively steep for teachers to develop the ability to teach and for young children to develop the ability to coordinate a “set” of transacted comprehension strategies.     

Whose story is this? Discrepancy triggers readers’ attention to source information in short narratives

Three experiments investigated the role of source information (i.e., who said what) in readers’ comprehension of short informational texts. Based on the Discrepancy-Induced Source Comprehension assumption (Braasch, Rouet, Vibert, & Britt, 2012), we hypothesized that readers would be more likely to make use of source information when summarizing stories that included discrepant statements. Readers would also memorize source information more accurately. Experiments 1 and 2 found that American and French college students were more likely to refer to source information when they summarized news reports containing discrepant assertions. A detailed content analysis of the summaries also indicated that students use hedging and several other tactics to resolve contradictions. Experiment 3 replicated Braasch et al.’s finding that sources of discrepant stories were more likely to be recalled than sources of consistent stories. Experiment 3 also extended these findings using longer texts and a different reading task. Altogether the data support the Documents Model framework of multiple source comprehension.     

Effects of Processing Time on Comprehension and Calibration in Print and Digital Mediums

This study explored the effects of processing texts in print or digitally on readers' comprehension, processing time, and calibration. Eighty-six undergraduates read print and digital versions of book excerpts about childhood ailments presented in counterbalanced order. Comprehension was tested at three levels (i.e., main idea, key points, and other relevant information). Direct comparisons between print and digital reading demonstrated a significant advantage for reading in print on students' recall of key points and other relevant information but not the main idea. When processing time was added as a mediator variable, it significantly affected the relation between medium and comprehension for all question levels. In terms of calibration, students read more quickly and judged their performance higher when engaged digitally, although their actual performance was much better when reading in print. Implications of these findings for subsequent research are considered.     

The influence of topic knowledge,external strategy use,and college experience on students' comprehension of controversial texts

This study examined the influence of three personal factors, namely, prior knowledge about the text topic, external strategy use during reading, and experience in college, on students' comprehension of the relations among controversial texts. Eighty-six 1-year and 80 3-year undergraduate students answered a questionnaire assessing topic knowledge. One week later, they read two controversial texts and then completed two tasks assessing their comprehension of intertextual relations and recall of intratextual arguments respectively. The results indicated that topic knowledge influenced the comprehension of intertextual relations through enhancing the processing of intratextual arguments. The production of summary notes during reading had indirect and direct positive effects. Longer experience in college led to a better understanding of intertextual relations.     

Electronic Textbooks: Antecedents of Students’ Adoption and Learning Outcomes

Faculty and students are increasingly faced with the opportunity to use electronic versions of textbooks (e‐texts). Despite the advantages of e‐texts and recent advances in technology, evidence suggests that students are still reluctant to adopt and use e‐texts. This situation leads us to investigate two research questions: What factors contribute to students’ acceptance of e‐texts? Are there differences between hardcopy texts and e‐texts when it comes to course grade? We draw on a variety of perspectives (i.e., psychology, management information systems, economics, environmental studies) to build a framework that allows us to determine the motivations of students for adopting e‐texts, and the learning outcomes of e‐text adoption. Data was collected via a survey administered in the business school of a metropolitan university with approximately 20,000 students, located in the western United States. Results suggest that perceived ease‐of‐use and the price of e‐texts relative to hardcopy texts are two key motivators in e‐text adoption, while perceived usefulness, Internet self‐efficacy and environmental concerns are not significant motivators. However, there was no significant difference in the grades of e‐text adopters compared to hardcopy adopters. We conclude this paper by discussing the implications of our findings for educators.     

Young learners’ reading and writing performance: Exploring collaborative modeling of text structure as an additional component of self-regulated strategy development

This study examined the effects of adding collaborative modeling of text structure as an additional component of self-regulated strategy development for elementary school 6th-grade students learning English as a second language (ESL). In this study, 34 students receiving a ‘Self-regulated strategy development plus collaborative modeling of text structure’ intervention were compared with 36 students receiving a ‘collaborative modeling of text structure only’ intervention, 38 students receiving a ‘self-regulated strategy development only’ intervention, and 36 students receiving traditional instruction. Several measures (i.e., content comprehension, summarization of main ideas, and essay writing) were administered after the one-month intervention. Results revealed that, compared to traditional instruction, self-regulated strategy development and collaborative modeling of text structure respectively resulted in better comprehension levels and writing performance. The combination of self-regulated strategy development and collaborative modeling of text structure was particularly effective in increasing primary school students’ content comprehension and writing quality. These findings highlight the benefit of coupling self-regulated strategy development and collaborative modeling of text structure for elementary school ESL classroom instruction.     

Improving comprehension of expository text in students with LD: a research synthesis

This article summarizes the findings of research studies designed to improve the comprehension of expository text for students with learning disabilities. Twenty-nine studies were located that met the inclusion criteria. Interventions gleaned from the review were categorized as content enhancement (i.e., advance and graphic organizers, visual displays, mnemonic illustrations, and computer-assisted instruction) or cognitive strategy instruction (i.e., text structure, main idea identification, summarization, questioning, cognitive mapping, reciprocal teaching). Treatment outcomes are discussed in relation to the various instructional approaches, student characteristics (e.g., grade, IQ), instructional features (e.g., materials, treatment length), methodological features, strategy maintenance, and generalization components. Implications for classroom practice and future research directions are provided.     

Improving Reading to Improve Math

Reading provides information across the curriculum. Thus, to the extent that fundamental (i.e., generalizable) reading comprehension strategies can be taught, the benefits should be found in multiple domains. To test this claim, children in the third and fourth grades read by simulating text content using the two-part, embodied Moved by Reading intervention. While reading six initial texts, children literally manipulated pictures on a computer screen to simulate sentence content; next, for additional texts the children imagined the manipulation of the pictures. These additional texts were in the form of mathematical story problems. Compared to a control condition, children using Moved by Reading solved more problems correctly, and this improvement is mainly attributed to a 35% reduction in the use of irrelevant numerical information in solution attempts. Thus, Moved by Reading teaches a fundamental strategy that encourages the sense-making that can aid mathematical story problem solution.     

Evidence‐Based Strategies for Improving the Reading Comprehension of Secondary Students: Implications for Students with Learning Disabilities

Reading comprehension is a complex skill that places significant demands on students, beginning with elementary school and continuing through the secondary grades. In this article, we provide an overview of possible factors associated with problems in reading comprehension among secondary students with learning disabilities. Discussion underscores the fact that comprehension problems are evidenced by a heterogeneous group of students. We argue that it is important for teachers to align an intervention with a specific area of difficulty (e.g., teaching prefixes and suffixes to increase reading vocabulary). We highlight research‐based interventions advocated by the National Reading Panel and offer ways that teachers can match specific strategies with the individual needs of students with problems in reading comprehension. Finally, we emphasize that whatever strategy is selected, it should be structured, explicit, scaffolded, and intense ( Williams et al., 2005 ).     

Ethnic DIF in Reading Tests With Mixed Item Formats

This article presents a study of ethnic Differential Item Functioning (DIF) for 4th-, 7th-, and 10th-grade reading items on a state criterion-referenced achievement test. The tests, administered 1997 to 2001, were composed of multiple-choice and constructed-response items. Item performance by focal groups (i.e., students from Asian/Pacific Island, Black/African American, Native American, and Latino/Hispanic origins) were compared with the performance of White students using simultaneous item bias and Rasch procedures. Flagged multiple-choice items generally favored White students, whereas flagged constructed-response items generally favored students from Asian/Pacific Islander, Black/African American, and Latino/Hispanic origins. Content analysis of flagged reading items showed that positively and negatively flagged items typically measured inference, interpretation, or analysis of text in multiple-choice and constructed-response formats. Items that were not flagged for DIF generally measured very easy reading skills (e.g., literal comprehension) and reading skills that require higher level thinking (e.g., developing interpretations across texts and analyzing graphic elements).     

What makes a word difficult? Insights into the mental representation of technical terms

Learning from texts requires reflection on how far one has mastered the material. Learners use such metacognitive processes to decide whether to engage in deeper learning activities or not. This article examines how the lexical surface of specialist concepts influences their mental representation. Lexical encodings that are the concise wordings of a concept (e.g., tension headache or migraine for specific types of headache) provide immediate access to the underlying content. To understand learning contents appropriately, learners have to work on such lexical covers to gain insight into the underlying semantic meaning. It was assumed that a technical term??s origin (either German or classical Latin/Greek) is used systematically as a hint for further elaboration. 41 college students rated the difficulty, familiarity, competence, accessibility, and their knowledge of 17 German-language (GL) terms and their classical language (CL) synonyms. The influence of word frequency was controlled. As expected, results showed that GL terms were perceived to be less difficult than CL terms. Consequently, comprehension of these terms was rated more highly. Analyses of how lexical encoding influenced accuracy of participants?? comprehension judgments showed that participants?? comprehension ratings were less accurate for GL terms. Theoretical and practical implications for learning from written information are discussed.     

Integrating Scenario‐Based and Component Reading Skill Measures to Understand the Reading Behavior of Struggling Readers

In recent years, researchers, educators, and policy makers have called for a new generation of reading comprehension assessments (e.g., Partnership for 21st Century Skills, 2008). Advocates of this movement argue for a deeper type of reading assessment, one that captures students’ ability to not only understand single texts in isolation but also to engage in purposeful, multisource integration of sources. While this shift in how we define and measure reading comprehension is laudable, assessments must also measure the fundamental reading skills that may impede higher‐level comprehension processes. This article presents data from two assessments that were designed to work in tandem to provide a more complete picture of reading comprehension. Middle school students were given a component skills battery which measured core reading skills such as word recognition, decoding, vocabulary, and morphology, as well a second assessment designed to measure reading comprehension. Reading comprehension was measured using a scenario‐based assessment approach, which required students to read a range of sources to fulfill a particular reading goal. The results indicate that students, including struggling readers, were able to read, understand, and problem solve in complex learning environments, but students’ ability to do so was often tempered by their basic reading skills. We argue that including a measure of component skills alongside a measure of higher‐level comprehension is beneficial in interpreting student performance. Accordingly, we present the results on the scenario‐based measure as a function of reading component skills and argue for the value of using this approach for struggling readers.     

Reading for meaning: The foundational knowledge every teacher of science should have

Reading is fundamental to science and not an adjunct to its practice. In other words, understanding the meaning of the various forms of written discourse employed in the creation, discussion, and communication of scientific knowledge is inherent to how science works. The language used in science, however, sets up a barrier, that in order to be overcome requires all students to have a clear understanding of the features of the multimodal informational texts employed in science and the strategies they can use to decode the scientific concepts communicated in informational texts. We argue that all teachers of science must develop a functional understanding of reading comprehension as part of their professional knowledge and skill. After describing our rationale for including knowledge about reading as a professional knowledge base every teacher of science should have, we outline the knowledge about language teachers must develop, the knowledge about the challenges that reading comprehension of science texts poses for students, and the knowledge about instructional strategies science teachers should know to support their students’ reading comprehension of science texts. Implications regarding the essential role that knowledge about reading should play in the preparation of science teachers are also discussed here.     

The use of source-related strategies in evaluating multiple psychology texts: a student–scientist comparison

Multiple text comprehension can greatly benefit from paying attention to sources and from using this information for evaluating text information. Previous research based on texts from the domain of history suggests that source-related strategies are acquired as part of the discipline expertise as opposed to the spontaneous use of these strategies by students just entering a field. In the present study, we compared the performance of students and scientists in the domain of psychology with regard to (a) their knowledge of publication types, (b) relevant source characteristics, (c) their use of sources for evaluating the credibility of multiple texts, and (d) their ability to judge the plausibility of argumentative statements in psychological texts. Participants worked on a battery of newly developed computerised tests with a think-aloud instruction to uncover strategies that scientists and students used when reading a text. Results showed that scientists scored higher in all of the assessed abilities and that these abilities were positively correlated with each other. Importantly, the superior performance of scientists in evaluating the credibility of multiple texts was mediated by their use of source information. Implications are discussed in terms of discipline expertise.