Studying and Constructing Concept Maps: a Meta-Analysis

A concept map is a node-link diagram in which each node represents a concept and each link identifies the relationship between the two concepts it connects. We investigated how using concept maps influences learning by synthesizing the results of 142 independent effect sizes (n = 11,814). A random-effects model meta-analysis revealed that learning with concept and knowledge maps produced a moderate, statistically significant effect (g = 0.58, p < 0.001). A moderator analysis revealed that creating concept maps (g = 0.72, p < 0.001) was associated with greater benefit relative to respective comparison conditions than studying concept maps (g = 0.43, p < 0.001). Additional moderator analyses indicated learning with concept maps was superior to other instructional comparison conditions, and was effective across science, technology, engineering, and math (STEM) and non-STEM knowledge domains. Further moderator analyses, as well as implications for theory and practice, are provided.     

Reading Instruction for English Learners in the Middle Grades: a Meta-Analysis

This meta-analysis synthesizes the last two decades of experimental and quasi-experimental research on reading instruction across academic contexts (e.g., social studies, science, mathematics, English language arts) for English learners (ELs) in grades 4 through 8, to determine (a) the overall effectiveness of reading instruction for upper elementary and middle school students who are ELs and (b) how the magnitude of the effect varies based on student, instructional, and study characteristics. The analysis included a total of 11 studies with 46 individual effect sizes and yielded a mean effect size of g?=?0.35 across all (i.e., standardized and unstandardized) reading measures, g?=?0.01 across standardized reading measures, and g?=?0.43 across unstandardized reading measures. For all reading, unstandardized reading, all vocabulary, and unstandardized vocabulary measures, results suggest that higher quality studies tended to have smaller effects, and these effects were even more evident for unstandardized measures (i.e., one unit increase in study quality was associated with decreased effects: g?=?0.21, g?=?0.30, g?=?0.24, g?=?0.30, respectively). For all comprehension measures, effects were larger for instruction that included both vocabulary and comprehension (g?=?0.39) than for instruction that focused on vocabulary alone (g?=?0.08). Results suggest the benefit of developing and refining high-impact approaches to reading instruction for ELs that can be delivered across content areas and grades.     

Mentoring teachers in systematic phonics instruction: effectiveness of an intensive year-long program for kindergarten through 3rd grade teachers and their students

Teaching systematic phonics effectively to beginning readers requires specialized knowledge and training which many primary grade teachers lack. The current study examined effects of a year-long mentoring program to improve teachers’ knowledge and effectiveness in teaching phonics and the extent that it improved students’ achievement in reading and spelling. Teachers in urban, lower SES schools completed a 45 h course followed by 90 h of in-school training. Mentors (N = 29) worked with kindergarten, 1st, 2nd, and 3rd grade teachers (N = 69) twice a week for 30 weeks during the year. Each visit included a 45 min prep period plus 45 min of modeling and feedback in the classroom. Mentors taught teachers how to provide systematic phonics instruction to their students (N = 1,336). Monthly ratings by mentors revealed that teachers improved their phonics teaching skills with many reaching the highest ratings by May. Teachers who were non-native speakers of English took a bit longer to learn the English sound system for letters, mainly because they lacked sufficient knowledge of English sounds and had to learn them. Given the increasing diversity of the teacher work force, future research is needed to study this difficulty, its solution, and impact on students. Teachers’ agreement with principles of phonics instruction remained strong or increased from fall to spring. Students’ reading and spelling skills showed large gains during the year and far exceeded effect sizes from comparable data sources. Students met grade-level expectations at the end of kindergarten and first grade but fell short in second and third grades. General education students outperformed bilingual/ELL and special needs students although all subgroups made large gains. Findings reveal the effectiveness of an intensive mentoring model of professional development applied to a subject that is difficult to teach and to a student population known for lower reading achievement. Findings point to the need for better pre-service teacher preparation coupled with appropriate curricula and PD from districts in order to improve students’ reading achievement.     

Measures of instruction for creative engagement: Making metacognition,modeling and creative thinking visible

The purpose of the current study was to estimate reliability, internal consistency and construct validity of the Measure of Instruction for Creative Engagement (MICE) instrument. The MICE uses an iterative process of evidence collection and scoring through teacher observations to determine instructional domain ratings and overall scores. The results demonstrated the sound inter-observer reliability, teacher stability and score validity of the MICE. We found (a) a low proportion of rater variance (0.14–5.99%), (b) moderate to highly correlated within-teacher ratings ranging from r(17) = 0.663, p < 0.01 to r(17) = 1.000, p < 0.01 and (c) a statistically-significant difference between classroom teachers and teaching artists, t(56) = 7.37, p = 0.000. These results relate to the development of classroom environment instruments and the substantive development of pedagogy that supports creative thinking and behaviours, both of which are a priority for enhancing teacher accountability and student learning.     

Relationships Between Student Perception of Teacher-Student Relations and PISA Results in Mathematics and Science

Teacher-student relations have a significant correlation with student motivation, academic performance and discipline. For example, the meta-analysis by Hattie (2009) revealed an effect size of d = 0.72 for the effect of relations on achievement, and the meta-analysis by Finn, Schrodt, Witt, Elledge, Jernberg & Larson (Communication Education, 58(4), 516–537, 2009) showed a correlation of 0.55 between the perceived care by teachers and student achievement. These were established by comparing students, but comparisons of schools or countries with high or low levels of teacher-student relations are missing. The present paper analyses the correlation between teacher-student relations and Programme for International Student Assessment (PISA) 2009 results in science and mathematics on three levels: student, school and country level. The study shows a weak positive relationship (correlations up to 0.16) at the student level, and a positive relationship (up to 0.34) at school level. The multilevel analysis revealed a negative relationship between teacher-student relations and PISA results (r = ?.51) at the country level. To understand the negative relationship, also known as an ecological fallacy, the countries were grouped into geographical regions in which the relationship was insignificant and the positive effect of teacher-student relations was found by comparing with some neighboring countries. Implications for practice and further studies are proposed on the basis of these findings.     

Problem-Centered Supplemental Instruction in Biology: Influence on Content Recall,Content Understanding,and Problem Solving Ability

To address the need for effective, efficient ways to apply active learning in undergraduate biology courses, in this paper, we propose a problem-centered approach that utilizes supplemental web-based instructional materials based on principles of active learning. We compared two supplementary web-based modules using active learning strategies: the first used Merrill’s First Principles of Instruction as a framework for organizing multiple active learning strategies; the second used a traditional web-based approach. Results indicated that (a) the First Principles group gained significantly from pretest to posttest at the Remember level (t(40) = ?1.432, p = 0.08, ES = 0.4) and at the Problem Solving level (U = 142.5, N1 = 21, N2 = 21, p = .02, ES = 0.7) and (b) the Traditional group gained significantly from pretest to posttest at the Remember level (t(36) = 1.762, p = 0.043, ES = 0.6). Those in the First Principles group were significantly more likely than the traditional group to be confident in their ability to solve problems in the future (χ² (2, N = 40) = 3.585, p = 0.09).     

Der Zusammenhang von Schulleitungshandeln,Unterrichtsgestaltung und Lernerfolg

Indicators and instruments for determining and measuring school quality within inspection systems are usually based on frameworks for inspection. These frameworks rely heavily upon school and teacher effectiveness research. Thus, a central assumption is that the effectiveness and improvement-oriented school conditions, as measured within an inspection, are related to student achievement. It is unclear if this assumption really holds true, as empirical evidence is still lacking. This study uses data from a random sampling of schools (n = 37) and teachers (n = 1663) and the achievement data from students (n = 23,943) to validate the interpretations and uses of school inspection results regarding the factor school leadership. The study follows Kane’s argument-based approach for validation. Results reveal that principals of schools with recurrent high student achievement very often demonstrate instructional leadership. It is evident that these principals are also leading in a fundamentally different way from principals in schools with lower achievement in that they lead with the specific school context in mind. The study demonstrates that it is possible to make inferences from scores provided by school inspections and to generalize from them. However, this generalizability does not extend to making extrapolations or decisions based on these scores. The analyses make it clear that providing feedback solely on the strengths and weakness of a school is insufficient when it comes to stimulating school improvement through inspection.     

The Effectiveness of Interventions Aimed at Reducing Teacher Burnout: a Meta-Analysis

We conducted a meta-analysis to investigate the effectiveness of interventions aimed at reducing teacher burnout. Online and reference list searches yielded 513 unique results, and the final sample contains 23 controlled trials (19 journal articles and 4 unpublished dissertations). More than two thirds of the studies had optimal quality, and the risk of bias was not related to the overall effectiveness of the interventions. The overall effects were small, but statistically significant (d = 0.18, SE = 0.05, Z = 3.26, p < 0.001, k = 23). Separate analyses on each burnout component showed similar intervention effects on emotional exhaustion and personal accomplishment, but almost null effects on depersonalization (d = 0.03, SE = 0.06, Z = 0.53, p > 0.05, k = 11). Additional moderator analyses suggested that mindfulness interventions had significant effects on exhaustion and personal accomplishment. Interventions on primary and middle school teachers reported effect sizes below the average effect. Similar to previous findings, interventions that lasted less than 1 month had the smallest levels of efficacy.     

Conditional cooperators: student prosocial dispositions and their perceptions of the classroom social environment

A common problem in education is getting students to cooperate effectively in groups during learning. Because interdisciplinary research has established that cooperation is sensitive to specific contextual factors such as reciprocity, friendship and benefit, similar factors could be shaping student interactions in contemporary classroom environments. The present article reports an initial investigation of this idea by examining how student perceptions of their classroom environment relate to their willingness to expend energy and resources on classmates (through helping). This was accomplished through the structural equation modeling of survey data collected from 845 undergraduate life sciences students from 41 laboratory classrooms at a research-intensive university. Characteristics of the classroom social environment previously associated with benefits in other contexts also predicted (reciprocity β = 0.576; friendship β = 0.156) the educational benefit that students perceive as coming from their classmates. This perceived benefit in turn was highly associated (β = 0.605) with student willingness to expend resources on classmates (i.e. their prosocial disposition). Also both reciprocity (β = 0.298) and perceived benefit (β = 0.403) concurrently predict a student’s support for enforcing cooperation in the classroom. Potential insights into the contribution of classroom social environment to student dispositions towards cooperation are discussed.     

Promoting Conceptual Change for Complex Systems Understanding: Outcomes of an Agent-Based Participatory Simulation

Components of complex systems apply across multiple subject areas, and teaching these components may help students build unifying conceptual links. Students, however, often have difficulty learning these components, and limited research exists to understand what types of interventions may best help improve understanding. We investigated 32 high school students’ understandings of complex systems components and whether an agent-based simulation could improve their understandings. Pretest and posttest essays were coded for changes in six components to determine whether students showed more expert thinking about the complex system of the Chesapeake Bay watershed. Results showed significant improvement for the components Emergence (r = .26, p = .03), Order (r = .37, p = .002), and Tradeoffs (r = .44, p = .001). Implications include that the experiential nature of the simulation has the potential to support conceptual change for some complex systems components, presenting a promising option for complex systems instruction.     

Beyond the Rainbow: Retrieval Practice Leads to Better Spelling than does Rainbow Writing

In three experiments, we compared the effectiveness of rainbow writing and retrieval practice, two common methods of spelling instruction. In experiment 1 (n?=?14), second graders completed 2 days of spelling practice, followed by spelling tests 1 day and 5 weeks later. A repeated measures analysis of variance demonstrated that spelling accuracy for words trained with retrieval practice was higher than for words trained with rainbow writing on both tests (η _p ² ?=?.49). In experiments 2 (second graders, n?=?16) and 3 (first graders, n?=?12), students completed 2 days of spelling practice followed by a spelling test 1 day later. Results replicated experiment 1; spelling accuracy was higher for words trained with retrieval practice compared with rainbow writing (η _p ² ?=?.42 and .64, respectively). Furthermore, students endorsed both liking and learning from retrieval practice at least as much as (and sometimes more than) rainbow writing. Results demonstrate that retrieval practice is a more useful (and as engaging) training method than is rainbow writing and extend the well-established testing effect to beginning spellers.     

Immediate and delayed effects of invented writing intervention in preschool

This study examined the effects of a 10 week invented writing program with five-year-old preschoolers (mean age 5.7 years) on their immediate post intervention literacy skills and also the facilitative effects of the intervention on the subsequent learning to read during the first 6 months of schooling. The study included 105 children (54 girls) from 12 preschools in Norway. The preschools were randomly assigned to the experimental group with the invented writing program, or the control group with the ordinary program offered to preschoolers. The classroom-based programs (40 sessions) were conducted by the children’s regular teachers. The children’s emergent literacy skills were evaluated using a pre-test, a post-test and a follow-up test 6 months later, and the data were analyzed using latent autoregressive models. The results showed that the invented writing group performed significantly better than the control group on the post-test for the measures of phoneme awareness (d = .54), spelling (d = .65) and word reading (d = .36). Additionally, indirect effects were observed on the delayed follow-up tests on phoneme awareness (d = .45), spelling (d = .48) and word reading (d = .26). In conclusion, we argue that invented writing appeared to smooth the progress of emergent literacy skills in preschool, including the subsequent reading development in school. Contextualized in a semi-consistent orthography and a preschool tradition that does not encourage the learning of written language skills, the findings add to our knowledge of how children learn to write and read.     

Child Readers and the Worlds of the Picture Book

Children as readers of picture books and the ways they respond to, and make meaning from, such texts are the focus of this article, which reports on a small-scale study undertaken in Norway and Wales, UK. The theoretical framing of the research draws on concepts of the multimodal ensemble in picture books and of the reading event as part of a social practice. The research design was developed from the team’s analysis of two texts, Pappa by Svein Nyhus (1998) and What does Daddy Do? by Rachel Bright (2009). Twenty-four children, who were 7 and 8 years old, took part in the study. This was built around two reading events for each book, staged as an immediate response and as a guided response. The data subsequently collected were analysed according to three overarching organisational principles, as book world, real world and play world. For both Daddy and Pappa, the first reading event showed the children’s responses were mainly directed towards exploring the book world. On the second reading event, references to the real world predominated for Daddy, while for Pappa the book world was again dominant. Across both reading events and for both books, the playworld revealed those occasions when the children expanded the meaning of the story, demonstrating an inventive ability to play with the text. Overall, the children’s responses moved fluidly across the three worlds, showing them to be energetically making connections between the reading, their experience of books and their own lives.     

Millennials,Technology and Perceived Relevance of Community Service Organizations: Is Social Media Replacing Community Service Activities?

This mixed-methods qualitative study examined the relationship between perceptions of the importance of social media (i.e., Facebook, Twitter) with community service projects and volunteerism. Participants (n = 80) were interviewed and surveyed regarding their experiences in participating in a variety of community service work (CSW) projects (i.e., urban forestry, community gardening) with their perceptions of the importance of social media. Results supported the hypothesis that a significant correlation exists (r = .286, p < .05) between perceptions of technology as an important part of my life and reduced importance of CSW activities. A significant correlation (r = 287, p < .001) also developed between perceptions of “connectedness” to one’s community, increased technology use and reduced perceptions of the importance of CSW activities. Additionally, a significant positive correlation (r = .454, p < .001) was found between reports of improved perceptions among ethnically diverse populations and the overall importance of CSW activities within the community. Results and suggestions for further research are offered regarding the application of theory to “real world” perspectives and problems involving education and environmental issues.     

A comparative examination of Canadian and American pre-service teachers’ self-efficacy beliefs for literacy instruction

This study explored Canadian and American pre-service elementary teachers’ self-efficacy beliefs for literacy instruction, as well as the contextual factors (i.e., course and field experiences) that contribute to these self-efficacy beliefs. Survey data were collected over a two-year period at the beginning and end of a required elementary literacy methods course that assessed pre-service teachers’ self-efficacy for literacy instruction. A content analysis of the American and Canadian literacy methods course syllabi was also conducted. Paired t test results showed no significant difference in pre-service teachers’ literacy teaching self-efficacy scores from pre-test to post-test; however, there was a significant difference in the pre-service teachers’ literacy efficacy beliefs related to oral reading from the beginning to the end of the course. A weak negative correlation was found between the Canadian pre-service teachers’ total Teachers’ Sense of Efficacy for Literacy Instruction (TSELI; Tschannen-Moran & Hoy, 2011) scores and their teaching experience specific to literacy instruction, r = ? .1, p = .04. There was a positive correlation between Canadian pre-service teachers’ self-efficacy scores related to engagement and differentiated instruction and their volunteer and work experiences. A positive correlation existed between Canadian and American pre-service teachers’ self-efficacy for reading/writing connections and university coursework related to literacy instruction. Implications for literacy teacher educators and recommendations for literacy instruction are discussed.     

Effects of an Animal-Assisted Intervention on Reading Skills and Attitudes in Second Grade Students

Reading skills are an important component of academic success for school-age youth, and are associated with increased academic performance and positive attitudes about school. The presence of an animal appears to reduce stress during reading. Therefore, the goal of this study was to assess the feasibility and effects of a 6-week after-school canine-assisted reading program in a public elementary school setting. Second-grade students were randomized to either an intervention group (n?=?14) in which they read to a registered therapy dog for 30 min once weekly for 6 weeks or a control group (n?=?14) with a standard classroom curriculum. Children’s reading skills were assessed biweekly and attitudes about reading were assessed pre- and post-intervention. The 6-week after-school canine-assisted reading program was feasible. Reading skill scores did not change significantly for either group. Although scores on recreational reading attitudes also did not change significantly for either group, the academic reading attitudes scores increased significantly in the intervention group (p?=?.002), but not in the control group (p?=?.06). These results support the benefits of an animal-assisted intervention for child literacy on children’s attitudes about reading and can inform future programs evaluating reading programs that include dogs.     

Development of comprehension monitoring in beginner readers

The current study was designed to understand the development of comprehension monitoring among beginner readers from first to third grade, and to determine the extent to which first graders’ comprehension monitoring predicts reading comprehension in grade three. Participants were 113 children (57% female) from four US states who were followed from Grade 1 (M = 7 years, SD = 4 months) to Grade 3 (M = 9 years, SD = 4 months). Measures included decoding, vocabulary, working memory, comprehension monitoring, and reading comprehension. Children’s ability to monitor comprehension grew significantly from first to third grade, with a deceleration in growth over time. In addition, comprehension monitoring in Grade 1 made a significant contribution to reading comprehension in Grade 3, even after controlling for decoding, vocabulary, and working memory. Together, these findings supplement our understanding of young readers’ development of comprehension monitoring as well as its association with reading comprehension at a later time. Practical implications of the results in the context of providing support for higher-level language skills in beginning reading instruction are discussed.