Incorporating Ethnographic-Based Techniques to Enhance Assessments of Culturally Diverse Students' Written Exposition

This article focuses on the need to include ethnographic-based approaches in the writing assessments of culturally and linguistically diverse populations. The inclusion of such approaches can help teachers gain a deeper understanding of the complexities of learning for all students and realize how students' social and cultural lives mingle with the assessment process and with their academic learning. In Part 1 of the article, I describe an investigation of the assessment of students' informative essays using a single-method, holistic approach. English teachers rated essays written by eight ethnically diverse fifth- and sixth-grade students using an array of rhetorical and linguistic measures - including overall quality, coherence, sentence-level mechanics, and use of an organizational structure. Findings indicate that, within this paradigm of assessment, culturally and linguistically diverse students may be penalized for preferring rhetorical patterns that differ from the mainstream academic patterns rewarded in schools. In Part 2, I describe an investigation of the assessment of the same eight students' informal informative essays using a multifaceted approach, including ethnographic techniques and micro- and macrolevel text analyses. Findings suggest that the multifaceted approach provided a more accurate picture of the students' expository language resources. In the final section, I demonstrate how the ethnographic-based techniques provide illustrative evaluation data useful for forging a fit among the language resources and functions of writing for culturally and linguistically diverse students and their assessment and instructional needs.     

Powerful students,powerful words: writing and learning in a poetry workshop

A poetry workshop can present opportunities to integrate students' knowledge and perspectives in classroom contexts, encouraging the use of language for expression, communication, learning and even empowerment. This paper describes how adolescent students respond to a poetry workshop in an English classroom centred on teaching writing that is based on their knowledge from their various life experiences and understanding of events beyond the classroom. Informed by New Literacy Studies and third space theories, ethnographic methods of participant observation were used to document an eighth‐grade urban public school classroom where a community member implemented a weekly programme using music lyrics and poetry for an entire school year. Findings illustrate how the poetry workshop encouraged students to contribute to the classroom learning context and engage critically with ideas that were relevant to their lives. Collaborating with a community member and tapping in to the powerful ways of using language to communicate led to important learning opportunities for students in this classroom. Poetic devices such as rhyme, rhythm, metaphor and wordplay enhanced and supported students' own language practices; students used these sophisticated writing strategies as they worked to convey their ideas, experiences and opinions.     

Teaching Writing to Students With Attention Deficit Disorders and Specific Language Impairment

Abstract

The self-regulated strategy development approach to instruction was used to help 3 middle school students who had learning problems, including attention deficit hyperactivity disorder and specific language impairment, learn a strategy for planning and writing expository essays. The composition strategy helped students to consider their topic in advance and to use text structure knowledge to develop 5-paragraph essays. Regular education teachers provided instruction to the target students in inclusive classrooms; special education teachers facilitated the writing program. A multiple-probe design across students (R. D. Horner & D. M. Baer, 1978) was used to assess the effects of the strategy. Instruction had a positive effect on the students' approach to writing and overall writing performance. Four weeks following instruction, students' papers remained improved and were still longer and more complete.     

Building and Supporting a Validity Argument for a Standards‐Based Classroom Assessment of English Proficiency Based on Teacher Judgments

Using an argument‐based approach to validation, this study examines the quality of teacher judgments in the context of a standards‐based classroom assessment of English proficiency. Using Bachman's (2005) assessment use argument (AUA) as a framework for the investigation, this paper first articulates the claims, warrants, rebuttals, and backing needed to justify the link between teachers' scores on the English Language Development (ELD) Classroom Assessment and the interpretations made about students' language ability. Then the paper summarizes the findings of two studies—one quantitative and one qualitative—conducted to gather the necessary backing to support the warrants and, in particular, address the rebuttals about teacher judgments in the argument. The quantitative study examined the assessment in relation to another measure of the same ability—the California English Language Development Test—using confirmatory factor analysis of multitrait‐multimethod data and provided evidence in support of the warrant that states that the ELD Classroom Assessment measures English proficiency as defined by the California ELD Standards. The qualitative study examined the processes teachers engaged in while scoring the classroom assessment using verbal protocol analysis. The findings of this study serve to support the rebuttals in the validity argument that state that there are inconsistencies in teachers' scoring. The paper concludes by providing an explanation for these seemingly contradictory findings using the AUA as a framework and discusses the implications of the findings for the use of standards‐based classroom assessments based on teacher judgments.     

Role of reading engagement in mediating effects of reading comprehension instruction on reading outcomes

The engagement model of reading development suggests that instruction improves students' reading comprehension to the extent that it increases students' engagement processes in reading. We compared how Concept‐Oriented Reading Instruction (CORI) (support for cognitive and motivational processes in reading), strategy instruction (support for cognitive strategies in reading), and traditional instruction in fourth‐grade classrooms differentially influenced students' reading comprehension, strategy use, and engagement in reading. Students experiencing CORI were significantly higher than both comparison groups on reading comprehension, reading strategies, and reading engagement. When students' level of reading engagement was statistically controlled, the differences between the treatment groups were not significant. We infer that the level of students' reading engagement during classroom work mediated the instructional effects on reading outcomes. © 2008 Wiley Periodicals, Inc.     

Language teacher education in Finland and the cultural dimension of foreign language teaching – a student teacher perspective

The increasing importance attributed to the cultural dimension of FL education has entailed new demands for teachers and teacher educators. This paper explores the cultural agenda in Finnish language teacher education from a student teacher perspective. The focus is on the students' perceptions regarding how effectively cultural aspects are dealt with in their training, and how these perceptions may be affected by the length of time they have spent abroad. The empirical evidence suggests that both the language studies and the pedagogical studies tend to address cultural aspects to a small or very small extent. The main emphasis is placed on traditional aspects of culture, such as literature and Realia knowledge, and strategies for teaching language seem to overshadow strategies for teaching language and culture in an integrated way. Interestingly, the students' perceptions seem to vary depending on the extent to which they have experienced first‐hand contacts with other cultures.     

Teachers' talk on students' writing: Negotiating students' texts in interdisciplinary teacher teams

This paper examines how a team of teachers in a Norwegian upper secondary school responds to, negotiates, and evaluates students' writing in and across different disciplines. The purpose is to identify discourse strategies and professional development as the teachers discuss students' texts, and to explore how the teachers develop a shared understanding of how writing relates to students' learning. The findings show how the teachers' discourse reflects an emerging understanding of how writing is both a subject-specific and interdisciplinary skill conducive to learning, but also how institutional traditions and discipline-specific concerns together allow for and constrain teachers' learning.     

Technology-Mediated Writing Instruction in the Early Literacy Program: Perils,Procedures, and Possibilities

The purpose of this qualitative case study was to examine one kindergarten teacher's use of digital and multimodal technologies to mediate early writing instruction and explore the students' appropriation of that instruction to support their independent writing. Data sources included observations of writing instruction, as well as students' participation during independent writing time, student writing samples, and interviews with case study participants. Data were analyzed inductively using a semantic relationship analysis (Hatch, 2002). Results of the study revealed that the teacher used a range of technologies to demonstrate what it means to compose narrative texts and how young children could go about it. Students were attentive and motivated to participate in writing instruction and related activities, given their fascination with the technology and multimodal texts their teacher created. Students appropriated important concepts and strategies from their teacher's technology-mediated instruction, which they used to compose narrative texts during independent writing time.     

Signaling organization and stance: academic language use in middle grade persuasive writing

Effective academic writing is accessible to readers because writers follow shared conventions for organization and signal their stance on particular topics; however, few specifics are known about how middle graders might develop knowledge of and use these academic language forms and functions to signal their organization and stance in persuasive essays. This study examined how differences in organization and stance marker use was related to writing quality in 664 persuasive essays written by 176 sixth, seventh, and eighth grade students. Essays were collected in the context of a supplemental vocabulary program, transcribed and analyzed for length by researchers, scored for overall writing quality by a team of teachers, and then coded for markers of organization and stance by researchers. Multilevel modeling results reveal that two specific emergent organizational marker types (evidence markers and code glosses) have statistically significant negative relationships to quality, and the variety of stance markers used is a positive predictor of quality when an interaction with length is included in the model. Findings give insight into the ways students are using organization and stance markers and point toward these language forms and functions as potentially pedagogically-relevant and worth assessing.     

Why educate “little scientists?” Examining the potential of practice‐based scientific literacy

In recent years, a number of curriculum reform projects have championed the notion of having students do science in ways that move beyond hands‐on work with authentic materials and methods, or developing a conceptual grasp of current theories. These reformers have argued that students should come to an understanding of science through doing the discipline and taking a high degree of agency over investigations from start to finish. This stance has occasionally been mocked by its critics as an attempt to create “little scientists”—a mission, it is implied, that is either romantic or without purpose. Here, we make the strong case for a practice‐based scientific literacy, arguing through three related empirical studies that taking the notion of “little scientists” seriously might be more productive in achieving current standards for scientific literacy than continuing to refine ideas and techniques based on the coverage of conceptual content. Study 1 is a classroom case study that illustrates how project‐based instruction can be carried out when teachers develop guidance and support strategies to bootstrap students' participation in forms of inquiry they are still in the process of mastering. Study 2 shows how sustained on‐line work with volunteer scientists appears to influence students' success in formulating credible scientific arguments in written project reports following an authentic genre. Study 3, using data from three suburban high school classes, suggests that involving students in the formulation of research questions and data analysis strategies results in better spontaneous use of empirical data collection and analysis strategies on a transfer task. The study also suggests that failing to involve students in the formulation of research can result in a loss of agency. The implications of these findings for future research and practice are discussed. © 2004 Wiley Periodicals, Inc. J Res Sci Teach 41: 234–266, 2004     

Tutor feedback on draft essays: developing students’ academic writing and subject knowledge

Providing feedback on draft essays is an accepted means of enacting a social-constructivist approach to assessment, aligning with current views on the value of formative feedback and assessment for learning (AFL). However, the use of this process as a means of improving not only content but also students' academic writing skills has not been widely studied, despite a widespread perception that there is scope for intervention at university level. This article explores the developmental potential of a drafting/tutor feedback/redrafting process on a first-year undergraduate course for trainee English language teachers at a UK university. The aims of this small-scale, largely qualitative study were to ascertain students' perceptions of the process and to determine the extent to which the process could contribute to the development of students' academic writing. Data are derived from first and second draft essay marks and questionnaires administered to 32 students. Findings suggest that feedback on drafts is acted on and can contribute to improved work when it is timely and detailed and when it raises students' metacognitive awareness, as was the case in this project. Also noteworthy, however, are the students' perceptions that redrafting is cognitively challenging and time-consuming. Comments from a less academically confident student with regard to the quantity of feedback and its detrimental impact are of particular concern. Questions are raised regarding the use of tutor reformulation, the sustainability of AFL and the provision of feedback to – and its interpretation by – weaker students. Finally, some key indicators for improved future practice are presented.     

Composing print essays versus composing across modes: students' multimodal choices and overall preferences

The current study presents results from students' engagement of composing print essays and composing across modes on the same topic. It builds on the premise that print‐based reading and writing should complement and coexist with multimodal pedagogy. A group of Taiwanese adolescent students were invited to complete one print essay and one multimodal product on the same topic of “My favorite place in the world”. For their multimodal product, students were required to use at least two modes (e.g. words and image, sounds and words) in any medium (e.g. video, collage, scrapbook or website) of their choice. It was found that the most frequently used medium for students' multimodal projects was video which incorporated words, sounds and visuals. Most students felt that for the topic of “My favorite place in the world”, their multimodal products helped them to convey their ideas better because they provided the audience with more sensory information. To conclude the paper, a few future research directions are outlined to help move the research of multimodal composing forward.     

Impact of the National Writing Project's College-Ready Writers Program in High-Need Rural Districts

By 2013, all 50 states and the District of Columbia had adopted college- and career-ready standards in English language arts and mathematics, placing a greater emphasis on argument writing to prepare students for life after high school. Solving the specific problem of how to help teachers teach to new standards for argument writing as well as the broader problem of improving teaching and learning requires continued efforts to understand how to support teachers in making substantial changes in instruction. This paper reports on a district-randomized controlled trial of the National Writing Project's College-Ready Writers Program (CRWP), implemented in high-need rural districts in 10 states, testing one instance of professional development paired with supporting curricular resources and a formative assessment tool designed to shift instruction to align with the new college- and career-ready standards in English language arts classes in Grades 7–10. Researchers randomly assigned 44 rural districts either to receive two years of CRWP or to be in a business-as-usual control group and found positive impacts on teacher practice and student source-based argument writing.     

How teachers respond to concerns about misbehavior in their classroom

The present study examined kindergarten to Year Two teachers' responses to concern about classroom misbehavior in terms of (a) support they access, (b) strategies they use, and (c) information they require to more effectively deal with misbehavior. The extent to which teachers' confidence in behavior management mediated the relationship between students' misbehavior and a, b, and c was also examined. Results indicated that concern about their students' misbehavior was negatively associated with teachers' confidence. Concern about misbehavior was positively associated with the use of school‐based support. Concern about misbehavior was positively associated with the use of non‐physical punishment and referral of the student to other school personnel. In relation to information needs, concern about students' misbehavior was most strongly associated with the need for specific information on how to deal with misbehavior and, to a lesser extent, associated with the need for positively‐focused and teacher‐focused information. Teachers' confidence mediated the relationship between misbehavior concerns and the tendency to refer the child to other school personnel. © 1999 John Wiley & Sons, Inc.     

Elementary students' views of explanation,argumentation, and evidence,and their abilities to construct arguments over the school year

Science includes more than just concepts and facts, but also encompasses scientific ways of thinking and reasoning. Students' cultural and linguistic backgrounds influence the knowledge they bring to the classroom, which impacts their degree of comfort with scientific practices. Consequently, the goal of this study was to investigate 5th grade students' views of explanation, argument, and evidence across three contexts—what scientists do, what happens in science classrooms, and what happens in everyday life. The study also focused on how students' abilities to engage in one practice, argumentation, changed over the school year. Multiple data sources were analyzed: pre‐ and post‐student interviews, videotapes of classroom instruction, and student writing. The results from the beginning of the school year suggest that students' views of explanation, argument, and evidence, varied across the three contexts with students most likely to respond “I don't know” when talking about their science classroom. Students had resources to draw from both in their everyday knowledge and knowledge of scientists, but were unclear how to use those resources in their science classroom. Students' understandings of explanation, argument, and evidence for scientists and for science class changed over the course of the school year, while their everyday meanings remained more constant. This suggests that instruction can support students in developing stronger understanding of these scientific practices, while still maintaining distinct understandings for their everyday lives. Finally, the students wrote stronger scientific arguments by the end of the school year in terms of the structure of an argument, though the accuracy, appropriateness, and sufficiency of the arguments varied depending on the specific learning or assessment task. This indicates that elementary students are able to write scientific arguments, yet they need support to apply this practice to new and more complex contexts and content areas. © 2011 Wiley Periodicals, Inc. J Res Sci Teach 48: 793–823, 2011     

Reification of instructional materials as part of the process of developing problem‐based practices in mathematics education

This teacher development study closely examined a teacher's practice for the purpose of understanding how she selected and implemented instructional materials, and correspondingly how these processes changed as she developed her problem‐based practice throughout a school year. Data sources included over 20 hours of planning and analysis meetings with the teacher and 27 video‐taped lessons with discussions before and after each lesson. Through qualitative analysis we examined the data for: students' cognitive demand for curricular materials the teacher selected and implemented; teacher's beliefs and practices for students' engagement in mathematical thinking; and teacher's and students' communication about mathematics during instruction. We found that the teacher shifted her views and use of instructional materials as she changed her practice towards more problem‐based approaches. The teacher moved from closely following her traditional, district‐adopted textbook to selecting problem‐based tasks from outside resources to build a curriculum. Simultaneously, she changed her practice to focus more on students' engagement in mathematical thinking and their communication about mathematics as part of learning. During this shift in practice, the teacher began to reify instructional materials, viewing them as instruments of her practice to meet students' needs. The process of shifting her views was gradual over the school year and involved substantial analysis and reflection on practice from the teacher. Implications include that teachers and teacher educators may need to devote more attention and support for teachers to use instructional materials to support instruction, rather than materials to prescribe instruction. This use of instructional materials may be an important part of transforming practice overall.     

Exploring teachers' informal formative assessment practices and students' understanding in the context of scientific inquiry

This study explores teachers' informal formative assessment practices in three middle school science classrooms. We present a model for examining these practices based on three components of formative assessment (e liciting, r ecognizing, and u sing information) and the three domains linked to scientific inquiry (epistemic frameworks, conceptual structures, and social processes). We describe the informal assessment practices as ESRU cycles—the teacher E licits a question; the S tudent responds; the teacher R ecognizes the student's response; and then U ses the information collected to support student learning. By tracking the strategies teachers used in terms of ESRU cycles, we were able to capture differences in assessment practices across the three teachers during the implementation of four investigations of a physical science unit on buoyancy. Furthermore, based on information collected in a three‐question embedded assessment administered to assess students' learning, we linked students' level of performance to the teachers' informal assessment practices. We found that the teacher who more frequently used complete ESRU cycles had students with higher performance on the embedded assessment as compared with the other two teachers. We conclude that the ESRU model is a useful way of capturing differences in teachers' informal assessment practices. Furthermore, the study suggests that effective informal formative assessment practices may be associated with student learning in scientific inquiry classrooms. © 2006 Wiley Periodicals, Inc. J Res Sci Teach     

Teachers' framing of argumentation goals: Working together to develop individual versus communal understanding

For students to meaningfully engage in science practices, substantive changes need to occur to deeply entrenched instructional approaches, particularly those related to classroom discourse. Because teachers are critical in establishing how students are permitted to interact in the classroom, it is imperative to examine their role in fostering learning environments in which students carry out science practices. This study explores how teachers describe, or frame, expectations for classroom discussions pertaining to the science practice of argumentation. Specifically, we use the theoretical lens of a participation framework to examine how teachers emphasize particular actions and goals for their students' argumentation. Multiple-case study methodology was used to explore the relationship between two middle school teachers' framing for argumentation, and their students' engagement in an argumentation discussion. Findings revealed that, through talk moves and physical actions, both teachers emphasized the importance of students driving the argumentation and interacting with peers, resulting in students engaging in various types of dialogic interactions. However, variation in the two teachers' language highlighted different purposes for students to do so. One teacher explained that through these interactions, students could learn from peers, which could result in each individual student revising their original argument. The other teacher articulated that by working with peers and sharing ideas, classroom members would develop a communal understanding. These distinct goals aligned with different patterns in students' argumentation discussion, particularly in relation to students building on each other's ideas, which occurred more frequently in the classroom focused on communal understanding. The findings suggest the need to continue supporting teachers in developing and using rich instructional strategies to help students with dialogic interactions related to argumentation. This work also sheds light on the importance of how teachers frame the goals for student engagement in this science practice.     

Skill and will: The role of motivation and cognition in the learning of college chemistry

This study investigated how students' level of motivation and use of specific cognitive and self-regulatory strategies changed over time, and how these motivational and cognitive components in turn predicted students' course performance in chemistry. Participants were 458 students enrolled in introductory college chemistry classes. Participants' motivation and strategy use were assessed at three time points over the course of one semester using self-report instruments. Results showed an overall decline in students' motivational levels over time. There was also a decline in students' use of rehearsal and elaboration strategies over time; students' use of organizational and self-regulatory strategies increased over time. These trends, however, were found to vary by students' achievement levels. In terms of the relations of motivation and cognition to achievement, the motivational components of self-efficacy and task value were found to be the best predictors of final course performance even after controlling for prior achievement.