Elementary teachers’ use of content knowledge to evaluate students’ thinking in the life sciences

Science learning environments should provide opportunities for students to make sense of and enhance their understanding of disciplinary concepts. Teachers can support students’ sense-making by engaging and responding to their ideas through high-leverage instructional practices such as formative assessment (FA). However, past research has shown that teachers may not understand FA, how to implement it, or have sufficient content knowledge to use it effectively. Few studies have investigated how teachers gather information to evaluate students’ ideas or how content knowledge factors into those decisions, particularly within the life science discipline. We designed a study embedded in a multi-year professional development program that supported elementary teachers’ development of disciplinary knowledge and FA practices within science instruction. Study findings illustrate how elementary teachers’ life science content knowledge influences their evaluation of students’ ideas. Teachers with higher levels of life science content knowledge more effectively evaluated students’ ideas than teachers with lower levels of content knowledge. Teachers with higher content exam scores discussed both content and student understanding to a greater extent, and their analyses of students’ ideas were more scientifically accurate compared to teachers with lower scores. These findings contribute to theory and practice around science teacher education, professional development, and curriculum development.     

Threats to the validity of science performance assessments for English language learners

In recent years, at the same time that performance assessments in science have become more popular, the number of English language learners (ELLs) (i.e., students whose native language is other than English) served by the U.S. educational system has also increased rapidly. While the research base is growing in each of these areas independently, little attention has been paid to their intersection. This case study of the use of a science performance assessment with 96 ELLs in five high school science classes investigated the face, construct, and consequential validity of this intersection. Qualitative and quantitative data analyses showed that both teachers and students had an overall favorable response to the assessment, although students' English comprehension and expression skills were determining factors for certain items. While most responses were reliably scored, ELL spelling and syntax on certain responses were significant sources of error. The degree of specificity of teachers' guidance also significantly affected students' scores. Recommendations from this study include increasing the clarity of an assessment's design, allowing ELLs more time to complete assessments, and scoring by raters who are knowledgeable about typical patterns in written English for this student population. Furthermore, it is recommended that the use of performance assessments with ELLs be exploratory until such time as their validity and reliability with this population can be more adequately established. J Res Sci Teach 34: 721–743, 1997.     

Student explanations of their science teachers’ assessments,grading practices and how they learn science

The current paper draws on data generated through group interviews with students who were involved in a larger ethnographic research project performed in three science classrooms. The purpose of the study from which this data was generated, was to understand science teachers’ assessment practices in an upper-secondary school in Sweden. During group interviews students were asked about their conceptions of what were the assessment priority of teachers, why the students were silent during lecturing and their experiences regarding peer- and self-assessments. The research design and analysis of the findings derives from what students told us about their assessments and learning sciences experiences. Students related that besides the results of the written test, they do not know what else teachers assessed and used to determine their grades. It was also found that students did not participate in the discussion on science because of peer-pressure and a fear of disappointing their peers. Student silence is also linked with student conceptions of science learning and student experiences with methodologies of teaching and learning sciences.     

Korean Students' Perceptions of Scientific Practices and Understanding of Nature of Science

Korean students have shown relatively little interest and confidence in learning science, despite being ranked in the top percentile in international evaluations of academic achievement in science such as the Trends in International Mathematics and Science Study. Although research indicates a positive relationship between student perceptions of science and their science learning, this area has not been sufficiently explored in Korea. Particularly, even though both students' perceptions of scientific practice and their understanding of the nature of science (NOS) are influenced by their science learning experiences at schools, little research examines how this perception, understanding, and experience are related to one another. This study aimed to uncover Korean students' perceptions of school scientific practice through exploring their drawings, writings, and responses to questionnaires. Participants were 500 Korean students in 3rd, 7th, and 10th grades who were asked to complete an open-ended questionnaire. The results indicated that Korean students typically viewed school scientific practices as experimental activities or listening to lecture; and that most participants held an insufficient understanding of the NOS. Overall, no significant relationship emerged between students' perceptions of school scientific practice and their understanding of the NOS. Our findings highlight the need to help both teachers and students understand the potential breadth of school scientific practices, beyond simple ‘activity mania.’ This study also suggests that teachers must balance implicit and explicit instructional approaches to teaching about the NOS through scientific practices in school science contexts.     

Exploring pre-service science teachers’ pedagogical capacity for formative assessment through analyses of student answers

Background: There has been an increasing emphasis on empowering pre-service and in-service science teachers to attend student reasoning and use formative assessments to guide student learning in recent years. Purpose: The purpose of this study was to explore pre-service science teachers’ pedagogical capacity for formative assessment. Sample: This study took place in Turkey. The participants include 53 pre-service science teachers in their final year of schooling. All but two of the participants are female. Design and methods: We used a mixed-methods methodology in pursing this inquiry. Participants analyzed 28 responses to seven two-tiered questions given by four students of different ability levels. We explored their ability to identify the strengths and weaknesses in students’ answers. We paid particular attention to the things that the pre-service science teachers noticed in students’ explanations, the types of inferences they made about students’ conceptual understanding, and the affordances of pedagogical decisions they made. Results: The results show that the majority of participants made an evaluative judgment (i.e. the answer is correct or incorrect) in their analyses of students’ answers. Similarly, the majority of the participants recognized the type of mistake that the students made. However, they failed to successfully elaborate on fallacies, limitations, or strengths in student reasoning. We also asked the participants to make pedagogical decisions related to what needs to be done next in order to help the students to achieve academic objectives. Results show that 8% of the recommended instructional strategies were of no affordance, 64% of low-affordance, and 28% were of high affordance in terms of helping students achieve the academic objectives. Conclusion: If our goal is to improve pre-service science teachers’ noticing skills, and the affordance of feedback that they provide, engaging them in activities that asks them to attend to students’ ideas and reasoning may be useful.     

An Investigation of Students’ Personality Traits and Attitudes toward Science

The purposes of this study were to validate an instrument of attitudes toward science and to investigate grade level, type of school, and gender differences in Taiwan’s students’ personality traits and attitudes toward science as well as predictors of attitudes toward science. Nine hundred and twenty‐two elementary students and 1,954 secondary students completed the School Student Questionnaire in 2008. Factor analyses, correlation analyses, ANOVAs, and regressions were used to compare the similarities and differences among male and female students in different grade levels. The findings were as follows: female students had higher interest in science and made more contributions in teams than their male counterparts across all grade levels. As students advanced through school, student scores on the personality trait scales of Conscientiousness and Openness sharply declined; students’ scores on Neuroticism dramatically increased. Elementary school and academic high school students had significantly higher total scores on interest in science than those of vocational high and junior high school students. Scores on the scales measuring the traits of Agreeableness, Extraversion, and Conscientiousness were the most significant predictors of students’ attitudes toward science. Implications of these findings for classroom instruction are discussed.     

Multi‐level Assessment of Scientific Content Knowledge Gains Associated with Socioscientific Issues‐based Instruction

This study explored the impact of using a socioscientific issue (SSI) based curriculum on developing science content knowledge. Using a multi‐level assessment design, student content knowledge gains were measured before and after implementation of a three‐week unit on global warming (a prominent SSI) that explored both the relevant science content and the controversy surrounding global warming. Measures of student content knowledge were made using a standards‐aligned content knowledge exam (distal assessment) and a curriculum‐aligned exam (proximal assessment). Data were collected from 108 students enrolled from two schools. Quantitative analysis of the distal assessment indicated that student post‐test scores were statistically significantly different than their pre‐test scores (F = 15.31, p<0.001). Qualitative analyses of student responses from the proximal assessment indicated that students, on average, expressed more accurate, more detailed, and more sophisticated understandings of global warming, the greenhouse effect, and the controversy and challenges associated with these issues following the three‐week unit. Combined results from the proximal and distal assessments explored in this study offer important evidence in supporting the efficacy of using SSI as contexts for science education. In addition to a discussion of the components of an SSI‐based curriculum, this study provides support for the use of SSI as a context for learning science content.     

Science Teachers’ Use of a Concept Map Marking Guide as a Formative Assessment Tool for the Concept of Energy

In this study, we investigated the value of a concept map marking guide as an alternative formative assessment tool for science teachers to adopt for the topic of energy. Eight high school science teachers marked students’ concept maps using an itemized holistic marking guide. Their marking was compared with the researchers’ marking and the scores of a multiple-choice diagnostic test. Statistical analysis revealed that teachers evaluated students’ concept maps consistently, but the concept map scores were only mildly correlated with the multiple-choice test scores. We explored what each assessment method revealed in terms of students’ understanding with one student’s performance as a showcase. Teachers’ views on using the marking guide of concept maps as an assessment tool were also included. We discuss the value of the concept map marking guide as a formative assessment tool for science teachers to create and modify in order to encourage students’ conceptual learning.     

Information literacy in science writing: how students find,identify, and use scientific literature

For undergraduate students to achieve science literacy, they must first develop information literacy skils. These skills align with Information Literacy Standards and include determining appropriate databases, distinguishing among resource types, and citing resources ethically. To effectively improve information literacy and science literacy, we must identify how students interact with authentic scientific texts. In this case study, we addressed this aim by embedding a science librarian into a science writing course, where students wrote a literature review on a research topic of their choice. Library instruction was further integrated through the use of an online guide and outside assistance. To evaluate the evolution of information literacy in our students and provide evidence of student practices, we used task-scaffolded writing assessments, a reflection, and surveys. We found that students improved their ability and confidence in finding research articles using discipline-specific databases as well as their ability to distinguish primary from secondary research articles. We also identified ways students improperly used and cited resources in their writing assignments. While our results reveal a better understanding of how students find and approach scientific research articles, additional research is needed to develop effective strategies to improve long-term information literacy in the sciences.     

Strategies that challenge: exploring the use of differentiated assessment to challenge high-achieving students in large enrolment undergraduate cohorts

Academics teaching large and highly diverse classes are familiar with the inevitable effect this has on promulgating teaching and assessment practices to ‘middle of the distribution’, thus ignoring the distribution extremes. Although the literature documents a wide range of strategies for supporting poor-performing students in large class settings, very little work has been reported on catering for more capable students who may feel frustrated and poorly challenged in such settings. This paper reports on the introduction of alternative assessment tasks into two first-year science units of study, with the aim of providing more challenging learning opportunities for high-performing students. It analyses student engagement with and perception of alternative assessment, and concludes that such opportunities are well received by students, even when no additional marks are available nor special credit recognition given for completing an advanced task.     

Using cogenerative dialogues to improve coteaching for language learner (LL) students in an inclusion science classroom

This paper presents findings from a study conducted in an urban elementary school in the United States with an English language learner (ELL) student and two teachers engaged in collaborative teaching in an inclusion science classroom. This study examines the efficacy of utilising cogenerative dialogues between an ELL student and his science teacher and English as second language teacher to improve instructional practices enacted during coteaching. Drawing from field notes, teacher and student interviews, and video captured during cotaught science lessons and during cogenerative dialogues between the student and his coteachers, we examined the ways in which cogenerative dialogue expands teachers’ agency to adapt curriculum and implement instructional strategies that can better meet the needs of their students. At the same time, we examined the ways in which participation in cogenerative dialogues with his teachers expanded this student’s agency as a science learner and a language learner.     

Using Educative Assessments to Support Science Teaching for Middle School English-language Learners

Grounded in Hallidayan perspectives on academic language, we report on our development of an educative science assessment as one component of the language-rich inquiry science for English-language learners teacher professional learning project for middle school science teachers. The project emphasizes the role of content-area writing to support teachers in diagnosing their students’ emergent understandings of science inquiry practices, science content knowledge, and the academic language of science, with a particular focus on the needs of English-language learners. In our current school policy context, writing for meaningful purposes has received decreased attention as teachers struggle to cover large numbers of discrete content standards. Additionally, high-stakes assessments presented in multiple-choice format have become the definitive measure of student science learning, further de-emphasizing the value of academic writing for developing and expressing understanding. To counter these trends, we examine the implementation of educative assessment materials—writing-rich assessments designed to support teachers’ instructional decision making. We report on the qualities of our educative assessment that supported teachers in diagnosing their students’ emergent understandings, and how teacher–researcher collaborative scoring sessions and interpretation of assessment results led to changes in teachers’ instructional decision making to better support students in expressing their scientific understandings. We conclude with implications of this work for theory, research, and practice.     

Teachers’ use of educative curriculum materials to engage students in science practices

New reform documents underscore the importance of integrating science practices into the learning of science. This integration requires sophisticated teaching that does not often happen. Educative curriculum materials – materials explicitly designed to support teacher and student learning – have been posited as a way to support teachers to achieve these ambitious goals, yet little is known about how elementary teachers actually use educative curriculum materials to support student engagement in science practices. To address this gap, this study investigated how five upper elementary teachers supported students to engage in science practices during an enactment of two curriculum units. Three of the teachers had units enhanced with educative features, informed by current research and reforms, while two of the teachers had units without these features. The teachers varied in how they supported students in the science practices of justifying predictions, constructing evidence-based claims, recording observations, and planning investigations. For example, some of the teachers with the educative features supported students in constructing evidence-based claims and justifying predictions in ways called for by the educative features. Implications for curriculum developers and teacher educators are discussed based on the patterns found in the teachers’ use of the educative curriculum materials.     

Explanation-Construction in Fourth-Grade Classrooms in Germany and the USA: A cross-national comparative video study

To help explain the differences in students' performance on internationally administered science assessments, cross-national, video-based observational studies have been advocated, but none have yet been conducted at the elementary level for science. The USA and Germany are two countries with large formal education systems whose students underperform those from peers on internationally administered standardized science assessments. However, evidence from the 2011 Trends in International Mathematics and Science Exam assessment suggests fourth-grade students (9–10 year-olds) in the USA perform higher than those in Germany, despite more instructional time devoted to elementary science in Germany. The purpose of this study is to comparatively analyze fourth-grade classroom science in both countries to learn more about how teachers and students engage in scientific inquiry, particularly explanation-construction. Videorecordings of US and German science instruction (n _1?=?42, n _2?=?42) were sampled from existing datasets and analyzed both qualitatively and quantitatively. Despite German science lessons being, on average, twice as long as those in the USA, study findings highlight many similarities between elementary science in terms of scientific practices and features of scientific inquiry. However, they also illustrate crucial differences around the scientific practice of explanation-construction. While students in German classrooms were afforded more substantial opportunities to formulate evidence-based explanations, US classrooms were more strongly characterized by opportunities for students to actively compare and evaluate evidence-based explanations. These factors may begin to help account for observed differences in student achievement and merit further study grounded in international collaboration.     

‘Being an artist you kind of,I mean,you get used to excellence’: Identity,Values and Fine Art Assessment Practices

In this article I report on a study into fine art lecturers’ assessment practices in higher education. This study explores the ways that lecturers bring themselves into the act of assessment (Hand & Clewes 2000). I interviewed twelve fine art lecturers who worked across six English universities. Lecturers were asked to relate to me how they learnt to assess student artwork and what informed their judgement making. My research explores the interfaces between fine art lecturers’ assessment practices, their values and identity/ies. My analysis offers a rendering of the ways that values underpin lecturers’ assessment practices. The article explores the ways that lecturers’ assessment decisions relate to their experiences as ex art students, their identity as artists, their own artistic practices, their conceptualisation of the arts arenas and the HE sector. My key overarching argument is that identity/ies and values underpin and enrich fine art lecturers’ assessment practices.     

Why Students Answer TIMSS Science Test Items the Way They Do

The purpose of this study was to explore how Year 8 students answered Third International Mathematics and Science Study (TIMSS) questions and whether the test questions represented the scientific understanding of these students. One hundred and seventy-seven students were tested using written test questions taken from the science test used in the Third International Mathematics and Science Study. The degree to which a sample of 38 children represented their understanding of the topics in a written test compared to the level of understanding that could be elicited by an interview is presented in this paper. In exploring student responses in the interview situation this study hoped to gain some insight into the science knowledge that students held and whether or not the test items had been able to elicit this knowledge successfully. We question the usefulness and quality of data from large-scale summative assessments on their own to represent student scientific understanding and conclude that large scale written test items, such as TIMSS, on their own are not a valid way of exploring students' understanding of scientific concepts. Considerable caution is therefore needed in exploiting the outcomes of international achievement testing when considering educational policy changes or using TIMSS data on their own to represent student understanding.     

Relationship between Science Teaching Practices and Students’ Achievement in Singapore,Chinese Taipei,and the US: An Analysis Using TIMSS 2011 Data

The assumption that inquiry-based instruction is more effective in influencing student science achievement than traditional didactic teaching has been the driving force of science education reform in recent decades and in many countries. However, the empirical relationship between these two kinds of science teaching and student science performance is not soundly established, which is worth a careful examination. Framed through the theoretical perspectives of inquiry-based instruction and culturally relevant pedagogy, using a two-level hierarchical linear modeling (HLM) approach and simultaneous multiple regression, this study examines the above relationship using the Trends in International Mathematics and Science Study (TIMSS) 2011 8th grade dataset from Singapore, Chinese Taipei, and the US. The study found that for the low-performing students, none of the inquiry-based teaching practice items measured had a significant relationship with the science achievements at any performance levels of students in any country/region except for the case of two inquiry-based teaching practice items that were positively related to Chinese Taipei students’ achievements. No didactic teaching practice items were associated with the Singapore students’ science achievement, three of these practice items were found negatively related to Chinese Taipei students’ science achievement, and one traditional didactic teaching practice was negatively related to the science achievement of U.S. students. However, for medium- and high-performing students, none of these inquiry-based or traditional didactic science-teaching practices were found to be positive predictors of science performance in all three countries/regions. However, in the case of Chinese Taipei, one didactic teaching practice item was negatively related with the medium level performing students’ achievement and two didactic teaching practices were found to hinder high-performing students’ science achievements.     

Enhancing Digital Simulated Laboratory Assessments: a Test of Pre-Laboratory Activities with the Learning Error and Formative Feedback Model

Digitally simulated laboratory assessments (DSLAs) may be used to measure competencies such as problem solving and scientific inquiry because they provide an environment that allows the process of learning to be captured. These assessments provide many benefits that are superior to traditional hands-on laboratory tasks; as such, it is important to investigate different ways to maximize the potential of DSLAs in increasing student learning. This study investigated two enhancements—a pre-laboratory activity (PLA) and a learning error intervention (LEI)—that are hypothesized to enhance the use of DSLAs as an educational tool. The results indicate students who were administered the PLA reported statistically lower levels of test anxiety when compared to their peers who did not receive the activity. Furthermore, students who received the LEI scored statistically higher scores on the more difficult problems administered during and after the DSLA. These findings provide preliminary evidence that both a PLA and LEI may be beneficial in improving students’ performance on a DSLA. Understanding the benefits of these enhancements may help educators better utilize DSLAs in the classroom to improve student science achievement.

     

Examining Factors Affecting Science Achievement of Hong Kong in PISA 2006 Using Hierarchical Linear Modeling

This study uses hierarchical linear modeling to examine the influence of a range of factors on the science performances of Hong Kong students in PISA 2006. Hong Kong has been consistently ranked highly in international science assessments, such as Programme for International Student Assessment and Trends in International Mathematics and Science Study; therefore, an exploration of the factors that affect science performances of Hong Kong students can give a lens to examine how science education can be improved in Hong Kong and other countries. The analyses reveal that student backgrounds as male, at higher grade levels, and born in mainland (when in the same grade) are associated with better science performance. Among the attitudinal factors, enjoyment of science and self-efficacy in science play important roles in scientific achievements. Most of the parental factors, on the other hand, are not having significant impacts on achievement after student attitudes are taken into account, with only parents’ value of science having a small effect. School student intake is found to be a strong predictor of school average achievement, as well as a major mediator of the effects of school enrollment size and school socio-economic status. The findings differ from recently reported results, which suggested that school enrollment size was associated with achievement. This study also points out the problems of the use of science instruction time as a school-level variable to explain science achievement in Hong Kong.     

The Effect of Linguistic Simplification of Science Test Items on Score Comparability

The use of accommodations has been widely proposed as a means of including English language learners (ELLs) or limited English proficient (LEP) students in state and districtwide assessments. However, very little experimental research has been done on specific accommodations to determine whether these pose a threat to score comparability. This study examined the effects of linguistic simplification of 4th- and 6th-grade science test items on a state assessment. At each grade level, 4 experimental 10-item testlets were included on operational forms of a statewide science assessment. Two testlets contained regular field-test items, but in a linguistically simplified condition. The testlets were randomly assigned to LEP and non-LEP students through the spiraling of test booklets. For non-LEP students, in 4 t-test analyses of the differences in means for each corresponding testlet, 3 of the mean score comparisons were not significantly different, and the 4th showed the regular version to be slightly easier than the simplified version. Analysis of variance (ANOVA), followed by pairwise comparisons of the testlets, showed no significant differences in the scores of non-LEP students across the 2 item types. Among the 40 items administered in both regular and simplified format, item difficulty did not vary consistently in favor of either format. Qualitative analyses of items that displayed significant differences in p values were not informative, because the differences were typically very small. For LEP students, there was 1 significant difference in student means, and it favored the regular version. However, because the study was conducted in a state with a small number of LEP students, the analyses of LEP student responses lacked statistical power. The results of this study show that linguistic simplification is not helpful to monolingual English-speaking students who receive the accommodation. Therefore, the results provide evidence that linguistic simplification is not a threat to the comparability of scores of LEP and monolingual English-speaking students when offered as an accommodation to LEP students. The study findings may also have implications for the use of linguistic simplification accommodations in science assessments in other states and in content areas other than science.