Teacher use of evidence to customize inquiry science instruction

This study investigated how professional development featuring evidence‐based customization of technology‐enhanced curriculum projects can improve inquiry science teaching and student knowledge integration in earth science. Participants included three middle school sixth‐grade teachers and their classes of students (N = 787) for three consecutive years. Teachers used evidence from their student work to revise the curriculum projects and rethink their teaching strategies. Data were collected through teacher interviews, written reflections, classroom observations, curriculum artifacts, and student assessments. Results suggest that the detailed information about the learning activities of students provided by the assessments embedded in the online curriculum motivated curricular and pedagogical customizations that resulted in both teacher and student learning. Customizations initiated by teachers included revisions of embedded questions, additions of hands‐on investigations, and modifications of teaching strategies. Student performance improved across the three cohorts of students with each year of instructional customization. Coupling evidence from student work with revisions of curriculum and instruction has promise for strengthening professional development and improving science learning. © 2010 Wiley Periodicals, Inc. J Res Sci Teach 47: 1037–1063, 2010     

Technology-based assessment in science: Issues underlying teacher advocacy of testing policy

The theme of this article is that the development of informed teacher advocacy for new advancements in technology-based assessment is an essential requirement if such advancements are to contribute toward the systemic improvement of the quality of school science instruction. The potential for advocacy involvement by teachers is considered a natural reaction toward the increasing tendency for classroom practices to be affected by local, state, or national assessment policy initiatives. In support of such an advocacy process, this article provides an awareness of the principles of good measurement practices in conjunction with the qualitative characteristics of technology-based assessment that together are sufficient to serve as a foundation for teachers whose concerns may motivate them to raise relevant questions regarding assessment policy. Based upon such implied standards of testing practice, the article suggests key evaluative questions for teachers to ask about any forms of science assessment that would have the effect of amplifying the potential value of new technology-based forms of assessment applications to enhance ongoing classroom processes of science teaching.     

The Benefits of Fixed Item Parameter Calibration for Parameter Accuracy in Small Sample Situations in Large‐Scale Assessments

Large‐scale assessments such as the Programme for International Student Assessment (PISA) have field trials where new survey features are tested for utility in the main survey. Because of resource constraints, there is a trade‐off between how much of the sample can be used to test new survey features and how much can be used for the initial item response theory (IRT) scaling. Utilizing real assessment data of the PISA 2015 Science assessment, this article demonstrates that using fixed item parameter calibration (FIPC) in the field trial yields stable item parameter estimates in the initial IRT scaling for samples as small as n = 250 per country. Moreover, the results indicate that for the recovery of the county‐specific latent trait distributions, the estimates of the trend items (i.e., the information introduced into the calibration) are crucial. Thus, concerning the country‐level sample size of n = 1,950 currently used in the PISA field trial, FIPC is useful for increasing the number of survey features that can be examined during the field trial without the need to increase the total sample size. This enables international large‐scale assessments such as PISA to keep up with state‐of‐the‐art developments regarding assessment frameworks, psychometric models, and delivery platform capabilities.     

Articulating the validity evidence for a science alternate assessment

Students with the most significant cognitive disabilities (SCD) are the 1% of the total student population who have a disability or multiple disabilities that significantly impact intellectual functioning and adaptive behaviors and who require individualized instruction and substantial supports. Historically, these students have received little instruction in science and the science assessments they have participated in have not included age‐appropriate science content. Guided by a theory of action for a new assessment system, an eight‐state consortium developed multidimensional alternate content standards and alternate assessments in science for students in three grade bands (3–5, 6–8, 9–12) that are linked to the Next Generation Science Standards (NGSS Lead States, 2013 ) and A Framework for K‐12 Science Education (Framework; National Research Council, 2012 ). The great variability within the population of students with SCD necessitates variability in the assessment content, which creates inherent challenges in establishing technical quality. To address this issue, a primary feature of this assessment system is the use of hypothetical cognitive models to provide a structure for variability in assessed content. System features and subsequent validity studies were guided by a theory of action that explains how the proposed claims about score interpretation and use depend on specific assumptions about the assessment, as well as precursors to the assessment. This paper describes evidence for the main claim that test scores represent what students know and can do. We present validity evidence for the assumptions about the assessment and its precursors, related to this main claim. The assessment was administered to over 21,000 students in eight states in 2015–2016. We present selected evidence from system components, procedural evidence, and validity studies. We evaluate the validity argument and demonstrate how it supports the claim about score interpretation and use.     

An investigation of experienced secondary science teachers' beliefs about inquiry: An examination of competing belief sets

The purpose of this study was to investigate the beliefs of six experienced high school science teachers about (1) what is successful science learning; (2) what are the purposes of laboratory in science teaching; and (3) how inquiry is implemented in the classroom. An interpretive multiple case study with an ethnographic orientation was used. The teachers' beliefs about successful science learning were substantively linked to their beliefs about laboratory and inquiry implementation. For example, two teachers who believed that successful science learning was deep conceptual understanding, used verification labs primarily to illustrate these concepts and used inquiry as a type of isolated problem‐solving experience. Another teacher who believed that successful science learning was enculturation into scientific practices used inquiry‐based labs extensively to teach the practices of science. Tension in competing beliefs sets and implications for reform are discussed. ? 2004 Wiley Periodicals, Inc. J Res Sci Teach 41: 936‐960, 2004.     

Implementing curriculum-embedded formative assessment in primary school science classrooms

The implementation of formative assessment strategies is challenging for teachers. We evaluated teachers’ implementation fidelity of a curriculum-embedded formative assessment programme for primary school science education, investigating both material-supported, direct application and subsequent transfer. Furthermore, the relationship between implementation fidelity and teacher variables was explored. N = 17 German primary school teachers participated in professional development on formative assessment, N = 11 teachers formed a control group. Teachers’ implementation fidelity was evaluated via classroom observations student ratings and an analysis of students’ workbooks, focusing on the frequency and quality of intended formative assessment elements (assessments, feedback and instructional adaptations). Regarding direct application, treatment group teachers’ implementation fidelity was high, with slight variations in quality. Regarding transfer, implementation fidelity was lower but teachers still implemented more formative assessment elements than the control group. Teachers’ pedagogical content knowledge and their evaluation of the formative assessment intervention were associated with implementation success.     

Welche Rolle spielt Kompetenzdiagnostik im Rahmen von Lehr-Lernprozessen?

Competence assessment can support evidence-based teaching and learning. Depending on its specific purpose, competence assessment can be applied at the individual, the classroom or school level as well as on a national level. Large-scale-assessments are typical examples for system monitoring. Competence assessment on the individual level can provide important information with respect to individual qualification and learning outcomes. Typically, competence assessment uses psychometric models from Item-Response-Theory (IRT). However, until present, competence assessment still struggles to tap its full potential regarding feedback and individual support. Teachers often have difficulties to interpret results from competence assessments that are based on IRT. Thus, it is crucial to support teachers in using these results to improve classroom teaching. One of the main challenges of educational measurement is to align everyday classroom teaching with formative and summative assessments and to establish competence models as a common ground. Process-orientated, formative assessment can inform criterion-based feedback and, consequently, promote teaching on the basis of educational standards that were defined on the system level. However, more work needs to be done with respect to research on assessments as well as their communication and implementation into teaching practice.     

The Assessment of Mathematics and Science Teacher Quality

The purpose of this study was to examine the types of instruments being used to document mathematics and science teacher quality characteristics in 48 nationally funded mathematics and science education awards. Each of the 48 projects operationalized teacher quality and determined how to assess it. The main research questions examined the instruments awardees used to gather data on mathematics and science teacher quality, and the main characteristics of teachers examined by awardees. Results showed that awardees most frequently used surveys or questionnaires to assess characteristics of mathematics and science teacher quality. The most common teacher characteristics examined by awardees' included teacher behaviors, practices, and beliefs, followed by the assessment of subject and pedagogical knowledge, and the documentation of mathematics and science teachers' certification. A few new instruments were under development and in use to assess characteristics of teacher quality. Detailed information on the development and psychometric properties of the instruments used for these examinations was not available from the reports. Because awardees were at different stages in their funded activities and data collection efforts were ongoing at the time of this analysis, this study offers a preliminary and formative review of the use of assessments to document mathematics and science teacher quality characteristics among these awards.     

Scaffolding Science Teachers in Open‐inquiry Teaching

The present study deals with a school‐based professional development trajectory for secondary science teachers, aiming at scaffolding teachers in open‐inquiry teaching for the topic of water quality. Its design was based on the leading principle of ‘guiding by scaffolding’. Seven experienced teachers participated in institutional meetings and teaching at school. The research focused on designing scaffolding tools, addressing these tools in the meetings, and implementing them in the classroom. The main research data were obtained from meetings, classroom discussions, and observations. The results indicated that the professional development trajectory has promoted teachers’ learning of scaffolding students in open inquiry, especially the ability to know when and how to give students a well‐balanced combination of ‘structure’ for open‐inquiry learning and sufficient ‘space’ for that. The implications for science teacher education are discussed.     

Instructional assessments: Lever for systemic change in science education classrooms

The Educational Testing Service/University of Delaware Science Education project has addressed the challenge of promoting systemic change in science education through the use of instructional assessments. Instructional assessments integrate performance-based assessments with curriculum and instruction at the classroom level. Instructional assessment provides a promising lever for promoting professional development and improving middle school science curriculum, instruction, and assessment.     

Preservice science teachers reflect on their practicum experiences

The practicum provides an opportunity for preservice teachers to apply knowledge and skills in actual classroom settings. Thus, it serves as a central component of virtually all teacher education programmes. This study focused the views of 16 preservice science teachers on their practicum experiences. Individual interviews were made to construct a picture of practicum as experienced by the preservice science teachers. Group seminar sessions, and written reflections were also utilised to confirm and support data from the interviews. The findings based on data gathered indicate that preservice science teachers were not exposed to environment that reflected their expectations toward learning outcomes. It is essential to provide conditions of a quality experience to preservice science teachers during their teacher education programmes in order to prepare preservice teachers to teach science effectively.     

我国小学科学教师专业素质现状调查

本文采用问卷调查、访谈和课堂观察等方法对小学科学教师的专业素质现状进行调查,从小学科学教师的知识素质、能力素质、专业态度和动机、个性特征上分析了存在的问题,以期真实反应我国小学科学教师的现状,引起各界重视。     

Can We Learn From Student Mistakes in a Formative,Reading Comprehension Assessment?

This article describes an ongoing project to develop a formative, inferential reading comprehension assessment of causal story comprehension. It has three features to enhance classroom use: equated scale scores for progress monitoring within and across grades, a scale score to distinguish among low‐scoring students based on patterns of mistakes, and a reading efficiency index. Instead of two response types for each multiple‐choice item, correct and incorrect, each item has three response types: correct and two incorrect response types. Prior results on reliability, convergent and discriminant validity, and predictive utility of mistake subscores are briefly described. The three‐response‐type structure of items required rethinking the item response theory (IRT) modeling. IRT‐modeling results are presented, and implications for formative assessments and instructional use are discussed.     

The impact of science content and professional learning communities on science teaching efficacy and standards‐based instruction

This study examines the impact of standards‐based professional development on teacher efficacy and instructional practice of elementary and middle school science teachers. Professional development activities were conducted over a period of 3 years and included content courses as well as teacher involvement in professional learning communities. Teacher efficacy was assessed at five time points using the Science Teacher Efficacy Beliefs Instrument (STEBI), and instructional practice was evaluated at four time points with classroom observations using the Reformed Teaching Observation Protocol (RTOP). Results indicate that there was significant growth in teacher self‐efficacy but not in outcome expectancy. There was also significant growth in the extent to which teachers implemented inquiry‐based instruction in the classroom. Additionally, a positive correlation was observed between changes in self‐efficacy and changes in the use of inquiry‐based instructional practice. These results are discussed in terms of a model of teacher learning wherein changes in teacher beliefs and changes in classroom practice mutually influence each other, and also in terms of the impact of collaboration on teacher efficacy and practice. © 2010 Wiley Periodicals, Inc., Inc. J Res Sci Teach 48: 534–551, 2011     

Children's perceptions of primary science assessment in England and Wales

This study builds on and contributes to work on assessment of children in primary school, particularly in science. Previous research has examined primary science assessment from different standpoints, but no studies have specifically addressed children's perspectives. This article provides additional insight into issues surrounding children's assessment in primary school and how the assessment of science might develop in England after the science SATs (Standard Assessment Tests) were abolished in 2009. Some research suggests that primary science assessment via SATs is a major reason for the observed decline in children's engagement with science in upper primary and lower secondary school. The analytic focus on engaging children as coresearchers to assist in the process of gathering informed views and interpreting findings from a large sample of children's views enables another contribution. The study, based on a survey of 1000 children in primary and secondary schools in England and Wales, reveals that despite being assessed under two different regimes (high‐stakes national tests in England and moderated teacher assessment in Wales), children's views of science assessment are remarkably consistent. Most appreciate the usefulness of science assessment and value frequent, non‐SATs testing for monitoring/improving science progress. There was a largely negative impact, however, of science assessment on children's well‐being, particularly due to stress. The paper demonstrates that children provide an important perspective on assessment and that including their views can improve policy‐making in relation to primary science assessment.     

Assessment of science learning: Living in interesting times

Beginning with a reference to living in a time of both uncertainty and opportunity, this article presents a discussion of key areas where shared understanding is needed if we are to successfully realize the design and use of high quality, valid assessments of science. The key areas discussed are: (1) assessment purpose and use, (2) the nature of assessment and the importance of research on learning, (3) assessment design processes, (4) validity arguments, (5) measurement and statistical inference, (6) affordances of technology, and (7) systems of assessment. After introducing each vital area, the article discusses how each of the five articles in the special issue is connected to the areas. Concluding comments emphasize the reminder that despite the large amount of work to be done, we are well positioned to realize the high quality, valid science education assessments that we need for K‐16 science education. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 831–841, 2012     

Observing the Indicators of Technological Pedagogical Content Knowledge in Science Classrooms: Video-Based Research

The purpose of the study was to observe the indicators of science teachers’ technological pedagogical content knowledge (TPACK) using a video-based research method. The study was conducted with four in-service science teachers who taught at a school that offered tablet-based education in primary and secondary levels. Data sources included video-recorded classroom teaching sessions and pre- and post-video teacher interviews. In addition to the in-depth contextual information provided, the findings from the qualitative analysis of teacher cases revealed indicators of teachers’ TPACK in their lesson design and actual teaching processes. Design indicators included technology selection, curriculum planning, lesson preparation, and assessment. Actual teaching indicators included lesson entry behaviors, teaching methods and strategies, technology-enhanced classroom management, troubleshooting, and assessment.