Psychometric models of student conceptions in science: Reconciling qualitative studies and distractor-driven assessment instruments

We stand poised to marry the fruits of qualitative research on children's conceptions with the machinery of psychometrics. This merger allows us to build upon studies of limited groups of subjects to generalize to the larger population of learners. This is accomplished by reformulating multiple choice tests to reflect gains in understanding cognitive development. This study uses psychometric modeling to rank the appeal of a variety of children's astronomical ideas on a single uniform scale. Alternative conceptions are captured in test items with highly attractive multiple choice distractors administered twice to 1250 8th through 12th-grade students at the start and end of their introductory astronomy courses. For such items, an unusual psychometric profile is observed—instruction appears to strengthen support for alternative conceptions before this preference eventually declines. This lends support to the view that such ideas may actually be markers of progress toward scientific understanding and are not impediments to learning. This method of analysis reveals the ages at which certain conceptions are more prevalent than others, aiding developers and practitioners in matching curriculum to student grade levels. This kind of instrument, in which distractors match common student ideas, has a profoundly different psychometric profile from conventional tests and exposes the weakness evident in conventional standardized tests. Distractor-driven multiple choice tests combine the richness of qualitative research with the power of quantitative assessment, measuring conceptual change along a single uniform dimension. © 1998 John Wiley & Sons, Inc. J Res Sci Teach 35: 265–296, 1998.     

Learning science through research apprenticeships: A critical review of the literature

Science education models for secondary and college students as well as K‐12 teachers have been dominated by classroom‐based approaches. Recently, research apprenticeships wherein learners worked with practicing scientists on authentic scientific research have become increasingly popular. The purpose of this critical review of the literature was to review and synthesize empirical studies that have explored learning outcomes associated with research apprenticeships for science learners. We reviewed 53 studies of scientific research apprenticeship experiences for secondary students, undergraduates and teachers, both pre‐service and in‐service. The review explored various learning outcomes associated with participation in research apprenticeships. These outcomes included effects of apprenticeship experiences on participant career aspirations, ideas about the nature of science (NOS), understandings of scientific content, confidence for doing science and intellectual development. The extant literature supported many of the presumed positive associations between apprenticeship experiences and desired learning outcomes, but findings related to some themes (e.g., NOS understandings) supported conflicting conclusions. Implications included importance of the length of the apprenticeship, need to explicitly place attention on desired outcomes, and engagement of participants. © 2009 Wiley Periodicals, Inc. J Res Sci Teach 47:235–256, 2010     

The classroom observation protocol for socioscientific issue-based instruction: development and implementation of a new research tool

Background: For the past decade, science educators have been exploring the use of Socio-scientific Issues (SSI) as contexts for science teaching and learning, and research indicates that doing so can support significant learning gains. However, research related to how teachers take up the practice of SSI-based instruction is far more limited, due in part to a lack of tools for use in this kind of research.

Purpose: The focus of this research is development and testing of a new classroom observation protocol specifically designed for SSI-based instructional contexts.

Design and methods: Development of this SSI-Observation Protocol (SSI-OP) took place in four distinct phases: review of existing protocols and SSI-based instruction frameworks, writing and revision of protocol items, initial testing of the draft protocol, and soliciting feedback from SSI experts.

Sample: Following the four stages of SSI-OP development, we progressed to a series of field tests. The field tests were conducted with three different samples. The first sample was an experienced (10 + years) high school biology teacher and one of her honors biology classes. The second sample consisted of seven Turkish Pre-service Science Teachers (PST) participating in a science methods course. The third sample included two Thai PST from a field experience course embedded within a teacher education program.

Results: The final version of the protocol addressed five dimensions of SSI-based instructional activities: focus of instruction, teaching moves, role of teacher, role of students, and classroom environment.

Conclusions: The SSI-OP could be used in a variety of ways for research including documentation of current practices, impacts of professional development and/or curricula on teaching practices, and changes in teaching over time. We offer the SSI-OP as a new tool with the potential to contribute to science teacher education and research that may advance the teaching and learning of science through SSI.     

The influence of interactions with students for the development of new academics as teachers in higher education

The aim of the current investigation was to provide an insight into how new lecturers in higher education develop as teachers and to identify some of the main influences upon this development. A qualitative, longitudinal design with three semi-structured interviews over a 2-year period was employed with eleven new teachers from a range of higher education institutions and settings. The analysis used case studies, alongside a thematic analysis, to provide fine-grained and idiosyncratic insights into the teachers’ development. The principal finding from the current study was the identification that instances of interactions with students, acted as a core influence upon the new teachers’ development. These instances appeared to provide the teachers with richer and fuller feedback about their teaching. This feedback supported their reflection and influenced the way in which they thought about teaching. Based on these findings it is suggested that teacher development could be enhanced by focussing upon specific instances of interactions with students as these instances provide specific and tangible moments that allow individuals to reflect upon and discuss their conceptions of teaching.     

Moral sensitivity and its contribution to the resolution of socio-scientific issues

This study explores models of how people perceive moral aspects of socio-scientific issues. Thirty college students participated in interviews during which they discussed their reactions to and resolutions of two genetic engineering issues. The interview data were analyzed qualitatively to produce an emergent taxonomy of moral concerns recognized by the participant. The participants expressed sensitivity to moral aspects including concern and empathy for the well-being of others, an aversion to altering the natural order and slippery slope implications. In arriving at their final resolutions, many participants integrated their moral concerns with non-moral factors. The patterns revealed suggest that moral and non-moral concerns act in concern as they influence socio-scientific decision-making.     

Estimating High School GPA Weighting Parameters With a Graded Response Model

The high school grade point average (GPA) is often adjusted to account for nominal indicators of course rigor, such as “honors” or “advanced placement.” Adjusted GPAs—also known as weighted GPAs—are frequently used for computing students’ rank in class and in the college admission process. Despite the high stakes attached to GPA, weighting policies vary considerably across states and high schools. Previous methods of estimating weighting parameters have used regression models with college course performance as the dependent variable. We discuss and demonstrate the suitability of the graded response model for estimating GPA weighting parameters and evaluating traditional weighting schemes. In our sample, which was limited to self‐reported performance in high school mathematics courses, we found that commonly used policies award more than twice the bonus points necessary to create parity for standard and advanced courses.     

Connecting high school physics experiences,outcome expectations,physics identity,and physics career choice: A gender study

This study explores how students' physics identities are shaped by their experiences in high school physics classes and by their career outcome expectations. The theoretical framework focuses on physics identity and includes the dimensions of student performance, competence, recognition by others, and interest. Drawing data from the Persistence Research in Science and Engineering (PRiSE) project, which surveyed college English students nationally about their backgrounds, high school science experiences, and science attitudes, the study uses multiple regression to examine the responses of 3,829 students from 34 randomly selected US colleges/universities. Confirming the salience of the identity dimension for young persons' occupational plans, the measure for students' physics identity used in this study was found to strongly predict their intended choice of a physics career. Physics identity, in turn, was found to correlate positively with a desire for an intrinsically fulfilling career and negatively with a desire for personal/family time and opportunities to work with others. Physics identity was also positively predicted by several high school physics characteristics/experiences such as a focus on conceptual understanding, real‐world/contextual connections, students answering questions or making comments, students teaching classmates, and having an encouraging teacher. Even though equally beneficial for both genders, females reported experiencing a conceptual focus and real‐world/contextual connections less frequently. The explicit discussion of under‐representation of women in science was positively related to physics identity for female students but had no impact for male students. Surprisingly, several experiences that were hypothesized to be important for females' physics identity were found to be non‐significant including having female scientist guest speakers, discussion of women scientists' work, and the frequency of group work. This study exemplifies a useful theoretical framework based on identity, which can be employed to further examine persistence in science, and illustrates possible avenues for change in high school physics teaching. © 2010 Wiley Periodicals, Inc. J Res Sci Teach 47: 978–1003, 2010