Development and evaluation of the conceptual inventory of natural selection

Natural selection as a mechanism of evolution is a central concept in biology; yet, most nonbiology‐majors do not thoroughly understand the theory even after instruction. Many alternative conceptions on this topic have been identified, indicating that the job of the instructor is a difficult one. This article presents a new diagnostic test to assess students' understanding of natural selection. The test items are based on actual scientific studies of natural selection, whereas previous tests have employed hypothetical situations that were often misleading or oversimplified. The Conceptual Inventory of Natural Selection (CINS) is a 20‐item multiple choice test that employs common alternative conceptions as distractors. An original 12‐item version of the test was field‐tested with 170 nonmajors in 6 classes and 43 biology majors in 1 class at 3 community colleges. The test scores of one subset of nonmajors (n = 7) were compared with the students' performances in semistructured interviews. There was a positive correlation between the test scores and the interview scores. The current 20‐item version of the CINS was field‐tested with 206 students in a nonmajors' general biology course. The face validity, internal validity, reliability, and readability of the CINS are discussed. Results indicate that the CINS will be a valuable tool for instructors. © 2002 Wiley Periodicals, Inc. J Res Sci Teach 39: 952–978, 2002     

A comparative study of the effects of a concept mapping enhanced laboratory experience on Turkish high school students’ understanding of acid-base chemistry

The research reported here consists of the introduction of an intervention based on a series of laboratory activities combined with concept mapping. The purpose of this intervention was to enhance student understanding of acid-base chemistry for tenth grade students’ from two classes in a Turkish high school. An additional aim was to enhance student attitude toward chemistry. In the research design, two cohorts of students were compared; those from the intervention group (N = 31) and a second group (N = 28) who were taught in a more traditional manner. Student understanding of acid-base chemistry was evaluated with a pretest/posttest research design using a purpose-designed instrument, the Concept Achievement Test (CAT) consisting of 25 items, 15 multiple choice and ten multiple choice with explanation. Alternative conceptions identified in the pretest were incorporated into the intervention, which thereby sought to move students toward views more in accord with scientific views for the concepts. Statistical tests indicate the instrument is reliable (with an alpha reliability of 0.81) and the analysis of the findings revealed statistically significant differences between the intervention and traditional groups with respect to conceptual understanding. Examination of student explanations and analyses of semi-structured interviews conducted with selected students suggest that the main influence was the laboratory activities. Analysis of the findings in the context of relevant literature that concept mapping in conjunction with laboratory activities is more enjoyable, helps student link concepts, and reduces their alternative conceptions.     

Understanding Early Elementary Children's Conceptual Knowledge of Plant Structure and Function through Drawings

This study examined children''s drawings to explain children''s conceptual understanding of plant structure and function. The study explored whether the children''s drawings accurately reflect their conceptual understanding about plants in a manner that can be interpreted by others. Drawing, survey, interview, and observational data were collected from 182 students in grades K and 1 in rural southeastern United States. Results demonstrated the children held a wide range of conceptions concerning plant structure and function. These young children held very simple ideas about plants with respect to both their structure and function. Consistent with the drawings, the interviews presented similar findings.     

Multifaceted Assessment of Inquiry-Based Science Learning

To improve student science achievement in the United States we need inquiry-based instruction that promotes coherent understanding and assessments that are aligned with the instruction. Instead, current textbooks often offer fragmented ideas and most assessments only tap recall of details. In this study we implemented 10 inquiry-based science units that promote knowledge integration and developed assessments that measure student knowledge integration abilities. To measure student learning outcomes, we designed a science assessment consisting of both proximal items that are related to the units and distal items that are published from standardized tests (e.g., Trends in International Mathematics and Science Study). We compared the psychometric properties and instructional sensitivity of the proximal and distal items. To unveil the context of learning, we examined how student, class, and teacher characteristics affect student inquiry science learning. Several teacher-level characteristics including professional development showed a positive impact on science performance.     

Building the BIKE: Development and Testing of the Biotechnology Instrument for Knowledge Elicitation (BIKE)

Identifying students’ conceptual scientific understanding is difficult if the appropriate tools are not available for educators. Concept inventories have become a popular tool to assess student understanding; however, traditionally, they are multiple choice tests. International science education standard documents advocate that assessments should be reform based, contain diverse question types, and should align with instructional approaches. To date, no instrument of this type targeting student conceptions in biotechnology has been developed. We report here the development, testing, and validation of a 35-item Biotechnology Instrument for Knowledge Elicitation (BIKE) that includes a mix of question types. The BIKE was designed to elicit student thinking and a variety of conceptual understandings, as opposed to testing closed-ended responses. The design phase contained nine steps including a literature search for content, student interviews, a pilot test, as well as expert review. Data from 175 students over two semesters, including 16 student interviews and six expert reviewers (professors from six different institutions), were used to validate the instrument. Cronbach’s alpha on the pre/posttest was 0.664 and 0.668, respectively, indicating the BIKE has internal consistency. Cohen’s kappa for inter-rater reliability among the 6,525 total items was 0.684 indicating substantial agreement among scorers. Item analysis demonstrated that the items were challenging, there was discrimination among the individual items, and there was alignment with research-based design principles for construct validity. This study provides a reliable and valid conceptual understanding instrument in the understudied area of biotechnology.     

Young People's Conceptions of Environment: A phenomenographic analysis

Environmental education in schools is an important strategy in achieving environmental improvement. However, it needs to be based on children's understandings of environment rather than on assumptions of what children know and believe. This paper reports on a research project where school children's answers to a question 'I think the term/word environment means ' were analysed using the qualitative research method of phenomenography. Six distinct conceptions were isolated, ranging from the least sophisticated--environment as a place--to the most inclusive and expansive--environment and people in a relationship of mutual sustainability. An important qualitative difference was found between conceptions that treat the environment as an object and relational conceptions. The implications of these findings for environmental education are discussed.     

Comparing children's and student teachers’ ideas about science concepts

Children and teachers may not think in the same way about particular science concepts. Such parallel lines of thought can compound children's confusion and misunderstanding as they learn science at primary school. The situation could be more acute when student teachers are teaching science, because of their limited experience of considering children's ideas. This paper investigates children's and student teachers’ ideas about certain science concepts: ‘animal’, ‘flower’, ‘living’, ‘force’ and ‘energy’. The ideas and understandings of 96 children and 168 student teachers were explored. Results showed that the student teachers and children had similar ideas about ‘flower’ and ‘animal’, whereas they evidenced very different responses to ‘living’, ‘energy’ and ‘force’. Implications for classroom practice are considered.     

Students’ conceptions of good teaching in three different disciplines

This paper explores students’ conceptions of good teaching in three different disciplines. Moreover, the aim is to explore the relation between these conceptions and students’ approaches to learning by combining qualitative and quantitative methods. A total of 695 students from the Faculties of Behavioural Sciences, Law and Veterinary Medicine participated in the study. The students’ conceptions of good teaching were analysed using a qualitative content analysis. Furthermore, the students were assigned to homogenous subgroups on the basis of their responses to items measuring approaches to learning and the differences between these subgroups and the students’ conceptions were examined. The association between the conceptions, disciplines and approaches to learning were examined using Chi‐square tests. Twenty‐one dimensions were created from the data and 12 of them differed between the disciplines. Only one dimension differed between the student groups. The study suggests that there is disciplinary variation in students’ conceptions of good teaching and universities should take this into account in the development process of the student evaluation system.     

Facilitating Conceptual Change in Students’ Understanding of Boiling Concept

The objective of this study was to construct a teaching strategy for facilitating students’ conceptual understanding of the boiling concept. The study is based on 52 freshman students in the primary science education department. Students’ ideas were elicited by a test consisting of nine questions. Conceptual change strategy was designed based on students’ alternative conceptions. Conceptual change in students’ understanding of boiling was evaluated by administering a pre-, post- and delayed post-test. The test scores were analysed both by qualitative and quantitative methods. Statistical analysis using one-way ANOVA of student test scores pointed to statistically significant differences in the tests and total scores (p < 0.05). Quantitative analysis of students’ responses on each test revealed different schema about changing their knowledge system. Both qualitative and quantitative analyses suggest that the teaching activities facilitated students’ conceptual understanding. No statistically significant differences were found between post-test and delayed post-test scores, suggesting that the teaching strategy enabled students to retain their new conceptions in the long-term memory.     

Young children's explorations of average through informal inferential reasoning

This study situates children's early notions of average within an inquiry classroom to investigate the rich inferential reasoning that young children drew on to make sense of the questions: Is there a typical height for a student in year 3? If so, what is it? Based on their deliberations over several lessons, students' ideas about average and typicality evolved as meaning reasonable, contrary to atypical, most common (value or interval), middle, normative, and representative of the population. The case study reported here documents a new direction for the development of children's conceptions of average in a classroom designed to elicit their informal inferential reasoning about data.     

College physical chemistry students' conceptions of equilibrium and fundamental thermodynamics

Hour-long structured interviews were conducted with 16 volunteer students from four undergraduate physical chemistry classes. Many student alternative conceptions and nonconceptions were expressed about important material covering equilibrium and thermodynamics. Twenty-nine of these were prevalent (present in >25% of the students.) The student conceptions expressed in their interviews were compared with those expressed by experts in textbooks and rated using a 6-point rubric. These ratings were averaged into a rating in each of four subjects and an overall rating. Correlation indices were computed. The “quality of student conception” rating was best predicted by an aggregated t score for the results on instructor-designed in-class exams. This result indicates that instructor's exams and grades do in fact demonstrate the level of a student's understanding of this course material. © 1998 John Wiley & Sons, Inc. J Res Sci Teach 35: 1151–1160, 1998.     

An interview study of responses to diagnostic,multiple-choice,physics items

Conclusion In three-quarters of the student-item pairs the multiple-choice items correctly identified the use of adequate or inadequate strategies so on a general level the items might be thought to have performed satisfactorily. However as diagnostic tools they were generally inadequate and this fact points to the desirability of using the student-oriented procedure for constructing such items. In this procedure student understanding of the domain of knowledge is probed through interviews and distractors are designed to reflect the dominant types of misconceptions. The importance of the school-related context was something which emerged during the interviews and, in the light of the discrepancy between student understanding as revealed through school tests and interview studies, this is an area to which more attention needs to be given.     

The relationship between design reflectivity and conceptions of informed design among high school students

ABSTRACT

Although reflection is a key behaviour of expert designers, it is often a challenging task for new designers. In addition, research on the reflectivity of student designers is limited. The purpose of this study is twofold: (1) to identify the levels of reflectivity while designing, and (2) to study the relationship between reflectivity and conceptions of informed design. We collected data from high school students engaged in an engineering design project. We developed a coding protocol to score levels of reflectivity in student reflections at three levels (low, medium, and high), and used the conceptions of design test to assess changes in student understanding of design activities. Using Wilcoxon signed-rank tests, we determined if students tended to select more ‘key’ design activities and fewer ‘distractors’ within each reflection group. We also performed McNemar’s tests to determine which specific design activities were important within each reflection group after the design project. The results show moderately reflective students had higher gains in understanding of informed design activities compared to those with high or low reflectivity. Results also indicate that different design activities became important for students within each of the three reflective groups. Implications from this research indicate that groups of students experience changing conceptions of design in different ways. An understanding of what students deem important while designing would better allow teachers to encourage behaviours that are like those of informed designers.     

Being constructive: An alternative approach to the teaching of introductory ideas in electricity

This paper reports on the development and implementation of an introductory course on electric circuits based on a constructivist model of curriculum development and teaching. Pupil interviews before instruction explored and clarified the range of children's existing ideas and conceptions. A teaching sequence was designed to elicit pupils’ ideas, to challenge these experimentally where they differed from accepted scientific ideas and to encourage discussion and reformulation of ideas. Post‐instruction interviews showed improved pupil understanding of several important basic concepts. The constructivist approach appeared to provide a viable and satisfactory basis for teachers’ classroom decision‐making and for the structuring and sequencing of activities as the course progressed.     

Measurement Efficiency of Innovative Item Formats in Computer-Based Testing

The psychometric literature provides little empirical evaluation of examinee test data to assess essential psychometric properties of innovative items. In this study, examinee responses to conventional (e.g., multiple choice) and innovative item formats in a computer-based testing program were analyzed for IRT information with the three-parameter and graded response models. The innovative item types considered in this study provided more information across all levels of ability than multiple-choice items. In addition, accurate timing data captured via computer administration were analyzed to consider the relative efficiency of the multiple choice and innovative item types. As with previous research, multiple-choice items provide more information per unit time. Implications for balancing policy, psychometric, and pragmatic factors in selecting item formats are also discussed.     

Investigation of worldview theory in a south african context

This article reports on an exploratory investigation carried out to identify conceptions of some components of worldview, based on logicostructural worldview theory, held by science student teachers in a South African context. It explores relationships among worldviews, student characteristics, and scientific concepts. The sample included 48 final-year science student teachers. Data were gathered by a questionnaire with follow-up interviews. Questions were based on Kearney's model of worldview with stimulus items related to each of seven worldview categories. Responses were categorized and examined for possible relationships. Results of the investigation indicated that students' conceptions of time and distance were nonmechanistic and psychologically bound and that authoritarian scientific explanation was considered as sufficient for proof. Some significant relationships were found between items as well as between field of study and scientific conceptions.     

Understanding Young Children's Three‐Dimensional Creative Potential in Art Making

This article explores aspects of young children's three‐dimensional development in art making. Understanding young children's three‐dimensional awareness and development is often a neglected area of early childhood educators' education and practice and often children's creative potential is not fully realised. The present article is based on a small scale qualitative study which focused on understanding 5–6 year‐olds' representational intentions in three‐dimensional artworks, understanding of visual/design concepts and expressive use of media (scrap paper and mod roc). The findings of the study suggest that young children are able to create satisfying three‐dimensional representations giving emphasis on forms, uprightness, balance, movement and modeling of multiple sides.     

Teachers' approaches to teaching and responses to student evaluation in a problem‐based medical program

Teachers' approaches to teaching may influence the way they interpret and respond to student evaluations. In this article we explore the relationship between teachers' approaches to teaching and responses to qualitative student feedback in a problem‐based medical program. We asked all lecturers and theme session presenters in 2003 who had received student feedback comments in the past 2 years (N=121) to complete anonymously the Approaches to Teaching inventory (16 items) and an Approach to Feedback Inventory (14 items). Results were that most teachers report making changes to their teaching in response to students' suggestions at least sometimes. The types of change(s) teachers make are consistent with their approach. Teachers strong on a conceptual‐change student‐focussed (CCSF) approach are more responsive to feedback and positive about strategies for improving their teaching. To encourage teachers to use student feedback as a guide to improving their teaching, institutions may need to provide a systematic program of teacher education that focuses on teachers' conceptions, approaches and supports observation of exemplary practice.