Development and Use of a Conceptual Survey in Introductory Quantum Physics

Conceptual surveys have become increasingly popular at many levels to probe various aspects of science education research such as measuring student understanding of basic concepts and assessing the effectiveness of pedagogical material. The aim of this study was to construct a valid and reliable multiple‐choice conceptual survey to investigate students’ understanding of introductory quantum physics concepts. We examined course syllabi to establish content coverage, consulted with experts to extract fundamental content areas, and trialled open‐ended questions to determine how the selected content areas align with students’ difficulties. The questions were generated and trialled with different groups of students. Each version of the survey was critiqued by a group of discipline and teaching experts to establish its validity. The survey was administered to 312 students at the University of Sydney. Using the data from this sample, we performed five statistical tests (item difficulty index, item discrimination index, item point biserial coefficient, KR‐21 reliability test, and Ferguson’s delta) to evaluate the test’s reliability and discriminatory power. The result indicates that our survey is a reliable test. This study also provided data from which preliminary findings were drawn on students’ understandings of introductory quantum physics concepts. The main point is that questions which require an understanding of the standard interpretations of quantum physics are more challenging for students than those grouped as non‐interpretative. The division of conceptual questions into interpretive and non‐interpretive needs further exploration.     

The effects of students' cognitive styles on conceptual understandings and problem‐solving skills in introductory mechanics

The purpose of this study was to determine if there are relationship among freshmen students' Field depended or field independent (FD/FI) cognitive style, conceptual understandings, and problem solving skills in mechanics. The sample consisted of 213 freshmen (female = 111, male = 102; age range 17–21) who were enrolled in an introductory physics course required for science education prospective teachers. Data collection was done during the fall semesters in three successive years. At the beginning of each semester the Force Concept Inventory (FCI) and the Group Embedded Figure Test (GEFT) were administered to assess students' initial understanding of basic concepts in mechanics and FD/FI tendency of students, respectively. After completion of the course, the FCI and the Mechanics Base Line Test (MBT) were administered. The results indicated that students conceptual understanding were not statistically related to their FD/FI cognitive styles for both pre and post results. However, their problem‐solving skills were statistically related to their FD/FI cognitive style. The findings of the present and previous studies are compared, and the possible effects of the present studies on previous studies on teaching, learning and assessment for introductory mechanics are discussed.     

Cross‐time attitudes,concept formation,and achievement in college freshman physics

The relationships among science and engineering attitude, physics conceptual understanding, and physics achievement were explored for a population of college freshman engineering students over two semesters. Gender and SAT‐Quantitative measures were included as exogenous variables in a longitudinal path analysis. Attitude was theorized to predict achievement contemporaneously and at the next time point, while conceptual understanding was theorized to predict physics achievement contemporaneously and at the next time point. Each at one time was theorized to predict scores at the next time. A sample of 200 freshman engineering students participating in an integrated curriculum were assessed in September, December, and April (with a loss of 64 students) with the Force Concepts Inventory (FCI), Mechanics Baseline Test (MBT), and a locally developed attitude measure. The observed model indicated that the FCI predicted attitude at time 1 with no other paths between them, that FCI at time 1 predicted MBT at time 1 and time 2, FCI at time 2 predicted MBT at time 3, and MBT at time 1 predicted FCI at time 2. Gender and SAT‐Quantitative scores were predictive only of FCI and MBT at time 1. Results supported an interactive model of conceptual understanding and achievement, with attitude largely irrelevant to the process for this population. © 2000 John Wiley & Sons, Inc. J Res Sci Teach 37: 1112–1120, 2000     

An analysis of 16–17-year-old students' understanding of solution chemistry concepts using a two-tier diagnostic instrument

This study focused on the development of a two-tier multiple-choice diagnostic instrument, which was designed and then progressively modified, and implemented to assess students' understanding of solution chemistry concepts. The results of the study are derived from the responses of 756 Grade 11 students (age 16–17) from 14 different high schools who participated in the study. The final version of the instrument included a total of 13 items that addressed the six aspects of solution chemistry, and students' understandings in the test were challenged in multiple contexts with multiple modes and levels of representation. Cronbach alpha reliability coefficients for the content tier and both tiers of the test were found to be 0.697 and 0.748, respectively. Results indicated that a substantial number of students held an inadequate understanding of solution chemistry concepts. In addition, 21 alternative conceptions observed in more than 10% of the students were reported, along with discussion on possible sources of such conceptions.     

Linking Brain Growth with the Development of Scientific Reasoning Ability and Conceptual Change during Adolescence

The hypothesis that an early adolescent brain growth plateau and spurt exists and that this plateau and spurt influence students' ability to reason scientifically and to learn theoretical science concepts was tested. In theory, maturation of the prefrontal lobes during early adolescence allows for improvements in students' abilities to inhibit task‐irrelevant information and coordinate task‐relevant information, which along with both physical and social experience influences scientific reasoning ability and the ability to reject scientific misconceptions and accept scientific conceptions. Two hundred ten students ages 13–16 years enrolled in four Korean secondary schools were administered tests of four prefrontal lobe activities, a test of scientific reasoning ability, and a test of air pressure concepts derived from kinetic‐molecular theory. A series of 14 lessons designed to teach the concepts were then taught. The concepts test was then readministered following instruction. As predicted, among the 13‐ and 14‐year‐olds, performance on the prefrontal lobe measures remained similar or regressed. Performance then improved considerably among the 15‐ and 16‐year‐olds. Also as expected, the measures of prefrontal lobe activity correlated highly with scientific reasoning ability. In turn, prefrontal lobe activity and scientific reasoning ability predicted concept gains and posttest performance. A principal components analysis showed that the study variables had two main components, which were interpreted as an inhibiting and a representing component. Therefore, theoretical concept acquisition was interpreted as a process involving both the inhibition of task‐irrelevant information (i.e., the rejection of intuitively derived misconceptions) and the representation of task‐relevant information (i.e, complex hypothetico‐deductive arguments and counterintuitive scientific conceptions about nonobservable entities). © 2000 John Wiley & Sons, Inc. J Res Sci Teach 37: 44–62, 2000     

A Cross-Age Study of Different Perspectives in Solution Chemistry from Junior to Senior High School

This study reports on research examining what students think about aspects of solution chemistry and seeks to establish what alternative conceptions they hold in this area. To achieve this aim the researchers developed a test comprising of open-ended questions that evaluated students understanding of solution chemistry. The test was administered to 441 students selected randomly from different grades, grade 7 through grade 10. The research findings suggest that students have difficulty at comprehending the investigated concepts in solution chemistry. Alternative conceptions about the concepts of dissolution, chemical bonding, evaporation and condensation influence latter learning. Interestingly, the grade 9 students have the least percentages, except for Item 3, amongst grades in terms of alternative conception. Also, students' alternative conceptions are also stored in long-term memory and interact with each another. In the light of the findings, it can be suggested that the future research may need to focus on classifying of students' responses in terms of categories in understanding such as propositions, strings, images, episode, intellectual skills and cognitive strategies.     

Development of a Three-Tier Test to Assess Misconceptions About Simple Electric Circuits

ABSTRACT

The authors aimed to propose a valid and reliable diagnostic instrument by developing a three-tier test on simple electric circuits. Based on findings from the interviews, open-ended questions, and the related literature, the test was developed and administered to 124 high school students. In addition to some qualitative techniques for establishing the validity, some quantitative techniques were also used. Consequently, Cronbach's alpha reliability coefficient was estimated for the test as .69, and results revealed that the test scores could be a valid and reliable measure of students’ qualitative understanding of simple electric circuits.     

Role of adjunct questions and reading ability levels on rote and conceptual learning from prose

This research evaluated the effect of question type (rote, conceptual) and adjunct question response mode (multiple choice, short answer) on rote and conceptual learning outcomes of high and low ability readers. Subjects were 98 freshman students of a small, historically black, undergraduate institution. Students studied a passage containing either rote- or conceptual-level adjunct questions or no questions. They were then administered a rote and a conceptual post-test over the presented concepts. A 2 × 2 × 2 factorial design was used. The results indicated, contrary to most other research, that rote adjunct questions were more helpful to readers than conceptual adjunct questions on both rote and conceptual post-tests. As expected, high reading ability students performed better than low reading ability students within treatments. There were no significant aptitude-treatment interactions.     

The Effect of Supplementing Instruction with Conceptual Change Texts on Students’ Conceptions of Electrochemical Cells

The aim of this study was to investigate the effectiveness of instruction supplemented by conceptual change texts (CCTs) over traditional instruction on students’ understanding of electrochemical (galvanic and electrolytic) cell concepts. The participants of the study consisted of 64 students from the two classes of a high school located in Turkey. Classes were randomly assigned to experimental group, which was exposed to CCTs as a supplementary material, and to control group, which was exposed to traditional instruction. A 23-item multiple-choice test was developed assess students’ conceptual understanding of electrochemical cells. This test was administered to both groups before and after the instruction. The results of ANCOVA indicated that students who were instructed by using CCTs had better conceptual understanding of electrochemical cells than those experiencing traditional instruction when their prior electrochemical cell concepts understanding was statistically controlled. The findings of this study suggest that CCTs can be used as a cost- and resource-effective supplement to classroom instruction to promote students’ understanding science concepts.     

Enhancing Students' Understanding of Photosynthesis and Respiration in Plant Through Conceptual Change Approach

This study investigated the effectiveness of combining conceptual change text and discussion web strategies on students' understanding of photosynthesis and respiration in plants. Students' conceptual understanding of photosynthesis and respiration in plants was measured using the two-tier diagnostic test developed by Haslam and Treagust (1987, Journal of Biological Education 21: 203--211). The test was administered as pretest and posttest to a total of 233 eighth-grade students in six intact classes of the same school located in an urban area. The test of logical thinking was used to determine the reasoning ability of students. The experimental group was a class of 116 students received discussion web and conceptual change text instruction. A class of 117 students comprised the control group received a traditional instruction. After instruction, data were analyzed with two-way analysis of covariance (ANCOVA) using the Test of Logical Thinking and pretest scores as covariate. The conceptual change instruction, which explicitly dealt with students' misconceptions, produced significantly greater achievement in understanding of photosynthesis and respiration in plant concepts. Analysis also revealed a significant difference between performance of females and that of males in the favor of females, but the interaction of treatment with gender difference was not significant for learning the concepts.     

A comparison of Olympians' and regular students' approaches and successes in solving counterintuitive dynamics problems

ABSTRACT

The aim of this study was to characterise thoroughly the differences between Physics Olympiad competitors' and regular students' successes and approaches in relation to counterintuitive dynamics problems (CDPs) in order to discover some of the differences between skilled problem-solvers and those with fewer such skills. A total of 23 Physics Olympiad competitors were found by snowball sampling, while 40 regular students were selected by means of convenience sampling to participate in this study. To compare the students' solutions, we ran through six CDP of low, medium, and high difficulty. Students' responses were analysed by means of both qualitative and quantitative methods. The findings indicate that Olympians are much more successful and careful in handling CDP than regular students. On the other hand, regular students' challenges were often associated with a superficial problem-solving approach and with inadequate analysis of the problem. It can be concluded that, when compared to regular students, expert students' in-depth analysis resulted in greater successes and more efficient approaches in solving counterintuitive problems. Hence, it may be claimed that, with the use of counterintuitive problems, teaching and assessment practices may be developed to help students advance to higher hierarchical categories of problem-solving.     

A diagnostic assessment for introductory molecular and cell biology

We have developed and validated a tool for assessing understanding of a selection of fundamental concepts and basic knowledge in undergraduate introductory molecular and cell biology, focusing on areas in which students often have misconceptions. This multiple-choice Introductory Molecular and Cell Biology Assessment (IMCA) instrument is designed for use as a pre- and posttest to measure student learning gains. To develop the assessment, we first worked with faculty to create a set of learning goals that targeted important concepts in the field and seemed likely to be emphasized by most instructors teaching these subjects. We interviewed students using open-ended questions to identify commonly held misconceptions, formulated multiple-choice questions that included these ideas as distracters, and reinterviewed students to establish validity of the instrument. The assessment was then evaluated by 25 biology experts and modified based on their suggestions. The complete revised assessment was administered to more than 1300 students at three institutions. Analysis of statistical parameters including item difficulty, item discrimination, and reliability provides evidence that the IMCA is a valid and reliable instrument with several potential uses in gauging student learning of key concepts in molecular and cell biology.     

Instructional influence of a molecular-level pictorial presentation of matter on students' conceptions and problem-solving ability

The instructional influence upon students' conceptions and problem-solving ability of presenting pictures at the molecular level when introducing chemistry concepts and solving chemistry problems was investigated. Before instruction, the Group Assessment of Logical Thinking (GALT) was administered and its score was used as a covariate. For the treatment group, 31 pictorial materials were used during 21 hours of Korean academic high school chemistry classes. For the control group, traditional instruction was used. Six classroom observations (1 hour each in duration) for each group were made. After instruction, the Chemistry Conceptions Test, and the Chemistry Problem-Solving Test (CPST) consisting of 10 pairs of pictorial and algorithmic problems, were administered. Korean students' success on pictorial questions from the CPST was higher than that reported in the literature for college students; however, Korean students did very poorly on algorithmic questions. The GALT score was significantly correlated with students' conceptions and problem-solving ability. Analysis of covariance results indicated that instruction with pictorial materials at the molecular level helped students construct more scientifically correct conceptions than traditional instruction. However, use of the pictorial materials had no facilitating effect on problem-solving ability. © 1997 John Wiley & Sons, Inc. J Res Sci Teach 34: 199–217, 1997.     

Study factors and their impact on military school performance measures

A 16-dimension survey to assess study skills was designed and administered to 705 students enrolled in five Navy schools. After revision based on reliability analyses, validity analyses were performed at two of the schools by correlating survey responses with test performance measures. At one school, correlations indicated that those students who were more competitive or motivated, had higher concentration or memorization skills, or asked more questions performed significantly better on the most difficult tests in the school. At the second school, using partial correlations to control for student ability, study factors reliably predicted test performance, irrespective of student ability. Multiple regression coefficients of .618 and .379 supported the independent contribution of several study factors to test performance. Selected study skill training resources used by the military are identified and functional research directions are described.The opinions expressed in this research report are those of the authors, are not official, and do not necessarily reflect the views of the U. S. Navy Department. The critical comment on an earlier version of this report by Jack Edwards and three anonymous reviewers is appreciated.     

Teaching social studies to learning disabled high school students: effects of a hypertext study guide

This study investigated the effectiveness of a computer-based study guide using hypertext software to increase textbook comprehension among four learning disabled students enrolled in a remedial high school social studies class. The program provided four levels of instructional cues that matched students to their highest level of independent interaction with a textbook passage, based on item-to-item responses to computer-generated questions. Using alternative forms of a 45-item multiple-choice test, a pre-test/post-test design was arranged, with a retention test given after a 30-day period. Fifteen questions were designated as control items by placing them in the 45-item tests but not in the computer treatment. The computer program consisted of three separate lessons administered across consecutive class sessions, with each followed by a written 15-item multiple choice test containing 10 computer questions and 5 control items. Results indicated a significant gain for pupils on computer items from pre-test to post-test and from pre-test to retention test, while no significant change occurred on control items across measures. A single-case analysis revealed a consistent relationship between gain scores on computer items, reading time on computer, and the number of instructional cues required by students. Two types of non-linear pathways that teacher might consider when constructing study guides are discussed.     

Early science learning with a virtual tutor through multimedia explanations and feedback on spoken questions

The purpose of this pilot study with a within-subject design was to gain a deeper understanding about the promise and restrictions of a virtual tutoring system designed to teach science to first grade students in Finland. Participants were 61 students who received six tutoring science sessions of approximately 20 min each. Sessions consisted of a sequence of narrated multimedia science presentations during which a virtual tutor explained science phenomena displayed in pictures. Narrated science explanations were followed by one or more multiple choice questions with immediate feedback about students’ choices and a possible second attempt, during which students reached 97% accuracy. A pretest and posttest was administered to assess students’ ability to reason about the science and to transfer knowledge to new contexts. Results indicated significantly greater improvement in the understanding of the science concepts taught during the tutoring sessions, relative to the concepts that were not taught. Results from the surveys administered to teachers and students indicated that the program was well received. Detailed analysis of student error responses provided a deeper understanding about the complex interplay between students’ prior knowledge, the way topics were taught in the multimedia lessons, and the way learning was assessed. Findings from the quantitative and qualitative analyses are discussed in the context of designing high quality lessons delivered through a virtual tutoring system.     

Innovative Training of In-service Teachers for Active Learning: A Short Teacher Development Course Based on Physics Education Research

In this contribution we describe a short development course for in-service physics teachers. The course structure and materials are based on the results of educational research, and its main objective is to provide in-service teachers with a first contact with the active learning strategy “Tutorials in Introductory Physics,” developed by the Physics Education Research Group at the University of Washington. The course was organized in a constructivist, active learning environment, so that teachers have first to experience, as regular students, the whole Tutorial sequence of activities: Tutorial pre-test, Tutorial, and Tutorial Homework. After each Tutorial, teachers reflect on, and recognize their own students’ learning difficulties, discussing their teaching experiences with their colleagues in small collaborative groups first and the whole class later. Finally they read and discuss specific Physics Education Research literature, where these learning difficulties have been extensively studied by researchers. At the beginning and at the end of the course the participants were given the conceptual multiple-choice test Force Concept Inventory (FCI). The pre-/post-instruction FCI data were presented as a practical example of the use of a research-based test widely used in educational research and in formative assessment processes designed to improve instruction.     

Conceptual difficulties experienced by senior high school students of electrochemistry: Electric circuits and oxidation-reduction equations

The purpose of this research was to investigate students' understanding of electrochemistry following a course of instruction. A list of conceptual and propositional knowledge statements was formulated to identify the knowledge base necessary for students to understand electric circuits and oxidation-reduction equations. The conceptual and propositional knowledge statements provided the framework for the development of a semistructured interview protocol which was administered to 32 students in their final year of high school chemistry. The interview questions about electric circuits revealed that several students in the sample were confused about the nature of electric current both in metallic conductors and in electrolytes. Students studying both physics and chemistry were more confused about current flow in metallic conductors than students who were only studying chemistry. In the section of the interview which focused on oxidation and reduction, many students experienced problems in identifying oxidation-reduction equations. Several misconceptions relating to the inappropriate use of definitions of oxidation and reduction were identified. The data illustrate how students attempted to make sense of the concepts of electrochemistry with the knowledge they had already developed or constructed. The implications of the research are that teachers, curriculum developers, and textbook writers, if they are to minimize potential misconceptions, need to be cognizant of the relationship between physics and chemistry teaching, of the need to test for erroneous preconceptions about current before teaching about electrochemical (galvanic) and electrolytic cells, and of the difficulties experienced by students when using more than one model to explain scientific phenomena.