Development and Use of a Conceptual Survey in Introductory Quantum Physics

Conceptual surveys have become increasingly popular at many levels to probe various aspects of science education research such as measuring student understanding of basic concepts and assessing the effectiveness of pedagogical material. The aim of this study was to construct a valid and reliable multiple‐choice conceptual survey to investigate students’ understanding of introductory quantum physics concepts. We examined course syllabi to establish content coverage, consulted with experts to extract fundamental content areas, and trialled open‐ended questions to determine how the selected content areas align with students’ difficulties. The questions were generated and trialled with different groups of students. Each version of the survey was critiqued by a group of discipline and teaching experts to establish its validity. The survey was administered to 312 students at the University of Sydney. Using the data from this sample, we performed five statistical tests (item difficulty index, item discrimination index, item point biserial coefficient, KR‐21 reliability test, and Ferguson’s delta) to evaluate the test’s reliability and discriminatory power. The result indicates that our survey is a reliable test. This study also provided data from which preliminary findings were drawn on students’ understandings of introductory quantum physics concepts. The main point is that questions which require an understanding of the standard interpretations of quantum physics are more challenging for students than those grouped as non‐interpretative. The division of conceptual questions into interpretive and non‐interpretive needs further exploration.     

Developing,Evaluating and Demonstrating the Use of a Conceptual Survey in Mechanical Waves

An understanding of mechanical waves is a pre‐requisite for the study of many topics in advanced physics, and indeed in many other disciplines. There have been many research studies in mechanical waves, all of which have revealed that students have trouble with the basic concepts. Therefore, in order for teachers to prepare appropriate instruction for their classes, it is useful to diagnose their students' conceptions—if possible before they enter class. It is for this purpose that many diagnostic instruments have been developed, often in the form of multiple‐choice tests. In this study, we have used the open‐ended Wave Diagnostic Test to develop a multiple‐choice conceptual survey in an evolutionary manner. The two‐year development procedure included open‐ended surveys and interviews involving 299 Thai students and 88 Australian students. The final version, called the Mechanical Waves Conceptual Survey, has been administered to 632 Australian students from high school to second‐year university and 270 Thai high school students. Standard statistical analyses show that the survey is reliable and valid. Further validity checks, including consultation with experts, were also carried out. The survey has four subtopics—propagation, superposition, reflection, and standing waves—and the teachers can choose the subtopics relevant for their students. In this paper we also demonstrate the use of a typical survey question to test students' conceptual understanding and identify common alternative conceptions.