Assessing students' ability to trace matter in dynamic systems in cell biology

College-level biology courses contain many complex processes that are often taught and learned as detailed narratives. These processes can be better understood by perceiving them as dynamic systems that are governed by common fundamental principles. Conservation of matter is such a principle, and thus tracing matter is an essential step in learning to reason about biological processes. We present here multiple-choice questions that measure students' ability and inclination to trace matter through photosynthesis and cellular respiration. Data associated with each question come from students in a large undergraduate biology course that was undergoing a shift in instructional strategy toward making fundamental principles (such as tracing matter) a central theme. We also present findings from interviews with students in the course. Our data indicate that 1) many students are not using tracing matter as a tool to reason about biological processes, 2) students have particular difficulties tracing matter between systems and have a persistent tendency to interconvert matter and energy, and 3) instructional changes seem to be effective in promoting application of the tracing matter principle. Using these items as diagnostic tools allows instructors to be proactive in addressing students' misconceptions and ineffective reasoning.     

问题教学:实施“情·知教学”的关键策略

“问题教学”是实施“情·知教学”的关键策略 ;“问题教学”必须对学生的问题采取“立体结构”的教学形式 ;“实际性”与“发展性”是实施“问题教学”策略的最基本、最核心的创境原则。     

When Teachers Misspell

Multiple-choice exams are often the standard in large, introductory college courses. Although students sometimes report that multiple-choice exams are easier than essay exams, the multiple-choice format often proves to be more difficult. This may be true because multiple-choice exams in college are often composed predominantly of application questions. They ask students to grapple with scenarios and recognize concepts in context, which proves to be difficult for many students. The author details the changes she has made in her introductory sociology curriculum and discusses some of the indicators of success.     

Impact of text availability and question format on reading comprehension processes

We conducted two experiments to analyze how text availability and question format affect readers’ processes and performance on measures of expository text reading comprehension. Junior high school students read expository texts and answered both multiple choice and open-ended questions on a computer that recorded reading times and readers’ actions with Read&Answer software. The results showed that readers reread prior text segments during initial reading of the text more often when they knew that the text would be unavailable when answering questions than when they knew that the text would be available. In addition, readers made more search decisions in the text- available condition when answering open-ended questions than when answering multiple-choice questions. Regarding performance, we repeatedly found an interaction effect between availability and question format: text availability benefited the open-ended but not the multiple-choice format. We concluded that the two availability conditions are useful in assessing different discourse processes. We discuss theoretical and practical implications for the development of models of reading and new ways to assess reading literacy skills that emphasize purposeful reading.     

高考数学选择题科学命题之我见

命题是教育测量的重要环节,是决定评价、有效与否的关键。高考数学选择题命题是否科学、合理关乎高考数学是否能准确、科学地对考生进行有效评价和考量,对于考生的发展与进一步学习,以及教学活动的组织和教学改革的开展有着不可忽视的意义。本文通过实验设计进行对比研究,进一步讨论高考数学选择题评价考生的利弊,并在此基础上就科学命题提出己见。     

Harnessing technology to improve formative assessment of student conceptions in STEM: forging a national network

Concept inventories, consisting of multiple-choice questions designed around common student misconceptions, are designed to reveal student thinking. However, students often have complex, heterogeneous ideas about scientific concepts. Constructed-response assessments, in which students must create their own answer, may better reveal students' thinking, but are time- and resource-intensive to evaluate. This report describes the initial meeting of a National Science Foundation-funded cross-institutional collaboration of interdisciplinary science, technology, engineering, and mathematics (STEM) education researchers interested in exploring the use of automated text analysis to evaluate constructed-response assessments. Participants at the meeting shared existing work on lexical analysis and concept inventories, participated in technology demonstrations and workshops, and discussed research goals. We are seeking interested collaborators to join our research community.     

Exploring the effect of background knowledge and text cohesion on learning from texts in computer science

In this study, we examine the effect of background knowledge and local cohesion on learning from texts. The study is based on construction–integration model. Participants were 176 undergraduate students who read a Computer Science text. Half of the participants read a text of maximum local cohesion and the other a text of minimum local cohesion. Afterwards, they answered open-ended and multiple-choice versions of text-based, bridging-inference and elaborative-inference questions. The results showed that students with high background knowledge, reading the low-cohesion text, performed better in bridging-inference and in elaborative-inference questions, than those who read the high-cohesion text. Students with low background knowledge, reading the high-cohesion text, performed better in all types of questions than students reading the low-cohesion text only in elaborative-inference questions. The performance with open-ended and multiple-choice questions was similar, indicating that this type of question is more difficult to answer, regardless of the question format.     

Written justifications to multiple-choice concept questions during active learning in class

Increasingly, instructors of large, introductory STEM courses are having students actively engage during class by answering multiple-choice concept questions individually and in groups. This study investigates the use of a technology-based tool that allows students to answer such questions during class. The tool also allows the instructor to prompt students to provide written responses to justify the selection of the multiple-choice answer that they have chosen. We hypothesize that prompting students to explain and elaborate on their answer choices leads to greater focus and use of normative scientific reasoning processes, and will allow them to answer questions correctly more often. The study contains two parts. First, a crossover quasi-experimental design is employed to determine the influence of asking students to individually provide written explanations (treatment condition) of their answer choices to 39 concept questions as compared to students who do not. Second, we analyze a subset of the questions to see whether students identify the salient concepts and use appropriate reasoning in their explanations. Results show that soliciting written explanations can have a significant influence on answer choice and, when it does, that influence is usually positive. However, students are not always able to articulate the correct reason for their answer.     

Using a fine-grained multiple-choice response format in educational drill-and-practice video games

When using educational video games, particularly drill-and-practice video games, there are several ways of providing an answer to a quiz. The majority of paper-based options can be classified as being either multiple-choice or constructed-response. Therefore, in the process of creating an educational drill-and-practice video game, one fundamental question to be answered is which is the most appropriate response format? This paper answers this question, proposing a hybrid format that we call fine-grained multiple-choice, where the player constructs their response one element at a time, with each element chosen from a pre-defined set. A comparative study was conducted with second grade students. When comparing the impact of an educational drill-and-practice video game that uses multiple-choice with one that uses fine-grained multiple-choice, we observe that the fine-grained multiple-choice game achieved better results. However, the multiple-choice game was substantially more successful at capturing the students' interest and motivation. Considering the widespread use of the multiple-choice format in game-based learning activities, as well as in interactive activities, this research suggests rethinking what the most suitable answer format might be for each area of the curriculum and for the different types of games.     

A comparison of sentence-learning errors in children of different achievement levels

Theoretical analyses of the multiple-choice test format suggest that a test constructor should give serious consideration to the form in which correct and incorrect alternatives are presented. In this experiment, third and fourth graders were tested for previously exposed information by multiple-choice items in which: (a) correct alternatives were stated in either verbatim or synonym form; and (b) incorrect alternatives consisted of plausible responses that were either familiar or new. Comparisons of errors and error patterns were made between high and low achieving students who had been given one of two different information-processing strategies. Based on a dual test function argument, it was concluded that synonym correct alternatives combined with plausible new responses are the most desirable of the four multiple-choice variations studied here. In particular, such items were sensitive to achievement level and strategy differences without systematically increasing students' likelihood of retaining misinformation.     

Higher retention after a new take-home computerised test

A new computerised testing system was used at home to promote learning and also to save classroom instruction time. The testing system combined the features of short-answer and multiple-choice formats. The questions of the multiple-choice problems were presented without the options so that students had to generate answers for themselves; they could click for the options when they were ready, and could choose one of the options within a brief, specified time period. One hundred thirty-eight Korean sixth-grade students (12-year olds) were divided into two groups: the experimental group took the intervening test on social studies using the new computerised testing method, and the control group used a computerised version of the traditional multiple-choice method. A few days after the intervening computerised test, a recall posttest was given in paper-and-pencil format. The mean posttest score was greater for the experimental group than for the control group. Implications of the result are discussed.     

Mathematics Strategy Use in Solving Test Items in Varied Formats

Although test scores from similar tests in multiple choice and constructed response formats are highly correlated, equivalence in rankings may mask differences in substantive strategy use. The author used an experimental design and participant think-alouds to explore cognitive processes in mathematical problem solving among undergraduate examinees (N = 64). The study examined the effect of format on mathematics performance and strategy use for male and female examinees given stem-equivalent items. A statistically significant main effect of format on performance was found, with constructed-response items more difficult. The multiple-choice format was associated with more varied strategies, backward strategies, and guessing. Format was found to moderate the effect of problem conceptualization on performance. Results suggest that while for purposes of ranking students on performance, the multiple-choice format may be adequate, for many contemporary educational purposes that seek to provide nuanced information about student cognition, the constructed response format should be preferred.     

Examining the Impact of Question Surface Features on Students’ Answers to Constructed-Response Questions on Photosynthesis

One challenge in science education assessment is that students often focus on surface features of questions rather than the underlying scientific principles. We investigated how student written responses to constructed-response questions about photosynthesis vary based on two surface features of the question: the species of plant and the order of two question prompts. We asked four versions of the question with different combinations of the two plant species and order of prompts in an introductory cell biology course. We found that there was not a significant difference in the content of student responses to versions of the question stem with different species or order of prompts, using both computerized lexical analysis and expert scoring. We conducted 20 face-to-face interviews with students to further probe the effects of question wording on student responses. During the interviews, we found that students thought that the plant species was neither relevant nor confusing when answering the question. Students identified the prompts as both relevant and confusing. However, this confusion was not specific to a single version.     

合作式听写在新闻听力中的应用

传统的新闻听力训练往往局限于选择题,判断正误题,问答题,填空题,学生往往对新闻听力学习缺乏兴趣。本文作者结合长期新闻听力教学实践提出一种新的新闻听力模式：合作式听写。在这种模式下,学生两人一组合作共同完成一项听写,在此基础上,学生再进行听说读写的综合训练。这不仅能提高学生新闻听力学习的积极性,还能提高学生的听说读写综合运用能力。     

基础护理教学中的思维训练

在基础护理教学中，要提高学生的思维能力，必须从关注师生之间的情感交流入手，激发学生的学习兴趣，通过适时设疑、鼓励质疑、合理设置情境的方法，激活学生的思维，从而促进教学目标的实现。     

浅谈科学课中探究式教学的实践

开展探究式教学是现代教学改革的必然要求,其核心是通过探究式教学使学生能动地获取科学知识,掌握科学方法,养成科学态度和科学精神。认为在中学科学课堂中开展探究式教学,要创设情景,激发学生质疑;要营造融洽课堂氛围,鼓励学生思疑;要开展实践探究,引导学生解疑;要提出新问题,使学生带着问题走进教室,带着更多的问题走出教室。     

Effect of Cooperative Learning Strategies on Students' Understanding of Concepts in Electrochemistry

The present study was conducted to investigate the degree of effectiveness of cooperative learning instruction over a traditional approach on 11th grade students' understanding of electrochemistry. The study involved forty-one 11th grade students from two science classes with the same teacher. To determine students' misconceptions concerning electrochemistry, the Electrochemistry Concept Test consisting of 8 open-ended and 12 multiple-choice questions was used as a pre-test and some students were interviewed. According to the results, twenty-four misconceptions (six of them initially identified) about electrochemistry were identified. The classrooms were randomly assigned to a control group (traditional instruction, 21 students) and an experimental group (cooperative learning based on a constructivist approach, 20 students). After instruction, the same test was administered to both groups as a post-test. The results from the t-test indicated that the students who were trained using cooperative learning instruction had significantly higher scores in terms of achievement than those taught by the traditional approach. According to the post-test and interviews, it was also found that instruction for the cooperative group was more successful in remediation of the predetermined misconceptions.     

学校知识的性质与基础教育改革的方向

基础教育学校教学什么知识?如何教学知识?如何实现学生的全面发展?对这些问题的回答,体现着基础教育改革的思路,影响着基础教育改革的方向。我国“新课程理念”受后现代主义等“当代西方新理论”的影响,在学校知识的性质、学校知识教学的方式以及实现学生全面发展的途径等问题上存在诸多模糊认识,体现了其在基础教育改革思路上有原则性失误。以马克思主义教育原理为指导,超越后现代主义等“当代西方新理论”的知识观和教学观,坚持“教学以传授书本知识为主”和“教育同生产劳动相结合”的原则,才能保证我国基础教育改革的正确方向。     

A Comparison of Quantitative Questions in Open-Ended and Multiple-Choice Formats

Open–ended counterparts to a set of items from the quantitative section of the Graduate Record Examination (GRE–Q) were developed. Examinees responded to these items by gridding a numerical answer on a machine-readable answer sheet or by typing on a computer. The test section with the special answer sheets was administered at the end of a regular GRE administration. Test forms were spiraled so that random groups received either the grid-in questions or the same questions in a multiple-choice format. In a separate data collection effort, 364 paid volunteers who had recently taken the GRE used a computer keyboard to enter answers to the same set of questions. Despite substantial format differences noted for individual items, total scores for the multiple-choice and open-ended tests demonstrated remarkably similar correlational patterns. There were no significant interactions of test format with either gender or ethnicity.     

Clinico-histologic conferences: histology and disease

Providing a context for learning information and requiring learners to teach specific content has been demonstrated to enhance knowledge retention. To enhance students' appreciation of the role of science and specifically histology in clinical reasoning, disease diagnosis, and treatment, a new teaching format was created to provide clinical context, promote integration and application of science knowledge, and to foster peer teaching and learning: the Clinico-Histologic Conference (CHC) for the Mount Sinai School of Medicine Histology course. Teams of six students were each assigned specific disease processes and were charged with creating oral presentations and handouts that taught their classmates about the clinical manifestations, etiopathogeneses, diagnoses, and treatments of the assigned processes, along with comparisons of normal histology to the pathology of the disease. Each team also created four questions, some of which were used on Histology written examinations. The physician facilitator evaluated the presentation and handouts. About two-thirds of students agreed the CHC enhanced appreciation of the importance of histology, provided a context for integration and application of basic science to patient care and enhanced their ability to teach their peers. Student feedback demonstrated that the CHCs were successful in promoting teamwork, peer teaching, and the application of histology to diagnose diseases. The authors believe that teaching basic science content in this new format enhanced student learning and application of medical knowledge, and that this new teaching format can be adopted by other medical school courses.