Conceptualizing Student Affect for Science and Technology at the Middle School Level: Development and Implementation of a Measure of Affect in Science and Technology (MAST)

We describe the development of the Measure of Affect in Science and Technology (MAST), and study its usefulness for measuring science affect in middle school students via both classical and Rasch measurement perspectives. We then proceed to utilize the measurement structure of the MAST to understand how middle school students at varying levels of affect express their interest and attitudes toward science and technology and gender differences in how students express their affect. We found that affect in science and technology comprises a main dimension, science interest, and four peripheral dimensions: interest in careers in science and technology, attitudes toward science, and interest in attending science class. Of these, careers in science and technology carry the highest affective demand. While males showed higher levels of personal and situational interest in science, a greater interest in careers in science and technology was the biggest contributor to males’ higher affect toward science and technology. We argue that whether the MAST is used as a measure of a single construct or multiple subconstructs depends upon specific research or evaluation goals; however, both uses of the MAST yield measures which produce valid inferences for student affect.     

Assessing the efficacy of the Measure of Understanding of Macroevolution as a valid tool for undergraduate non-science majors

Efficacy of the Measure of Understanding of Macroevolution (MUM) as a measurement tool has been a point of contention among scholars needing a valid measure for knowledge of macroevolution. We explored the structure and construct validity of the MUM using Rasch methodologies in the context of a general education biology course designed with an emphasis on macroevolution content. The Rasch model was utilized to quantify item- and test-level characteristics, including dimensionality, reliability, and fit with the Rasch model. Contrary to previous work, we found that the MUM provides a valid, reliable, and unidimensional scale for measuring knowledge of macroevolution in introductory non-science majors, and that its psychometric behavior does not exhibit large changes across time. While we found that all items provide productive measurement information, several depart substantially from ideal behavior, warranting a collective effort to improve these items. Suggestions for improving the measurement characteristics of the MUM at the item and test levels are put forward and discussed.     

Empirical validation of a modern genetics progression web for college biology students

ABSTRACT

Research in learning progressions (LPs) has been essential towards building understanding of how students’ ideas change over time. There has been little work, however, into how ideas between separate but related constructs within a multi-faceted LP relate. The purpose of this paper is to elaborate on the idea of progression webs to model connections within and between related constructs simultaneously, and to explain and demonstrate the efficacy of path analysis towards validating a hypothesised progression web for understanding of modern genetics. Specifically, we evaluate strength of evidence for a progression web based upon multiple related constructs within a multi-faceted LP describing undergraduate biology students’ understanding of genetics. We then utilise the progression web to generalise theory around how undergraduate students understand relationships between related genetics concepts, and how they use simpler concepts to scaffold those which are more complex.     

Learning science content through socio-scientific issues-based instruction: a multi-level assessment study

Science educators have presented numerous conceptual and theoretical arguments in favor of teaching science through the exploration of socio-scientific issues (SSI). However, the empirical knowledge base regarding the extent to which SSI-based instruction supports student learning of science content is limited both in terms of the number of studies that have been conducted in this area and the quality of research. This research sought to answer two questions: (1) To what extent does SSI-based instruction support student learning of science content? and (2) How do assessments at variable distances from the curriculum reveal patterns of learning associated with SSI-based instruction? Sixty-nine secondary students taught by three teachers participated in the study. Three teachers implemented an SSI intervention focused on the use of biotechnology for identifying and treating sexually transmitted diseases. We found that students demonstrated statistically and practically significant gains in content knowledge as measured by both proximal and distal assessments. These findings support the claim that SSI-based teaching can foster content learning and improved performance on high-stakes tests.     

Impacts of enquiry-based science teaching on achievement gap between high-and-low SES students: findings from PISA 2015

The purpose of this study was to empirically investigate, in a large-scale assessment, the prevalence of enquiry-based teaching, as defined by PISA, implemented in science lessons, and the extent to which it is related to students from different socioeconomic status (SES) family backgrounds in the U.S. The Programme of International Student Assessment (PISA) 2015 data including 5,146 students in the U.S. were used. A Latent Profile Analysis (LPA) was conducted to classify students into different science teaching subgroups. Mixture regression analysis was conducted to examine whether there the association between SES and achievement varied across science teaching subgroups. Four science teaching subgroups were identified, varying in the frequency of and type of teaching practices used. Students’ attitudes, gender, science instruction time, and reading achievement are significant predictors of the subgroup membership. SES-achievement gap also varied across the science teaching subgroups. Discussions for the results and suggestions for future study were presented.     

Exploring Secondary Students' Knowledge and Misconceptions about Influenza: Development,validation, and implementation of a multiple-choice influenza knowledge scale

Understanding infectious diseases such as influenza is an important element of health literacy. We present a fully validated knowledge instrument called the Assessment of Knowledge of Influenza (AKI) and use it to evaluate knowledge of influenza, with a focus on misconceptions, in Midwestern United States high-school students. A two-phase validation process was used. In phase 1, an initial factor structure was calculated based on 205 students of grades 9–12 at a rural school. In phase 2, one- and two-dimensional factor structures were analyzed from the perspectives of classical test theory and the Rasch model using structural equation modeling and principal components analysis (PCA) on Rasch residuals, respectively. Rasch knowledge measures were calculated for 410 students from 6 school districts in the Midwest, and misconceptions were verified through the χ ² test. Eight items measured knowledge of flu transmission, and seven measured knowledge of flu management. While alpha reliability measures for the subscales were acceptable, Rasch person reliability measures and PCA on residuals advocated for a single-factor scale. Four misconceptions were found, which have not been previously documented in high-school students. The AKI is the first validated influenza knowledge assessment, and can be used by schools and health agencies to provide a quantitative measure of impact of interventions aimed at increasing understanding of influenza. This study also adds significantly to the literature on misconceptions about influenza in high-school students, a necessary step toward strategic development of educational interventions for these students.     

Customization of Curriculum Materials in Science: Motives, Challenges, and Opportunities

Exemplary science instructors use inquiry to tailor content to student’s learning needs; traditional textbooks treat science as a set of facts and a rigid curriculum. Publishers now allow instructors to compile pieces of published and/or self-authored text to make custom textbooks. This brings numerous advantages, including the ability to produce smaller, cheaper text and added flexibility on the teaching models used. Moreover, the internet allows instructors to decentralize textbooks through easy access to educational objects such as audiovisual simulations, individual textbook chapters, and scholarly research articles. However, these new opportunities bring with them new problems. With educational materials easy to access, manipulate and duplicate, it is necessary to define intellectual property boundaries, and the need to secure documents against unlawful copying and use is paramount. Engineers are developing and enhancing information embedding technologies, including steganography, cryptography, watermarking, and fingerprinting, to label and protect intellectual property. While these are showing their utility in securing information, hackers continue to find loop holes in these protection schemes, forcing engineers to constantly assess the algorithms to make them as secure as possible. As newer technologies rise, people still question whether custom publishing is desirable. Many instructors see the process as complex, costly, and substandard in comparison to using traditional text. Publishing companies are working to improve attitudes through advertising. What lacks is peer reviewed evidence showing that custom publishing improves learning. Studies exploring the effect of custom course materials on student attitude and learning outcomes are a necessary next step.     

The influence of exercise-induced fatigue on cognitive function

Abstract

Although anecdotal reports suggest that information processing and decision making is impaired immediately following prolonged periods of physical activity, results obtained from laboratory studies of exercise-induced fatigue have been inconsistent. Fatigue effects may be task specific and related to the time of post-exercise testing. The present study examined the effects on adults' performance of two cognitive tasks that differed in processing demands over an 80-min period of fatigue. Thirty young adult men and women were randomly assigned to either an exercise group and completed a 60-min bout of cycle ergometry at 90% ventilatory threshold or a control group and rested for 60 min. Following interventions, each participant completed a simple and complex version of a visual perceptual discrimination test, a 40-min memory-based vigilance test and a repetition of the visual perceptual discrimination tests. Those who exercised evidenced significant decrements in performance on complex perceptual-discrimination tasks compared to participants who rested. The response time of exercisers during a memory-demanding vigilance test were significantly slower than those of participants who rested; however, detection performance did not differ between groups neither was there a decrease in target detection across the vigil. The effects of exercise-induced fatigue may be task specific, with greater effects on perceptual tasks, which involve relatively automatic processing, compared to effortful memory-based tasks.