Assessing Students’ Deep Conceptual Understanding in Physical Sciences: an Example on Sinking and Floating

This paper presents a transformative modeling framework that guides the development of assessment to measure students’ deep understanding in physical sciences. The framework emphasizes 3 types of connections that students need to make when learning physical sciences: (1) linking physical states, processes, and explanatory models, (2) integrating multiple explanatory models, and (3) connecting scientific models to concrete experiences. We carried out a 2-phase exploratory study that helped further develop and refine the framework. In the first phase, we developed 3 items on sinking and floating and pilot tested them with 18 undergraduate students. Analysis of student responses revealed various student misconceptions and the different connections students made among science ideas. Based on the findings, we revised the assessment, modified the instruction, and collected data from another cohort of 26 students. The second cohort of students showed significant improvement of understanding of sinking and floating after instruction. Implications and limitations of how our assessment framework can be used to improve students’ conceptual understanding in science are discussed.     

How to use (five) curriculum design principles to align authentic learning environments,assessment, students’ approaches to thinking and learning outcomes

In this article, we articulate five principles of curriculum design and illustrate their application in a third‐year undergraduate course for environmental and ecological scientists. In this way, we provide a practical framework for others wishing to enhance their students’ learning. To apply the five principles, we created a learning environment consisting of a broad range of learning resources and activities which were structured and sequenced with an integrated assessment strategy. The combined effect of this ensured alignment between the learning environment we created, the thinking approaches students used and the learning outcomes they achieved. More specifically, the assessment activities guided students by requiring them to recognise when their understanding was limited – and then to engage them in thinking approaches that would develop their understanding further. By providing a framework of thoughts, ideas and information, we sought to progressively enhance the sophistication of our learners’ thinking. Thus, the assessment required students to integrate, synthesise and construct their understandings in ways consistent with the discipline and the professional pathways on which they had embarked. We intend that this illustration will act as a guide to other academics to adopt the same principles in their teaching.     

Understanding the Greenhouse Effect by Embodiment – Analysing and Using Students' and Scientists' Conceptual Resources

Over the last 20 years, science education studies have reported that there are very different understandings among students of science regarding the key aspects of climate change. We used the cognitive linguistic framework of experientialism to shed new light on this valuable pool of studies to identify the conceptual resources of understanding climate change. In our study, we interviewed 35 secondary school students on their understanding of the greenhouse effect and analysed the conceptions of climate scientists as drawn from textbooks and research reports. We analysed all data by metaphor analysis and qualitative content analysis to gain insight into students' and scientists' resources for understanding. In our analysis, we found that students and scientists refer to the same schemata to understand the greenhouse effect. We categorised their conceptions into three different principles the conceptions are based on: warming by more input, warming by less output, and warming by a new equilibrium. By interrelating students' and scientists' conceptions, we identified the students' learning demand: First, our students were afforded with experiences regarding the interactions of electromagnetic radiation and CO₂. Second, our students reflected about the experience-based schemata they use as source domains for metaphorical understanding of the greenhouse effect. By uncovering the—mostly unconscious—deployed schemata, we gave students access to their source domains. We implemented these teaching guidelines in interventions and evaluated them in teaching experiments to develop evidence-based and theory-guided learning activities on the greenhouse effect.     

The Influence of Toy Design Activities on Middle School Students’ Understanding of the Engineering Design Processes

The societal demand for inspiring and engaging science, technology, engineering, and mathematics (STEM) students and preparing our workforce for the emerging creative economy has necessitated developing students’ self-efficacy and understanding of engineering design processes from as early as elementary school levels. Hands-on engineering design activities have shown the potential to promote middle school students’ self-efficacy and understanding of engineering design processes. However, traditional classrooms often lack hands-on engineering design experiences, leaving students unprepared to solve real-world design problems. In this study, we introduce the framework of a toy design workshop and investigate the influence of the workshop activities on students’ understanding of and self-efficacy beliefs in engineering design. Using a mixed method approach, we conducted quantitative analyses to show changes in students’ engineering design self-efficacy and qualitative analyses to identify students’ understanding of the engineering design processes. Findings show that among the 24 participants, there is a significant increase in students’ self-efficacy beliefs after attending the workshop. We also identified major themes such as design goals and prototyping in students’ understanding of engineering design processes. This research provides insights into the key elements of middle school students’ engineering design learning and the benefits of engaging middle school students in hands-on toy design workshops.     

Investigating the Impact of Using a CAD Simulation Tool on Students’ Learning of Design Thinking

Engineering design thinking is hard to teach and still harder to learn by novices primarily due to the undetermined nature of engineering problems that often results in multiple solutions. In this paper, we investigate the effect of teaching engineering design thinking to freshmen students by using a computer-aided Design (CAD) simulation software. We present a framework for characterizing different levels of engineering design thinking displayed by students who interacted with the CAD simulation software in the context of a collaborative assignment. This framework describes the presence of four levels of engineering design thinking—beginning designer, adept beginning designer, informed designer, adept informed designer. We present the characteristics associated with each of these four levels as they pertain to four engineering design strategies that students pursued in this study—understanding the design challenge, building knowledge, weighing options and making tradeoffs, and reflecting on the process. Students demonstrated significant improvements in two strategies—understanding the design challenge and building knowledge. We discuss the affordances of the CAD simulation tool along with the learning environment that potentially helped students move towards Adept informed designers while pursuing these design strategies.     

SodaConstructing knowledge through exploratoids

In this article, we describe a preliminary study that integrates research on engineering design activities for K‐12 students with work on microworlds as learning tools. Here, we extend these bodies of research by exploring whether—and how—authentic recreations of engineering practices can help students develop conceptual understanding of physics. We focus on the design–build–test (DBT) cycle used by professional engineers in simulation‐based rapid modeling. In this experiment, middle‐school students worked for 10 hr during a single weekend to solve engineering design challenges using SodaConstructor, a Java‐based microworld, as a simulation environment. As a result of the experiment, students learned about center of mass. Our data further suggest that in the process of simulation‐based modeling, rapid iterations of the DBT cycle progressively linked students' interest in the design activities and understanding of the concept of center of mass. We suggest that these rapid iterations of the DBT cycle functioned as exploratoids: short fragments of exploratory action in a microworld that cumulatively develop interest in and understanding of important scientific concepts. © 2006 Wiley Periodicals, Inc. J Res Sci Teach     

Scientific arguments as learning artifacts: designing for learning from the web with KIE

We designed Knowledge Integration Environment (KIE) debate projects to take advantage of internet resources and promote student understanding of science. Design decisions were guided by the Scaffolded Knowledge Integration instructional framework. We report on design studies that test and elaborate on our instructional framework. Our learning studies assess the arguments students construct using the Knowledge Integration Environment debate project about light propagation and, explore the relationship between students' views of the nature of science and argument construction. We examine how students use evidence, determine when they add further ideas and claims and measure progress in understanding light propagation. To a modeate degree, students' views of the nature of science align with the quality of the arguments.     

Questioning as thinking: a metacognitive framework to improve comprehension of expository text

Despite a push to develop high levels of active engagement in learning by helping students reflect, refine and extend their ideas through effective questioning strategies, evidence suggests that teacher‐dominated interaction patterns permeate classroom instruction. This Initiate, Respond and Evaluate process leads students to maintain a passive stance towards learning and non‐engagement with text. As a result students fail to develop the strategies to solve comprehension problems and monitor their own learning with text. In contrast, effective, active instructional patterns provide students with opportunities to negotiate textual meaning. Through the use of the Question as Thinking framework we provide teachers with tools to enable pupils to reflect on their reading and understanding of expository texts. This article describes a framework for questioning designed to assist in the development of an active instructional pattern promoting the joint negotiation of meaning.     

Teaching science as a language: A “content‐first” approach to science teaching

Our research project was guided by the assumption that students who learn to understand phenomena in everyday terms prior to being taught scientific language will develop improved understanding of new concepts. We used web‐based software to teach students using a “content‐first” approach that allowed students to transition from everyday understanding of phenomena to the use of scientific language. This study involved 49 minority students who were randomly assigned into two groups for analysis: a treatment group (taught with everyday language prior to using scientific language) and a control group (taught with scientific language). Using a pre–post‐test control group design, we assessed students' conceptual and linguistic understanding of photosynthesis. The results of this study indicated that students taught with the “content‐first” approach developed significantly improved understanding when compared to students taught in traditional ways. © 2008 Wiley Periodicals, Inc. J Res Sci Teach 45: 529–553, 2008     

Managing cognitive load in educational multi-user virtual environments: reflection on design practice

In this paper, we explore how the application of multimedia design principles may inform the development of educational multi-user virtual environments (MUVEs). We look at design principles that have been shown to help learners manage cognitive load within multimedia environments and conduct a conjectural analysis of the extent to which such principles can help manage cognitive load in the highly immersive “beyond multimedia” environments that 3-D educational MUVEs represent. We frame our discussion as a design practice analysis of the River City MUVE, a science inquiry environment that has middle school students collaborating to develop and test hypotheses regarding illnesses sweeping a virtual town. We analyze the current River City interface design using a framework describing cognitive overload scenarios and associated approaches to manage cognitive load. We also discuss the potential difficulties that may be seen as multimedia principles are applied to 3-D MUVEs. Our discussion describes a blueprint for research implementations that we are undertaking to systematically investigate the effect of an educational MUVE interface design based on multimedia principles—implementations that we hope will provide an action framework for other MUVE researchers to use in their own studies.     

Embracing student experience in inclusive design education through learner-centred instruction

This paper explores the process and outcome of using learner-centred methods to develop students’ empathic design abilities during an educational workshop on inclusive design. In the first section of the paper, we suggest the significance of incorporating inclusive design within the education of design disciplines. Then, we introduce a workshop on inclusive design awareness that architecture and interior design students participated, which applied various learner-centred methods. We discuss the process that incorporated project-based learning, role-playing/simulation and students’ reflections and feedback on their experience. The workshop process, the student project experience and students’ reflections on their learning indicate how multiple methods of learning engage students and enhance their empathic understanding so they can embrace differences and adopt a user-centred design approach. Based on the findings, we provide suggestions for similar educational events that can be applied in other disciplinary contexts.     

Nurturing Students’ Critical Knowledge Using Technology-enhanced Scaffolding Strategies in Science Education

Critique is central to the development of scientific knowledge. From a cognitive perspective, critique can be used to enhance understanding. From a social perspective, critique serves to maintain the standards of a professional field. In science education, it is of tremendous value to diagnose and nurture students’ critical knowledge. How students develop and apply criteria for critique, however, remains unclear. What factors influence students’ performance of critique, and how can educators incorporate technology-enhanced scaffolding strategies to help diagnose and nurture students’ critical knowledge? In this paper, I define critical knowledge as the criteria people use to evaluate other knowledge, the ability to use these criteria across contexts, and the reflective understanding of such processes. Building on existing literature, I develop a conceptual framework that describes the components and processes involved in a critique activity. Using this framework, I discuss the application of technology-enhanced scaffolding strategies to facilitate critique activities in science classrooms.     

Developing the ability to recontextualise cellular respiration: an explorative study in recontextualising biological concepts

In many science education practices, students are expected to develop an understanding of scientific knowledge without being allowed a view of the practices and cultures that have developed and use this knowledge. Therefore, students should be allowed to develop scientific concepts in relation to the contexts in which those concepts are used. Since many concepts are used in a variety of contexts, students need to be able to recontextualise and transfer their understanding of a concept from one context to another. This study aims to develop a learning and teaching strategy for recontextualising cellular respiration. This article focuses on students’ ability to recontextualise cellular respiration. The strategy allowed students to develop their understanding of cellular respiration by exploring its use and meaning in different contexts. A pre- and post-test design was used to test students’ understanding of cellular respiration. The results indicate that while students did develop an acceptable understanding of cellular respiration, they still had difficulty with recontextualising the concept to other contexts. Possible explanations for this ack of understanding are students’ familiarity with the biological object of focus in a context, the manner in which this object is used in a context and students’ understanding of specific elements of cellular respiration during the lessons. Although students did develop an adequate understanding of the concept, they do need more opportunities to practice recontextualising the concept in different contexts. Further research should focus on improving the strategy presented here and developing strategies for other core concepts in science.     

E-textbooks and Connectivity: Proposing an Analytical Framework

This paper is concerned with the development of e-textbooks. We claim that analysis (and design) of e-textbooks requires the development of a specific frame. Digital affordances provide particular opportunities (e.g. in terms of interactions between users) that require specific considerations for their analysis, as teachers and students use them for their individual and collective purposes. In this study, we develop a framework for mathematics e-textbook analysis, based on the notion of “connectivity.” We introduce criteria to assess the different aspects of connectivity and build an analysis grid for e-textbooks. We illustrate the framework proposed by analyzing 2 commonly used French grade 10 mathematics e-textbooks. The results of the analyses show that there are major differences between the 2 e-textbooks in terms of connectivity, which can be related to differences in their design. Beyond these 2 examples, we claim that focusing on connectivity is a useful and relevant way of analyzing e-textbooks, as it can provide a window into issues of interactivity, both practically and cognitively.     

Supporting Knowledge Integration in Chemistry with a Visualization-Enhanced Inquiry Unit

This paper describes the design and impact of an inquiry-oriented online curriculum that takes advantage of dynamic molecular visualizations to improve students’ understanding of chemical reactions. The visualization-enhanced unit uses research-based guidelines following the knowledge integration framework to help students develop coherent understanding by connecting and refining existing and new ideas. The inquiry unit supports students to develop connections among molecular, observable, and symbolic representations of chemical reactions. Design-based research included a pilot study, a study comparing the visualization-enhanced inquiry unit to typical instruction, and a course-long comparison study featuring a delayed posttest. Students participating in the visualization-enhanced unit outperformed students receiving typical instruction and further consolidated their understanding on the delayed posttest. Students who used the visualization-enhanced unit formed more connections among concepts than students with typical textbook and lecture-based instruction. Item analysis revealed the types of connections students made when studying the curriculum and suggested how these connections enabled students to consolidate their understanding as they continued in the chemistry course. Results demonstrate that visualization-enhanced inquiry designed for knowledge integration can improve connections between observable and atomic-level phenomena and serve students well as they study subsequent topics in chemistry.     

Examining Middle School Students’ Engineering Design Processes in a Design Workshop

Design thinking has an important role in STEM education. However, there has been limited research on how students engage in various modalities throughout the design process in hands-on design tasks. To promote middle school students’ engineering literacy, it is necessary to examine the use of design modalities during design. Using a case study approach, we examine middle school students’ design stages and modalities during design activities. We also identify the patterns of design processes in the teams with different design outcomes. Drawing on theories in design thinking and embodied interaction, we proposed a framework and devised a video analysis protocol to examine students’ design stages and modalities. Middle school students attending a design workshop engaged in two design activities in teams of 3–4 people. The design sessions were video recorded and analyzed using the video analysis protocol. The teams engaged in the stages of planning, building, and testing, while employing the verbal, the visual, and the physical modalities. The teams that varied in design outcomes exhibited different patterns in the use of multiple modalities during the design stages. This study contributes to research on design thinking by proposing a framework for analyzing middle school students’ multimodal design processes and presenting data visualization methods to identify patterns in design stages and modalities. The findings suggest the necessity to examine students’ use of design modalities in the context of design stages and imply the potential benefits of using multiple modalities during design. The implications for future research and education practices are also discussed.

     

Students’ understanding of the structure of deductive proof

While proof is central to mathematics, difficulties in the teaching and learning of proof are well-recognised internationally. Within the research literature, a number of theoretical frameworks relating to the teaching of different aspects of proof and proving are evident. In our work, we are focusing on secondary school students learning the structure of deductive proofs and, in this paper, we propose a theoretical framework based on this aspect of proof education. In our framework, we capture students’ understanding of the structure of deductive proofs in terms of three levels of increasing sophistication: Pre-structural, Partial-structural, and Holistic-structural, with the Partial-structural level further divided into two sub-levels: Elemental and Relational. In this paper, we apply the framework to data from our classroom research in which secondary school students (aged 14) tackled a series of lessons that provided an introduction to proof problems involving congruent triangles. Using data from the transcribed lessons, we focus in particular on students who displayed the tendency to accept a proof that contained logical circularity. From the perspective of our framework, we illustrate what we argue are two independent aspects of Relational understanding of the Partial-structural level, those of universal instantiation and hypothetical syllogism, and contend that accepting logical circularity can be an indicator of lack of understanding of syllogism. These findings can inform how teaching approaches might be improved so that students develop a more secure understanding of deductive proofs and proving in geometry.     

Investigating the mechanisms of learning from a constrained preparation for future learning activity

Many studies have shown benefits associated with engaging students in problem-solving activities prior to administering lessons. These problem-solving activities are assumed to activate relevant knowledge and allow students to develop some initial knowledge structures, which support understanding of the lesson. In this paper we report the results of two studies in which we investigated the underlying benefits of engaging in a preparatory activity—setting up experiments without running them or receiving feedback—prior to an interactive computerized lesson on experimental design compared to only engaging in the interactive lesson. We predicted that the seventh-grade participants who demonstrated some initial knowledge of the topic—experimental design—would benefit more from spending the whole time engaged in instructional activities. However, we expected students who did not demonstrate initial knowledge would benefit more from engaging in the preparatory activity, which would allow them to activate or develop initial knowledge that would aid their understanding of the subsequent instruction. The predicted condition by initial knowledge interaction was found in both studies. In Study 1, the benefit of only engaging in the instruction was found only for the lowest-knowledge of students who demonstrated initial knowledge. For students who did not demonstrate some initial knowledge, the benefit of completing the preparatory activity appeared to be due to the development of an understanding of the general goal of the activity rather than of specific knowledge of experimental design. Based on this finding, in Study 2, we investigated an initial goal by condition interaction. In fact, students who did not express an understanding of the task goal on the pretest benefited from engaging in the preparatory activity and students who did benefited more from the instruction. Again, this benefit appeared to be due to students’ development of an appropriate understanding of the task goal during the preparatory activity.     

Student engagement in the educational interface: understanding the mechanisms of student success

Student success and retention continue to be of concern for higher education institutions. Wider participation, combined with lower completion rates for non-traditional students, highlights the need for new ways of understanding the student experience to ground policy and practice. This article provides this insight by drawing together a number of key constructs to refine a recent framework of student engagement. We argue that the transition metaphor, focusing on the first year, is limited because it depicts differences between students and institutions as both transient and temporal. Instead, we use a cultural lens to introduce the educational interface as a metaphor for the individual psychosocial space within which institutional and student factors combine and student engagement in learning occurs. Incorporating the interface into the existing framework of student engagement makes three contributions to our understanding of the student experience. First, the educational interface is a tangible way of representing the complex interactions between students and institutions, and how those interactions influence engagement. Second, the refined framework highlights four specific psychosocial constructs: self-efficacy, emotions, belonging and well-being, which, we contend, are critical mechanisms for mediating the interactions between student and institutional characteristics and student engagement and success. Finally, the refined framework helps to explain why some students with demographic characteristics associated with lower completion rates are retained and do go on to successfully complete their studies, while similar others do not. These three contributions, the interface, the key constructs within it being mediating mechanisms and their explanatory utility, provide focus for the design and implementation of curricula and co-curricular initiatives aimed at enhancing student success and retention, and importantly to evaluate the impact of these interventions.