Analyzing the temporal evolution of students’ behaviors in open-ended learning environments

Metacognition and self-regulation are important for developing effective learning in the classroom and beyond, but novice learners often lack effective metacognitive and self-regulatory skills. However, researchers have demonstrated that metacognitive processes can be developed through practice and appropriate scaffolding. Betty’s Brain, an open-ended computer-based learning environment, helps students practice their cognitive skills and develop related metacognitive strategies as they learn science topics. In this paper, we analyze students’ activity sequences in a study that compared different categories of adaptive scaffolding in Betty’s Brain. The analysis techniques for measuring students’ cognitive and metacognitive processes extend our previous work on using sequence mining methods to discover students’ frequently-used behavior patterns by (i) developing a systematic approach for interpreting derived behavior patterns using a cognitive/metacognitive task model and (ii) analyzing the evolution of students’ frequent behavior patterns over time. Our results show that it is possible to identify students’ learning behaviors and analyze their evolution as they work in the Betty’s Brain environment. Further, the results illustrate that changes in student behavior were generally consistent with the scaffolding provided, suggesting that these metacognitive strategies can be taught to middle school students in computer-based learning environments.     

Teachable Agents and the Protégé Effect: Increasing the Effort Towards Learning

Betty’s Brain is a computer-based learning environment that capitalizes on the social aspects of learning. In Betty’s Brain, students instruct a character called a Teachable Agent (TA) which can reason based on how it is taught. Two studies demonstrate the protégé effect: students make greater effort to learn for their TAs than they do for themselves. The first study involved 8th-grade students learning biology. Although all students worked with the same Betty’s Brain software, students in the TA condition believed they were teaching their TAs, while in another condition, they believed they were learning for themselves. TA students spent more time on learning activities (e.g., reading) and also learned more. These beneficial effects were most pronounced for lower achieving children. The second study used a verbal protocol with 5th-grade students to determine the possible causes of the protégé effect. As before, students learned either for their TAs or for themselves. Like study 1, students in the TA condition spent more time on learning activities. These children treated their TAs socially by attributing mental states and responsibility to them. They were also more likely to acknowledge errors by displaying negative affect and making attributions for the causes of failures. Perhaps having a TA invokes a sense of responsibility that motivates learning, provides an environment in which knowledge can be improved through revision, and protects students’ egos from the psychological ramifications of failure.     

Science-based laboratory comprehension: an examination of effective practices within traditional,online and blended learning environments

An increase in online education is causing science educators to evaluate student cognitive understanding after completing virtual, computer-simulated laboratories. Online education has demonstrated comparable learning gains when analysed to those of the traditional classroom, but research is mixed when reviewing students’ ability to manipulate tangible laboratory equipment after participating in online experimentation. The question remains, are students who are exclusively enrolled in online science courses equipped with the cognitive ability to operate laboratory equipment within a physical laboratory? When considering the optimal learning environment for science majors, educators have discovered the blended classroom may provide the perfect opportunity to combine the benefits of face-to-face instruction and feedback with the reinforcement of scientific theory through technology integration. New advances in virtual education provide promising examples of enhancing the online classroom laboratory in all scientific disciplines. Further insight into the blended classroom has the potential to influence the field of education towards an optimal learning environment for science majors in colleges and universities.     

The Comparative Effectiveness of Physical,Virtual, and Virtual-Physical Manipulatives on Third-Grade Students’ Science Achievement and Conceptual Understanding of Evaporation and Condensation

The purpose of this study was to investigate the relative effectiveness of experimenting with physical manipulatives alone, virtual manipulatives alone, and virtual preceding physical manipulatives (combination environment) on third-grade students’ science achievement and conceptual understanding in the domain of state changes of water, focusing on the concepts of evaporation and condensation. A pretest-posttest design was used that involved 208 third-grade students assigned to the three learning conditions. A science achievement test and a two-tier conceptual test were administered to students before and after a teaching intervention. The results revealed that using virtual preceding physical manipulatives and virtual manipulatives alone enhanced students’ knowledge gains about evaporation and condensation greater than the use of physical laboratory activities alone. It was also found that the combination environment promoted students’ knowledge gains about these concepts equally well as the use of virtual laboratory activities alone. On the other hand, the results showed that using virtual preceding physical manipulatives promoted students’ conceptual understanding most efficiently compared to the use of either physical or virtual manipulatives alone; in contrast, experimenting with physical manipulatives alone was least influential for students’ conceptual understanding compared to the other manipulatives.     

Sensor-Augmented Virtual Labs: Using Physical Interactions with Science Simulations to Promote Understanding of Gas Behavior

Deep learning of science involves integration of existing knowledge and normative science concepts. Past research demonstrates that combining physical and virtual labs sequentially or side by side can take advantage of the unique affordances each provides for helping students learn science concepts. However, providing simultaneously connected physical and virtual experiences has the potential to promote connections among ideas. This paper explores the effect of augmenting a virtual lab with physical controls on high school chemistry students’ understanding of gas laws. We compared students using the augmented virtual lab to students using a similar sensor-based physical lab with teacher-led discussions. Results demonstrate that students in the augmented virtual lab condition made significant gains from pretest and posttest and outperformed traditional students on some but not all concepts. Results provide insight into incorporating mixed-reality technologies into authentic classroom settings.     

Learning about Inheritance in an Out‐of‐School Setting

The purpose of this study was to investigate primary students’ learning through participation in an out‐of‐school enrichment programme, held in a science centre, which focused on DNA and genes and whether participation in the programme led to an increased understanding of inheritance as well as promoted interest in the topic. The sample consisted of two groups (245 students in the experimental group and 150 students in the control group) of upper primary students (Grade 5) from six schools in Singapore. Two instruments were developed—a 15‐item multiple‐choice test to measure learning gains and a 17‐item survey form to measure student feedback. Pre‐, post‐, and delayed post‐tests were administered. Results showed statistically significant gains in learning for the experimental group that appeared to be stable as well as high levels of interest stimulated by the programme.     

Realizing the full potential of individualizing learning

The potential of individualization to transform learning that new technology makes possible has generated wide interest. We ask here whether individualization has been exploited to its maximum advantage. We explore its potential to provide individualized scaffolding at the meta-level of students’ reflection on their own thinking as they engaged in inquiry activity to support their reasoning about a multivariable causal system – a capability central to scientific thinking and higher-order thinking more broadly. In Study 1, middle-school pairs’ self-paced inquiry was individually guided by an adult who prompted them to question their assertions and strategies. Study 2 investigated how such scaffolding might be automated to provide individualization at scale. Delayed posttests for both studies involving new scenarios showed that gains in both inquiry and multivariable causal inference skills transferred to new content. Delayed far-transfer assessments showed that the intervention achieved its learning goals most effectively when an adult worked with a pair of students, compared to students working as a whole class (Study 1); students also learned effectively with an automated agent, but only when a human adult was also involved (Study 2). Implications are considered for developing and deploying technology that individualizes and supports self-directed, reflective meta-level thinking and learning, while remaining mindful of human social context.     

Making inquiry-based science learning visible: the influence of CVS and cognitive skills on content knowledge learning in guided inquiry

ABSTRACT

Many science curricula and standards emphasise that students should learn both scientific knowledge and the skills associated with the construction of this knowledge. One way to achieve this goal is to use inquiry-learning activities that embed the use of science process skills. We investigated the influence of scientific reasoning skills (i.e. conceptual and procedural knowledge of the control-of-variables strategy) on students’ conceptual learning gains in physics during an inquiry-learning activity. Eighth graders (n?=?189) answered research questions about variables that influence the force of electromagnets and the brightness of light bulbs by designing, running, and interpreting experiments. We measured knowledge of electricity and electromagnets, scientific reasoning skills, and cognitive skills (analogical reasoning and reading ability). Using structural equation modelling we found no direct effects of cognitive skills on students’ content knowledge learning gains; however, there were direct effects of scientific reasoning skills on content knowledge learning gains. Our results show that cognitive skills are not sufficient; students require specific scientific reasoning skills to learn science content from inquiry activities. Furthermore, our findings illustrate that what students learn during guided inquiry activities becomes visible when we examine both the skills used during inquiry learning and the process of knowledge construction. The implications of these findings for science teaching and research are discussed.     

Early science learning with a virtual tutor through multimedia explanations and feedback on spoken questions

The purpose of this pilot study with a within-subject design was to gain a deeper understanding about the promise and restrictions of a virtual tutoring system designed to teach science to first grade students in Finland. Participants were 61 students who received six tutoring science sessions of approximately 20 min each. Sessions consisted of a sequence of narrated multimedia science presentations during which a virtual tutor explained science phenomena displayed in pictures. Narrated science explanations were followed by one or more multiple choice questions with immediate feedback about students’ choices and a possible second attempt, during which students reached 97% accuracy. A pretest and posttest was administered to assess students’ ability to reason about the science and to transfer knowledge to new contexts. Results indicated significantly greater improvement in the understanding of the science concepts taught during the tutoring sessions, relative to the concepts that were not taught. Results from the surveys administered to teachers and students indicated that the program was well received. Detailed analysis of student error responses provided a deeper understanding about the complex interplay between students’ prior knowledge, the way topics were taught in the multimedia lessons, and the way learning was assessed. Findings from the quantitative and qualitative analyses are discussed in the context of designing high quality lessons delivered through a virtual tutoring system.     

Learning science by doing science: an authentic science process-learning model in postsecondary education

Research on understanding the full extent that an authentic science research experience engages students in how scientists think and act is sparse. ‘Learning-science-by-doing-science’ (LSDS) is an emerging self-guided process-learning model in postsecondary science education. It offers authentic science research opportunities that drive students to think and act like scientists. This study investigates the LSDS approach as a potential model for science learning at postsecondary level and aims to answer a main research inquiry – what are the students’ and teaching staff’s perceptions of students’ learning gains and the quality of their learning experiences in an authentic research environment within the LSDS model? To answer this question, data were collected from the students, alumni, instructors, teaching assistants and the program director via questionnaires, focus groups and interviews. Students’ and staff’s lived experiences and their perceptions on their authentic research experiences within the LSDS model were used to articulate the key attributes and stages of the LSDS model. The outcomes of this study can be used to help other science programs implement similar authentic research process learning approaches in their own contexts.     

A digital game-based assessment of middle-school and college students’ choices to seek critical feedback and to revise

A major goal of contemporary education is to teach students how to learn on their own. Assessments have largely lagged behind this goal, because they measure what students have learned and not necessarily their learning processes. This research presents Posterlet, an assessment that collects evidence regarding the strategies that students choose while learning on their own. Posterlet is an educational game-based assessment that measures two design thinking choices: students’ choices to seek critical (ie, negative) feedback and to revise their work while they learn graphic design principles through creating posters. This research also presents an examination of students’ choices to seek feedback and to revise, as well as of students’ learning outcomes based on these choices. This game-based assessment approach is empirically validated with three research studies sampling nearly 300 middle-school and college students who played Posterlet and completed a posttest. Results show that the game helps students learn, as students who play the game before completing the posttest learn more graphic design principles than students who only complete the posttest. Moreover, the choices to seek critical feedback and to revise can predict learning and can be used as valid outcome measures for learning. Findings can be used in developing and evaluating models of instruction and assessment that may help students make informed learning choices. A discussion of present and future trends in theory regarding digital feedback environments is also included.     

Supporting Scientific Experimentation and Reasoning in Young Elementary School Students

Researchers from multiple perspectives have shown that young students can engage in the scientific reasoning involved in science experimentation. However, there is little research on how well these young students learn in inquiry-based learning environments that focus on using scientific experimentation strategies to learn new scientific information. This work investigates young children’s science concept learning via inquiry-based instruction on the thermodynamics system in a developmentally appropriate, technology-supported learning environment. First- and third-grade students participate in three sets of guided experimentation activities that involve using handheld computers to measure change in temperature given different types of insulation materials. Findings from pre- and post-comparisons show that students at both grade levels are able to learn about the thermodynamics system through engaging in the guided experiment activities. The instruction groups outperformed the control groups on multiple measures of thermodynamics knowledge, and the older children outperform the younger children. Knowledge gains are discussed in the context of mental models of the thermodynamics system that include the individual concepts mentioned above and the relationships between them. This work suggests that young students can benefit from science instruction centered on experimentation activities. It shows the benefits of presenting complex scientific information authentic contexts and the importance of providing the necessary scaffolding for meaningful scientific inquiry and experimentation.     

Examining whether touch sensory feedback is necessary for science learning through experimentation: A literature review of two different lines of research across K-16

The focus of this paper is on the contribution that active touch sensory feedback offered through physical or virtual (with haptic feedback) manipulatives, makes to students' learning through science experimentation. Both theoretical perspectives and empirical evidence are presented. The theoretical perspectives were drawn from two types of theories, namely embodied cognition and additional (touch) sensory channel, which were associated with the use of physical and virtual manipulatives for learning purposes. The empirical evidence was drawn from two different lines of research. The first line of research involves studies that have focused on comparing physical manipulatives and virtual manipulatives (without the provision of haptic feedback), whereas the second involves studies that have focused on comparing virtual manipulatives with and without the provision of touch sensory (haptic) feedback. Both theories supply strong arguments for providing touch sensory feedback during science experimentation, whereas the empirical research outcomes show that providing touch sensory feedback is not always a prerequisite for learning science through experimentation. Those instances for which touch sensory feedback does appear to be a necessity for learning science through experimentation are identified. However, science education studies are limited within the aforementioned research areas. In addition, their findings are inconsistent, especially for the research focused on comparing virtual manipulatives with and without haptic feedback. The latter makes it difficult to arrive at a solid framework that depicts when and how touch sensory feedback should be offered to students for learning science through experimentation. The article concludes with suggestions for future research that would contribute towards development of such a framework.     

Measuring the Impact of Haptic Feedback Using the SOLO Taxonomy

The application of Biggs’ and Collis’ Structure of Observed Learning Outcomes taxonomy in the evaluation of student learning about cell membrane transport via a computer‐based learning environment is described in this study. Pre‐test–post‐test comparisons of student outcome data (n = 80) were made across two groups of randomly assigned students: one that received visual and haptic feedback, and one that relied on visual feedback only as they completed their virtual investigations. The results of the Mann–Whitney U‐test indicated that the group mean difference scores were significantly different statistically (p = .043). Practically speaking, this study provides some early evidence suggesting that the haptic augmentation of computer‐based science instruction may lead to a deeper level of processing. The strengths and weaknesses of this current diagnostic approach and a novel approach based on a non‐verbal model of cognition are discussed in light of their potential contributions to the teaching and learning of science.     

核心概念的学习进阶:促进项目学习常态化的有效路径

聚焦于核心概念可以提升学习效率,借鉴学习进阶有助于概念学习路径科学化。基于核心概念学习进阶的项目学习教学设计包括确定学习目标、开发教学内容、进行反馈三个阶段:通过提取课标建立概念网络图,依据概念发展层级模型确定学习表现;基于学习进阶设计学习过程,使得项目内容符合学生认知发展规律;依靠反馈确保项目内容与学习进阶吻合。实践表明,项目学习在促进学生概念理解方面具有优势,能够有效减小性别差异,得到师生的高度认同,可作为促进学生核心素养发展的优良选择。     

Electrifying Engagement in Middle School Science Class: Improving Student Interest Through E-textiles

Most interventions with “maker” technologies take place outside of school or out of core area classrooms. However, intervening in schools holds potential for reaching much larger numbers of students and the opportunity to shift instructional dynamics in classrooms. This paper shares one such intervention where electronic textiles (sewable circuits) were introduced into eighth grade science classes with the intent of exploring possible gains in student learning and motivation, particularly for underrepresented minorities. Using a quasi-experimental design, four classes engaged in a traditional circuitry unit while the other four classes undertook a new e-textile unit. Overall, students in both groups demonstrated significant learning gains on standard test items without significant differences between conditions. Significant differences appeared between groups’ attitudes toward science after the units in ways that show increasing interest in science by students in the e-textile unit. In particular, they reported positive identity shifts pertaining to their perceptions of the beliefs of their friends, family, and teacher. Findings and prior research suggest that student-created e-textile designs provide opportunities for connections outside of the classroom with friends and family and may shift students’ perceptions of their teacher’s beliefs about them more positively.     

Developing Sixth Graders’ Inquiry Skills to Construct Explanations in Inquiry‐based Learning Environments

The purpose of this study is to investigate how sixth graders develop inquiry skills to construct explanations in an inquiry‐based learning environment. We designed a series of inquiry‐based learning activities and identified four inquiry skills that are relevant to students’ construction of explanation. These skills include skills to identify causal relationships, to describe the reasoning process, to use data as evidence, and to evaluate explanations. Multiple sources of data (e.g., video recordings of learning activities, interviews, students’ artifacts, and pre/post tests) were collected from two science classes with 58 sixth graders. The statistical results show that overall the students’ inquiry skills were significantly improved after they participated in the series of the learning activities. Yet the level of competency in these skills varied. While students made significant progress in identifying causal relationships, describing the reasoning process, and using data as evidence, they showed slight improvement in evaluating explanations. Additionally, the analyses suggest that phases of inquiry provide different kinds of learning opportunities and interact with students’ development of inquiry skills.     

How teaching science using project-based learning strategies affects the classroom learning environment

This study involved 458 ninth-grade students from two different Arab middle schools in Israel. Half of the students learned science using project-based learning strategies and the other half learned using traditional methods (non-project-based). The classes were heterogeneous regarding their achievements in the sciences. The adapted questionnaire contained 38 statements concerning students’ perceptions of the science classroom climate. The results of the study revealed that students who learned sciences by project-based teaching strategies perceived their classroom learning climate as significantly more Satisfying and Enjoyable, with greater Teacher Supportiveness, and the Teacher–Student Relationships as significantly more positive. The differences between the experimental (project-based learning strategies) and control (non-project) groups regarding their perceptions of the science classroom learning climate could be explained by differences between the two science teaching and learning strategies.