Exploring the Use of Electroencephalography to Gather Objective Evidence of Cognitive Processing During Problem Solving

Currently, there is significant interest being directed towards the development of STEM education to meet economic and societal demands. While economic concerns can be a powerful driving force in advancing the STEM agenda, care must be taken that such economic imperative does not promote research approaches that overemphasize pragmatic application at the expense of augmenting the fundamental knowledge base of the discipline. This can be seen in the predominance of studies investigating problem solving approaches and procedures, while neglecting representational and conceptual processes, within the literature. Complementing concerns about STEM graduates’ problem solving capabilities, raised within the pertinent literature, this paper discusses a novel methodological approach aimed at investigating the cognitive elements of problem conceptualization. The intention is to demonstrate a novel method of data collection that overcomes some of the limitations cited in classic problem solving research while balancing a search for fundamental understanding with the possibility of application. The methodology described in this study employs an electroencephalographic (EEG) headset, as part of a mixed methods approach, to gather objective evidence of students’ cognitive processing during problem solving epochs. The method described provides rich evidence of students’ cognitive representations of problems during episodes of applied reasoning. The reliability and validity of the EEG method is supported by the stability of the findings across the triangulated data sources. The paper presents a novel method in the context of research within STEM education and demonstrates an effective procedure for gathering rich evidence of cognitive processing during the early stages of problem conceptualization.     

A framework to foster problem-solving in STEM and computing education

ABSTRACT

Background: Recent developments in STEM and computer science education put a strong emphasis on twenty-first-century skills, such as solving authentic problems. These skills typically transcend single disciplines. Thus, problem-solving must be seen as a multidisciplinary challenge, and the corresponding practices and processes need to be described using an integrated framework.

Purpose: We present a fine-grained, integrated, and interdisciplinary framework of problem-solving for education in STEM and computer science by cumulatively including ways of problem-solving from all of these domains. Thus, the framework serves as a tool box with a variety of options that are described by steps and processes for students to choose from. The framework can be used to develop competences in problem-solving.

Sources of evidence: The framework was developed on the basis of a literature review. We included all prominent ways of domain-specific problem-solving in STEM and computer science, consisting mainly of empirically orientated approaches, such as inquiry in science, and solely theory-orientated approaches, such as proofs in mathematics.

Main argument: Since there is an increasing demand for integrated STEM and computer science education when working on natural phenomena and authentic problems, a problem-solving framework exclusively covering the natural sciences or other single domains falls short.

Conclusions: Our framework can support both practice and research by providing a common background that relates the ways, steps, processes, and activities of problem-solving in the different domains to one single common reference. In doing so, it can support teachers in explaining the multiple ways in which science problems can be solved and in constructing problems that reflect these numerous ways. STEM and computer science educational research can use the framework to develop competences of problem-solving at a fine-grained level, to construct corresponding assessment tools, and to investigate under what conditions learning progressions can be achieved.     

Effects of 6E-oriented STEM practical activities in cultivating middle school students’ attitudes toward technology and technological inquiry ability

ABSTRACT

Background: STEM education has become a focus of research and teaching interest in recent years. However, not all scholars agree on the definition and purpose of STEM education. This paper summarizes related past research and suggests that, according to the requirements of Taiwan’s educational environment, STEM education should focus on the cultivation of middle school students’ attitudes toward technology and their ability to engage with technological inquiry.

Purpose: The purpose of this study is to explore the effects of STEM education on attitudes toward technology and technological inquiry abilities of middle school students, this study used the 6E Learning byDeSIGN? model proposed by the International Technology and Engineering Educators Association in the US to design a 6E-oriented STEM practical activity.

Sample: The sample of the study consisted of 139 seventh-grade students from six different classes who participated in a practical activity related to egg protection devices.

Design and methods: To achieve this research purpose, a quasi-experimental design was used, with pre-treatment and post-treatment evaluations of each group. Both the experimental and control groups participated in the activity; however, the experimental group students were guided through the activity using a 6E teaching strategy, whereas the control group students were guided using a problem-solving teaching strategy.

Results: The results showed that a 6E teaching strategy had a positive effect on middle school students’ attitudes toward technology and technological inquiry abilities, but these effects were not statistically different from the effect on the control group with problem-solving teaching strategy.

Conclusions: This study indicates there is no significant advantage in using a 6E process over a problem solving approach. Technology teachers aiming to improve students’ attitudes toward technology and their technological inquiry abilities consider refining the 6E-oriented STEM practical activity process, and students may demonstrate better performance in these two areas.     

Disciplinary Foundations for Solving Interdisciplinary Scientific Problems

Problem-solving has been one of the major strands in science education research. But much of the problem-solving research has been conducted on discipline-based contexts; little research has been done on how students, especially individuals, solve interdisciplinary problems. To understand how individuals reason about interdisciplinary problems, we conducted an interview study with 16 graduate students coming from a variety of disciplinary backgrounds. During the interviews, we asked participants to solve two interdisciplinary science problems on the topic of osmosis. We investigated participants’ problem reasoning processes and probed in their attitudes toward general interdisciplinary approach and specific interdisciplinary problems. Through a careful inductive content analysis of their responses, we studied how disciplinary, cognitive, and affective factors influenced their interdisciplinary problems-solving. We found that participants’ prior discipline-based science learning experiences had both positive and negative influences on their interdisciplinary problem-solving. These influences were embodied in their conceptualization of the interdisciplinary problems, the strategies they used to integrate different disciplinary knowledge, and the attitudes they had toward interdisciplinary approach in general and specific interdisciplinary problems. This study sheds light on interdisciplinary science education by revealing the complex relationship between disciplinary learning and interdisciplinary problem-solving.     

Individual differences: A third component in problem-solving instruction

Present research in problem solving appears to be primarily concerned with problem-solving methods and with degree of knowledge acquisition. A brief argument is advanced that this conceptualization is incomplete because of failure to consider individual differences among problem solvers (other than in problem-solving methods and extent of knowledge). A viable theory of problem-solving instruction must take into account all three areas. Evidence for the argument is presented in the form of data on problem-solving success in junior high school students with extreme scores on Witkin's field independence-field dependence measure of cognitive style. Problem-solving protocols are examined as a second source of data. Field independent students significantly out-performed field dependent students on the problems. Examination of protocols revealed consistent performance patterns favoring field independent students.     

Problem Solving and Teaching How to Solve Problems in Technology-Rich Contexts

ABSTRACT

Problem solving is perhaps the key characteristic that makes us human. Given the kinds of problems that we face in a competitive economy and society, the new generation of learners is ever more required to have problem-solving abilities. By drawing from the literature on technological pedagogical content knowledge, design thinking, general and specific methods of problem solving, and role of technologies for solving problems, this article highlights the importance of problem solving for future teachers and discusses strategies that can help them become good problem solvers and understand the requirements of teaching their students problem solving in technology-rich contexts. This article consists of two main parts. Part 1 focuses on strategies required to help preservice teachers to be better problem solvers, and Part 2 summarizes approaches to introduce preservice teachers to the methods of teaching problem solving. The strategies reviewed provide a tangible guidance for teacher education programs regarding how to promote future teachers’ problem-solving skills.     

The role of epistemic emotions in mathematics problem solving

The purpose of this research was to examine the antecedents and consequences of epistemic and activity emotions in the context of complex mathematics problem solving. Seventy-nine elementary students from the fifth grade participated. Students self-reported their perceptions of control and value specific to mathematics problem solving, and were given a complex mathematics problem to solve over a period of several days. At specific time intervals during problem solving, students reported their epistemic and activity emotions. To capture self-regulatory processes, students thought out loud as they solved the problem. Path analyses revealed that both perceived control and value served as important antecedents to the epistemic and activity emotions students experienced during problem solving. Epistemic and activity emotions also predicted the types of processing strategies students used across three phases of self-regulated learning during problem solving. Finally, shallow and deep processing cognitive and metacognitive strategies positively predicted problem-solving performance. Theoretical and educational implications are discussed.     

Conceptualization and Measurement of Cognitive Holding Power

The concept of cognitive holding power is synthesized from theories of settings and of cognitive structures and is conceptualized as a characteristic of a learning setting that presses students into different kinds of cognitive activity. Settings which press students into using first- or second-order cognitive procedures are regarded as having first- or second-order cognitive holding power. The development of an instrument to measure these two dimensions of cognitive holding power is outlined. The independence of the dimensions, their reliabilities and validity, and factor structures are examined. Each dimension was found to have high reliability across vocational education and high school settings, and each was correlated as predicted with other classroom variables. The potential contribution of this research to understanding the relationship between different approaches to the teaching of problem solving and the ability to undertake problem-solving transfer tasks is outlined.     

Complex problem solving in L1 education: Senior high school students' knowledge of the language problem-solving process

The solving of reasoning problems in first language (L1) education can produce an understanding of language, and student autonomy in language problem solving, both of which are contemporary goals in senior high school education. The purpose of this study was to obtain a better understanding of senior high school students' knowledge of the language problem-solving process. Fifty-three 11th-grade high school students solved standard, comprehension, and linguistic reasoning problems. Before solving the problems, the participants had filled in open-ended questions inquiring about their knowledge regarding the effectiveness of a chosen problem-solving strategy. Content analysis of the responses indicated four categories and nine subcategories. The implications of the relatively few responses in the category of explicit knowledge of the language problem-solving process are discussed in the light of the changing needs of L1 students.     

Toward a design theory of problem solving

Problem solving is generally regarded as the most important cognitive activity in everyday and professional contexts. Most people are required to and rewarded for solving problems. However, learning to solve problems is too seldom required in formal educational settings, in part, because our understanding of its processes is limited. Instructional-design research and theory has devoted too little attention to the study of problem-solving processes. In this article, I describe differences among problems in terms of their structuredness, domain specificity (abstractness), and complexity. Then, I briefly describe a variety of individual differences (factors internal to the problem solver) that affect problem solving. Finally, I articulate a typology of problems, each type of which engages different cognitive, affective, and conative processes and therefore necessitates different instructional support. The purpose of this paper is to propose a metatheory of problem solving in order to initiate dialogue and research rather than offering a definitive answer regarding its processes. This paper represents an effort to introduce issues and concerns related to problem solving to the instructional design community. I do not presume that the community is ignorant of problem solving or its literature, only that too little effort has been expended by the field in articulating design models for problem solving. There are many reasons for that state of affairs. The curse of any introductory paper is the lack of depth in the treatment of these issues. To explicate each of the issues raised in this paper would require a book (which is forthcoming), which makes it unpublishable in a journal. My purpose here is to introduce these issues in order to stimulate discussion, research, and development of problem-solving instruction that will help us to articulate better design models.     

Using model-based scaffolds to support students solving context-based chemistry problems

ABSTRACT

Context-based learning aims to make learning more meaningful by raising meaningful problems. However, these types of problems often require reflection and thinking processes that are more complex and thus more difficult for students, putting high demands on students’ problem-solving capabilities. In this paper, students’ approaches when solving context-based chemistry problems and effects of systematic scaffolds are analysed based on the Model of Hierarchical Complexity. Most answers were initially assigned to the lowest level of the model; higher levels were reached without scaffolds only by few students and by most students with scaffolds. The results are discussed with regard to practical implications in terms of how teachers could make use of context-based tasks and aligned scaffolds to help students in this activity.     

Nonverbal Displays as Indicants of Task Difficulty

Accurately determining when students are having difficulty with cognitive tasks is important in educational settings. This study investigated whether college students emitted observable displays of cognitive difficulty when engaged in solitary problem-solving tasks. Participants high and low in self-monitoring tendencies were videotaped while solving both hard and easy problems. Ten-second segments of the videotapes were rated for displayed difficulty levels. Results indicate that college students do emit nonverbal displays indicating task difficulty: Students' displayed significantly less difficulty while solving easy problems than while solving hard problems. Results also indicated that the difficulty displays of low self-monitors were more discernible than the difficulty displays of high self-monitors. Copyright 2001 Academic Press.     

How Can We Improve Problem Solving in Undergraduate Biology? Applying Lessons from 30 Years of Physics Education Research

If students are to successfully grapple with authentic, complex biological problems as scientists and citizens, they need practice solving such problems during their undergraduate years. Physics education researchers have investigated student problem solving for the past three decades. Although physics and biology problems differ in structure and content, the instructional purposes align closely: explaining patterns and processes in the natural world and making predictions about physical and biological systems. In this paper, we discuss how research-supported approaches developed by physics education researchers can be adopted by biologists to enhance student problem-solving skills. First, we compare the problems that biology students are typically asked to solve with authentic, complex problems. We then describe the development of research-validated physics curricula emphasizing process skills in problem solving. We show that solving authentic, complex biology problems requires many of the same skills that practicing physicists and biologists use in representing problems, seeking relationships, making predictions, and verifying or checking solutions. We assert that acquiring these skills can help biology students become competent problem solvers. Finally, we propose how biology scholars can apply lessons from physics education in their classrooms and inspire new studies in biology education research.     

Inquiring into the Nature of STEM Problems

Around the world, there is a growing interest in integrated STEM (science, technology, engineering, mathematics) education. Many of the calls for integrated STEM emphasize the need for students to engage with complex STEM problems that cut across multiple fields. Yet there is a need to clarify the nature of those problems and differentiate STEM problems from those of different kinds. This conceptual work examines the nature of STEM problems in order to inform pre-college educational efforts in STEM. A typology is introduced that situates STEM problems within a broader space of problems within STEM and non-STEM fields, and the characteristics of STEM problems are described. The typology and characteristics are then applied to different approaches to STEM instruction. A key conclusion is that many integrated STEM education efforts tend to focus on STEM problems that are narrowly framed and that do not include attention to social, cultural, political, or ethical dimensions. However, alternative instructional approaches exist that re-introduce those missing dimensions. If STEM education is to prepare students to grapple with complex problems in the real world, then more attention ought to be given to approaches that are inclusive of the non-STEM dimensions that exist in those problems.

     

Mathematical problem-solving profiles of students with mathematics disabilities with and without comorbid reading disabilities

The purpose of this study was to describe the mathematical problem-solving profiles of students with mathematics disabilities (MD) with and without comorbid reading disabilities (RD). The disability status of fourth-grade students was verified through testing (n = 18 MD; n = 22 MD + RD). Then a hierarchy of mathematics problem-solving tasks was administered. The results demonstrated large deficits for both groups; however, the differences between students with MD and those with MD + RD were mediated by the level of problem solving (arithmetic story problems vs. complex story problems vs. real-world problem solving) and by performance dimension (operations vs. problem solving). On arithmetic story problems, the differences between the disability subtypes were similar for operations and problem solving. By contrast, on complex story problems and real-world problem solving, the differences between the subtypes were larger for problem solving than for operations.     

Teacher interactions and effects on group triple problem solving space

ABSTRACT

Research shows that collaborative work promotes student learning and improves social skills, but teachers are still exploring how to best support problem-solving in a small group context, particularly in the science classroom. This study builds on prior research to characterise teacher interactions with small groups in secondary science and analyses how those interactions affect a collectively constructed space – the triple problem solving space (TPSS) – in which group members collectively understand a task (content/cognitive dimension), manage social interactions (social/relational dimension), and co-construct the emotional life of the group (affective dimension). Results of two biology teachers’ interactions with students in small groups working on inquiry and engineering design activities show that most interactions were administrative and had little influence on the group’s TPSS. Teacher interactions that engaged students in monitoring their problem-solving process, however, did have the capacity to increase cognitive work of the group, which subsequently impacted the students’ group affect and social dimension. These findings suggest that interactions focused on cognitive processes have the potential to support all aspects of a group’s TPSS. Though this research is only a first step in understanding the impact of teacher interactions on small group work, implications for teaching practices are discussed.     

Cognitive restructuring as an early stage in problem solving

This article examines the hypothesis that there are preliminary stages in problem solving which most chemists neglect when trying to teach their students how to solve problems in introductory chemistry courses. It is during these early stages that relevant information is disembedded from the question and the problem is restructured. Unless students can successfully complete these cognitive restructuring stages, they cannot proceed on to the more analytic stages in problem solving that have received more attention from chemists. Preliminary evidence for this hypothesis consists of linear correlations between student ability to handle disembedding and cognitive restructuring tasks in the spatial domain and their ability to solve chemistry problems.     

Validation study of a method for assessing complex ill-structured problem solving by using causal representations

The important but little understood problem that motivated this study was the lack of research on valid assessment methods to determine progress in higher-order learning in situations involving complex and ill-structured problems. Without a valid assessment method, little progress can occur in instructional design research with regard to designing effective learning environments to facilitate acquisition of expertise in complex, ill-structured knowledge domains. In this paper, we first present a method based on causal representations for assessing progress of learning in complex, ill-structured problem solving and discuss its theoretical framework. Then, we present an experimental study investigating its validity against adapted protocol analysis. This study explored the impact of a massively multiplayer online educational game, which was designed to support an interdisciplinary STEM education on ninth-grade students’ complex, ill-structured problem solving skill acquisition. We identify conceptual similarities and differences between the two methods, present our comparative study and its results, and then discuss implications for diagnostics and applications. We conclude by determining how the two approaches could be used in conjunction for further research on complex and ill-structured problem solving.