Epistemic Progress: A Construct for Understanding and Evaluating Inquiry

In this essay Clinton Golding introduces a new construct and area of research — epistemic progress — and argues that it can shed new light on educational inquiry. By clearly distinguishing progress through developing better ideas (epistemic progress) from progress through developing better inquiry skills (procedural progress), teachers and students can better understand, participate in, and evaluate inquiry. In addition, epistemic progress complements other epistemic constructs, such as “knowledge,” and could provide new insights about different kinds of inquiry or research, as well as about the diverse disciplines and areas of study.     

Building on Each Other’s Ideas: A Social Mechanism of Progressiveness in Whole-Class Collective Inquiry

In recent decades, important advances have been made in understanding how discursive symmetry can be achieved in whole-class dialogue. However, very little is known about how this dialogue may progress in the sense of critically linking ideas in coherent lines of collective inquiry. This article investigates this issue by analyzing 4 consecutive sessions of a science class with children ages 8 to 10 and identifies a social mechanism that can explain the emergence of progressiveness in collective inquiry. The identified mechanism consists of a series of iterations of the sequence (Direction) → Inference ? Observation ? Consensus → Fixation. This sequence enables the transition from local to collective agency and meaning. Direction creates a gap in a semantic structure, leading to the local formation of an inference. This inference then escalates through observation and consensus before finally being fixed through the creation of an artifact that reifies it as a collective meaning. Based on this collective meaning, a new direction leads to a new local inference, and the cycle begins again.     

Inquiry as a Members’ Phenomenon: Young Children as Competent Inquirers

Understanding children’s inquiry often draws on exogenous understanding (i.e., scientists’ inquiry, classroom expectations) without first understanding inquiry in children’s everyday lives. In contrast, we examine young children’s inquiry in their families to better understand their competent engagement in inquiry. Specifically, we develop an endogenous representation of inquiry as a members’ phenomenon (IMP)—a representation formulated by participants in the course of their own activity. IMP highlights key moments in inquiry—beginning by orienting to inquiry, making progress by drawing on sensemaking resources, and orienting to ending inquiry. This representation also allows us to recognize evidence of young children’s competence in managing interactional, affective, and epistemic challenges inherent in these key moments of inquiry; the diverse array of sensemaking resources through which children address those challenges; and a range of children’s interests and concerns addressed within their inquiry. Furthermore, IMP provides a prism for reconceptualizing learning from learners’ perspective: attending to how participants orient to a moment of inquiry, inquire together, and come to what counts to them as a satisfactory end to their inquiry. This representation of inquiry is an important step in basic learning sciences research and informative for the design of science and other domain learning environments.     

Student-Directed Assessment of Knowledge Building Using Electronic Portfolios

Despite emphasis and progress in developing collaborative inquiry in computer-supported collaborative learning research, little attention has been given to examining how collective learning can be assessed in computer-supported collaborative learning classrooms, and how students can have agency in assessing their own collaborative process. We propose that assessments should capture both individual and collective aspects of learning and be designed in ways that foster collaboration. We describe the design of student-directed electronic portfolio assessments to characterize and “scaffold” collaborative inquiry using Knowledge Forum?. Our design involved asking students to identify exemplary notes in the computer discourse depicting knowledge building episodes using four knowledge building principles as criteria. We report three studies that examined the designs and roles of knowledge building portfolios with graduate and Grade 12 students in Hong Kong and Canada. The findings suggest that knowledge building portfolios help to characterize collective knowledge advances and foster domain understanding. We discuss lessons learned regarding how knowledge building may be fostered and provide principles for designing assessments that can be used to evaluate and foster deep inquiry in asynchronous online discussion environments.     

A systematic review of empirical studies using log data from open-ended learning environments to measure science and engineering practices

Technology-based, open-ended learning environments (OELEs) can capture detailed information of students' interactions as they work through a task or solve a problem embedded in the environment. This information, in the form of log data, has the potential to provide important insights about the practices adopted by students for scientific inquiry and problem solving. How to parse and analyse the log data to reveal evidence of multifaceted constructs like inquiry and problem solving holds the key to making interactive learning environments useful for assessing students' higher-order competencies. In this paper, we present a systematic review of studies that used log data generated in OELEs to describe, model and assess scientific inquiry and problem solving. We identify and analyse 70 conference proceedings and journal papers published between 2012 and 2021. Our results reveal large variations in OELE and task characteristics, approaches used to extract features from log data and interpretation models used to link features to target constructs. While the educational data mining and learning analytics communities have made progress in leveraging log data to model inquiry and problem solving, multiple barriers still exist to hamper the production of representative, reproducible and generalizable results. Based on the trends identified, we lay out a set of recommendations pertaining to key aspects of the workflow that we believe will help the field develop more systematic approaches to designing and using OELEs for studying how students engage in inquiry and problem-solving practices.

Practitioner notes

What is already known about this topic

• Research has shown that technology-based, open-ended learning environments (OELEs) that collect users' interaction data are potentially useful tools for engaging students in practice-based STEM learning.
• More work is needed to identify generalizable principles of how to design OELE tasks to support student learning and how to analyse the log data to assess student performance.

What this paper adds

• We identified multiple barriers to the production of sufficiently generalizable and robust results to inform practice, with respect to: (1) the design characteristics of the OELE-based tasks, (2) the target competencies measured, (3) the approaches and techniques used to extract features from log files and (4) the models used to link features to the competencies.
• Based on this analysis, we can provide a series of specific recommendations to inform future research and facilitate the generalizability and interpretability of results:
  • Making the data available in open-access repositories, similar to the PISA tasks, for easy access and sharing.
  • Defining target practices more precisely to better align task design with target practices and to facilitate between-study comparisons.
  • More systematic evaluation of OELE and task designs to improve the psychometric properties of OELE-based measurement tasks and analysis processes.
  • Focusing more on internal and external validation of both feature generation processes and statistical models, for example with data from different samples or by systematically varying the analysis methods.

Implications for practice and/or policy

• Using the framework of evidence-centered assessment design, we have identified relevant criteria for organizing and evaluating the diverse body of empirical studies on the topic and that policy makers and practitioners can use for their own further examinations.
• This paper identifies promising research and development areas on the measurement and assessment of higher-order constructs with process data from OELE-based tasks that government agencies and foundations can support.
• Researchers, technologists and assessment designers might find useful the insights and recommendations for how OELEs can enhance science assessment through thoughtful integration of learning theories, task design and data mining techniques.

     

Positioning as not‐understanding: The value of showing uncertainty for engaging in science

Not understanding is central to scientific work: what scientists do is learn about the natural world, which involves seeking out what they do not know. In classrooms, however, the position of not‐understanding is generally a liability; confusion is an unfortunate condition to resolve as quickly as possible, or to conceal. In this article, we argue that students' public displays of uncertainty or confusion can be pivotal contributions to the classroom dynamics in initiating and sustaining a class's science inquiry. We present this as a central finding from a cross‐case analysis of eight episodes of students' scientific engagement, drawing on literature on framing to show how participants positioned themselves as not‐understanding and how that was consequential for the class's scientific engagement. We show how participants enacted this positioning by asking questions or expressing uncertainty around a phenomenon or model. We then analyze how participants' displays of not‐understanding shaped the conceptual, epistemic, and social aspects of classroom activity. We present two cases in detail: one in which a student's positioning helped initiate the class's scientific engagement and another in which it helped sustain it. We argue that this work motivates considering how to help students learn to embrace and value the role of expressing one's confusion in science.     

Identifying patterns of students' performance on simulated inquiry tasks using PISA 2015 log-file data

Previous research has demonstrated the potential of examining log-file data from computer-based assessments to understand student interactions with complex inquiry tasks. Rather than solely providing information about what has been achieved or the accuracy of student responses (product data), students' log files offer additional insights into how the responses were produced (process data). In this study, we examined students' log files to detect patterns of students' interactions with computer-based assessment and to determine whether unique characteristics of these interactions emerge as distinct profiles of inquiry performance. Knowledge about the characteristics of these profiles can shed light on why some students are more successful at solving simulated inquiry tasks than others and how to support student understanding of scientific inquiry through computer-based environments. We analyzed the Norwegian PISA 2015 log-file data, science performance as well as background questionnaire (N = 1,222 students) by focusing on two inquiry tasks, which required scientific reasoning skills: coordinating the effects of multiple variables and coordinating theory and evidence. Using a mixture modeling approach, we identified three distinct profiles of students' inquiry performance: strategic, emergent, and disengaged. These profiles revealed different characteristics of students' exploration behavior, inquiry strategy, time-on-task, and item accuracy. Further analyses showed that students' assignment to these profiles varied according to their demographic characteristics (gender, socio-economic status, and language at home), attitudes (enjoyment in science, self-efficacy, and test anxiety), and science achievement. Although students' profiles on the two inquiry tasks were significantly related, we also found some variations in the proportion of students' transitions between profiles. Our study contributes to understanding how students interact with complex simulated inquiry tasks and showcases how log-file data from PISA 2015 can aid this understanding.     

Promoting elementary students’ epistemology of science through computer-supported knowledge-building discourse and epistemic reflection

This study examined the role of computer-supported knowledge-building discourse and epistemic reflection in promoting elementary-school students’ scientific epistemology and science learning. The participants were 39 Grade 5 students who were collectively pursuing ideas and inquiry for knowledge advance using Knowledge Forum (KF) while studying a unit on electricity; they also reflected on the epistemic nature of their discourse. A comparison class of 22 students, taught by the same teacher, studied the same unit using the school’s established scientific investigation method. We hypothesised that engaging students in idea-driven and theory-building discourse, as well as scaffolding them to reflect on the epistemic nature of their discourse, would help them understand their own scientific collaborative discourse as a theory-building process, and therefore understand scientific inquiry as an idea-driven and theory-building process. As hypothesised, we found that students engaged in knowledge-building discourse and reflection outperformed comparison students in scientific epistemology and science learning, and that students’ understanding of collaborative discourse predicted their post-test scientific epistemology and science learning. To further understand the epistemic change process among knowledge-building students, we analysed their KF discourse to understand whether and how their epistemic practice had changed after epistemic reflection. The implications on ways of promoting epistemic change are discussed.     

Beliefs about knowledge and knowing and multiple‐text comprehension among upper secondary students

Using a sample of 282 Norwegian upper secondary students, we examined whether two dimensions of topic‐specific epistemic beliefs, concerning the certainty of knowledge and the justification for knowing, predicted students' understanding of seven texts representing partly conflicting views on climate change. Text comprehension was measured at three different levels. Topic knowledge and topic interest were included in the analyses as control variables. Hierarchical regression analyses showed that students' beliefs about justification for knowledge positively predicted text comprehension at all three levels. That is, students believing that knowledge claims about climate change should be based on rules of inquiry and the evaluation and integration of multiple information sources did better on the three comprehension measures.     

Defining the future: an interrogation of education and time

This paper examines notions of ‘educational time’ with particular reference to the work of Basil Bernstein. It focuses closely on the 1967 Plowden report as a particularly appropriate policy case study to demonstrate how different constructions of time can exist within the same document. It then develops educational models originally mapped out by Bernstein, arguing that a full understanding of the areas of consensus and conflict among these models is vital if we are to understand how teaching professionals think about the future. The paper addresses the following questions: How does time affects education? What influence does this have on educational outcomes? How does this relate to public policy initiatives? Assuming a tacit, collective understanding of time and the future can undermine the very policy intentions a government might be seeking to promulgate.     

Disentangling Robust Developmental Constraints From the Instructionally Mutable: Young Children's Epistemic Reasoning About a Study of Their Own Design

This study examines first graders' epistemic reasoning, in tacit “practical epistemologies” reflected in thinking about an investigation of their own design. I analyzed children's epistemic reasoning, following a design experiment scaffolding increasing regulation of scientific inquiry in a domain they studied in depth. Participants consisted of children in two first grade classes (n = 35). The study capitalizes on the final phase of the design experiment, wherein pairs assumed substantial responsibility for design and implementation of an investigation pursuing their own question. I conducted structured interviews with each pair, eliciting their thinking about their investigation. Forty-three percent of the children attributed uncertainty to their findings. Forty-nine percent transcended phenomenon-based reasoning in thinking about how to improve their study, reasoning instead in terms of relation between variables. Forty percent posited additional potentially influential variables, reflecting a tacit understanding of the lack of any straightforward one-to-one correspondence between cause and effect. These findings suggest that epistemic reasoning is plastic, sensitive to instructional opportunities. I argue that the children's relatively deep familiarity with the domain, experience in assuming increasing responsibility for structuring scientific inquiry, and investment they had in their own investigations contributed to the surprisingly robust epistemic reasoning they revealed in this context.     

Acting as accountable authors: Creating interactional spaces for agency work in teacher education

In this paper, relying on the sociocultural framework of learning, we report on the results of an ethnographically-grounded investigation of agency work among nine pre-service teachers: The main objective is to determine how agency emerges and is constructed in situated discourse practices within the context of a teacher education program embedded in the collective inquiry approach. Our study identifies the forms of agency that emerged in the collective discussions of the classroom community, evidencing pre-service teachers’ transformative agency, relational agency and epistemic agency. This study also shows that the negotiation and framing of agency, and acting as accountable authors, involves changes in teacher-student positions, such as crossing and transforming traditional expert-novice boundaries, as well as recognizing and crediting this crossing of boundaries. The methods and conditions for supporting students’ agency work in teacher education are discussed.     

Criteria of excellence for geological inquiry: The necessity of ambiguity

According to Gowin, a curriculum properly derives its authority by representing the “criteria of excellence” for evaluating the claims produced within a field of inquiry. GowinÕs epistemology applied to examples from geological inquiry yields criteria of excellence responsive to the demands characteristic of geological problems. Student efforts to learn these criteria hold the promise of making progress toward independence in accessing, using, and evaluating knowledge. This understanding contributes to the reformation of the concept of inquiry as a “step beyond science as process” called for in the National Science Education Standards and reinforces the need to consider the diversity as well as unity of styles of scientific reasoning. Geological inquiries differ from those of other sciences because they refer to objects with histories. These histories create a demand for concepts that necessarily contain an irreducible element of ambiguity, thus permitting comparison and contrast of geological objects. A case study of how geologists apply analogies, impose boundaries on categories of thought, and constrain the ambiguity of key concepts in reasoning about the accumulation of sediments at a continental margin is used to support this argument. Such examples of geological reasoning support a skeptical attitude toward interdisciplinary curricula that omit or oversimplify criteria of excellence. © 1998 John Wiley & Sons, Inc. J Res Sci Teach 35: 189–212, 1998.     

On the Goals of Epistemic Education: Promoting Apt Epistemic Performance

Recent years have seen a surge in educational efforts to foster the development of learners’ epistemologies. Our 1^st aim is to problematize some current assumptions about the goals of epistemic education and to argue that existing models of lay or expert epistemologies cannot directly translate into educational goals. Our 2^nd aim is to present a fresh integrative analysis of the goals of epistemic education based on both philosophical arguments and empirical research. Synthesizing these sources, we propose that the overarching purpose of epistemic education is to promote learners’ apt epistemic performance, defined as performance that achieves valuable epistemic aims through competence. We identify 5 key aspects of epistemic performance that are important to achieving this goal: engaging in reliable cognitive processes that lead to the achievement of epistemic aims, adapting epistemic performance to diverse situations, metacognitively regulating and understanding epistemic performance, caring about and enjoying epistemic performance, and participating in epistemic performance together with others. Each of these aspects involves competent engagement with epistemic aims and value, epistemic ideals, and reliable epistemic processes. Our analysis can help educators plan and evaluate epistemic education and suggests ways in which current curricula might be better designed to promote epistemic growth.     

The Teacher as Guide: A conception of the inquiry teacher

This article explains how teachers might navigate inquiry learning despite the experience of a constant tension between abandoning their students and controlling them. They do this by conceiving of themselves as guides who decide the path with students, not for them. I build on a conception of teaching as guiding from Burbules, and argue that inquiry teachers should take the particular stance of an expedition-educator (rather than the stance of either a tour-leader or an expedition-leader). They should guide students to make progress during co-inquiry, rather than leading them to follow the teacher’s agenda. This stance gives a heuristic they can use to balance control and abandonment in their pedagogical practice—they judge which pedagogical actions to take, and when, according to which actions are likely to help their students to engage in autonomous inquiry and hence learn to guide themselves. Students thus can learn to inquire by participating in an inquiry which is guided, but not controlled, by their teacher.     

Towards decolonial praxis: reconfiguring the human and the curriculum

ABSTRACT

This theoretical inquiry applies threads of Sylvia Wynter’s intellectual project to scholarship in curriculum studies to consider how Wynter’s insights might urge new potential in educational theorising and practice. The central concern driving Wynter’s intellectual project is that our present understanding about what it means to be human is entrenched in epistemological legacies of colonialism that preserve a Western bourgeois genre of Man. This essay begins by detailing Sylvia Wynter’s rigorous and innovative intellectual project that reworks the category of the human. We argue that contemporary curriculum is based upon this Western genre of the human and explore the limits of multicultural curricula. Synthesising Wynter’s interrelated lines of thought – how the notion of being hybridly human calls forth a conceptualisation of humanness as a collective act – we argue that her revised category of the human is a necessary means to radically reimagine and decolonise curriculum.     

Knowledge relations and epistemic infrastructures as mediators of teachers' collective autonomy

This paper examines how teachers' knowledge relations and the profession's epistemic infrastructure shape collective autonomy. Professionals' autonomy derives partially from their responsibility for a specific knowledge base. This responsibility is currently challenged by educational policies and complex knowledge landscapes. Existing research has shown how epistemic policy instruments impact teachers' autonomy. However, less attention has been paid to how professional autonomy is informed by teachers' knowledge relations, and to collective, rather than individual, aspects of teachers' autonomy. Implications include how teachers can define the role of knowledge resources in professional work, and how the profession can navigate epistemic and political landscapes.