Investigations of a complex,realistic task: Intentional,unsystematic, and exhaustive experimenters

This study examines how students' experimentation with a virtual environment contributes to their understanding of a complex, realistic inquiry problem. We designed a week‐long, technology‐enhanced inquiry unit on car collisions. The unit uses new technologies to log students' experimentation choices. Physics students (n = 148) in six diverse high schools studied the unit and responded to pretests, posttests, and embedded assessments. We scored students' experimentation using four methods: total number of trials, variability of variable choices, propensity to vary one variable at a time, and coherence between investigation goals and experimentation methods. Students made moderate, significant overall pretest to posttest gains on physics understanding. Coherence was a strong predictor of learning, controlling for pretest scores and the other experimentation measures. We identify three categories of experimenters (intentional, unsystematic, and exhaustive) and illustrate these categories with examples. The findings suggest that students must combine disciplinary knowledge of the investigation with intentional investigation of the inquiry questions in order to understand the nature of the variables. Mechanically executing well‐established experimentation procedures (such as varying one variable at a time or comprehensively exploring the experimentation space) is less likely to lead students to valuable insights about complex tasks. Our proposed categories extend and refine previous efforts to categorize experimenters by linking scientific procedures with understanding of the science discipline. © 2011 Wiley Periodicals, Inc. J Res Sci Teach 48: 745–770, 2011     

Supporting linguistically diverse students' science learning with dynamic visualizations through discourse-rich practices

Carefully scaffolded dynamic visualizations have potential to promote science learning for all students, including English language learners (ELLs) who are often underserved in mainstream science classrooms, but little is known about how to design effective scaffolding to support such diverse students' learning with dynamic visualizations. This study investigated how two forms of scaffolding embedded in dynamic visualizations, expert guidance and generating guidance, can foster ELLs' and non-ELLs' understanding of unobservable scientific phenomena. While interacting with dynamic visualizations, students in the expert guidance condition were provided with scientifically accurate explanations to interpret visual representations, whereas students in the generating guidance condition were prompted to generate their own explanations using visual representations. The results show the significant advantage of generating guidance over expert guidance for both ELLs and non-ELLs, although students in the generating guidance condition did not receive feedback on their generated artifacts. Analyses of video data and log data from 40 pairs revealed that each form of scaffolding affected the quantity and quality of linguistically diverse students' conversations. The results show that generating guidance enabled students, particularly ELLs, to engage in discourse-rich practices to evaluate various sources of evidence from the visualization and compare the evidence to their alternative ideas to develop a coherent understanding of the target concepts. This study shows the unique benefits of generating guidance as an effective strategy to support linguistically diverse students' science learning with dynamic visualizations.     

Assessing dialogic argumentation in online environments to relate structure,grounds, and conceptual quality

The national science standards, along with prominent researchers, call for increased focus on scientific argumentation in the classroom. Over the past decade, researchers have developed sophisticated online science learning environments to support these opportunities for scientific argumentation. Assessing the quality of dialogic argumentation, however, has proven challenging. Existing analytic frameworks assess dialogic argumentation in terms of the nature of students' discourse, formal argumentation structure, interactions, and epistemic forms of reasoning. Few frameworks, however, connect these assessments to conceptual quality. We present an analytic framework for assessing argumentation in online science learning environments that relates levels of opposition with discourse moves, use of grounds, and conceptual quality. We then apply the proposed framework to students' dialogic argumentation within a representative online science learning environment to investigate the framework's potential affordances as well as to assess issues of reliability and appropriateness. The results suggest that the framework offers significant affordances and that it also offers high interrater reliability for trained coders. The applicability of the framework for offline contexts and future extensions of the framework are discussed in light of these results. © 2007 Wiley Periodicals, Inc. J Res Sci Teach 45: 293–321, 2008     

Examining the effect of teachers' adaptations of a middle school science inquiry‐oriented curriculum unit on student learning

Reform based curriculum offer a promising avenue to support greater student achievement in science. Yet teachers frequently adapt innovative curriculum when they use them in their own classrooms. In this study, we examine how 19 teachers adapted an inquiry‐oriented middle school science curriculum. Specifically, we investigate how teachers' curricular adaptations (amount of time, level of completion, and activity structures), teacher self‐efficacy (teacher comfort and student understanding), and teacher experience enacting the unit influenced student learning. Data sources included curriculum surveys, videotape observations of focal teachers, and pre‐ and post‐tests from 1,234 students. Our analyses using hierarchical linear modeling found that 38% of the variance in student gain scores occurred between teachers. Two variables significantly predicted student learning: teacher experience and activity structure. Teachers who had previously taught the inquiry‐oriented curriculum had greater student gains. For activity structure, students who completed investigations themselves had greater learning gains compared to students in classrooms who observed their teacher completing the investigations as demonstrations. These findings suggest that it can take time for teachers to effectively use innovative science curriculum. Furthermore, this study provides evidence for the importance of having students actively engaging in inquiry investigations to develop understandings of key science concepts. © 2010 Wiley Periodicals, Inc., J Res Sci Teach 48: 149–169, 2011     

Conceptualising strategic alignment between curriculum and pedagogy through a learning design framework

Abstract

Improved clarity concerning the relationship between curriculum and pedagogy in higher education is needed to address issues concerning learning and teaching quality. This paper explores the relationship between curriculum and pedagogy and argues for a stronger and more explicit link between the two. On that basis, the paper proposes a conceptual learning design framework that has the potential to act as a clarifying tool for academic developers and academics as they conceptualise and develop contemporary learning environments for effective learning. Reflections on the implication of the framework for practice are discussed.     

Interactions between reasoning about complex systems and conceptual understanding in learning chemistry

“Complex systems” is a general-purpose reasoning scheme, used in a wide range of disciplines to make sense of systems with many similar entities. In this paper, we examine the generality of this approach in learning chemistry. Students' reasoning in chemistry in terms of emergent complex systems is explored for two curricula: a normative and a complexity-based one, so that the interaction could be examined under both the conditions. A quasi-experimental pretest-intervention-posttest comparison group design was used to explore student's learning, complemented with interview data. The experimental group (n = 47) studied the topic of gases with a complexity-based curriculum. A comparison group (n = 45) studied with a normative curriculum for the same duration. Students' answers to questionnaires were coded with a complexity-based approach that included levels (distinguishing micro- and macro-levels), stochastic particle behaviors, the emergence of macro-level patterns from micro-level behaviors, and the source of control in the system. It was found that students' reasoning about chemistry concepts in terms of complex systems falls into three distinct and coherent mental models. A sophisticated mental model included most of the above-described complexity features, while the nonsophisticated model included none. The intermediate model is typified by distinguishing between levels, but not by stochastic and emergent behaviors. The nonsophisticated mental model was used mostly in the pretest. In the posttest, the experimental group used the intermediate and sophisticated models; while the comparison group used the nonsophisticated and intermediate models. Discussion approaches the topics of the generality of the complex systems approach; and the unique forms of reasoning that a complexity approach may contribute to learning science.     

A design framework for educational hypermedia systems: theory, research, and learning emerging scientific conceptual perspectives

This paper focuses on theory and research issues associated with the use of hypermedia technologies in education. It is proposed that viewing hypermedia technologies as an enabling infrastructure for tools to support learning—in particular learning in problem-based pedagogical environments involving cases—has particular promise. After considering research issues with problem-based learning related to knowledge transfer and conceptual change, a design framework is discussed for a hypermedia system with scaffolding features intended to support and enhance problem-based learning with cases. Preliminary results are reported of research involving a new version of this hypermedia design approach with special ontological scaffolding to explore conceptual change and far knowledge transfer issues related to learning advanced scientific knowledge involving complex systems as well as the use of the system in a graduate seminar class. Overall, it is hoped that this program of research will stimulate further work on learning and cognitive sciences theoretical and research issues, on the characteristics of design features for robust and educationally powerful hypermedia systems, on ways that hypermedia systems might be used to support innovative pedagogical approaches being used in the schools, and on how particular designs for learning technologies might foster learning of conceptually difficult knowledge and skills that are increasingly necessary in the 21st century.

The use of a computer simulation to promote scientific conceptions of moon phases

This study described the conceptual understandings of 50 early childhood (Pre‐K‐3) preservice teachers about standards‐based lunar concepts before and after inquiry‐based instruction utilizing educational technology. The instructional intervention integrated the planetarium software Starry Night Backyard™ with instruction on moon phases from Physics by Inquiry by McDermott (1996). Data sources included drawings, interviews, and a lunar shapes card sort. Videotapes of participants' interviews were used along with the drawings and card sorting responses during data analysis. The various data were analyzed via a constant comparative method in order to produce profiles of each participant's pre‐ and postinstruction conceptual understandings of moon phases. Results indicated that before instruction none of the participants understood the cause of moon phases, and none were able to draw both scientific moon shapes and sequences. After the instruction with technology integration, most participants (82%) held a scientific understanding of the cause of moon phases and were able to draw scientific shapes and sequences (80%). The results of this study demonstrate that a well‐designed computer simulation used within a conceptual change model of instruction can be very effective in promoting scientific understandings. © 2007 Wiley Periodicals, Inc. J Res Sci Teach 45: 346–372, 2008     

Informed learning design: teaching and learning through engagement with information

ABSTRACT

While higher education teachers are able to use information in sophisticated ways to learn and communicate within their disciplines, they may not be accustomed to teaching their students to use information creatively and reflectively to support their work in a course. This article introduces informed learning design, a curriculum design model by which teachers specifically enable students to learn course content through intentional engagement with information. Drawing from informed learning pedagogy and the variation theory of learning, the design model outlines an instructional pattern for enabling student awareness of critical aspects and features of the object being studied related to both information use and course content.     

Teacher use of evidence to customize inquiry science instruction

This study investigated how professional development featuring evidence‐based customization of technology‐enhanced curriculum projects can improve inquiry science teaching and student knowledge integration in earth science. Participants included three middle school sixth‐grade teachers and their classes of students (N = 787) for three consecutive years. Teachers used evidence from their student work to revise the curriculum projects and rethink their teaching strategies. Data were collected through teacher interviews, written reflections, classroom observations, curriculum artifacts, and student assessments. Results suggest that the detailed information about the learning activities of students provided by the assessments embedded in the online curriculum motivated curricular and pedagogical customizations that resulted in both teacher and student learning. Customizations initiated by teachers included revisions of embedded questions, additions of hands‐on investigations, and modifications of teaching strategies. Student performance improved across the three cohorts of students with each year of instructional customization. Coupling evidence from student work with revisions of curriculum and instruction has promise for strengthening professional development and improving science learning. © 2010 Wiley Periodicals, Inc. J Res Sci Teach 47: 1037–1063, 2010     

Bridging scientific reasoning and conceptual change through adaptive web‐based learning

This study reports an adaptive digital learning project, Scientific Concept Construction and Reconstruction (SCCR), and examines its effects on 108 8th grade students' scientific reasoning and conceptual change through mixed methods. A one‐group pre‐, post‐, and retention quasi‐experimental design was used in the study. All students received tests for Atomic Achievement, Scientific Reasoning, and Atomic Dependent Reasoning before, 1 week after, and 8 weeks after learning. A total of 18 students, six from each class, were each interviewed for 1 hour before, immediately after, and 2 months after learning. A flow map was used to provide a sequential representation of the flow of students' scientific narrative elicited from the interviews, and to further analyze the level of scientific reasoning and conceptual change. Results show students' concepts of atoms, scientific reasoning, and conceptual change made progress, which is consistent with the interviewing results regarding the level of scientific reasoning and quantity of conceptual change. This study demonstrated that students' conceptual change and scientific reasoning could be improved through the SCCR learning project. Moreover, regression results indicated students' scientific reasoning contributed more to their conceptual change than to the concepts students held immediately after learning. It implies that scientific reasoning was pivotal for conceptual change and prompted students to make associations among new mental sets and existing hierarchical structure‐based memory. © 2009 Wiley Periodicals, Inc. J Res Sci Teach 47: 91–119, 2010     

Scaffolding students' use of learner-generated content in a technology-enhanced inquiry learning environment

Having students inspect and use each other's work is a promising way to advance inquiry-based science learning. Research has nevertheless shown that additional guidance is needed for students to take full advantage of the work produced by their peers. The present study investigated whether scaffolding through an integrated support tool could bring about the desired effect. This tool was embedded in an online inquiry learning environment and outlined the steps in searching for information in peer-created concept maps. It also contained specific directions to assess the quality of the retrieved information. The effectiveness of this search guidance tool was investigated during an inquiry-based science project. Main results indicated that high school students who were supported by the tool (n?=?19) developed a more differentiated and interconnected conceptual understanding than students who did not receive this scaffold (n?=?23). However, the search guidance tool also seemed to put additional demands on students' self-regulatory abilities, and might therefore require some practice or regulatory support to reach its full potential.     

Educational affordances and learning design in music software development

Although music software has become increasingly affordable and widely adopted in today’s classrooms, concerns have been raised about a lack of consideration for users’ needs during the software development process. This paper examines intra- and inter-sectoral communication pertaining to software development and music education to shed light on the improvement of the educational affordances for music software in classroom teaching and learning. Semi-structured interviews with music software developers (n = 3) and music teachers (n = 15) are used to gain insights into how to enhance the educational affordances of music software. The findings of this study fill a gap in the literature by detailing the knowledge exchange required to effectively develop music education software. Improving the synergy between the knowledge bases of software development and music education could enhance novel educational affordances, providing music teachers with the opportunity to develop new, pedagogically sound music teaching and learning activities.     

Feminist theory and collaborative learning in seminar contexts

This paper describes the processes undertaken to construct more equitable and accountable evaluation procedures within seminars: that is, contexts where the salient modalities being evaluated are participation and oral expression. We describe the distinctive features of our model, including facilitation of the work of teaching assistants, ways to operationalize feminist pedagogy, and processes for evaluation. We articulate the specifics of these features as well as offering a comprehensive 'insider's' account of the actual seminar process we employ. We end by describing teaching, learning, evaluation and institutional outcomes.     

Supporting accomplished facilitation: examining the use of appreciative inquiry to inform the development of learning resources for medical educators

This paper examines the use of appreciative inquiry (AI) to guide development of web-based learning resources for medical educators who facilitate simulation-based learning experiences for doctors-in-training. AI can be viewed as a positive form of action research, which seeks to avoid deficit-based analyses and solutions, and commonly associated defensiveness. The use of AI to guide research and curriculum development has hitherto received scant attention.

Simulated medical practice allows learners’ needs to take top priority because simulated patients replace real patients (whose care would otherwise be top priority). Each episode of simulated clinical practice is followed by facilitated debriefing. Facilitators complete an initial ‘train the trainers’ course (typically one or three days). Our learning resources aimed to complement and extend initial courses.

AI informed data collection and analysis. It focused attention on identifying and understanding what was good about contemporary debriefing practices. We identified examples of practical wisdom and designed resources to help make these more transparent and accessible to all facilitators. Selected video records and interview excerpts demonstrated key points. We found opportunities to introduce ideas that would extend facilitators’ expertise.

We critique AI as an approach to action research and curriculum development, and recommend further use of AI in other contexts.     

A critique of the role of culture in Maori education

Educational under-achievement by a section of the Maori population is a persistent problem for New Zealand. This article is a theoretical examination of the practice and consequences of a culture-based curriculum that is promoted as the solution. We develop the argument that not only is the ‘cultural solution’ at odds with the complex social reality in New Zealand, but it is itself a contributor to educational under-achievement.     

Connecting learning to the world beyond the classroom through collaborative philosophical inquiry

This study explored the impact of facilitating collaborative philosophical inquiry (CPI), in the tradition of “Philosophy for Children,” on connectedness pedagogies. The study employed an experimental design that included 59 primary teachers in 2 groups. The experimental group received an intervention that comprised training in CPI and the comparison group received training in Thinking Tools (graphic organisers), a subset of the CPI training. Lessons were coded on four variables of connectedness pedagogies, across the two groups, at three time-points. Teacher interviews were conducted to gather participants’ perspectives. Between-groups analysis of variance (ANOVA) on particular measures of pedagogy revealed that CPI significantly broadened teachers’ pedagogical repertoires, in ways that included drawing on students’ background knowledge and preparing a problem-based curriculum which connects students to the world beyond the classroom.     

A comparison of students' conceptual understanding of electric circuits in simulation only and simulation‐laboratory contexts

The aim of this experimental study was to compare learning outcomes of students using a simulation alone (simulation environment) with outcomes of those using a simulation in parallel with real circuits (combination environment) in the domain of electricity, and to explore how learning outcomes in these environments are mediated by implicit (only procedural guidance) and explicit (more structure and guidance for the discovery process) instruction. Matched‐quartets were created based on the pre‐test results of 50 elementary school students and divided randomly into a simulation implicit (SI), simulation explicit (SE), combination implicit (CI) and combination explicit (CE) conditions. The results demonstrated that the instructional support had an expected effect on students' understanding of electric circuits when they used the simulation alone; pure procedural guidance (SI) was insufficient to promote conceptual understanding, but when the students were given more guidance for the discovery process (SE) they were able to gain significant amount of subject knowledge. A surprising finding was that when the students used the simulation and the real circuits in parallel, the explicit instruction (CE) did not seem to elicit much additional gain for their understanding of electric circuits compared to the implicit instruction (CI). Instead, the explicit instruction slowed down the inquiry process substantially in the combination environment (CE). Although the explicit instruction was able to improve students' conceptual understanding of electrical circuits considerably in the simulation environment, their understanding did not reach the level of the students in the combination environment. These results suggest that when teaching students about electricity, the students can gain better understanding when they have an opportunity to use the simulation and the real circuits in parallel than if they have only a computer simulation available, even when the use of the simulation is supported with the explicit instruction. © 2010 Wiley Periodicals, Inc. J Res Sci Teach 48: 71–93, 2011