Merlin C. Wittrock's Enduring Contributions to the Science of Learning

This paper critiques present trends in several areas of educational psychology from the perspective of the inapplicability of their research designs for producing knowledge which can be applied in classrooms. Several suggestions are offered for adapting designs and/or changing research emphases so that more applicable findings are produced.     

Living Anatomy

Recently, the study of sport and sport-related behavior has become of particular interest to scientists. As the field of physical education expands, various subdisciplines have emerged which generally employ conventional research methods. The purpose of the present paper is to suggest that in addition to the traditional experimental method, sport researchers can find valuable use for non-experimental methodologies. These techniques, which are currently underused in sport research, can facilitate the study of questions that are applied in nature. Several designs and alternatives are presented and reviewed, including time series designs, multiple baseline case designs, and field experiments. Specific examples from sport situations are provided to demonstrate the potential usefulness of these designs in the applied setting. Recommendations for integrating basic and applied research orientations are also discussed. This dualistic approach is viewed as an essential function for a maturing field of study.     

Optimal Design for Two-Level Random Assignment and Regression Discontinuity Studies

An important concern when planning research studies is to obtain maximum precision of an estimate of a treatment effect given a budget constraint. When research designs have a multilevel or hierarchical structure changes in sample size at different levels of the design will impact precision differently. Furthermore, there will typically be differential costs of enrolling additional units at different levels of the hierarchy. The optimal design problem in multilevel research studies involves determining the optimal sample size at each level of the design given specified design parameters and a specified marginal cost of recruitment at each level. The current work extends existing results by considering optimal design for (a) unbalanced random assignment designs and (b) regression discontinuity designs.     

Subtyping of reading disorders: Implications for remediation

Present research methods do not seem to be leading us toward general agreement regarding reading disability subtypes. Even if there were agreement, conventional group research designs are not adequate for determining the optimal remedial procedure for each subtype. It is recommended that careful thought be given to the formulation of more appropriate theoretical frameworks and behavioral measures, and that single-subject research designs which yield information about subtypes and remediation effects be designed through collaboration of researchers and practitioners. Presented at the 33rd Annual Conference of The Orton Dyslexia Society, San Diego, California, November 1983.     

Undertaking Experiments in Social Sciences: Sequential,Multiple Time Series Designs for Consideration

In social sciences, the use of stringent methodological approaches is gaining increasing emphasis. Researchers have recognized the limitations of cross-sectional, non-manipulative data in the study of causality. True experimental designs, in contrast, are preferred as they represent rigorous standards for achieving causal flows between variables. The Solomon four-group design, for example, is ideal for its positioning to account for, and factor out, confounded influences of predictors on outcomes. However, in daily life settings, it is often difficult to emulate true experimental conditions. Identified limitations include financial resources, logistic difficulties, time constraint, and small sample sizes in social science research settings. There are, of course, other experimental designs that are noteworthy for consideration. Time series and single-case designs, quasi in nature, are effective alternatives for educators and researchers to consider in their research foci. This article examines the different experimental designs that may be implemented in naturalistic classroom settings. In particular, one important inquiry of our theoretical discussion pertains closely to the conceptualization of two innovative designs that we have made, consequently as a result of our research development and examination of the literature: a sequential, multiple time series multi-group design and a multi time series, multi-group single-case design. These experimental designs are innovative and enable comparisons for within and between differences under different experimental conditions.     

Learner preferences for varying screen densities using realistic stimulus materials with single and multiple designs

Learner preferences for varying screen density levels were examined using multiple screen designs (high external validity) and single screen designs (high internal validity). When viewing multiple screens for each design in Study 1, subjects indicated the highest preference for medium-density screens while tending to select higher-density over lower density screens in individual comparisons. When viewing only the first screen of each density level in Study 2, subjects again expressed preferences for higher-density over lower-density designs. Suggestions are provided concerning the use of realistic and nonrealistic content for the stimulus materials as well as implications of using externally and internally valid screen designs for future research on computer-based instruction screen design.     

Single Case Research: An Added Tool for Counselors and Supervisors

Single case research is proposed as a valuable means of involving counselors in the research process, providing feedback to the counselor and supervisor and gathering accountability data. Yet relatively little research of this type is conducted. One reason for this paucity of single case research is a lack of familiarity. If one is familiar with single case research, it is usually with case study methodologies and not with the intensive N of 1 designs. The purpose of this article is to familiarize the reader with the two major types of intensive N of 1 designs: experimental and association. Several different examples of each are presented in hopes of stimulating usage.     

液压快速回转头压力机液压系统机理研究

提出了一种新型液压快速回转头压力机液压系统的三种设计方案,分析和探讨了各自的结构、工作原理和控制原理。选择其一进行具体实施,实验结果表明可以达到要求。     

An examination of gender and situational interest in multimedia learning environments

Existing research highlights conflicting results attempting to capture gender preferences with respect to unimodal versus multimodal designs in online learning. As online learning continues to expand, more research examining the role of gender in multimedia design holds considerable potential. However, the presence of multimedia in online learning contexts presents a more complex problem when taking into consideration the concept of learner interest. The current study sought to investigate gender differences in situational interest (SI) with respect to three different but related designs of an online, multimedia learning environment for continuing, professional education in emergency medical services. The content in these designs was identical, but applied different combinations of the redundancy and modality multimedia principles. A two-way analysis of variance was used to examine the types of SI by gender and type of multimedia design. While no significant difference or interaction effect was identified between gender and triggered SI, an interaction effect was observed for females and the different multimedia designs. Specifically, females reported a higher maintained SI when animation, narration and text were effectively combined. The findings of this study provide insight into best practices for instructional and media designers developing multimedia learning environments as well as future research implications.     

Mixed methods research in inquiry-based instruction: an integrative review

ABSTRACT

This integrative literature review takes up the ongoing discussion about the place of mixed methods designs in educational research. We focus on studies that investigate the role of argumentation in inquiry-based learning, either as a means for enhancing inquiry (argument-based inquiry) or as a learning outcome (inquiry-based argument). We argue that this field of research offers a perfect example of the ways in which a paradigm and its research questions call for mixed-methods designs. We then present an integrative review to explore patterns and identify gaps in the literature, asking: (1) How frequently and in what ways are mixed methods used in the field? (2) What rationales are driving the use of mixed methods? and (3) To what extent is the potential of mixed methods research being realized in the field?. For readers studying argumentation in inquiry-based instruction, we hope to open up a critical dialogue about aims and methodologies in the field. For readers interested in mixed-methods designs we hope to offer a case study of how to build a rationale from within a discipline for leveraging the range of mixed methodologies to study a problem. We conclude with recommendations for further research.     

Meta-Analysis and Meta-Synthesis Methodologies: Rigorously Piecing Together Research

For a variety of reasons, education research can be difficult to summarize. Varying contexts, designs, levels of quality, measurement challenges, definition of underlying constructs, and treatments as well as the complexity of research subjects themselves can result in variability. Education research is voluminous and draws on multiple methods including quantitative, as well as, qualitative approaches to answer key research questions. With increased numbers of empirical research in Instructional Design and Technology (IDT), using various synthesis methods can provide a means to more deeply understand trends and patterns in research findings across multiple studies. The purpose of this article is to illustrate structured review or meta-synthesis procedures for qualitative research, as well as, novel meta-analysis procedures for the kinds of multiple treatment designs common to IDT settings. Sample analyses are used to discuss key methodological ideas as a way to introduce researchers to these techniques.     

The impact of AI and robotics on physical,social-emotional and intellectual learning outcomes: An integrated analytical framework

This qualitative study examines the use of artificial intelligence (AI) and robotics in learning designs from the perspective of learning sciences. The literature on the topic indicates that there is not enough research on including diverse learning outcomes in the designs for learning. Therefore, the purpose of this study was to understand how AI and robots impact physical, social-emotional and intellectual learning outcomes through the implementation of learning designs that are guided by selected design principles. In this study, the design-based research (DBR) methodology was employed for investigating learning in naturalistic contexts. The intervention was implemented in a primary school in which learners used educational robots. The main findings reveal that the development of an integrated analytical framework, which considers a broader spectrum of human potential, allows for analyzing students’ learning outcomes in a more integral, inclusive and balanced way. This, in turn, promotes students’ learning by using AI and robots. Another finding reveals that the impact of using AI and robotics on learning designs is reflected in learners’ personal trajectories having different pathways and paces. Finally, the lessons learned and the challenges to be overcome are summarized, and recommendations are made for future research for the enhancement of learning experiences that use AI and robotics.     

Case Study Research: A Valuable Learning Tool for Performance Improvement Professionals

Although it is sometimes recommended that performance improvement (PI) professionals include experimental research designs in their repertoire of PI tools and methods, it has been long understood that experimental designs can be difficult to implement due to impediments resulting from the complex nature of the organizational settings. However, the utilization of case study research has proven to be an effective alternative to aid in the identification of strengths and opportunities for the improvement of organizational procedures, policies, processes, or programs. Case study research helps managers and practitioners make sense of real world problems. This article presents a summary of steps in the design of case study research and provides examples of how these methods have been used within organizational settings. Implications for PI practitioners are provided.     

What time-series designs may have to offer educational researchers

The promise of time-series designs for educational research and evaluation is reviewed. Ten time-series designs are presented and discussed in the context of threats to internal and external validity. The advantages and disadvantages of various visual and statistical data-analysis techniques are presented. It is argued that time-series research paradigms are useful when researchers (a) wish to involve a single subject in experimental research (individuals as units of analysis) or conduct program-evaluation studies (aggregates as units of analysis), (b) are interested in nearly continuous measurement, (c) cannot meet conventional design and statistical assumptions, or (d) wish to specify individual differences through N = 1 research strategies. It is also suggested that more research endeavors be devoted to combining unique characteristics of time-series research with conventional multi-unit paradigms.     

Oh No! They Cut My Funding! Using “Post Hoc” Planned Missing Data Designs to Salvage Longitudinal Research

Having one’s funding cut in the course of conducting a longitudinal study has become an increasingly real challenge faced by developmental researchers. The main purpose of the current work is to propose “post hoc” planned missing (PHPM) data designs as a promising solution in such difficult situations. This study discusses general guidelines that can be followed to search for viable PHPM designs within a given budget restriction. Illustrative examples across different longitudinal research contexts are provided, each showing how PHPM data designs can help salvage longitudinal studies when an unexpected funding cut occurs mid-study. With the illustrative examples, the article also shows how developmental researchers can conveniently identify viable designs using the R package simPM .     

A Simulation Study Evaluating the Generalized Additive Model for Assessing Intervention Effects with Small Samples

Single subject (SS) designs are popular in educational and psychological research. There exist several statistical techniques designed to analyze such data and to address the question of whether an intervention has the desired impact. Recently, researchers have suggested that generalized additive models (GAMs) might be useful for modeling nonlinear effects that are common with SS designs. This study sought to extend the use of GAM from SS to a research design in which individuals may be placed in separate groups and receive different interventions. Results of the simulation study found that using a mixed model form of GAM (GAMM) resulted in higher power for detecting actual effects in the population than was true for either GAM or a Bayesian GAM estimator. Thus, GAMMs are recommended for use with SS designs when interventions are expected to induce nonlinear relationships between time and the outcome variable and individuals receive different treatments.     

Experimental control and threats to internal validity of concurrent and nonconcurrent multiple baseline designs

Single‐case research designs are often applied within school psychology. This article provides a critical review of the scientific merit of both concurrent and nonconcurrent multiple baseline (MB) designs, relative to their capacity to assess threats of internal validity and establish experimental control. Distinctions are established between AB replications and nonconcurrent multiple baseline designed studies using the initial conception proposed by P.J. Watson and E.A. Workman (1981). Despite some previously pessimistic evaluations of nonconcurrent multiple baseline designs, the findings of this review suggest that various threats of internal validity can be assessed and ruled out using either concurrent or nonconcurrent MB designs. It seems that nonconcurrent designs can be used to assess the intervening effects of history, but might be more prone to threats of mortality. These and other threats of internal validity are reviewed and recommendations are provided. © 2007 Wiley Periodicals, Inc. Psychol Schs 44: 451–459, 2007.