Additional Influences on Response Certitude and Feedback Requests

This study was designed to build on the previous work of R. W. Kulhavy and associates by investigating additional influences on the relationship between feedback and response certitude during the learning process. The results of the study showed that in addition to response certitude and correctness (as predicted by Kulhavy & Stock, 1989), other factors, including the goal subjects were attempting to attain and their commitment to that goal, also influenced the frequency in which they requested feedback. In addition, requesting feedback as a strategy to learn the material and the subjects′ confidence in reaching their goal influenced performance on the test over the information in a learning task.     

Children's use of response confidence in the processing of instructional feedback

The main purpose of the present study was to extend a model of instructional feedback (Kulhavy & Stock, 1989) to elementary school children. Forty-five third and fifth graders (third graders, N = 21; fifth graders, N = 24) read text passages, answered questions, and either rated response confidences for each question or used an imagery strategy. Although differences were not found between treatment groups, analyses of response patterns revealed differential age effects. Response patterns for fifth graders were similar to those of college populations; however, these patterns did not emerge for third graders.     

The use of informational feedback in instruction: Implications for future research

The use of informational feedback has long been advocated and verified as being an important part of learning. Many studies have been conducted to examine which variables might affect learning from feedback. The purpose of this review is to examine these studies within various constructs and identify areas that need further investigation and clarification. Feedback is examined from early studies, which viewed the process behaviorally as reinforcement, to present research that advocates an information-processing perspective and an emphasis on error correction. A current model of feedback (Kulhavy & Stock, 1989) is presented as a context for discussion. The issues of response certainty, feedback elaboration, and error analysis are also addressed. Recommendations to future researchers are presented in light of conclusions drawn.When this article was written, she was a Visiting Research Associate at the Center for Educational Technology at Florida State University.     

Using a Diagnosis-Based Approach to Individualize Instructional Explanations in Computer-Mediated Communication

To maximize the effectiveness of instructional explanations, they should be tailored to an individual learner. However, instructors are often not able to collect diagnostically relevant information about a learner to individualize their explanations. This is particularly true in computer-mediated settings where it is more difficult to thoroughly assess a learner’s understanding. We present an approach that provides instructors in asynchronous and text-based computer-mediated communication settings with information about a learner’s understanding that has sufficient diagnostic power to enable them to generate learner-tailored explanations. A series of experiments testing this approach suggest several conclusions. First, instructors need information about a learner to individualize explanations. Second, instructors are able to design explanations that are specifically adapted to a learner’s individual understanding. Third, learner-tailored explanations facilitate the processing of new information and make instructional communication more efficient. Fourth, learner-tailored explanations enhance a deep understanding of the information processed and make instructional communication more effective.     

Cognitive Style FD/FI as a Learner Selection Criterion in Formative Evaluations A Qualitative Analysis

Single–subject formative evaluation appears to be a cost–effective strategy for improving instructional products. However, the criterion to use for selecting an appropriate test subject who could generate optimal feedback data for improving the instructional product remains a central concern among performance technologists. This article reports the results of a qualitative study of the effectiveness of the cognitive style construct field–dependent/independent as a student selection criterion in formative evaluation. In the study, we collected formative evaluation data from two field–dependent (FD) and two field–independent (FI) test subjects while they were individually interacting with a CAI package. We focused on four different sources of data: think–aloud protocols, researcher/subject interactions, informal observations, and debriefing interviews. Our analysis of the formative evaluation data indicates that the FI individuals were better test subjects than their FD counterparts. FI subjects showed a great deal of confidence in entering the formative evaluation process. Their feedback was abundant and precise and included specific suggestions for improving the material. They not only identified their own difficulties but also speculated about difficulties other students may encounter. In contrast, the FD subjects were anxious and demonstrated less confidence in approaching the evaluation activities. Frequent probing was necessary to trigger their reactions and generate their feedback. Their feedback data were vague, and more inferences were required for translating them into revision decisions. Both FD and FI subjects could identify major discrepancies in the presentation of the material (events of learning) as well as gross misconceptions in the processing of information. Although the FD and FI feedback data differ both qualitatively and quantitatively, no conflicting observation was made.     

Does spatial or visual information in maps facilitate text recall? Reconsidering the conjoint retention hypothesis

The conjoint retention hypothesis (CRH) claims that students recall more text information when they study geographic maps in addition to text than when they study text alone, because the maps are encoded spatially (Kulhavy, Lee, & Caterino, 1985). This claim was recently challenged by Griffin and Robinson (2000), who found no advantage for maps over feature lists in facilitating text recall. In two experiments, we crossed maps and lists with icons and names (c.f., Griffin & Robinson), and employed materials and methodology very similar to those used in previous CRH studies by Kulhavy and colleagues (Kulhavy, Stock, Verdi, Rittschof, and Savenye, 1993; Stock, Kulhavy, Peterson, Hancock, & Verdi, 1995). In addition, we included a concurrent task to measure spatial encoding, as did Griffin and Robinson. No advantages were found for maps over lists in facilitating text recall, nor were maps processed in a more spatial manner than litsts. Instead, it appears that the key stimulus feature for facilitating text recall is mimetic icons (i.e., icons that represent features) rather than the spatial characteristics of geographic maps, a finding that supports dual-coding theory (Paivio, 1986), but not the CRH.     

Text Learning Using Scientific Diagrams: Implications for Classroom Use

In two experiments, eighth-graders viewed ecologically valid diagrams and then read a text containing multiple feature-to-fact associations or studied the same materials in reverse order. Using the Kulhavy and Stock model of text learning using organized spatial displays, it was predicted that those students viewing the diagram prior to reading the text would recall more facts and features than subjects viewing the material in the reverse order. These predictions were well supported. In addition, since the materials used in the experiments were created from actual classroom materials, these experiments examined whether the model for text learning is also valid using this type of materials. In this area the model proved to be very effective as well.     

Towards a personalized task selection model with shared instructional control

Modern education emphasizes the need to flexibly personalize learning tasks to individual learners. This article discusses a personalized task-selection model with shared instructional control based on two current tendencies for the dynamic sequencing of learning tasks: (1) personalization by an instructional agent which makes sequencing decisions on the basis of learner’s expertise, and (2) personalization by the learner who is given control over – final – task selection. The model combines both trends in a model with shared instructional control. From all available learning tasks, an instructional agent selects a subset of tasks based on the learner’s performance scores and invested mental effort (i.e., system-control). Subsequently, this subset is presented to the learner who makes the final decision (i.e., learner control). A computer-assisted instructional program has been developed to put the model into practice and preliminary results are discussed. The model can be used to increase the efficiency and effectiveness of instruction and to make it more appealing by providing the learner an optimal level of control over task selection. This research project is funded by the Netherlands Organization for Scientific Research (NWO, The Hague, project No. 411-02-107-V).     

Behavioral patterns of students under an individualized learning strategy

The study examines the behavioral patterns of high, average and low achievers in classrooms implementing an individualized instructional strategy. The study makes use of an observational instrument modelled on Medely's Personal Record of school Experiences (PROSE). Seventy-two boys and girls chosen from 12 first, second and third grade classrooms were included in the sample; 1/3 were ranked by the teacher as high achievers, 1/3 as average and 1/3 as low achievers. The findings revealed that students spent about 2/3 of their time on independent work; and the time spent interacting with teacher was about equal to the time spent interacting with classmate.The results also showed that interaction patterns between teacher and individual students are related to the student achievement level. In addition, distinctly different work patterns of independent activity were discerned in high and low achievers indicating higher involvement in on-task activities among high students compared with low achievers. Similiar patterns of interaction between students were found for high, average and low achievers demonstrating either on-task or off-task interaction of a verbal nature among students of the same sex. Implications for teachers, teachers trainers and instructional developers are discussed.     

A cultural embrace

Conclusion As culture is at the heart of meaning making, it warrants exacting attention in the systemic design process. As Gustafson & Powell (1991) point out, too often models are not tested for validity and reliability. It is for this reason that we emphasize that research must critically evaluate this expanded ADDIE model. As technology enables us to increase our interaction with the peoples of the world, we are enriched by the incessant shifts in our own cultural paradigms. Attention to this cultural dynamism and incessant interplay leads to both improved designs and improved designers. As instructional designers, we must be able to critically analyze our learner’s cultures and allow it to strengthen the instructional design process. In this way we address our ethical commitment to creating culturally sensitive products. His research interests include culture, identity development, and meaning making in technology rich environments. His research interests are in the areas of Educational Gerontology, Instructional Design, and the Digital Divide. His research interests include Systemic Change and the Digital Divide.     

Non-School English of High-School Students

Abstract

This study explores the effects of classroom feedback and evaluation structure on students’ attributional tendencies. It extends the application of attribution theory from its conventional use in the context of individual differences to the classroom level. A classroom model was developed describing the effects of feedback and evaluation practices on the distributional pattern of students’ attributional tendencies. The results of this study suggest that the feedback and the evaluation system in the classroom affect students’ causal explanations of their successes and failures in school. The results show’ that in classrooms where the feedback structure is rich, more specific, and individualized, the attributional tendencies of the low achievers are closer to those of the high achievers.     

Map Perspective and the Learning of Text

In two studies, undergraduates learned a map of the city of Rome in either a flat survey map or a one-point perspective format. The perspective map lead to greater feature recall in the first study and to better memory for a related text when features were correctly located in the second study. Both studies suggest that map scanning patterns may differ depending on the learner′s point of view.     

Teachers' differential behavior

This paper reviews research and theory pertaining to teachers' differential treatment of different students in the classroom. Research on the behavioral-mediation (or transmission) of teacher expectancies is the major source of information about teachers' differential behavior toward high and low achievers. The common behaviors in expectancy-mediation research are listed, together with their meta-analytic effect magnitudes. A proposed conceptualization of teachers' differential behavior distinguishes between (a) the relatively equitable distribution of teachers' feedback; (b) compensation of low achievers in the instructional domain; and (c) a reversed trend of providing a warmer emotional climate and more positive affect to high achievers. Subsequent discussion focuses on students' perceptions of teachers' differential behavior, with special emphasis on gaps between students' and teachers' perceptions in the affective domain. Latter sections of the paper review teachers' differential behavior toward specific student types, particularly toward teachers' pets, and teachers' differential behavior in the physical space of the classroom.     

Distinguishing Two Stages of Mathematics Conceptual Learning

In this theoretical article, we distinguish two stages of learning a new mathematical concept – participatory and anticipatory. We use a recently developed mechanism for explaining mathematical conceptual learning – reflection on activity-effect relationship – as well as von Glasersfelds tripartite model of a scheme, to explain qualitative distinctions between the two stages. We use this distinction to explain why instructional interventions (including inquiry-based approaches) may not bring about the intended instructional goals.     

Capacity building to bridge data use and instructional improvement through evidence on student thinking

While schools and systems across the globe promote data-driven decision making, teachers often struggle to use data, especially from external assessments, to inform daily instruction. In this paper, we examine teacher capacity building for a less typical form of data use - evidence on student thinking. We draw on data from a longitudinal, in-depth qualitative study involving middle school math teachers who were engaged in an instructional improvement project. Findings show that data use occurred when evidence from student thinking was introduced as part of the instructional planning process. This shift was facilitated by an instructional coach whose capacity building efforts with teachers focused on coherence, specifically planning high quality instruction and using data effectively, while also meeting district pacing and unit planning goals. When teachers put new strategies into practice, feedback from formative assessment data allowed teachers to identify and address misconceptions in student thinking. Learning how to use data as part of instruction helped teachers build capacity to reflect on their own practice. Implications for theory, practice, and research are discussed.     

Feedback about Teaching in Higher Ed: Neglected Opportunities to Promote Change

Despite ongoing dissemination of evidence-based teaching strategies, science teaching at the university level is less than reformed. Most college biology instructors could benefit from more sustained support in implementing these strategies. One-time workshops raise awareness of evidence-based practices, but faculty members are more likely to make significant changes in their teaching practices when supported by coaching and feedback. Currently, most instructional feedback occurs via student evaluations, which typically lack specific feedback for improvement and focus on teacher-centered practices, or via drop-in classroom observations and peer evaluation by other instructors, which raise issues for promotion, tenure, and evaluation. The goals of this essay are to summarize the best practices for providing instructional feedback, recommend specific strategies for providing feedback, and suggest areas for further research. Missed opportunities for feedback in teaching are highlighted, and the sharing of instructional expertise is encouraged.     

The priorities established among data sources when instructional designers revise written materials

The objective of the study was to investigate the priorities instructional designers establish among data sources when they revise written materials and the relationship of their practice to standard models of formative evaluation. Two modules of printed instructional material were revised by each of eight experienced instructional designers under three treatment conditions, using a counterbalanced design. Data were collected using a think-aloud procedure. The think-aloud protocol was segmented, coded and analysed. Results show that instructional designers were significantly more likely to incorporate their own knowledge into revisions than to use feedback data, and when they did use feedback data, they preferred learner comments. They did not accurately assess their use of their own knowledge or of feedback data; they thought they used feedback data more than the results showed. These instructional designers reflected some aspects of the standard instructional design model when they revised instructional materials, but their experience has caused many of the procedures to become internalized, so they are invisible in the protocols. This research was funded in part by a grant from the Social Sciences and Humanities Research Council of Canada.     

An attitudinal study of computer-assisted testing as a learning method

The study investigated the effects of exposure to computer-assisted testing (CAT) as an effective instructional method and its effects on attitudes toward computer-assisted instruction (CAI). Five computer quizzes consisting of 20 randomly drawn multiple-choice questions were individually administered on 10 teletype terminals. A feedback mechanism was incorporated in the CAT program and provided detailed explanations of questions. Results indicated that subjects exposed to CAT had significantly more favorable attitudes toward CAI than subjects not exposed to CAT. In addition, CAT was perceived by students to be an effective instructional method in aiding mastery of conceptual and factual material.