Blocking in landmark-based search in honeybees

Two experiments tested blocking in landmark-based search in honeybees. Honeybees in the experimental group were trained in Phase 1 with a single landmark in a constant spatial relation to the target (sugar water). In the compound training second phase, the landmark used in Phase 1 (blocking landmark) and a new landmark (blocked landmark) were presented at constant spatial relations to the target. The blocking and blocked landmarks differed from each other in color and position, and the blocking landmark retained the same spatial relationship to the target as in Phase 1. In Experiment 1, the control group experienced only Phase 2 training with two landmarks. In Experiment 2, the control group was trained with a different landmark in a different position in Phase 1. Blocking was found in both cases.     

Overexpectation in appetitive Pavlovian and instrumental conditioning

In three experiments that used appetitive preparations with rats, we examined the effects of reinforcing a compound consisting of two previously reinforced stimuli on subsequent responding to those stimuli. Experiment 1 showed that a Pavlovian conditioned stimulus given this treatment evoked fewer magazine entries when presented alone than did a reinforced stimulus that did not receive the compound treatment. Experiment 2 examined inhibition of delay and generalization decrement accounts for the results of Experiment 1. Experiment 3 extended this finding to an instrumental learning paradigm.     

Target-absent controls in blocking experiments with rats

In three between-groups blocking experiments with rats, two concurrent and one forward, several common control procedures were employed: Reinforced trials with the putative blocking stimulus were either omitted entirely (Kamin control), replaced by unsignaled reinforcements (Wagner control), or replaced by reinforced trials with a different stimulus (C1 control). In each experiment, parallel treatments with the target stimulus absent during training served to examine the possibility that differential responding in tests with the target stimulus might be traced solely to differential exposure to the nontarget stimuli. In Experiment 1, responding by a concurrent blocking group during the test was no different than responding by a Kamin control group, and responding by a Wagner control group was greater than that of either of the other groups—a pattern of results, mirrored in the performance of the target-absent groups, that could be attributed to the elevation of contextual excitation by unsignaled reinforcement. In Experiment 2, responding in the test by a concurrent blocking group was no different than that by a C1 control group. In Experiment 3, a finding of less responding by a forward blocking group than by a C1 control group when the target stimulus was present during training, but not when it was absent, provided plausible evidence of blocking.     

Stimulus selection in discriminative taste-aversion learning in the rat

In three experiments, rats were presented compound solutions consisting of a common element, saccharin, mixed with one of two different flavor elements, cinnamon and wintergreen. Rats in the experimental groups consistently received a toxicosis-inducing injection following one compound solution but not following the other compound solution. Rats in the control groups received toxicosis-inducing injections half the time following each of the compound solutions. After training in each experiment, there were tests for conditioning to the saccharin alone. The experimental groups drank significantly more than the control groups, indicating that the aversion to the partially reinforced saccharin in isolation was less when the different flavor cues were more highly correlated with reinforcement. In Experiment III, there was also a test for conditioning to the cinnamon or wintergreen flavor alone. The experimental group drank significantly less of the continuously reinforced flavor than the control group did of the partially reinforced flavor. These results are similar to those reported within more traditional conditioning paradigms.     

Compound conditioning in honeybees: Blocking tests of the independence assumption

Six experiments with color-odor compounds failed to produce convincing evidence of blocking in honeybees even when the possibility of masking by within-compound association could be discounted. The parsimonious assumption that the components of a compound stimulus gain and lose associative strength independently with reinforcement and nonreinforcement of the compounds (which the experiments were designed to challenge) remains tenable for color-odor compounds, although perhaps not for intramodal compounds.     

CS-US temporal relations in blocking

In four trace-conditioning experiments with rats, the influence on the blocking of differences between the blocking cue-unconditioned stimulus (US) and the blocked cue-US trace intervals was explored. Experiment 1 demonstrated blocking despite the blocked cue’s having a shorter trace interval than the blocking cue in both elemental (Phase 1) and compound (Phase 2) training. In Experiment 2, blocking was attenuated when the blocked cue had a longer trace interval than did the blocking cue in both elemental and compound training. In Experiments 3 and 4, the trace intervals of the two cues during compound training were matched (i.e., unlike in Experiments 1 and 2, neither had temporal priority). Blocking was attenuated when the blocking cue trace interval in the elemental phase was shorter (Experiment 3) or longer (Experiment 4) than the compound cue trace during compound training. The findings indicate that subjects encode interstimulus intervals, and they further suggest that cue competition is greatest when the competing cues have the same temporal information as the US.     

Overshadowing as a function of trial number: Dynamics of first- and second-order comparator effects

In two conditioned lick suppression experiments with rats, we examined the permanence of the overshadowing effect as a function of the number of compound reinforced training trials. In Experiment 1, robust overshadowing was observed following 4 compound-US pairings but dissipated with 36 pairings. Overshadowing decreased because responding to the overshadowed stimulus increased, not because responding by the control group decreased. This dissipation was stimulus specific and not attributable to a response ceiling. Experiment 2 extended the generality of the effect to a sensory preconditioning design and further demonstrated that overshadowing lost through many compound-US pairings was restored by posttraining extinction of the training context. The results are explicable in terms of the extended comparator hypothesis (Denniston, Savastano, & Miller, 2001) under the assumption that the impacts of first- and second-order comparator processes grow differentially as a function of number of trials.     

Representations of single and compound stimuli in negative and positive patterning

In four experiments, rats were trained on different patterning discriminations before being tested with compounds composed of novel combinations of the trained stimuli. In Experiment 1, rats were trained on a negative-patterning schedule (A+ B+ AB-) intermixed with reinforced presentations of a second compound (CD+). On a subsequent test, the rats responded more to two novel compounds, AC and BD, than to A and B, but less than to CD. In Experiment 2, rats were trained on two concurrent negative-patterning discriminations (A+ B+ AB-, C+ D+ CD-). On test, they responded more to AC and BD than to AB and CD, but less than to the single stimuli. In Experiment 3, rats were trained on two concurrent positive-patterning discriminations (A-B- AB+, C- D- CD+). On test, their response rates to AC and BD were not different from the response rates to the trained compounds (AB and CD). Finally, in Experiment 4, rats were trained on a positive- and negative-patterning discrimination concurrently. Once again, on test, response rates to AC and BD were not different from responding on reinforced trials of the trained discriminations (A+, B+, and CD+). We discuss the implications of these findings for elemental and configural models of stimulus representation.     

Learning about qualitatively different outcomes during a blocking procedure

In four experiments, rat subjects were used in appetitive Pavlovian magazine-approach and instrumental conditioning procedures. Experiments 1 and 2 found successful blocking of the Pavlovian conditioning of X when it was reinforced in an AX compound after prior conditioning of A. This occurred whether the outcome following AX was the same as or qualitatively different from what followed A. Experiment 3 repeated those findings but also used a transfer procedure to identify the individual associations between X and outcomes. Stimulus X developed an association with the outcome following AX when that outcome differed from that following A alone but not when it was the same as that following A alone. Experiment 4 repeated that pattern of observations for the case of an X that was an instrumental discriminative stimulus. These results suggest that different associative structures may result from a qualitatively changed and unchanged outcome in a blocking experiment. The results are related to comparable findings for the case of overexpectation.     

Blocking in human causal learning is affected by outcome assumptions manipulated through causal structure

Additivity-related assumptions have been proven to modulate blocking in human causal learning. Typically, these assumptions are manipulated by means of pretraining phases (including exposure to different outcome magnitudes), or through explicit instructions. In two experiments, we used a different approach that involved neither pretraining nor instructional manipulations. Instead, we manipulated the causal structure in which the cues were embedded, thereby appealing directly to the participants’ prior knowledge about causal relations and how causes would add up to yield stronger outcomes. Specifically, in our “different-system” condition, the participants should assume that the outcomes would add up, whereas in our “same-system” condition, a ceiling effect would prevent such an assumption. Consistent with our predictions, Experiment 1 showed that, when two cues from separate causal systems were combined, the participants did expect a stronger outcome on compound trials, and blocking was found, whereas when the cues belonged to the same causal system, the participants did not expect a stronger outcome on compound trials, and blocking was not observed. The results were partially replicated in Experiment 2, in which this pattern was found when the cues were tested for the second time. This evidence supports the claim that prior knowledge about the nature of causal relations can affect human causal learning. In addition, the fact that we did not manipulate causal assumptions through pretraining renders the results hard to account for with associative theories of learning.     

Extinction and blocking of conditioned inhibition in human causal learning

Two experiments investigated extinction and blocking of a conditioned inhibitor in a human contingency learning task. Lotz and Lachnit (2009) and Melchers, Wolff, and Lachnit (2006) reported extinction of inhibition only when participants experienced outcome levels lower than those used in training. In Experiment 1, which used more neutral instructions than the previously mentioned studies, we found that extinction of inhibition occurred, whether or not participants experienced lower outcome levels. In Experiment 2, we applied this outcome manipulation to blocking of a conditioned inhibitor. We found blocking of inhibition both when participants had experience with lower outcomes and when they did not. The results of our two experiments are consistent with Rescorla and Wagner’s (1972) associative model, and inconsistent with an inferential account of causal learning (De Houwer, Beckers, & Vandorpe, 2005).     

Reciprocal overshadowing in the discrimination of color-odor compounds by honeybees: Further tests of a continuity model

Honeybees were trained to discriminate between simultaneously presented color-odor compounds, one group with color and odor confounded and a control group with color relevant and odor irrelevant; in subsequent differentially reinforced training with the colors in the absence of the odors, the performance of the two groups was the same (Experiment 1). When, however, response to the colors was measured in a 10-min extinction test, discrimination was found to be poorer after confounded training (Experiment 2), and like results were obtained in an extinction test with the odors after control animals had been trained with odor relevant and color irrelevant, the confounded animals showing poorer discrimination of the odors than the controls (Experiment 3). The results of the first two experiments, in which overshadowing of color by odor was found only with an extinction test, require us to take seriously the possibility that our previous modeling experiments (with probability of correct choice in differentially reinforced training as the measure of performance) may have been insufficiently sensitive to noncontinuity effects. Our first efforts to model extinction suggest, however, that all the results of the present experiments can be understood without sacrifice of the parsimonious independence principle.     

Some determinants of response summation

Response summation in pigeons was examined in four experiments. In Experiment 1, summation was not found with a compound of two visual stimuli on a television screen after they had individually been used for instrumental conditioning. In this experiment, the training and test trials were separated by an interval during which the television screen was dark. Summation was found in Experiment 2 for which the television screen was permanently white during the interval between trials and in the region that was not occupied by the experimental stimuli. These results were replicated using a within-subject design (Experiment 3) and autoshaping (Experiment 4). Experiment 2 also revealed summation with compounds of auditory and visual stimuli, but not with compounds of two auditory stimuli or two diffuse lights. The results can be explained by a variety of theories of learning, if they take account of generalization between the stimuli.     

Positive and negative patterning in human classical skin conductance response conditioning

Three experiments on classical differential conditioning of the human skin conductance response to elemental and compound stimuli are reported. Subjects in Experiment 1 received both positive and negative patterning training, followed by either positive or negative patterning transfer tests on new stimuli. In positive patterning, a compound of two stimuli is reinforced and its elements are nonreinforced. In negative patterning, the elements are reinforced and the compound is nonreinforced. Subjects in Experiments 2 and 3 received either positive or negative patterning during training, followed by transfer tests on new stimuli. In Experiment 2, the transfer series began with new elements, after which their compound was presented; in Experiment 3, the new compound was presented first in the transfer series, and then the separate elements were administered. All three experiments provided evidence of the acquisition of positive patterning, while negative patterning was found only in Experiments 2 and 3. Positive patterning transferred to new stimuli, indicating that it was not attributable solely to summation of sub-threshold excitation conditioned to the elements on reinforced compound trials. This finding, coupled with the negative patterning found in Experiments 2 and 3, provided support for the unique cue hypothesis. It was concluded that the assumed unique cue constituted a learned “rule,” and that the actual elemental stimuli were neither perceptually nor otherwise modified during the conditioning process.     

Temporal control during maintenance and extinction of conditioned keypecking in ring doves

Timing of conditioned keypecking was investigated using a delay autoshaping procedure. In two experiments, the CS-US interval (ISI) was varied and the temporal pattern of responding during unreinforced probe trials extending beyond the reinforced ISI was recorded. Both experiments showed temporal control of keypecking at ISIs of 4, 8, and 16 sec, regardless of whether the probe duration was held constant (Experiment 1) or covaried with the ISI (Experiment 2). Analyses showed that the timing of keypecking was scalar. Increased responding near the end of the probe was due possibly to independent timing of the probe duration. In a third experiment, a group of subjects trained at an ISI of 8 sec were extinguished by presentation of only probe trials. Although the maximal response rate declined progressively, timing of keypecking did not change.     

Overshadowing by food of stimulus control by a keylight in a two-element serial compound

Pigeons were given successive discrimination training in which pecking during a choice period when the key was white was either reinforced or not, depending upon the prior presence or absence of a discriminative stimulus, which was a two-element serial compound. The compound consisted of a keylight and food, with food presented second or first in a forward or backward pairing for different groups of pigeons. In Experiment 1, the sequence was an S+ indicating reinforced trials, while in Experiment 2, the sequence was an S? indicating nonreinforced trials. Following acquisition of discriminated operant behavior, a sequence generalization test was administered during which all possible orders of the two stimuli were presented on test trials prior to the onset of the choice period. The results showed that food overshadowed stimulus control by the color of the light on the key on the sequence-generalization test, independently of whether food was presented first or second during training and independently of whether food was associated with reinforcement or nonreinforcement. The similarity of results for the two experiments suggests that overshadowing occurs independently of whether the compound is a discriminative stimulus for reinforcement or nonreinforcement. Simultaneous presentation of elements of a compound stimulus is not necessary for overshadowing because the phenomenon was captured with sequentially presented stimuli.     

Conditioning of simultaneous and serial feature-positive discriminations

Three experiments with rat subjects examined the development of simultaneous and serial feature-positive discriminations in appetitive conditioning. In Experiment 1, reinforced presentations of a simultaneous light-tone compound were intermixed with nonreinforced presentations of either the light or the tone. The compound stimulus acquired conditioned behaviors of a form characteristic of the predictive feature alone; the element common to reinforced and nonreinforced trials did not evoke conditioned behavior. In Experiment 2, reinforced presentations of a serial light-trace-tone compound were intermixed with nonreinforced tone-alone presentations. The light feature stimulus acquired conditioned behaviors characteristic of visual CSs. The tone stimulus, common to reinforced and nonreinforced trials, evoked conditioned behaviors characteristic of auditory CSs, but only when preceded by the light. In Experiment 3, variations in the interval between the light and tone on reinforced trials had little effect on responding to the light CS but substantially altered the pattern of responding to the tone CS. These results suggested that simultaneous and serial feature-positive discriminations may be solved differently. Performance in simultaneous feature-positive discriminations may be determined solely by associations between the feature stimulus and the reinforcer, but performance in serial discriminations may also involve the acquisition of a conditional cue function to the feature.     

When more is less: Extending training of the blocking association following compound training attenuates the blocking effect

Three conditioned lick suppression experiments with rats were performed to assess the influence, following compound training of two stimuli (A and X) with the same outcome (AX-O trials), of extending training of the blocking association (i.e., A-O) on responding to the target stimulus (X) at test. In Experiment 1, backward blocking was attenuated when the blocking association was extensively trained. Experiment 2 showed that forward blocking was also attenuated by extensive further training of the blocking association following the AX-O trials. Experiment 3 contrasted candidate explanations of the results of Experiments 1 and 2 and demonstrated that these results are consistent with the framework of the extended comparator hypothesis (Denniston, Savastano, & Miller, 2001).     

Savings test for associations between neutral stimuli

Three experiments showed a savings procedure to be an effective and sensitive alternative to sensory preconditioning procedures as a measure of associations among neutral stimuli. Experiment 1 showed that within-compound associations developed more rapidly in reinforced appetitive serial compound conditioning when nonreinforced preexposure to the serial compound was given than when separate element or no preexposure was given. Experiment 2 showed the savings effect to be highly stimulus specific. Experiment 3 examined the facilitation of serial compound conditioning after either simultaneous or serial nonreinforced preexposure to the elements of the compound. The results of that experiment were consistent with those of analogous sensory preconditioning experiments. When preexposure involved only the two elements of the subsequently reinforced compound, serial preexposure produced more savings than simultaneous preexposure. But when preexposure involved a three-stimulus procedure like that used by Rescorla (1980b), simultaneous preexposure resulted in more savings. Advantages of the savings procedure over sensory preconditioning as a measure of association among neutral stimuli are discussed.     

A landmark blocks searching for a hidden platform in an environment with a distinctive shape after extended pretraining

In the blocking phase of three experiments, rats had to find a submerged platform beneath a spherical landmark in one corner of a triangular pool. Prior to this treatment, they were required to find the platform relative to either a sphere above it (blocking groups) or a rod attached to it (control groups). The position of the platform changed from trial to trial for the initial training. The sphere did not restrict learning about the geometric cues provided by the triangular arena in the blocking phase when 12 sessions of initial training took place in either the triangular (Experiment 1) or a circular (Experiment 3) pool. Blocking was observed, however, after 24 sessions of initial training in either the triangular (Experiment 2) or the circular (Experiment 3) pool. Thus, blocking of geometric cues by a landmark is possible after extended initial training with the blocking cue.