A fading procedure facilitates the maintenance of observing responses when the more valued stimulus is not produced

Pigeons served in two experiments in which responding on an observing key converted a two-component mixed schedule to the corresponding multiple schedule of reinforcement. Presentation of the stimulus correlated with the more valued component was faded out (probabilistically) over sessions, so that ultimately an observing response produced only the stimulus correlated with the less valued component. Observing was well maintained after a fading procedure when a stimulus was produced by a single response, regardless of whether the less valued stimulus was associated with food or with extinction (Experiment 1). However, observing was not well maintained after a fading procedure when a stimulus was produced according to an intermittent schedule (Experiment 2). Taken together, the results of the two experiments suggest that the absence of an exteroceptive stimulus change after a single response may become discriminative in its own right for the more valued component, and that the fading procedure is an effective means of promoting this discrimination. However, if observing responses produce a stimulus change according to an intermittent schedule, then the absence of a stimulus change after a response is correlated with both components. Under these conditions, the absence of stimulus change is not discriminative for either component, even with fading, and observing is not maintained.     

Differential effects of omitting comparison stimuli on symbolic and identity matching to sample: Evidence for altered instructional processes in pigeon short-term memory

Two experiments were performed to determine the effects of omitting the comparison stimuli in a matching-to-sample task. In Experiment 1, birds were trained initially on both symbolic and identity matching to sample. Comparison stimuli were then omitted following the presentation of a particular sample stimulus, and this decreased the number of sample (observing) responses. The reintroduction of the comparison stimuli on subsequent probe trials revealed that the accuracy of symbolic matching was reduced to chance levels, while identity matching accuracy was significantly below chance. In Experiment 2, a similar procedure was employed; however, observing responses to the comparison-omitted samples were maintained by direct reinforcement (fixed ratio 20). Matching accuracy during probe trials was again at chance levels for symbolic matching but, contrary to Experiment 1, was significantly above chance for identity matching. The differential effects of omitting comparison stimuli on symbolic and identity matching trials in these two experiments were interpreted within a framework which assumes that instructional processes are altered by comparison-omission procedures.     

Variations of two temporal parameters in observing response procedures

Temporal parameters were varied in two different observing response procedures. In Experiment I, concurrent variable-interval chain schedules were employed. Responding on one key led to either a stimulus correlated with reinforcement or a stimulus correlated with time-out. Responding on the other key led to a stimulus which ended either in reinforcement or time-out. The duration of the delay to reinforcement or time-out was varied, the delays for all three stimuli always remaining equal in a given phase. It was found that the longer the delay, the greater the preference for the observing response. In Experiment II a procedure was employed in which birds pecked during a “trial” to produce stimuli correlated with reinforcement or time-out at the end of the trial. The duration of the trial ending in time out was varied while the positive trial duration remained constant. It was found that the longer the duration of the negative trial, the greater the strength of observing responses. The results were interpreted as supporting the hypothesis that the value of a positive stimulus is a function of time spent in stimuli correlated with nonreinforcement.

     

Response rate is not an effective mediator of learned stimulus equivalence in pigeons

We explored response rate as a possible mediator of learned stimulus equivalence. Five pigeons were trained to discriminate four clip art pictures presented during a 10-sec discrete-trial fixed interval (FI) schedule: two paired with a one-pellet reinforcer, which supported a low rate of responding, and two paired with a nine-pellet reinforcer, which supported a high rate of responding. After subjects associated one stimulus from each of these pairs with a discriminative choice response, researchers presented two new clip art stimuli during a 10-sec FI: one trained with a differential reinforcement of low rate schedule (DRL) after the FI and the other trained with a differential reinforcement of high rate schedule (DRH) after the FI. Each of the stimuli that were withheld during choice training was later shown to see if the choice responses would transfer to these stimuli. The results suggest that response rate alone does not mediate learned stimulus equivalence.     

Stimulus variation and dimensional contrast

In two experiments, a maintained generalization procedure was employed to examine stimulus control of pigeons’ responses to a visual wavelength continuum. For both experiments, pigeons’ responses were periodically reinforced during wavelength values from one end of a continuum, while responses during other stimulus values were extinguished. In Experiment 1, the set of positive stimulus values remained constant, while the spacing of the set of negative stimuli varied. In Experiment 2, the set of negative stimulus values remained constant, while the spacing of positive stimuli varied. Positive dimensional contrast effects were obtained in both experiments. In general, the results indicated that variation in the spacing of negative stimuli had little effect on positive dimensional contrast. However, variation in the spacing of positive stimuli produced changes in the peak of the dimensional contrast gradient, without apparent change in the magnitude of the effect.     

Microanalysis of variable-interval performance during stimulus compounding

Additive summation is observed when more responses are emitted to the simultaneous presentation (tone-plus-light) of independently conditioned stimuli (tone and light) than to either stimulus presented alone. The current experiment sought to determine if this increased rate during tone-plus-light was a function of a new modal interresponse time (IRT) or a differential mixing of pauses with a modal IRT characteristic of the responding in tone and light alone. Three rats were trained on a three-component multiple schedule where tone and light were each associated with a variable-interval 30-sec schedule while a variable-interval 100-sec operated in the simultaneous absence of these stimuli, tone-off and light-out. Baseline response rates were 2–4 times as high in tone or light as in their absence. In testing, more responses were emitted to tone-plus-light than to tone or light by all animals, but the modal IRT was in the 0.2–0.4-sec IRT bin for all test conditions. Tone-plus-light controlled fewer long IRT values and more responses in the short modal category than tone or light alone. These results support the response mixing hypothesis of stimulus control; i.e., no “new” behavior was observed during the novel combination of stimulus elements, only a mixture of previously reinforced behavior patterns in different proportions.     

Preference for the interval schedule following multiple variable-ratio yoked-variable-interval schedule training

Pigeons were studied on multiple variable-ratio yoked-variable-interval schedules in which components had equal rates of food reinforcement and appeared equally often on each of two keys. Interpolated between component changes on the final multiple schedule were 10-sec probes in which both schedule stimuli were present, one on each key. During multiple schedule training, variable-ratio response rates were greater than yoked-variable-interval rates; however, response rate differences in the components were not a function of the mean ratio value for the 40-to-320-ratio range studied. During the choice probes, subjects responded more to the stimulus associated with the interval schedule than to the one associated with the ratio schedule. It was concluded that pigeons prefer interval schedules over equal reinforcement rate ratio schedules, because the former generate fewer responses per reinforcement.     

Pigeons’ discrimination of color proportion in computer-generated visual displays

Pigeons were trained to discriminate the proportion of red to green color in paired stimulus displays. Initially, the stimuli were horizontal bars composed of continuous blocks of color that varied from being all red versus all green to .5 proportions of these two colors. Discrimination accuracy decreased as a function of the disparity in the proportions of the two colors. This relationship was maintained when the stimulus configurations were altered in various ways. Tests with horizontal bars indicated that the pigeons could utilize differences in the lengths (or areas) of one of the colors when choosing between stimuli. They did not rely only on this type of cue to assess proportion disparities but rather on multiple stimulus parameters. Also, the form of the discrimination function suggests that the pigeons distinguished ratio differences, so that Weber’s law applies to this type of discrimination.     

Differential-outcomes effect using hedonically nondifferential outcomes with delayed matching to sample by pigeons

When differential outcomes follow correct responses to each of two comparison stimuli in matching to sample, relative to the appropriate control condition, higher matching accuracy is typically found, especially when there is a delay between the sample and the comparison stimuli. In two experiments, we examined whether this differential-outcomes effect depends on using outcomes that differ in hedonic value (e.g., food vs. water). In Experiment 1, we found facilitated retention when a blue houselight followed correct responses to one comparison stimulus and a white houselight followed correct responses to the other, prior to nondifferential presentations of food. In Experiment 2, we found facilitated retention again when a blue houselight followed correct responses to one comparison stimulus and a tone followed correct responses to the other, prior to nondifferential presentations of food. The results of both experiments indicate that the differential-outcomes effect does not depend on a difference in hedonic value of the differential outcomes, and they suggest that outcome anticipations consisting of relatively arbitrary but differential stimulus representations can serve as cues for comparison choice.     

Spontaneous recovery in cross-motivational transfer (counterconditioning)

In two experiments with rat subjects, we examined the effects of a retention interval on performance in two conditioning paradigms in which a conditioned stimulus (CS) was associated with different unconditioned stimuli (USs) in successive phases of the experiment- Experiment 1 was designed to examine aversive-appetitive transfer, in which the CS is associated with shock and then food; Experiment 2 was designed to examine appetitive-aversive transfer, in which the CS is associated with food and then shock. Aversive and appetitive conditioned responses (freezing and head-jerk responding, respectively) were scored from videotape. In both experiments, a 28-day retention interval following the end of Phase 2 caused a recovery of the Phase 1 response and a resuppression of the Phase 2 response. The results suggest that the original association is not destroyed when the CS is associated with a new US in Phase 2. They also suggest that both retroactive and proactive interference effects may result-from interference with performance output rather than a disruption or loss of what is learned during or stored from the target phase.     

The isolation of stimulus-reinforcer associations established with multiple schedules

Multiple schedules established stimulus-reinforcer (S-S^R) associations on baselines in which equal response rates and patterning were maintained in all components. Subsequently, stimuli associated with an increase in reinforcement but no change in ongoing response rate were compounded. For one experimental group, free-operant avoidance (FOA) was programmed in tone and in light while variable-interval (VI) food reinforcement was effective in their simultaneous absence (T + L). The opposite stimulus-schedule combinations were programmed for the other. Both groups remained in their VI components 85% of the session on schedule preference tests, and on a stimulus compounding test emitted approximately 1.5 times as many responses to tone-plus-light (T + L) as to tone or light alone. This is the first report of additive summation to combined discriminative stimuli associated with only an increase in reinforcement. Nondifferentially trained controls who had the same contingency effective in tone, light, and T + L-VI or FOA—showed neither preference among schedule components or summation during stimulus compounding, indicating that nonassociative stimulus factors made no contribution to either resultant in the experimental animals. Evidence supporting an algebraic combination of response and reinforcement associations is presented, and functional similarities between transfer-of-control studies and the stimulus compounding tests of the experimental groups in the present experiment are discussed.     

Overshadowing and stimulus intensity

Two experiments on conditioned suppression in rats examined overshadowing between visual and auditory components of a compound conditioned stimulus. In the first experiment, when one component was markedly more salient than the other, the more salient overshadowed the less salient, but the latter, although acquiring significant associative strength, did not overshadow the former. When the two components were of approximately equal salience, each overshadowed the other. In the second experiment, reciprocal overshadowing was again observed between two equally salient stimuli, but only when their absolute intensities were relatively low. The failure to observe reciprocal overshadowing under all conditions raises problems for those theories of stimulus selection which assume that stimuli compete for some strictly limited resource. It was suggested, instead, that overshadowing might occur when animals fail to learn to attend to, or actually learn to ignore, stimuli that are not uniquely successful predictors of reinforcement.     

Observing behavior: Redundant stimuli and time since information

Pigeons were allowed to observe a stimulus signaling food (S+) by pecking one side key of a three-key chamber, or a stimulus signaling extinction (S?) by pecking the opposite side key. Components were 30 sec long and separated by 3-sec blackouts (after extinction periods) or 3-sec access to an illuminated food hopper (terminating food periods). Pigeons came to peck the S+ key almost exclusively. When food and extinction periods were presented in random order, the S+ key was pecked in nearly every component. But when the components alternated in abab fashion, the probability of an S+ keypeck during extinction decreased (after 3-sec access to food) while remaining high in food components (after 3-sec blackout). This suggested the development of trace stimulus control by the stimuli separating the components and that redundant stimuli would maintain observing when they signaled food. Results were discussed in terms of traditional notions of conditioned reinforcement and were not seen as supporting information theory explanations of observing behavior.     

Potentiation of responding on a VR schedule by a stimulus correlated with reinforcement: Effects of diffuse and localized signals

In Experiment 1, rats were trained to leverpress on a variable ratio (VR) 30 schedule with a 500-msec delay between the reinforced response and food delivery. Subjects that experienced a signal during the delay responded faster than did control subjects that received the stimulus un-correlated with reinforcement. Higher response rates were obtained when the stimulus used to signal reinforcement was auditory rather than visual. Experiments 2 and 3 compared the effects of signaling reinforcement with either a localized or a diffuse light on responding maintained by VR schedules of reinforcement. Elevated response rates were observed with the diffuse stimulus, but the localized stimulus failed to produce such potentiation. Experiment 3 also examined the conditioned reinforcing power of localized and diffuse visual stimuli. These results are discussed with reference to (1) theories of selective association and sign tracking and (2) their implications for current theories of signaling reinforcement.     

Outcome-specific conditioned inhibition in Pavlovian backward conditioning

In the present experiments, the outcome specificity of learning was explored in an appetitive Pavlovian backward conditioning procedure with rats. The rats initially were administered Pavlovian backward training with two qualitatively different unconditioned stimulus conditioned-stimulus (US-CS) pairs of stimuli (e.g., pellet --> noise or sucrose --> light), and then the effects of this training were assessed in Pavlovian-to-instrumental transfer (Experiment 1) and retardation-of-learning (Experiment 2) tests. In the transfer test, it was shown that during the last 10-sec interval, the CSs selectively reduced the rate of the instrumental responses with which they shared a US, relative to the instrumental responses with which they did not share a US. The opposite result was obtained when the USs (in the absence of the CSs) were presented noncontingently. In the retardation test, conditioned magazine approach, responding to the CSs was acquired more slowly when the stimulus-outcome combinations in the backward and the forward conditioning phases were the same, as compared with when they were reversed. These results are collectively in accord with the view that Pavlovian backward conditioning can result in the formation of outcome-specific inhibitory associations. Alternative views of backward conditioning are also examined.     

Proactive interference in monkeys: Delay and intersample interval effects are noncomparable

Two prominent theories of proactive interference in animal memory predict that the effects of varying the interval between the interfering and to-be-remembered stimulus in a delayed-matching-to-sample paradigm ought to be comparable to the effects of manipulating the retention interval. To assess this prediction, monkeys were tested in a situation in which a sample was presented, followed by a variable intersample interval, whereupon a second sample was presented. After a delay interval, a choice test was given between the two stimuli that had served as samples. The correct choice was always the most recently presented sample stimulus, and the initial sample of a sequence provided a potential source of proactive interference. In two experiments, delay interval altered performance, whereas interstimulus interval had little or no effect. In a third experiment, using a small set of sample stimuli, intertriai interval altered proactive interference, but again interstimulus interval had no effect. One way of accounting for these data is in terms of distinct short- and long-term memory processes.     

Spontaneous recovery evoked by a nonreinforced stimulus

Pigeons (nine groups of seven) were given one acquisition session of 20 trials. The following day their responding was extinguished, and after a 30-min rest period they were tested for residual response strength. The groups differed with respect to (1) whether a distinctive stimulus was presented during acquisition on the first trial, the 15th trial, or not at all, (2) whether or not responses to the distinctive stimulus were reinforced, and (3) whether a distinctive stimulus, a standard stimulus, or a completely novel stimulus was presented on the test trial. Results supported the position that a stimulus associated with the onset of an acquisition session, but not with the extinction session, evokes greater response strength on a spontaneous recovery test trial than do other stimuli in the acquisition session. This holds true even if responses to this stimulus are never reinforced. In addition, it was found that, unlike a previous study that invoked five daily acquisition sessions, pigeons did not demonstrate increased responding to a novel stimulus.     

Operant responding by bonnet macaques for color videotape recordings of social stimuli

Socially reared juvenile bonnet macaques responded at high sustained levels in an operant task for presentation of color videotaped television images of social stimuli. Absolute levels of response depended upon the nature of the stimulus. In two experiments, subjects responded at 60.8% and 74.6% of the 1-h experimental sessions for presentation of a color videotape of a conspecific adult female moving freely in an enclosed stimulus chamber. In a later experiment, subjects maintained high levels of response during 15-min sessions for presentations of the conspecific image, but responded with significantly shorter duration responses for similar presentation of a videotape of an adult female of another macaque species, a still picture of a conspecific adult female, and a videotape of the empty stimulus chamber. With longer, 1-h, stimulus presentation, the three social stimuli sustained high levels of response while responses for presentation of the empty stimulus chamber waned significantly over the experimental session. The sustained high levels of response obtained over several hours of stimulus presentation suggest the value of color videotape stimuli in the experimental study of social perception in nonhuman primates.     

A failure to obtain magnetic discrimination in the pigeon

Six pigeons were trained on a multiple-concurrent schedule. During both multiple-schedule components, two response keys were available. In Component 1, responses to the left key were reinforced on a variable-interval 45-sec schedule, whereas responses to the right key were not reinforced. In Component 2, these contingencies were reversed. Following each reinforcer, the component next presented was chosen randomly with equal probability. The two components were differentially signaled by presentation of various stimuli during Component 1. Over the course of the experiment, these stimuli were various intensities of light, a noise, and various fluctuating and static magnetic fields. While subjects showed good discrimination of the light and noise stimuli, no stimulus control using the magnetic fields was obtained.     

Summation and overexpectation with qualitatively different outcomes

In five experiments, a Pavlovian appetitive conditioning preparation was used with rats to explore the interaction of associations with different, but equivalently valued, outcomes. Experiment 1 demonstrated summation in magazine responding when two stimuli previously associated with different outcomes were combined. Experiments 2A and 2B found that pairing that stimulus compound with one of the outcomes led to a decrease in performance (overexpectation) for both of the stimulus elements. Experiments 3A and 3B confirmed that result but demonstrated the continued presence of the original stimulus-outcome associations. The results are consonant with a view in which replacing one outcome with another leads to an associative structure containing both stimulus-outcome associations and an outcome-independent depressive process.