Stimulus control of topographically tagged responding

Pigeons’ responses on an operant key were reinforced according to either multiple variable-interval variable-interval or multiple variable-interval extinction schedules. The multiple-schedule components were signaled by line-tilt stimuli on a second key (signal key). Signal-key responses never produced reinforcement, and operant-key responses were not reinforced if they followed within 1 sec of a signal-key response. Behavioral contrast was not observed on the operant key, although there was a small, but reliable, increase in signal-key responding in the variable-interval component of the multiple variable-interval extinction condition. Generalization tests were interspersed between sessions of multiple variable-interval extinction training. Generalization gradients along the line-tilt dimension exhibited peak shift for both operant-key and signal-key responding following intradimensional (line tilt) discrimination training. Line-tilt generalization gradients following interdimensional discrimination did not exhibit peak shift. Gradients following intradimensional discrimination were sharper than gradients following interdimensional discrimination for both operant-key and signal-key responding. It was concluded that dimensional stimulus control of topographically tagged responding maintained by the stimulusreinforcer relation parallels that maintained by the response-reinforcer relation.     

Rates of responding in the pigeon generated by simple and complex schedules which provide the same rates of reinforcement

Four pigeons pecked for food reinforcement on variable interval 1-min schedules and on the variable-interval 1-min components of multiple, concurrent, and pseudoconcurrent schedules. The pseudoconcurrent schedule provided only one schedule of reinforcement; but, any reinforcer could be collected by responding on either of two keys. The rate of responding generated by the variable interval schedule was not greater than the rates of responding generated by the components of the complex schedules. But, the rate of reinforcement obtained from the variable interval schedule was greater than the rates of reinforcement obtained from the components of the multiple schedule. These results may contradict the equation proposed by Herrnstein (1970). The equation predicts that the rate of responding generated by a schedule of reinforcement will be greater when the schedule appears alone, than when it appears as one component of a complex schedule.     

Behavioral momentum and relapse of extinguished operant responding

Previous experiments on behavioral momentum have shown that relative resistance to extinction of operant behavior in the presence of a stimulus depends on the rate of reinforcement associated with that stimulus, even if some of those reinforcers occur independently of the behavior. We present three experiments examining whether the rate of reinforcement in the presence of a stimulus similarly modulates the relative relapse of operant behavior produced by reinstatement, resurgence, and renewal paradigms. During baseline conditions, pigeons responded for food reinforcement on variable-interval 120-sec schedules in alternating periods of exposure to two stimuli arranged by a multiple schedule. Additional response-independent food presentations were also delivered in the presence of one of the multiple-schedule stimuli. Consistent with previous research, baseline response rates were lower in the presence of the stimulus with the added response-independent reinforcement, and relative resistance to extinction was greater in the presence of that stimulus. In addition, following extinction, the relative relapse of responding produced by reinstatement, resurgence, and renewal paradigms was greater in the presence of the stimulus associated with the higher rate of reinforcement. We suggest that a model of extinction from behavioral momentum theory may be useful for understanding these results.     

Grasping in the pigeon (Columba livid): Stimulus control during conditioned and consummatory responses

Control of beak opening (gape) and peck location was examined in pigeons. Feeding pecks showed accurate guidance that positioned the seed between the beaks. At the moment of contact with the seed, gape was proportional to seed diameter, although pecks with gape less than seed diameter were more frequent following an increase in seed size during a meal. There were no substantial differences between pigeons trained to keypeck with autoshaping and those trained with operant conditioning procedures. With either procedure, water reinforcement produced keypecks with the beak closed; seed reinforcers of different sizes produced means for gape proportional to the seed diameters. Black or white circular stimuli of different sizes projected as conditioning signals had little influence upon gape, but a greater percentage of responses was directed to white stimuli. These results indicate that visual stimuli elicit and orient the peck, whereas the adjustment of gape also involves the somatosensory stimuli provided during previous experience with a particular reinforcer or food type.     

The role of response-reinforcer correlation in signaled reinforcement effects

In three experiments, we examined the effects of signaling reinforcement during operant responding in order to illuminate the factors underlying instrumental overshadowing and potentiation effects. Specifically, we examined whether signaling reinforcement produces an enhancement and attentuation of responding when the response-reinforcer correlation is weak and strong, respectively. In Experiment 1, rats responded on variable-ratio (VR) or variable-interval (VI) schedules that were equated for the number of responses emitted per reinforcer. A signal correlated with reinforcement enhanced response rates on the VR schedule, but attenuated response rates were produced by the signal on the VI schedule. In Experiment 2, two groups of rats responded on a VI schedule while the two other groups received a conjoint VI, negative fixed-ratio schedule in which the subjects lost the availability of reinforcements if they emitted high response rates. A reinforcement signal attenuated responding for the simple VI groups but not for the animals given the negative fixed-ratio component, although the signal improved response efficiency in both groups. In Experiment 3, a poor correlation between responding and reinforcement was produced by a VI schedule onto which the delivery of response-independent food was superimposed. A signal for reinforcement initially elevated responding on this schedule, relative to an unsignaled condition; however, this pattern was reversed with further training. In sum, the present experiments provide little support for the view that signaling reinforcement enhances responding when the response-reinforcer correlation is weak and attenuates responding when this correlation is strong.     

Remembering: The role of extraneous reinforcement

In two experiments, pigeons' responding on an extraneous task was explicitly reinforced during delayed matching-to-sample trials. In Experiment 1, red or green sample stimuli were followed by retention intervals of 0.2, 1, 4, or 12 sec, during which pecks to a white center key were reinforced with 2.5-sec access to wheat according to extinction, variable-interval 30-sec, and variable-interval 15-sec schedules in different conditions. A proportion of .2, .5, .7, or .9 of subsequent red or green choice responses that matched the sample were reinforced with 3-sec access to wheat. The result was that increasing center key reinforcement, or reducing reinforcer probability, lowered overall accuracy. Initial discriminability fell, but with no change in the rate of forgetting. In Experiment 2, initial discriminability was affected by extraneous reinforcers that were contingent on center key pecking, but not by noncontingent reinforcers. A plausible conclusion is that initial discriminability decreases when reinforcers strengthen competing behaviors.     

A matching law analysis of the reinforcing efficacy of wheel running in rats

Previous research has demonstrated that running in a rotating wheel functions as a reinforcer for leverpressing in rats. In these studies, the pattern of responding was similar to the pattern of responding maintained by consummatory reinforcers, such as food and water. The present study investigated quantitative features of responding maintained by running. In previous experiments in which responses were reinforced according to variable-interval (VI) schedules and food and water served as the reinforcer, the equation for a rectangular hyperbola described the relationship between response rate and reinforcement rate. This experiment tested whether this quantitative regularity also applies to leverpressing maintained by the opportunity to run in a wheel. Fourteen male Wistar rats responded on levers for the opportunity to run. In each session, subjects were exposed to a series of VI schedules. An opportunity to run for 60 sec was the reinforcing consequence. Results showed that response rate was a negatively accelerated function of reinforcement rate, and the relationship between these two variables was described well by the equation for a rectangular hyperbola. To further test the similarity between running and consummatory reinforcers, the response requirement and access were manipulated. In previous experiments with food and water, these types of manipulations differentially changed the two parameters of the hyperbola. A similar pattern of results was obtained with wheel running. Thus, the equation appears to apply to running about as well as it does to consummatory reinforcers.     

Pavlovian contingencies and anticipatory contrast

Pigeons were trained on a four-component multiple schedule in which two target components with identical reinforcement schedules were followed by other components with either higher or lower reinforcement rates. The Pavlovian signal properties of the target-component stimuli were varied by changes in their duration relative to the following components, and by whether the two following components were cued by the same or different stimuli, When different stimuli occurred in the following components, response rates were higher in the target component preceding the following component with the lower reinforcement rate, and these contrast effects were larger with shorter relative durations. But with nondifferential stimuli in the following components, contrast consistently occurred only with the longer durations of the target components. Moreover, several subjects with the shorter duration target stimuli had higher response rates in the target followed by the richer schedule—that is, Pavlovian conditioning occurred to the target stimuli. This interaction suggests that the processes underlying anticipatory contrast and Pavlovian conditioning are in opposition, and that the Pavlovian effect can dominate ifthe signaling properties of the target components are sufficiently enhanced.     

Adjunctive drinking during variable and random-interval food reinforcement schedules

Rats were trained to leverpress for food and subsequently exposed to either arithmetic series or random variable-interval reinforcement schedules. Adjunctive drinking developed in all subjects exposed to arithmetic variable-interval reinforcement, but did not develop in six of the eight animals trained on the random schedule. The results suggest that adjunctive drinking is the result of an interaction between the tendency of rats to drink after eating and the ability of locally low probabilities of reinforcement within schedules to induce conditioned behavioral states.     

Variations of two temporal parameters in observing response procedures

Temporal parameters were varied in two different observing response procedures. In Experiment I, concurrent variable-interval chain schedules were employed. Responding on one key led to either a stimulus correlated with reinforcement or a stimulus correlated with time-out. Responding on the other key led to a stimulus which ended either in reinforcement or time-out. The duration of the delay to reinforcement or time-out was varied, the delays for all three stimuli always remaining equal in a given phase. It was found that the longer the delay, the greater the preference for the observing response. In Experiment II a procedure was employed in which birds pecked during a “trial” to produce stimuli correlated with reinforcement or time-out at the end of the trial. The duration of the trial ending in time out was varied while the positive trial duration remained constant. It was found that the longer the duration of the negative trial, the greater the strength of observing responses. The results were interpreted as supporting the hypothesis that the value of a positive stimulus is a function of time spent in stimuli correlated with nonreinforcement.

     

Preference between fixed-interval and variable-interval schedules of reinforcement: Separate roles of temporal scaling and predictability

Pigeons’ preference between fixed-interval and variable-interval schedules was examined using a concurrent-chains procedure. Responses to two concurrently available keys in the initial links of the concurrent chains occasionally produced terminal links where further responses were reinforced under either a fixed- or variable-interval schedule. In previous studies, preferences for the variable schedule with such a procedure have been interpreted as reflecting atemporal scaling process that heavily weights the shorter intervals in the variable schedule. The present experiment examined whetherpredictability, i.e., the presence of external stimuli correlated with the reinforcement interval, might also influence preference in such situations. When the two intervals in a variable schedule were made predictable by being associated with different key colors, preference for that schedule increased. This increase was reliable but small in magnitude and transient when initial-link responses only occasionally produced terminal links; it was large in magnitude when only one response in the initial link was required to produce the appropriate terminal-link schedule. The results suggest that preference between fixed and variable schedules may be influenced both by temporal scaling and to a lesser extent by predictability of the reinforcement intervals.     

Time and response matching with topographically different responses

Four pigeons were exposed to several nonindependent concurrent variable-interval schedules of reinforcement. One schedule component required a keypecking response; the other component required a treadlepressing response. The birds matched the ratio of their behavior (as measured by responses and time) between the two topographically different responses to the ratio of reinforcement in those two components. When additional foods not contingent on a keypeck or treadle-press were then added, the birds matched time spent in the components to total rates of food delivered in those components; response matching was somewhat disrupted. The matching law, developed under concurrent variable-interval schedules requiring similar responses, can thus account for choice behavior involving topographically different responses.     

Autoshaping of initial feeding and drinking reactions in newly hatched chicks

Newly hatched chicks were force-fed food and water throughout rearing, and food, water, or sand reinforcers during exposure to an omission-training procedure. The chicks were thus prevented from performing approach and contact responses to the reinforcer at any time in their lives. Nevertheless, the subjects displayed approach and species-specific feeding or drinking reactions directed toward an illuminated key paired with food or water, but not with sand. Illumination of a key either uncorrelated or negatively correlated with food or water did not engender appreciable responding. Feeding and drinking reactions were topographically distinct, determined by the type of reinforcer, but were not elicited by the reinforcer. These findings support a “learned release” view of autoshaping, according to which phylogenetically preorganized behavior patterns are triggered by distal stimuli paired with biologically significant proximal stimulation, and suggest a close relationship between autoshaping and primitive instances of visual object recognition.     

Operant responding with free access to the reinforcer: A replication and extension

This study was conducted to assess the maintenance of operant responding in the presence of free access to the reinforcer. The results replicated earlier research using food reinforcement and demonstrated that the same general results could be obtained with water reinforcement.     

Operant response topographies of rats receiving food or water reinforcers on FR or FI reinforcement schedules

Separate groups of food- and water-deprived rats pressed a lever for food or water, respectively, on continuous reinforcement and various fixed-ratio and fixed-interval reinforcement schedules. Food-reinforced rats on continuous, FR 2-, or FI 10-sec schedules showed consistently longer mean lever contact durations per leverpress than did water-reinforced rats on the same schedules. Mean lever-contact-duration differences between food- and water-reinforced rats were greatly attenuated or disappeared under FR 4-, FR 8-, FI 20-sec, and FI 30-sec schedules of reinforcement. These results are interpreted as supporting earlier hypotheses that there are respondent components of operantly conditioned and autoshaped leverpresses, but that these respondent components weaken with partial reinforcement and the leverpress topography comes under the control of operant contingencies.     

Behavioral contrast in pigeons and rats: A comparative analysis

The effects of reinforcement rate on behavioral contrast were examined in pigeons and rats. Each species was exposed to a series of 12 multiple variable-interval schedules, divided into four 3-schedule series. Each series consisted of a standard contrast manipulation, and baseline schedules provided a different rate of reinforcement in each of the series. The functions relating reinforcement rate to the magnitude of contrast were different across species. Rats showed a U-shaped function, with reliable contrast occurring only at high reinforcement rates. Pigeons showed an inverted U-shaped function, with contrast occurring on all schedules except the schedule providing the lowest rate of reinforcement. Pigeons discriminated between schedule components better than rats did, although differences in discrimination were probably not responsible for the differences in contrast. The results suggest that behavioral contrast in rats may be a different phenomenon from behavioral contrast in pigeons. The results cannot be explained by current theories, which view contrast as the product of a single general process.     

Choice responding following multiple schedule training

Pigeons’ choice responding on 10-sec interpolated probes was studied after baseline training on multiple variable-interval variable-interval schedules of food reinforcement. Unreinforced choice following training with three different relative reinforcement rates (Experiment 1), with a 3-ply multiple schedule (Experiment 2), and with three different relative reinforcement durations (Experiment 3) was examined. Least squares lines were fit to choice relative response rate and schedule relative response rate as functions of training relative reinforcement rate; choice slope was significantly greater than schedule slope in all three experiments. This result is counter to the prediction of Herrnstein’s (1970) theory that these slopes should not differ. Luce’s (1959) theory also failed to account for the data. It was concluded that choice responding was controlled by both approach to the stimulus associated with the smaller mean interreinforcer interval or the longer duration, and avoidance of the other stimulus.     

Preference for the interval schedule following multiple variable-ratio yoked-variable-interval schedule training

Pigeons were studied on multiple variable-ratio yoked-variable-interval schedules in which components had equal rates of food reinforcement and appeared equally often on each of two keys. Interpolated between component changes on the final multiple schedule were 10-sec probes in which both schedule stimuli were present, one on each key. During multiple schedule training, variable-ratio response rates were greater than yoked-variable-interval rates; however, response rate differences in the components were not a function of the mean ratio value for the 40-to-320-ratio range studied. During the choice probes, subjects responded more to the stimulus associated with the interval schedule than to the one associated with the ratio schedule. It was concluded that pigeons prefer interval schedules over equal reinforcement rate ratio schedules, because the former generate fewer responses per reinforcement.     

The role of stimulus disparity in concurrently available reinforcement schedules

Eight White King pigeons were exposed to various two-component arrangements of concurrently available variable-interval reinforcement schedules. Line orientation stimuli associated with each component differed by 45,15, or 0 deg for different subjects. Relative responding matched relative reinforcement with 45 deg separation, while undermatching resulted with 15 deg separation and extreme undermatching resulted with 0 deg separation. Since obtained relative reinforcement indicated contact with the contingencies in all conditions of line orientation disparity, it is concluded that stimulus disparity between components of concurrently available reinforcement schedules is an important determinant of response distribution between components.