The determiners of keypeck duration

In Experiment 1, pigeons were exposed to a discriminative autoshaping procedure in which one keylight was correlated with negative automaintenance and the other keylight was correlated with positive automaintenance. The negative automaintenance procedure maintained shorter keypeck durations than the positive automaintenance procedure. Keypecking tended to occur in bursts of two, three, or four pecks, and within these bursts keypeck durations reliably decreased. In Experiment 2, keypeck durations and off-keypecks were initially examined during exposure to a positive automaintenance procedure. When a negative keypeck-reinforcer contingency was introduced, keypeck durations decreased and the ratio of off-keypecks to on-keypecks increased. When a positive keypeck-reinforcer contingency was introduced, keypeck durations increased and the ratio of off-keypecks to on-keypecks decreased. These results suggest that keypeck duration is determined by the extent to which the peck is directed at the key.     

The effect of redundant contextual stimuli on autoshaping the pigeon’s keypeck

Three experiments investigated the effect of contextual and trial stimulus lighting conditions on keypeck autoshaping in pigeons. White illumination of a response key before food presentation readily produced keypecking in a brightly lit chamber but failed to do so in a chamber without house illumination (Experiments I and III). Keypecking in a darkened cubicle progressively increased and the facilitatory effect of a houselight decreased as the keylight stimulus was varied from a color change (Experiment II) to a feature change (Experiment III). These findings support a “cue localization” hypothesis of autoshaping. according to which reinforcement signals select specific behaviors for expression and direct these behaviors toward the source of stimulation. This account was extended to superstitious and operant conditioning situations.     

Time and response matching with topographically different responses

Four pigeons were exposed to several nonindependent concurrent variable-interval schedules of reinforcement. One schedule component required a keypecking response; the other component required a treadlepressing response. The birds matched the ratio of their behavior (as measured by responses and time) between the two topographically different responses to the ratio of reinforcement in those two components. When additional foods not contingent on a keypeck or treadle-press were then added, the birds matched time spent in the components to total rates of food delivered in those components; response matching was somewhat disrupted. The matching law, developed under concurrent variable-interval schedules requiring similar responses, can thus account for choice behavior involving topographically different responses.     

Control of responding by a conditioned reinforcer in the presence of free food

It has been reported that animals will “work” in preference to “freeloading.” However, the variables responsible for this phenomenon are not well understood. Two pigeons were trained to keypeck for food on a fixed-ratio 300 schedule. Next, the food hopper was propped up to permit continuous access to food, and the presence or absence of the hopper light was manipulated. When the hopper light was presented contingent upon the fixed-ratio schedule, keypecking occurred; when it was not presented, keypecking ceased. Thus, responding in the presence of free food was shown to be a function of the conditioned reinforcing properties of the hopper light.     

Maintenance of keypecking in pigeons by a food avoidance but not by a shock avoidance contingency

Response key illuminations were followed by food delivery or shock, and keypecks were programmed to prevent the occurrence of whichever stimulus was scheduled. At high shock intensity, pigeons did not peck: at low shock intensity, pigeons pecked in about half of the trials. When different key colors signaled food and shock trials, pigeons pecked on food trials, thus preventing food delivery, but not on shock trials, thus failing to avoid shock delivery. That pecks occurred despite the fact that they avoided food but did not occur when they avoided shock is taken as evidence that the keypeck is frequently governed by biological predispositions, and not by its consequences.     

Signal properties of reinforcement and reinforcement omission on a multiple fixed-ratio schedule

A series of experiments used food-deprived pigeons to examine several parameters of reinforcement omission in an attempt to control changes of keypeck response measures on a subsequent schedule. In Experiments 1 and 2, the pigeons were tested with a multiple fixed-ratio schedule on which reinforcement was occasionally omitted at the completion of the first component. The duration of the delay occurring in lieu of reinforcement was systematically varied. In Experiment 3, the stimulus that signaled the second component of the schedule was altered to appear either more or less similar to the stimulus that signaled the first component. Two principal results are reported: (1) Response latency decreased and, to a much lesser extent, terminal response rate increased as the delay occurring in lieu of reinforcement decreased; and (2) both latency decrease and response-rate increase were enhanced by a second component stimulus which was similar to the first. The results are evaluated in terms of Amsel’s frustration theory and an analysis by Staddon which suggests that reinforcement inhibits responding. The data appear to support Staddon’s argument that rate increases and latency decreases following reinforcement omission are largely a function of an attenuation of the inhibitory influence of reinforcement, an effect that is enhanced by stimulus generalization. Accordingly, it is proposed that an animal’s response to reinforcement omission is determined by a stimulus complex that minimally includes the omission event and component cues.     

Effects of trial duration on overall and momentary rates of maintained autoshaped keypecking: Choice and single-stimulus trials

Pigeons were exposed to differentially cued autoshaping trials in which conditioned stimuli were followed by food after 6 or 14 sec. Average and momentary rates of keypecking were examined on two types of unreinforced test trials: single-stimulus probe trials and simultaneous choice trials, each 40 sec in duration. Rates averaged over the 40-sec test trials did not favor the cue associated with the shorter delay to food (the short-delay cue) on either type of test trial; however, average rates prior to the scheduled time of food delivery were reliably higher for the short-delay cue on choice trials. Momentary rates of keypecking during choice trials varied as a function of both cue and elapsed time from trial onset. At short elapsed trial times, rate of pecking was higher for the short-delay cue, with this difference reversing at longer times. A reversal of the programmed relation between key color and delay to food presentation for 5 birds confirmed the generality of these findings. Implications of these data for models of Pavlovian conditioning and for methods of assessing conditioned response strength are discussed.     

Temporal control during maintenance and extinction of conditioned keypecking in ring doves

Timing of conditioned keypecking was investigated using a delay autoshaping procedure. In two experiments, the CS-US interval (ISI) was varied and the temporal pattern of responding during unreinforced probe trials extending beyond the reinforced ISI was recorded. Both experiments showed temporal control of keypecking at ISIs of 4, 8, and 16 sec, regardless of whether the probe duration was held constant (Experiment 1) or covaried with the ISI (Experiment 2). Analyses showed that the timing of keypecking was scalar. Increased responding near the end of the probe was due possibly to independent timing of the probe duration. In a third experiment, a group of subjects trained at an ISI of 8 sec were extinguished by presentation of only probe trials. Although the maximal response rate declined progressively, timing of keypecking did not change.     

Conjunctive differentiation of gape during food-reinforced keypecking in the pigeon

The pigeon’s keypecking response includes both a head-transport (peck) and a jaw-movement (gape) component. Because the two components are mediated by different effector systems, they may potentially be viewed as orthogonal responses. A response differentiation procedure was used to bring gape amplitude under operant control. The procedure employed a conjunctive response requirement in which reinforcement was contingent upon both gaping and key contact. The key-contact requirement was held constant, while the gape contingency was systematically varied to reinforce either decreases or increases in gape amplitude with respect to baseline. The procedure was effective in shifting the gape distributions in both the upward and downward directions and in inducing new gape values that deviated from the baseline in the reinforced direction. These observations indicate that gape may be brought under operant control. However, subjects showed a bias in the differentiation of the gape response, such that larger gapes were more readily differentiated than smaller gapes. The results are discussed in relation to the methodological utility of the paradigm, the problem of biological constraints on learning, and the heuristic utility of a response components analysis.     

Imitation and social facilitation in the pigeon

The sight of another pigeon pecking a response key for grain resulted in similar pecking by more pigeons than did the sight of another pigeon eating or the sight of another pigeon (neither pecking nor eating). But more pigeons pecked the response key when they could see another pigeon that was neither pecking nor eating than when no other pigeon was there (whether or not key-light/grain pairings were observable in the adjacent compartment). Finally, observation of another pigeon pecking but not eating produced pecking comparable to observation of both pecking and eating. The presence of both imitation and social facilitation of keypecking were demonstrated. Observation of the consummatory response contributed little to keypecking.     

Sign and goal tracking during delay and trace autoshaping in pigeons

In two experiments, pigeons were exposed to an autoshaping procedure in which a keylight was followed by food under delay or trace conditions, while measures were taken of keypecking and time spent near the key. In Experiment 1, the birds in the trace group spent less time near the key than did the delay birds. Moreover, the trace birds exhibited a pattern of withdrawal from the key during the trial. In Experiment 2, visual observations of the birds’ location and latencies to eat both indicated that the trace birds’ withdrawal from the conditioned stimulus was accompanied by goal tracking. The difference in performance between the delay and trace conditions was taken as evidence that a trace stimulus may exert control over behavior as an occasion setter.     

Consummatory response latency and the stimulus-reinforcer relation in autoshaping

Autoshaping procedures with pigeons were used to assess the susceptibility of unconditioned response (UR) activity to Pavlovian relations between stimulus and reinforcer events. Foodpeck latency (a measure of UR activity) was investigated as a function of the interval between stimulus (keylight) and reinforcer (grain) presentations, and of the stimulus-reinforcer contingency, that is, the conditional probabilities of reinforcer delivery in the presence and absence of the stimulus. Four experiments indicated that food-peck latency was sensitive to both manipulations. Generally, conditions that led to higher keypeck rates were associated with shorter latencies. Thus, UR potentiation was demonstrated. However, when the bird’s location prior to grain delivery was fixed by imposing a keypeck-reinforcer contingency, UR potentiation vanished; it then reappeared when the location constraint was removed. Visual observations supported the conclusion that food-peck latency effects were mediated by approach/withdrawal tendencies generated by the stimulus-reinforcer relation. Implications of these results for expectancy theory are discussed.     

Some tests of the additivity (autoshaping) theory of behavioral contrast

Two experiments were performed to determine whether the location of the discriminative stimuli affects the amount of positive behavioral contrast exhibited during discrimination learning by pigeons. When signals for reinforcement and nonreinforcement of keypecking were situated directly on the response key (different line tilts), pecking rates during the positive stimulus were higher than when the source of the signals was located elsewhere (changes in chamber illumination or auditory click frequency). These results are in general agreement with the additivity theory of behavioral contrast, which attributes contrast to the combined effects of stimulus-reinforcer and response-reinforcer correlations on behavior directed at signals of reinforcement. Some shortcomings of the theory were discussed, and the notion that behavioral contrast is a basic, unitary phenomenon was criticized.     

Omission training and positive conditioned suppression in the rat

Suppression of operant responding during a conditioned stimulus (CS) was studied in two procedures. In both procedures, operant leverpressing was maintained by a variable-interval 1-min food-delivery schedule, and insertion of a second lever served as the CS. In the first procedure, autoshaping, food followed each CS presentation irrespective of a subject’s behavior during the CS. In the second procedure, omission training, contact with the CS canceled the delivery of food scheduled for the end of that CS. In the first experiment, subjects were exposed to omission training followed by autoshaping; these procedures were reversed in the second experiment. In each experiment, the omission contingency resulted in fewer CS contacts and less suppression of operant responding during the CS than did autoshaping. These differences were more notable in subjects receiving the sequence autoshaping→omission training (Experiment 2). Direct observations in Experiment 2 revealed that, for subjects that were contacting the CS frequently when the omission contingency was introduced, reductions in signal contacts were accompanied by redistributions of behavior. The form of these redistributions depended upon behavior allocation at the time the omission contingency was imposed.     

Contrast during multiple schedules with different component response requirements

Positive and negative behavioral contrast were examined when pigeons were required to keypeck in one component and treadle press in the other component of a series of multiple schedules. The experimental conditions were constructed so that the positive and negative contrast groups were exposed to complementary conditions. Positive keypeck and negative treadle-press contrast occurred in all subjects. Positive treadle-press contrast seemed to depend on the order of schedule presentation. Only one subject exhibited strong negative keypeck contrast. The results indicate that symmetrical conditions are not sufficient to produce positive and negative contrast for a given response when topographically different responses are used in the components of a multiple schedule. The results are globally consistent with the competition theory of behavioral contrast.     

The “disinhibition” of extinguished operant behavior in pigeons: Trial-tempo shifts and novel stimulus effects

After conditioning and extinction of keypecking with 25-see intertrial intervals between key illuminations, an immediate change to 5-sec intertrial intervals reinstated pecking during trials. Brief illuminations of the chamber during intertrial intervals also temporarily restored extinguished keypecking. The same manipulations of trial tempo and chamber illumination usually weakened well established, still reinforced keypecking. No recovery of extinguished behavior occurred when the intertrial interval was shifted upward from 5 sec to 25 sec. These and other behavioral findings were examined in relation to (a) Pavlov’s and Skinner’s research and views on “disinhibition” and “external inhibition” and to (b) analogous phenomena in physiological studies of habituation and dishabituation. The reliable evidence of disinhibition obtained in the present experiments suggests the involvement of an inhibitory process in extinction.     

Prediction of concurrent keypeck treadle-press responding from simple schedule performance

Four pigeons pecked keys and pressed treadles for food reinforcers delivered by several variable-interval schedules of reinforcement. Then the subjects responded on several concurrent schedules. Keypecking produced reinforcers in one component, and treadle-pressing produced reinforcers in the other. The changeover delay, which prevented reinforcement after all switches from one response to the other, was 0, 5, or 20 sec long. An equation proposed by Kerrnstein (1970) described the rates of treadle-pressing and keypecking emitted during the variable-interval schedules. The k parameter of this equation was larger for keypecking than for treadle-pressing. The R₀ parameters were not systematically different for the two responses. The rates of keypecking and treadle-pressing emitted during the components of the concurrent schedules correlated with, but were not equal to, the rates of responding predicted by Herrnstein’s equation and the subject’s simple schedule responding. The ratios of the rates of responding emitted during, and the ratios of the time spent responding on, the components of the concurrent schedules conformed to an equation proposed by Baum (1974), but not to Herrnstein’s equation.     

Control of pigeons’ keypecking topography by a schedule of alternating food and water reward

Food- and water-deprived pigeons keypecked for food or water reinforcement on alternate trials. Under one condition, explicit stimuli on the key provided information about the trial outcome; under another condition, only the alternation schedule provided this information. Latency and/or response rate differences between food- and water-rewarded trials emerged during both conditions. Response topography also differed on food- and water-rewarded trials. These differences, as revealed by duration and force measurements of the keypeck and by human ratings of the pecking responses as being water- or food-related, were anticipatory in nature. These results not only extend previous work on reward alternation and reward-specific response topographies, but also have implications for theories of animal memory. In particular, these results are amenable to memory models that assume that an animal “codes” information that later must be recalled.     

Sexual approach conditioning: Omission contingency tests

Male Japanese quail learned to approach a light that predicted visual exposure to a female quail. In Experiment 1, duration of visual exposure to the female did not systematically affect the speed or strength of conditioning. Introduction of an omission contingency for approach to the light after acquisition did not suppress conditioned approach relative to the performance of yoked controls. In Experiment 2, males learned to approach a light that predicted visual exposure to a female despite an omission contingency for approach in effect during acquisition. Experimental males were not slower to acquire the approach response under an omission contingency than were yoked controls. The findings indicate strong Pavlovian control of sexual conditioned approach in Japanese quail.