Inescapable shock interferes with the acquisition of an appetitive operant

This article reports the reinforcer generality of the interference effect resulting from exposure to inescapable shock. In Experiment 1, rats that received inescapable shock showed weak interference with the acquisition of an appetitive operant compared to animals exposed either to escapable or no shock. In Experiment 2, the response-reinforcer contingency was degraded by introducing a 1-sec delay of reinforcement on the appetitive task. Inescapable shock produced much stronger interference with the acquisition of the operant response than in Experiment 1. The results demonstrate reinforcer generality of the debilitating effects produced by inescapable shock.     

Resistance to extinction: contingency termination and generalization decrement

We present an algebraic model of resistance to extinction that is consistent with research on resistance to change. The model assumes that response strength is a power function of reinforcer rate and that extinction involves two additive, decremental processes: (1) the termination of the reinforcement contingency and (2) generalization decrement resulting from reinforcer omission. The model was supported by three experiments. In Experiment 1, 4 pigeons were trained on two-component multiple variable-interval (VI) 60-sec, VI 240-sec schedules. In two conditions, resistance to change was tested by terminating the response-reinforcer contingency and presenting response-independent reinforcers at the same rate as in training. In two further conditions, resistance to change was tested by prefeeding and by extinction. In Experiment 2, 6 pigeons were trained on two-component multiple VI 150-sec schedules with 8-sec or 2-sec reinforcers, and resistance to change was tested by terminating the response-reinforcer contingency in three conditions. In two of those conditions, brief delays were interposed between responses and response-independent reinforcers. In both Experiments 1 and 2, response rate was more resistant to change in the richer component, except for extinction in Experiment 1. In Experiment 3, 8 pigeons were trained on multiple VI 30-sec, VI 120-sec schedules. During extinction, half of the presentations of each component were accompanied by a novel stimulus to produce generalization decrement. The extinction data of Experiments 1 and 3 were well described by our model. The value of the exponent relating response strength and reinforcement was similar in all three experiments.     

Animal memory: The contribution of generalization decrement to delayed conditional discrimination retention functions

Delayed conditional discriminations in which a sample indicates which comparison stimulus is correct have typically been used in working memory research with animals. Following acquisition with no (0-sec) delay between the offset of the sample and the onset of the comparison stimuli, delays of variable duration are introduced. The resulting retention functions are taken as a measure of memory. We suggest that, in addition to memory loss due to the delay, the comparison of matching accuracy at the 0-sec training delay with relatively novel test delays may produce a generalization decrement that varies as a function of increasing delay. We tested this hypothesis by training pigeons with a mixed delay procedure from the start and found that the retention functions for these pigeons were significantly shallower than those for a control group trained with 0-sec delays and tested with longer delays, and, although reduced in magnitude, the differences persisted for as many as 15 sessions. We propose that a measure of animals’ working memory can be obtained uninfluenced by a generalization decrement if they have received comparable training with all of the delays that are tested.     

Differential rates of visual information processing in full-term and preterm infants

This study investigated the effect of increasing familiarization time on the visual recognition memory of 6- and 12-month-old full-term and preterm infants. Infants were given trials in which they viewed a shape for either 10-, 15-, 20-, or 30-sec familiarization and were then tested for visual recognition memory using the paired comparison technique. While the older infants showed evidence of recognition memory after less familiarization time than the younger ones, at both ages preterms required considerably longer familiarization than full-terms. The pattern of performance replicates our earlier finding of developmental lags in the visual information processing of 6-month-old preterms and extends these findings to 12-month-olds. These results suggest that there are persistent differences between preterm and full-term infants throughout at least the first year of life in this very fundamental aspect of cognition.     

Specification of the stimulus-reinforcer relation in multiple schedules: Delay and probability of reinforcement

Control of pigeons’ keypecking by a stimulus-reinforcer contingency was investigated in the context of a four-component multiple schedule. In each of three experiments, pigeons were exposed to a schedule consisting of two two-component sequences. Discriminative stimuli identifying each sequence were present only in Component 1, which was 4, 6, or 8 sec in duration, while reinforcers could be earned only in Component 2 (30 sec in duration). Control by a stimulus-reinforcer contingency was sought during Component 1 by arranging a differential relation between Component 1 cues and schedule of reinforcement in Component 2. In Experiment 1, rate of keypecking during Component 1 varied with the presence and absence of a stimulus-reinforcer contingency. When a contingency was introduced, rate of keypecking increased during the Component 1 cue associated with the availability of reinforcement in Component 2. In Experiment 2, the stimulus-reinforcer contingency was manipulated parametrically by varying the correlation between Component 1 cues and Component 2 schedules of reinforcement. Responding in Component 1 varied as a function of strength of the stimulus-reinforcer contingency. The relatively high rates of Component 1 responding observed in Experiments 1 and 2 pose difficulties for conceptions of stimulus-reinforcer control based on probability of reinforcement. In these two experiments, the stimulus-associated probabilities of reinforcement in Component 1 were invariant at zero. An alternate dimension of stimulus-reinforcer control was explored in Experiment 3, in which Component 1 cues were differentially associated with delay to reinforcement in Component 2, while probability of reinforcement was held constant across components. When the stimulus-reinforcer contingency was in force, rate of responding in Component 1 varied inversely with delay to reinforcement in Component 2. In a quantitative analysis of data from Experiments 2 and 3, relative rate of responding during Component 1 was strongly correlated with two measures of relative delay to reinforcement.     

Reinforcing the occurrence or nonoccurrence of interim drinking

Four pairs of rats were studied in a yoked control design intended to determine if an interim activity (schedule-induced drinking) was sensitive to operant contingencies. Food was always presented on a fixed-time 30-sec schedule. Additionally, a positive or negative operant contingency was in effect during the first 6 sec of each interval. The positive (drink/food) contingency produced an extra food presentation at the 6th second of an interval if the lead rat drank at least once in the first 6 sec. The negative (no-drink/food) contingency produced an extra food presentation only if the lead rat did not drink in the first 6 sec. Two pairs of rats were first exposed to the positive contingency and then to the negative contingency. Two pairs received training in the reverse order. In drink/food training, all lead rats developed patterns of drinking that produced extra food presentations in most intervals. There were some indications that the positive contingency facilitated early acquisition of drinking, but the yoked rats eventually developed temporal distributions and asymptotic levels of drinking comparable to those that occurred in lead rats. In no-drink/food training, the two lead rats initially exposed to the positive contingency showed high levels of drinking inappropriate to the negative contingency, but the two lead rats initially exposed to the negative contingency showed appropriately low levels of drinking. The latter effects seem attributable to the no-drink/food contingency.     

Effects of schedule and delay of reinforcement on acquisition speed

The effects of schedule of reinforcement (partial vs. consistent) and delay of reward (0 to 20 sec) on running in rats were examined in two investigations. The effects of delay depended upon schedule of reinforcement; acquisition speed decreased as delay increased under consistent reinforcement, a common finding, while acquisition speed was independent of delay under partial reinforcement, a new finding. The partial-reinforcement acquisition effect or PRAE is defined as faster acquisition speed under partial than under consistent reinforcement. Because running speed was independent of delay under partial reinforcement, but decreased as delay increased under consistent reinforcement, the PRAE increased as delay of reinforcement increased.     

Instrumental responding by rats on free-operant schedules with components that schedule response-dependent reinforcer omission: Implications for optimization theories

In two experiments, we assessed whether rats optimize the number of reinforcers per response. In Experiment 1, one group of rats was trained to leverpress for food reinforcement on a simple variable-interval (VI) 60-sec schedule. For another group, a negative fixed-ratio component was imposed on the VI schedule to produce a conjoint contingency in which reinforcement became available on the VI schedule but was omitted when the ratio criterion was satisfied. In Experiment 2, one group of rats responded on a VI schedule and also received response-independent food. For another group, responding above a certain rate canceled the response-independent food. Despite the negative contingency experienced by the groups in Experiments 1 and 2, responding was maintained at a level at which the number of obtained reinforcers was reduced substantially below the maximum number possible. In addition, in both experiments, the groups that experienced the negative contingency responded at a lower rate than did a yoked control group that experienced the same frequency of reinforcement but lacked the negative component. These results demonstrate that although rats do not optimize their behavior with respect to reinforcement, they are nevertheless sensitive to some aspect of the instrumental contingency in operation.     

Serial discrimination reversal learning in pigeons as a function of intertrial interval and delay of reinforcement

Pigeons learned a series of reversals of a simultaneous red-green visual discrimination. Delay of reinforcement (0 vs. 2 sec) and intertrial interval (ITI; 4 vs. 40 sec) were varied across blocks of reversals. Learning was faster with 0-sec than with 2-sec delays for both ITI values and faster with 4-sec ITIs than with 40-sec ITIs for both delays. Improvement in learning across successive reversals was evident throughout the experiment, furthermore, even after more than 120 reversals. The potent effects of small differences in reinforcement delay provide evidence for associative accounts and appear to be incompatible with accounts of choice that attempt to encompass the effects of temporal parameters in terms of animals’ timing of temporal intervals.     

Preference reversal and delayed reinforcement

Pigeons chose, in a two-key discrete-trial procedure, between 2- and 4-sec access to grain, with the larger amount always presented 4 sec later than the smaller. As the delay between the choice and the availability of the smaller reinforcement was varied from .01 to 12 sec, all subjects reversed preference from the small-early to the large-late reinforcement. The values of delay at which preference reversed were approximately consistent with the matching law as adapted for delayed reinforcement.     

Acquisition and extinction of runway performance under escape,avoidance, and partial-avoidance procedures

The acquisition and extinction of locomotor responses of rats in a straight alley were examined for groups trained under escape, partial-avoidance, and avoidance procedures. During acquisition, one group (escape) received a 0-sec delay between being dropped into the alley and the onset of shock; two groups (partial avoidance) had 0.5- and 1-sec delays; and two groups (avoidance) had delays of 2 and 4 sec. On the final day of acquisition, the partial-avoidance rats displayed higher running speeds than either the escape- or avoidance-trained animals. The 4-sec avoidance group was consistently slower than all other groups. Speeds for all groups decreased during extinction, with rate of decline showing some relation to terminal acquisition level. Relative group performance levels proved to be consistent with a simple arithmetic model based on the assumption that changes in running speeds affect the aversiveness of the situation by altering US duration, CS duration, and effective US length.     

Matching and oddity learning in pigeons: Effects of penalty time for incorrect responding

In simultaneous matching-to-sample and oddity-from-sample tasks, briefly delaying the offset of trial stimuli following an incorrect choice response was found to facilitate task acquisition (Experiment 1). Because thispenalty-time procedure also resulted in longer choice-response latencies, it was hypothesized that any procedure that increased response latency would facilitate task acquisition. However, in Experiment 2, no evidence of facilitation was found when a 2-sec pause was imposed prior to the choice response. The results of Experiment 3 suggest that penalty-time facilitation of acquisition was not due to either the added differential outcome on correct versus incorrect trials (i.e., incorrect choice responses do not darken the keys as do correct choice responses) or the aversive effects associated with trial prolongation (i.e., incorrect responses not only result in the absence of reinforcement but also delay the start of the next trial). Instead, results suggest that birds trained with the penalty-time procedure review the trial stimuli following an incorrect choice.     

The effect of sample and comparison ratio schedules on delayed matching to sample in the pigeon

In Experiment 1, three food-deprived pigeons received trials that began with red or green illumination of the center pecking key. Two or four pecks on this sample key turned it off and initiated a 0- to 10-sec delay. Following the delay, the two outer comparison keys were illuminated, one with red and one with green light. In one condition, a single peck on either of these keys turned the other key off and produced either grain reinforcement (if the comparison that was pecked matched the preceding sample) or the intertrial interval (if it did not match). In other conditions, 3 or 15 additional pecks were required to produce reinforcement or the intertrial interval. The frequency of pecking the matching comparison stimulus (matching accuracy) decreased as the delay increased, increased as the sample ratio was increased, and decreased as the comparison ratio was increased. The results of Experiment 2 suggested that higher comparison ratios adversely affect matching accuracy primarily by delaying reinforcement for choosing the correct comparison. The results of Experiment 3, in which delay of reinforcement for choosing the matching comparison was manipulated, confirmed that delayed reinforcement decreases matching accuracy.     

The Influence of Perinatal Risk Status on Contingency Learning in Six-to Thirteen-Month-Old Infants

Learning of a manipulative response was examined in 6-13-month-old well babies and in risk infants who, in the perinatal period, had experienced a range of respiratory interventions (low- and high-risk). 2 contingency conditions (contingent and yoked) were crossed with 2 locations of feedback (local and remote). Both well-baby and low-risk groups reliably discriminated between contingent and noncontingent feedback when it was presented locally, whereas high-risk babies failed to make this distinction in the conditioning phase. Risk status reliably predicted the learning performance. No response acquisition was obtained in the remote feedback condition. In extinction, the well-baby and low-risk groups decreased their responding, but the high-risk group showed an initial response burst. The findings are discussed in the context of risk-related differences in contingency awareness and frustrative nonreward. Overall, the results confirm that the effects of perinatal compromise involving respiratory complications influence infants' processing of contingency information during the first year of life.     

Pigeons’ memory for event duration: Intertrial interval and delay effects

The effects of within-session variations in the intertriai interval (ITI) and delay on pigeons’ memory for event duration were studied in delayed symbolic matching-to-sample tasks. Pigeons were trained to peck one color following a long (8 sec) sample and another color following a short (2 sec) sample. In the first three experiments, the baseline conditions included a 10-sec delay (retention interval) and a 45-sec ITI. During testing, the delay was varied from 0 to 20 sec, and the ITI that preceded the trial was varied from 5 to 90 sec. When the ITI and delay were manipulated separately (Experiments 1 and 2), the pigeons displayed a choose-short tendency when the delay was longer than 10 sec or when the ITI was longer than 45 sec, and a choose-long tendency when either the delay or the ITI was shorter than these baseline values. These effects occurred whether the sample was food access or light. When the ITI and delay were manipulated together, the pigeons showed a large choose-long error tendency when the short delay was tested together with a short ITI, and no systematic error tendency when the short delay was tested together with a longer ITI. A very large choose-short error tendency emerged on trials with a long delay and a long ITI; a reduced choose-short tendency was present when the long delay was presented together with a short ITI. In Experiment 4, the baseline conditions were a 0-sec delay and a 45-sec ITI. In this case variations in the ITI had a smaller and unidirectional effect: the pigeons showed a choose-long error tendency when the ITI was decreased, but no effect of ITI increases. Two hypotheses were proposed and discussed: (1) that pigeons judge sample durations relative to a background time composed of the ITI and delay, and (2) that the delay and ITI effects might arise from a combination of subjective shortening and proactive effects of samples from previous trials.     

The role of trial tracking in rats’ working memory

The experiments reported in the present study tested whether decreasing intertrial intervals (ITIs) intensifies the disruptive effects of increasing retention intervals (RIs) in a delayed conditional discrimination by decreasing the animal’s trial tracking accuracy (Cohen & Armstrong, 1996; Cohen & Roberts, 1996). Rats responded on a fixed ratio (FR) 1 or fixed interval (FI) 10-sec reinforcement schedule at a second light or tone stimulus, S2, when the first light or tone stimulus, S1, had signaled an FI 10-sec or FR 1 schedule, respectively. RIs between S1 and S2 were increased from 3 to 24 sec and never exceeded ITIs that were reduced from 24 to 6 sec. For some rats, the trials were separated from each other by extending the lever at S1 and retracting it at the end of S2 (ITI lever-retracted group). For other, control rats, the lever remained extended throughout the session (lever-extended group, Experiment 1) or was extended and retracted with the onset and offset of each stimulus (RI/ITI lever-retracted group, Experiment 2). The rats under all trial conditions learned to delay leverpressing on the FI 10-sec schedule. Latency to begin leverpressing on the FI 10-sec schedule declined as RIs were increased, but this effect was attenuated in the ITI lever-retracted groups in both experiments, as would be predicted by thetrial tracking hypothesis. Decreasing ITIs from 24 to 6 sec intensified the disruptive effects of increasing RIs from 3 to 6 sec in the RI/ITI lever-retracted group (Experiment 2), as would be predicted by the trial tracking hypothesis.     

Retention period differentially attenuates win–shift/lose–stay relative to win–stay/lose–shift performance in the rat

Hungry rats were trained in a two-lever conditioning chamber to earn food reinforcement according to either a win–shift/lose–stay or a win–stay/lose–shift contingency. Performance on the two contingencies was similar when there was little delay between the initial, information part of the trial (i.e., win or lose) and the choice portion of the trial (i.e., stay or shift with respect to the lever presented in the information stage). However, when a delay between the information and choice portions of the trial was introduced, subjects experiencing the win–shift/lose–stay contingency performed worse than subjects experiencing the alternative contingency. In particular, the lose–stay rule was differentially negatively impacted relative to the other rules. This result is difficult for ecological or response interference accounts to explain.     

Effects of intertrial interval and exteroceptive feedback duration on discriminative avoidance acquisition in the gerbil

A series of studies of shuttlebox-avoidance learning in the gerbil evaluated the efficacy of an exteroceptive feedback stimulus (FS). Experiment 1 assessed the relative effectiveness of a FS at 30- and 90-sec intertriai intervals (ITIs), and found that the FS and warning signal termination contingencies were additive sources of avoidance reinforcement; i.e., they produced “supernormal acquisition” at the short ITI, but not at the 90-sec ITI. The effectiveness of a FS at the 30-sec ITI was further explored in Experiments 2 and 3, in which FS duration was varied in delayed and trace avoidance conditioning, respectively. In both studies, a FS facilitated acquisition but FS duration was not a critical determinant of performance. These results were interpreted in terms of an expectancy account of the informational value of a FS, and the problem of experimentally distinguishing between cognitive and inhibition-of-fear accounts of avoidance learning was discussed.     

Stimulus duration and conditioned reinforcing value measured by a learning-tests procedure

The relationship between the duration of stimuli and their conditioned reinforcing effect was investigated using a learning-tests procedure. In Experiment 1, stimuli were the same duration on training (stimulus → reward) and test (choice response → stimulus). Ten- and 30-sec stimuli provided effective differential conditioned reinforcement but 3-sec stimuli did not. In Experiment 2, different pigeons had each combination of the 3- and 30-sec stimuli on training and test trials. Evidence of conditioned reinforcement was obtained only for the birds with 30-sec stimuli on both training and test. The results were interpreted as indicating that stimuli become effective conditioned reinforcers on test trials only when their duration exceeds the duration of differential short-term memory cues resulting from a difference in the events that precede them on training and test trials.     

Systematic errors in pigeons’ memory for event duration: Interaction between training and test delay

Pigeons trained to choose different stimuli following short- and long-duration signals make disproportionately more “short” choices (i.e., “choose-short errors”) following an increase in the retention interval and more “choose-long errors” following a decrease in this delay. The present experiment provided a systematic investigation of how these selective errors depend on the relationship between the training delay and the test delay. Pigeons were first trained with a 0-sec delay between the signal (2- or 8-sec food presentations) and the choice stimuli (red- and blue-lit keys). On subsequent test trials with 5- and 10-sec delays, choose-short errors predominated. Next, the birds were trained with a constant 10-sec delay and then tested with shorter or longer delays on some trials. The birds now responded accurately and without selective errors at the 10-sec training delay, but made choose-long errors at shorter delays and choose-short errors at longer delays. Finally, the birds were trained with a constant 20-sec delay and then tested with shorter and longer delays. Choose-long errors again appeared at shorter test delays, choose-short errors at longer test delays, and no differential errors at the 20-sec training delay. The selectivity of these errors generally increased with the absolute difference between the training and test delay. Theoretical implications of these results are discussed.