Intertrial interval and unconditioned stimulus durations in autoshaping

Four groups of pigeons were exposed to an autoshaping procedure in which a 20-sec key illumination preceded the presentation of response-independent grain, The groups differed according to the duration of feeder access and the intertriai intervals, If feeder durations are not included in the time between trials, two of the groups had identical intertriai intervals. If feeder durations are included, each of the other two groups was identical to one of the first two in terms of the intertriai interval, The speed of acquisition and maintained measures of responding were directly related to the duration of the interval from food offset to signal onset, Groups exposed to equivalent intertriai intervals and different feeder durations did not differ from one another on these measures, The results were interpreted as evidence that feeder durations were not included in the functional intertrial interval and that feeder duration, per se, did not affect autoshaped responding.     

A comparison of the short-term memory performances of pigeons and jackdaws

Two experiments employed a delayed conditional discrimination procedure in which half the trials began with the presentation of food and half with no food; following a retention interval, subjects were presented with a choice between red and green keys, a response to one of which was reinforced according to whether the trial had started with food or no food. In Experiment 1, after 38 training sessions during which the retention interval was gradually increased, pigeons performed at a moderate level with intervals of 5 to 7.5 sec. A final test produced a steep forgetting function for food trials, but not for no-food trials; performance was unaffected by the duration of the intertriai interval (10 or 40 sec). Experiment 2 used the delayed conditional discrimination procedure to compare short-term memory in jackdaws (Corvus monedulus) with that in pigeons. Although the performance of the jackdaws was below that of the pigeons at the start of training, they showed more rapid learning over long delays, and, in the final test, a shallower forgetting function for food trials than that shown by pigeons. The results suggested superior short-term memory in jackdaws, which may help to explain the better performance of corvids in general when compared with that of pigeons in certain complex learning tasks.     

Signal-food contingency and signal frequency in a continuous trials auto-shaping paradigm

Five groups of pigeons were studied in an auto-shaping procedure which programmed two types of trials represented by hues on the response key. Each signal was separated by a brief intertriai interval. Three groups were studied with a positive correlation between one of the signals and food (contingent groups). They differed with respect to the frequency with which the positive signal appeared. Two noncontingent groups were studied in which the correlation between the signals and food was eliminated by programming food with the same probability following either signal. One noncontingent group had a high density of reinforcement produced by adding reinforcement in the other signal, at the same rate as programmed in the positive signal for the contingent groups. The other noncontingent group experienced the same number of reinforcements in the session as the contingent group with the least frequent positive trial, but these reinforcements were distributed with equal probability across the signals. Birds in the contingent groups with intermediate or infrequent positive signals all acquired reliable pecking, with acquisition most rapid for the infrequent signal. Maintained responding covaried with the speed of acquisition. No birds in the noncontingent groups showed reliable responding. Birds in the contingent group with a frequent positive signal (approximately 3/4 of the session), also showed no reliable pecking. This result suggests that more than one noncontingent group is informative for assessing the role of differential reinforcement probability in the acquisition of auto-shaped keypecking. In particular, a noncontingent group which controls for the frequency of reinforced trials is an appropriate reference group.

     

The effect of scopolamine on reference and working memory in pigeons

A comparison of the effects of scopolamine hydrobromide on working memory and reference memory in White Carneaux pigeons was undertaken by means of a modified delayed matching-to-sample procedure. Performance on working-memory trials was disrupted by decreases in sample duration and intertriai interval and by increases in delay interval. Performance on reference memory trials was not disrupted by any of these parametric manipulations. In Experiment 1, the pigeons received injections of scopolamine hydrobromide (0.01, 0.05, or 0.1 mg/kg), scopolamine methyl bromide (0.1 mg/kg), or saline prior to test sessions. In Experiment 2, the pigeons received injections of scopolamine hydrobromide (0.01 or 0.03 mg/kg), scopolamine methyl bromide (0.03 mg/kg), or saline. In both experiments, scopolamine hydrobromide had greater disruptive effects on working-memory trials than on reference-memory trials. The centrally active form of scopolamine disrupted working-memory trial accuracy more than the peripherally active form. However, no drug dose × delay interval interaction was obtained. Thus, the interference on working-memory-trial accuracy produced by central cholinergic blockade would not appear to be due to alterations in the active maintenance of information during the delay interval.     

Pigeons’ spatial memory: V. Proactive interference in the delayed matching of key location paradigm occurs only under restricted conditions

In the delayed matching of key location procedure, pigeons must remember the location of the sample key in order to choose correctly between two comparison keys. The deleterious effect of short intertrial intervals on key location matching found in previous studies suggested that pigeons’ short-term spatial memory is affected by proactive interference. However, because a reward expectancy mechanism may account for the intertriai interval effect, additional research aimed at demonstrating proactive interference was warranted. In Experiment 1, matching accuracy did not decline from early to late trials within a session, a finding inconsistent with a proactive interference effect. In Experiment 2, evidence suggestive of proactive interference was found: Matching was more accurate when the locations that served as distractors and as samples were chosen from different sets. However, this effect could have been due to differences in task difficulty, and the results of the two subsequent experiments provided no evidence of proactive interference. In Experiment 3, the distractor on Trialn was either the location that had served as the sample on Trialn ? 1 or one that had been a sample on earlier trials. Matching accuracy was not inferior on the former type of trial. In Experiment 4, the stimuli that served as samples and distractors were taken from sets containing 2, 3, 5, or 9 locations. Matching accuracy was no worse, actually slightly better, with smaller memory set sizes. Overall, these findings suggested that pigeons’ memory for spatial location may be immune to proactive interference. However, when, in Experiment 5, an intratrial manipulation was used, clear evidence of proactive interference was found: Matching accuracy was considerably lower when the sample was preceded by the distractor for that trial than when it was preceded by the sample or by nothing. Possible reasons why interference was produced by intratrial but not intertrial manipulations are discussed, as are implications of these data for models of pigeons’ short-term spatial memory.     

Preference for the interval schedule following multiple variable-ratio yoked-variable-interval schedule training

Pigeons were studied on multiple variable-ratio yoked-variable-interval schedules in which components had equal rates of food reinforcement and appeared equally often on each of two keys. Interpolated between component changes on the final multiple schedule were 10-sec probes in which both schedule stimuli were present, one on each key. During multiple schedule training, variable-ratio response rates were greater than yoked-variable-interval rates; however, response rate differences in the components were not a function of the mean ratio value for the 40-to-320-ratio range studied. During the choice probes, subjects responded more to the stimulus associated with the interval schedule than to the one associated with the ratio schedule. It was concluded that pigeons prefer interval schedules over equal reinforcement rate ratio schedules, because the former generate fewer responses per reinforcement.     

US duration and local trial spacing affect autoshaped responding

The acquisition and maintenance of signal-directed pecking was examined in week-old Leg-Horn chicks responding to a keylight stimulus paired with heat. In contrast with previous studies using pigeons with food as the US, both speed of acquisition and asymptotic level of keypecking were a direct function of US duration. Experiment 2 examined responding using a within-subject design to isolate the effects of trial spacing on performance during the immediate trial from the effects on performance during a following trial of fixed length. These comparisons revealed a significant effect of intertriai interval (ITI), with less responding after shorter intervals. The effect of different temporal spacing was apparent in responding on the immediate trial, but not on the following trial. These local ITI effects were better predicted by a recent autoshaping model based on relative waiting time (Jenkins, Barnes, & Barrera, 1981) than by a model based on relative US expectancy (Gibbons & Balsam, 1981). However, neither model predicted the effect of US duration. A reexamination of the US-duration literature suggested that the diversity of previous findings is consistent with the assumption that conditioned responding is an inverted U-shaped function of US duration.     

Proactive effects in pigeons’ timing behavior: Implications for an internal-clock model

We have found proactive effects in pigeons’ timing behavior, a finding inconsistent with internal-clock models of timing that assume a resetable working-memory component. Six pigeons were trained to discriminate between 2- and 10-sec illuminations of a white light; choice of a red pecking key was correct and rewarded after presentation of the short stimulus whereas choice of a green key was correct and rewarded after presentation of the long stimulus. During training sessions, there were 60 trials separated by a 20-sec intertriai interval; short and long light occurred in a randomized order and correct choices were reinforced with 5-sec access to grain on a partial (75%) schedule. During test sessions, there were 120 trials separated by a 2-sec intertrial inter val. Light presentations occurred in a fixed order throughout these sessions: 2, 6, 10, 10, 6, 2 2, 6, 10 sec, and so forth. Choice of either red or green after 6 sec was not reinforced. However, red continued to be correct after 2 sec and green continued to be correct after 10 sec. Of central interest was how the subjects classified 6 sec of light in ascending (2, 6, 10) and descending (10. 6, 2) sequences of durations: Subjects chose the short alternative on 42% of the 6-sec trials in ascending series but only 29% in descending series, a result most plausibly interpreted as show ing that duration information from a preceding trial affects duration classifications on the cur rent trial. Such proactive effects should not occur according to working-memory models that as sume that stored information is cleared at the end of a trial.     

Pigeons’ memory for event duration: Intertrial interval and delay effects

The effects of within-session variations in the intertriai interval (ITI) and delay on pigeons’ memory for event duration were studied in delayed symbolic matching-to-sample tasks. Pigeons were trained to peck one color following a long (8 sec) sample and another color following a short (2 sec) sample. In the first three experiments, the baseline conditions included a 10-sec delay (retention interval) and a 45-sec ITI. During testing, the delay was varied from 0 to 20 sec, and the ITI that preceded the trial was varied from 5 to 90 sec. When the ITI and delay were manipulated separately (Experiments 1 and 2), the pigeons displayed a choose-short tendency when the delay was longer than 10 sec or when the ITI was longer than 45 sec, and a choose-long tendency when either the delay or the ITI was shorter than these baseline values. These effects occurred whether the sample was food access or light. When the ITI and delay were manipulated together, the pigeons showed a large choose-long error tendency when the short delay was tested together with a short ITI, and no systematic error tendency when the short delay was tested together with a longer ITI. A very large choose-short error tendency emerged on trials with a long delay and a long ITI; a reduced choose-short tendency was present when the long delay was presented together with a short ITI. In Experiment 4, the baseline conditions were a 0-sec delay and a 45-sec ITI. In this case variations in the ITI had a smaller and unidirectional effect: the pigeons showed a choose-long error tendency when the ITI was decreased, but no effect of ITI increases. Two hypotheses were proposed and discussed: (1) that pigeons judge sample durations relative to a background time composed of the ITI and delay, and (2) that the delay and ITI effects might arise from a combination of subjective shortening and proactive effects of samples from previous trials.     

Stimulus preference and the transitivity of preference

Four pigeons were exposed to multiple schedules with concurrent variable interval (VI) components and then tested for preference transfer. Half of the pigeons were trained on a multiple concurrent VI 20-sec, VI 40-sec/cuncurrent VI 4G-sec5 VI 80-sec schedule. The remaining pigeons were trained on a multiple concurrent VI 80-sec, VI 40-sec/concurrent VI 40-sec, VI 20-sec schedule-After stability criteria for time and response proportions were simultaneously met, four preference transfer tests were conducted with the stimuli associated with the VI 40-sec schedules. During the transfer tests, each pigeon allocated a greater proportion of responses (M=0,79) and time (M=0.82) to the stimulus associated with the VI 40-sec schedule that was paired with the VI 80-sec schedule than lo the VI 40-sec schedule stimulus paired with the VI 20-sec schedule. Absolute reinforcement rates on the two VI 40 sec schedules were approximately equal and unlikely to account for the observed preference. Nor was the preference consistent with the differences in local reinforcement rates associated with the two stimuli. Instead, the results were interpreted in terms of the differential value that stimuli acquire as a function of previous pairings with alternative schedules of reinforcement.     

Partial reinforcement in autoshaping with pigeons

The acquisition, maintenance, and extinction of autoshaped responding in pigeons were studied under partial and continuous reinforcement. Five values of probability of reinforcement, ranging from .1 to 1.0, were combined factorially with five values of intertrial interval ranging from 15 to 250 sec for different groups. The number of trials required before autoshaped responding emerged varied inversely with the duration of the intertriai interval and probability of reinforcment, but partial reinforcement did not increase the number of reinforcers before acquisition. During maintained training, partial reinforcement increased the overall rate of responding. A temporal gradient of accelerated responding over the trial duration emerged during maintenance training for partial reinforcement groups, and was evident for all groups in extinction. Partial reinforcement groups responded more than continuous reinforcement groups over an equivalent number of trials in extinction. However, this partial-reinforcment extinction effect disappeared when examined in terms of the omission of “expected” reinforcers.     

Effects of proactive interference on rats’ continuous nonmatching-to-sample performance

Rats performed a new delayed matching-to-sample task—the continuous nonmatching-to-sample task. A variable number of trials with one stimulus alternated with trials with a second stimulus. A response on the trial following a stimulus change (nonmatch trial) was reinforced. Responses to repeated stimuli were never reinforced. Rats could maximize reinforcement by remembering across the intertriai interval which stimulus was presented on the previous trial. Sequential analysis indicated that interference from previous conflicting trials (proactive interference, PI) reduced response accuracy but did not affect retention: Accuracy was lower on trials following a nonmatch trial than on trials following repeated stimuli. Furthermore, accuracy increased as a function of the time between the to-be-remembered nonmatch trial and the previous interfering trial. However, neither time between trials nor the distance from a stimulus change affected the rate of decline in accuracy over the retention interval.     

Inescapable shock interferes with the acquisition of a low-activity response in an appetitive context

This study investigates the effects of exposure to inescapable shock on the acquisition of a low-activity appetitive response using a trial procedure. Inescapable shock was found to interfere with the acquisition of a nose-poke response to obtain food as compared with animals exposed to either escapable shock or no shock. In addition, general activity levels were measured separately during the trial and the intertrial interval during the appetitive test. Inescapably shocked animals were less active during the trial component than were either the escapably shocked or the nonshocked animals. However, no differential levels of activity were observed during the intertriai interval component of the appetitive test. The relevance of these findings for both the learned helplessness and the learned inactivity hypotheses is discussed.     

Pigeon and human performance in a multi-armed bandit task in response to changes in variable interval schedules

The tension between exploitation of the best options and exploration of alternatives is a ubiquitous problem that all organisms face. To examine this trade-off across species, pigeons and people were trained on an eight-armed bandit task in which the options were rewarded on a variable interval (VI) schedule. At regular intervals, each option’s VI changed, thus encouraging dynamic increases in exploration in response to these anticipated changes. Both species showed sensitivity to the payoffs that was often well modeled by Luce’s (1963) decision rule. For pigeons, exploration of alternative options was driven by experienced changes in the payoff schedules, not the beginning of a new session, even though each session signaled a new schedule. In contrast, people quickly learned to explore in response to signaled changes in the payoffs.     

Some temporal factors affecting conditional discrimination

Pigeons acquired a serial conditional discrimination in which the onset of one of two colors (the instructional cue) on the center key preceded the onset of a white light (the trial cue) on one of two side keys. An autoshaping preparation was employed, in which food was delivered depending upon the color-side combination. Five groups of birds were studied at instructional cue durations of either 30 or 60 sec, and trial cue durations of 3, 6, or 12 sec. These temporal parameters allowed for different ratios of the instructional stimulus duration (I) to the trial stimulus duration (T), while keeping the absolute duration of the instructional stimulus constant, and for different absolute durations of the instructional stimulus, while keeping the I/T ratio constant. These manipulations were studied with either a 30 or a 60-sec cycle (the interval between the onset of the intertriai interval and the offset of the trial cue), thus permitting examination of the cycle duration to trial duration ratios as well. The results showed that the larger the value of I relative to that of T, the greater the final level of accuracy; this implicates the I/T ratio as a controlling variable. In contrast, the larger the cycle duration (C) relative to T, the greater the rate of responding to the trial stimulus, which is consistent with previous findings in autoshaping studies. These results suggest that whereas the C/T ratio directly influences response rate, the I/T ratio affects accuracy in a serial conditional discrimination.     

The CS-US interval (ISI) function in rabbit nictitating membrane response conditioning with very long intertriai intervals

In Experiment 1, four values of conditioned stimulus-unconditioned stimulus interval, or interstimulus interval (ISI) (200, 500, 800, and 1,100 msec) were studied in one trial/day acquisition of the conditioned nictitating membrane response of the rabbit. The 1,100-msec ISI group was superior to the other groups, contrary to the usual findings of ISI studies in the conditioning literature. In Experiment 2, effective conditioning levels were attained with an ISI as long as 2,200 msec, when the intertriai interval was set at either 24 or 48 h. Results are interpreted in terms of the role of orienting responses in the conditioning process.     

Midsession reversal learning: why do pigeons anticipate and perseverate?

Past research has shown that when given a simultaneous visual-discrimination midsession reversal task, pigeons typically anticipate the reversal well before it occurs and perseverate after it occurs. It appears that they use the estimation of time (or trial number) into the session, rather than (or in addition to) the more reliable cue, the outcome from the previous trial (i.e., a win–stay/lose–shift response rule), to determine which stimulus they should choose. In the present research, we investigated several variables that we thought might encourage pigeons to use a more efficient response strategy. In Experiment 1, we used a treadle-stepping response, rather than key pecking, to test the hypothesis that reflexive key pecking may have biased pigeons to estimate the time (or trial number) into the session at which the reversal would occur. In Experiment 2, we attempted to make the point of reversal in the session more salient by inserting irrelevant trials with stimuli different from the original discriminative stimuli, and for a separate group, we added a 5-s time-out penalty following incorrect choices. The use of a treadle-stepping response did not improve reversal performance, and although we found some improvement in reversal performance when the reversal was signaled and when errors resulted in a time-out, we found little evidence for performance that approached the win–stay/lose–shift accuracy shown by rats.     

Unraveling sources of stimulus control in a temporal discrimination task

In temporal discriminations tasks, more than one stimulus may function as a time marker. We studied two of them in a matching-to-sample task, the sample keylight and the houselight that signaled the intertrial interval (ITI). One group of pigeons learned a symmetrical matching-to-sample task with two samples (2 s or 18 s of a center keylight) and two comparisons (red and green side keys), whereas another group of pigeons learned an asymmetrical matching-to-sample task with three samples (2 s, 6 s, and 18 s) and two comparisons (red and green). In the asymmetrical task, 6-s and 18-s samples shared the same comparison. In a subsequent retention test, both groups showed a preference for the comparison associated with the longer samples, a result consistent with the hypothesis that pigeons based their choices on the duration elapsed since the offset of the houselight (i.e., sample duration + retention interval). Results from two no-sample tests further corroborated the importance of the ITI illumination as a time marker: When the ITI was illuminated, the proportion of choices correlated positively with the retention interval; when the ITI was darkened, choices fell to random levels. However, the absolute value of choice proportions suggested that the sample stimulus was also a time marker. How multiple stimuli acquire control over behavior and how they combine remains to be worked out.     

Cross-modal transfer of stimulus control in the albino rat: A stimulus delay procedure

The present experiment demonstrated in a simultaneous discrete trial discrimination that the stimulus control of a rat’s leverpress response can be errorlessly transferred across stimulus modalities, i.e., from light to click location and from click to light location. Subsequent to acquisition of the original discrimination, the original and new discriminative stimuli were simultaneously presented for several sessions. Then the new discriminative stimulus was presented 3 sec prior to the onset of the original discriminative stimulus. Within the direction of transfer, e.g., from light to click location, the delay group emitted fewer trial and intertriai errors than the control group. As the new discriminative stimuli acquired control over responding, the response latency distributions were differentially affected. The results suggest that the transfer of control from the original to the new discriminative stimuli is mediated by the temporal aspects of the delay interval.     

Reversing the reinforcement contingencies of eating and keypecking behaviors

Four of five pigeons were conditioned to peck a key at a high, stable rate on a VI schedule and then given concurrent access to free food. It was found, in replication of Neuringer’s results, that the pigeons pecked a key for grain in the presence of free grain. When availability of the response key (high-probability response) was made contingent on eating free grain (a lower probability response), there was a progressive increase in free-food eating, confirming Premack’s reinforcement principle. For two additional birds, when availability of the key was made contingent onnot eating the free food (a type of DRO schedule), the frequency of free-food eating declined. Thus, availability of the key. depending on the contingency, reinforced both the eating and noneating of free food.