Differential second-order aversive conditioning using contextual stimuli

Two experiments were conducted to determine if contextual stimuli used as S₂ in a higher-order differential conditioning procedure would control the performance of rats. Discrete stimuli were first paired with footshock in a separate training context. During second-order training, a shock-associated discrete stimulus was presented in one of two discriminable observation chambers. Over 4 days of training, subjects engaged in more freezing in the context associated with an excitatory discrete S₁, relative to a context in which no discrete stimulus, or a stimulus that had been explicitly unpaired with shock delivery, was presented. After acquisition of the second-order discrimination, animals were returned to the original training context where they received a “signaled inflation” treatment designed to change the current value of S₁, and the US. This postconditioning manipulation did not selectively affect performance of defensive freezing or conditional analgesia in S₂.     

Second-order conditioning of the conditioned emotional response: Some methodological considerations

Employing rats in a CER procedure, the present study sought to determine the extent to which the second-order conditioning effects reported by Rizley and Rescorla (1972) represented first-rather than second-order conditioning. Subjects receiving first-order pairings of flashing light (CS₁) and shock followed by second-order pairings of noise (CS₂) and CS₁ displayed greater suppression to CS₂ than did control subjects receiving second-order pairings in the absence of first-order conditioning. This was true whether or not control subjects had experienced unsignaled shock or habituation to CS₁ prior to CS₂CS₁ pairings. Simple stimulus pairings did produce some suppression to CS₂, however. The procedure developed by Rizley and Rescorla (1972) appears to be a reliable means for producing and studying second-order aversive conditioning.     

Latent inhibition of the conditioning context: Further evidence of contextual potentiation of retrieval in the absence of appreciable context-US associations

Previous research in our laboratory has found superior performance when classically conditioned responses are observed in the training context as opposed to outside it, even when direct context-US associations have been minimized by either the choice of conditioning parameters or extinction to the context. The present experiment used latent inhibition of the conditioning context as an alternative method of examining contextual cue effects in the absence of appreciable direct context-US associations. Water-deprived rats received tone-footshock pairings in one of two distinctly different apparatuses, but all were tested in a common apparatus. Animals conditioned in the test enclosure displayed more lick suppression than those conditioned outside the test enclosure. Other animals tested without the tone present also exhibited more suppression if conditioning had occurred in the test context rather than outside it, indicating that direct associations between the conditioning context and shock had been formed. However, when formation of direct associations to the conditioning context was attenuated in additional animals through extensive preexposure to the context prior to conditioning, more suppression to the tone was still seen when conditioning had occurred in the test context rather than outside it. These results add support to the position that the training context augments recall even when direct associations between the context and the US are attenuated. The phenomenon is discussed in terms of facilitated retrieval of nominal CS-US associations, configural retrieval cues, and conditional discriminations.     

Contextual associations in trace conditioning

Rats were given tone-footshock pairings with a 0-, 10-, or 30-sec trace interval between tone offset and shock onset. Half the rats within each trace interval were tested for their conditioned fear of the tone through a lick suppression procedure; the remaining rats were evaluated for their fear of the background or contextual cues through their avoidance of the compartment in which conditioning had occurred. Less conditioning was observed to the tone with increasing trace intervals. However, conditioned fear of the context increased with increases in the trace duration. The ability of the more predictive stimulus, the tone, to overshadow the contextual cues was determined by the tone’s temporal contiguity with the footshock. The need to incorporate temporal parameters within current theories of conditioning is discussed.     

Concurrent extinction does not render appetitive conditioning context specific

In an experiment with rats, an appetitive conditioning method was used to investigate the generality of the hypothesis that extinction should arouse attention to contextual cues, resulting in all learning in that context becoming context specific. Rats received appetitive conditioning with a tone either while extinction of a flasher occurred (Group With Extinction) or while it did not (Group No Extinction). Half of each group was subsequently tested in extinction in the context in which training had taken place or in a different context. The results revealed a three-way interaction of extinction and context with trials, in a direction opposite to the one the hypothesis would suggest. When rats were tested in a different context, there was generally better responding in Group With Extinction than in Group No Extinction. In the same context, there was generally lower responding in Group With Extinction than in Group No Extinction. Subsequent testing showed an ABA recovery effect. Results are discussed in terms of the challenges they pose for the revised retrieval theory presented by Callejas-Aguilera and Rosas (2011).     

Classical-classical transfer: Excitatory associations between “competing” motivational stimuli during classical conditioning of the rabbit

A sensory preconditioning analogue was employed to separate signaling effects from motivational effects observed in appetitive-to-aversive transfer of training. Rabbits received appetitive conditioning (tone-water pairings) of the jaw-movement response, followed by aversive conditioning of the nictitating membrane response, during which water delivery served as the CS for para-orbital shock. When the tone was subsequently presented, only subjects exposed to both sets of pairings demonstrated conditioned jaw movement and nictitating membrane responses. The occurrence of both responses to the tone is inconsistent with the action of reciprocal inhibition between motivational states. The results are interpreted in terms of multiple mediators for transfer-of-training paradigms.     

Appetitive-aversion interactions: Facilitation of aversive conditioning by prior appetitive training in the rat

In Experiment 1, four groups of rats received conditioned suppression training in which a tone was reinforced with shock. If the tone had been previously paired with response-independent food, aversive conditioning was slightly facilitated by comparison to control groups preexposed either to the tone randomly associated with food or to the tone and food unpaired. However, by comparison to a control which was not preexposed to the tone, animals receiving prior pairings of the tone and food showed retarded aversive conditioning. Experiment 2 replicated the facilitation in aversive conditioning after the tone had been paired with food relative to the random control condition and demonstrated that this difference occurred even if the tone and background stimuli continued to be associated with response-independent food during aversive conditioning. This result suggests that pairing a stimulus with an appetitive reinforcer reduces the retardation of aversive conditioning produced by stimulus preexposure.     

The role of within-trial location of the retention interval in rats’ delayed conditional discrimination performance

Rats were trained and tested on delayed conditional discriminations (DCDs) consisting of four possible light and tone stimulus sequences: light-light, tone-tone, light-tone, and tone-light. A lever was presented after the offset of the second or test stimulus, S₂. Two retention intervals (RIs) were present within the DCD task, one (RI-1) between the sample or first stimulus (S₁) and S₂, and the other (RI-2) between S₂ and presentation of the lever. Liquid reinforcement was contingent upon pressing only when S₂ matched S₁ in Experiment 1 or only when S₂ differed from S₁ in Experiment 2. RI-1 and RI-2 were separately increased to 5,10, and 20 sec from 1-sec training conditions. Increasing RI-1 produced greater declines in performance to light S₁ than to tone S₁ in both experiments. No such stimulus modality effect occurred for increases in RI-2 in these experiments. These results indicate that retrospection of S₁ occurred during RI-1 and prospection of a response decision and reward expectancy primarily occurred during RI-2.     

Stimulus competition in the absence of compound conditioning

Most associative theories have assumed that stimulus competition occurs only between conditioned stimuli (CSs) that are trained in compound. The present research investigated the possibility of competition between two CSs that were individually paired to the same unconditioned stimulus (US). We used human subjects in an anticipatory suppression analogue to Pavlovian conditioning. Experiment 1 showed that X+ training followed by A+ training resulted in impaired responding to X. This did not occur when A+ training preceded X+ training. Experiment 2 replicated the basic effect and showed that it did not occur when the Phase 2 training consisted of A? instead of A+ nor when the A+ pairings occurred in a second context. Experiment 3 showed that A+ pairings occurring in a second context could still produce the effect when X was tested in the context in which the A+ pairings had occurred, but not when X was tested in a context different from that used for A+ training. Collectively, these results suggest that individually trained CSs may compete with each other when one of those CSs is more strongly activated by the test context than the other one.     

Stimulus-reinforcer interactions in Pavlovian conditioning of pigeons: Implications for selective associations

In a Pavlovian procedure, groups of pigeons were presented with a compound auditory-visual stimulus that terminated with either response-independent electric shock or food. In a subsequent test, the tone CS was dominant in aversive conditioning, reliably eliciting conditioned head raising and prancing. The red light CS was dominant in appetitive conditioning, reliably eliciting pecking. This result was replicated in a second experiment, in which trials were widely spaced. Pour additional groups of pigeons received pairings of the separate element CSs with the USs. Red light, but not tone, was an effective CS in appetitive conditioning, whereas tone, but not red light, was effective in aversive conditioning. There was no discriminative responding in zero-contingency control groups. Several theoretical accounts of these data are discussed.     

Effects of partial vs consistent reward in noncontingent pairings of stimuli with reward: A noncontingently produced positive contrast effect

Rats received pairings of two stimuli with reward noncontingently in the Skinner box. During noncontingent pairings, the bar was immobilized. For Group CC 100% of the presentations of both stimuli were rewarded (S₁ ±, S₂ ±), for Group PP 50% of the presentations of each stimulus were rewarded (S₁, ±, S₂±), and for Group PC one stimulus was followed by reward on 50% of its presentations, while the second stimulus was followed by reward on 100% of its presentations (S₁ ±, S₂ ±). A fourth group received the stimuli and reward nonpaired. In a subsequent rewarded test phase, the response facilitating effects of the stimuli were evaluated. In the test phase all groups that received reward paired with S₁, and S₂ performed better in the presence of S₁ and S₂ than the group for which the stimuli were not paired with reward. For groups that received the stimuli paired with reward, a difference due to schedule of reward occurred when schedule of reward was varied within Ss (Group PC), but not when varied between Ss (Group PP vs Group CC). The specific form of this finding was that Group PC’s performance in the presence of S₂ ± was more vigorous than its performance in the presence of S₁ ± and was more vigorous than the performance of Groups PP and CC to S₂. Group PC’s performance to S₁ ± did not differ from that of Groups PP and CC to S₁.     

Retrospective and prospective short-term memory in delayed response tasks in rats

Separate groups of rats were trained and tested on asymmetrically and symmetrically reinforced successive delayed matching-to-sample (DMTS) or delayed discrimination (DD) tasks in Experiment 1. Each rat received training and testing on symmetrically reinforced DMTS and DD tasks in Experiment 2. The only difference between each task was that the rats had to respond correctly to a light or tone test stimulus, S₂, if it matched a light or tone sample stimulus, S₁, in DMTS, but could respond to either S₂ if S₁ had been a particular stimulus in DD. Only correct leverpresses were reinforced in the asymmetrically reinforced version of each task. Both correct presses and correct omissions were reinforced in the symmetrically reinforced version of each task. Response biases to leverpress during tests for delayed responding to S₁ were reduced in both symmetrically reinforced tasks, but only in the DD task did such contingencies produce consistently poorer performance in responding to either S, in Experiment 1. Declines in accuracy of performance that occurred in both experiments were greater to the visual than to the auditory S₁ only in the DMTS tasks with increased intervals between S₁ and S₂. A third experiment, in which rats had to respond to S₂ if it matched S₁ (DMTS) or if S₂ mismatched S, (DMmTS), was carried out. Modality of S₁ similarly affected accuracy of delayed responding in each task, as in the first two experiments. Methodological and theoretical implications of these results are discussed in terms of Honig and Thompson’s (1982) dual-process theory of working memory.     

Contextual control of first- and second-learned excitation and inhibition in equally ambiguous stimuli

In two three-phase experiments, rats received a final third excitatory (Experiment 1) or inhibitory (Experiment 2) phase of conditioning with a tone. The third phase came immediately prior to a test with the tone, either in the context where the tone was trained or in a different context. Groups differed in each experiment with respect to the first two phases. Rats in Groups EIE (Experiment 1) and EII (Experiment 2) received excitatory conditioning with the tone in Phase 1, followed by inhibitory conditioning with the tone. Rats in Groups IEE (Experiment 1) and IEI (Experiment 2) received inhibitory conditioning in Phase 1, followed by excitatory conditioning in Phase 2. Thus, the association being expressed in Phase 3 was consistent either with what was learned first about the stimuli or with what was learned second. Contrary to expectations, the association being expressed at the end of Phase 3, either excitatory or inhibitory, was affected by a context change, regardless of its consistency with what was learned first about the CS.     

Decrement in distress to an aversive event during a conditioned positive opponent-process

During Phase 1, 24 rats received CS₁ (light)-shock trials while the remaining 24 rats received CS₁ and shock on a random control schedule. During Phase 2, all subjects were presented trials of CS₂ (tone)-shock. When CS₂ was subsequently presented immediately after CS, while subjects licked for water, it was found that subjects that had received CS₁-shock pairings during Phase 1 exhibited less suppression of licking to CS₂, indicating less distress, than control subjects. The results are compatible with the opponent-process theory and suggest the presence of a positive hedonic afterreaction to an aversive event which reduced distress to a following aversive event.     

Temporal encoding in trace conditioning

Conditioned lick suppression in rats was used to explore the role of timing in trace conditioning. In Experiment 1, two groups of rats were exposed to pairings of a CS (CS1) with a US, under conditions in which the interstimulus interval (ISI) that separated CS1 offset and US onset was either 0 or 5 sec. Two additional groups were also exposed to the same CS1→US pairings with either a 0 or a 5-sec ISI, and then received “backward” second-order conditioning in which CS1 was immediately followed by a novel CS2 (i.e., CS1→CS2). A trace conditioning deficit was observed in that the CS1 conditioned with the 5-sec gap supported less excitatory responding than the CS1 conditioned with the 0-sec gap. However, CS2 elicited more conditioned responding in the group trained with the 5-sec CS1-US gap than in the group trained with the 0-sec CS1-US gap. Thus, the CS1-US interval had inverse effects on first- and second-order conditioned responding. Experiment 2 was conducted as a sensory preconditioning analogue to Experiment 1. In Experiment 2, rats received the CS1?CS2 pairings prior to the CS1→US pairings (in which CS1 was again conditioned with either a 0 or a 5-sec ISI). Experiment 2 showed a dissociation between first- and second-order conditioned responding similar to that observed in Experiment 1. These outcomes are not compatible with the view that differences in responding to CSs conditioned with different ISIs are mediated exclusively by differences in associative value. The results are discussed in the framework of the temporal coding hypothesis, according to which temporal relationships between events are encoded in elementary associations.     

Bidirectional heart rate responses in rats associated with excitatory and inhibitory stimuli

Following classical conditioning to a shock-reinforced tone CS (T₁+), heart rate (HR) of three groups of rats was examined in response to a new reinforced tone (T₂+) and a nonreinforced light (L?) CS given during conditioned inhibition (T₂+ vs. T₁L?), discrimination conditioning (T₂+ vs. L?), or explicitly unpaired (T₂/L? vs. US alone) procedures. Decelerative HR reactions occurred to the reinforced T₂+ and T₂+ CSs. To the respective nonreinforced CSs, the conditioned inhibition group displayed diminished but sizable HR deceleration, the discrimination group showed near-zero responding, and the explicitly upaired group showed HR acceleration. Subsequent reversal conditioning to L was retarded in the conditioned inhibition and explicitly unpaired groups relative to the discrimination group. Group differences on combined-cue [T₂/L?) trials were not found. Both the HR responses during inhibitory training and the reversal-conditioning impairments suggest that inhibition may have been established to L? in the conditioned inhibition and explicitly unpaired groups.     

Pain-elicited aggression in the squirrel monkey: An implicit avoidance contingency

Squirrel monkeys were given either forward pairings of a bite-tube CS and shock US or backward pairings of these stimuli. Backward pairings produced stronger control of biting by the bite tube alone than did forward pairings. In a second experiment, subjects received backward pairings of US and CS with either a fixed ITI or a random ITI. Conditioned biting was obtained only when trials were presented with a fixed ITI. The magnitude of unconditioned biting was also significantly greater with the fixed ITI. It was argued that these results demonstrate that conditioning in this situation depends upon the degree to which biting predicts a relatively long shock-free period. When trials occur randomly in time, biting predicts no definite shock-free period; hence, it is not learned.     

Effects of an aversive CS+ and CS− under deprivation upon successive classical appetitive and aversive conditioning

Rabbits under high or moderate water deprivation received in Stage 1 either paired (CS+), unpaired (CS?), or no-tone/shock presentations, with the pairings being appropriate for nictitating membrane conditioning. In Stage 2, all groups were given paired tone and water deliveries for jaw-movement conditioning, while, in Stage 3, all group received the tone and shock paired together for membrane conditioning. In Stage 2, the previously established aversive CS+ suppressed jaw-movement conditioning under high deprivation, and membrane CR decrements were directly related to deprivation. Also in Stage 2, the aversive CS? raised jaw-movement conditioning under moderate deprivation. In Stage 3, membrane CR performance immediately returned in the aversive CS+ group. For the other groups, conditioning was faster under high, relative to moderate, deprivation; however, the initial membrane CR occurrence required more trials if unpaired presentations were used in Stage 1. These results suggest that CSs can acquire both opponent-process and associative effects expressed according to the prevailing training conditions.     

Disruption of latent inhibition by interpolation of task-irrelevant stimulation between preexposure and conditioning

Latent inhibition refers to attenuated responding to a conditioned stimulus (CS) that was repeatedly presented without reinforcement prior to the CS-unconditioned stimulus (US) pairings. Using water-deprived rats as subjects, we observed that interpolating task-irrelevant stimulation between the preexposure and conditioning phases of a latent inhibition procedure attenuated latent inhibition (Experiments 1A, 1B, and 2). Apparently, interpolated stimulation segments the preexposure and conditioning treatments into two separate experiences, much in the same way that a change of context would. Consistent with this view, the interpolated stimulation did not disrupt latent inhibition if it was also presented during both preexposure and conditioning (Experiment 3). We view these results as analogous to those of Escobar, Arcediano, and Miller (2003), who suggested that the difficulty in observing latent inhibition in human adults is related to the segmentation between preexposure and conditioning caused by the usual interpolation of instructions in preparations with humans.     

The dual role of the context in postpeak performance decrements resulting from extended training

The context??s role in Pavlovian conditioning depends on the trial spacing during training, with massed trials revealing a function akin to that of discrete stimuli, and spaced trials revealing a modulatory function (Urcelay & Miller, Journal of Experimental Psychology. Animal Behavior Processes, 36, 268?C280, 2010). Here we examined the contextual determinants of a common but largely ignored effect: attenuated conditioned responding with extended reinforced training (i.e., a postpeak performance deficit [PPD]). Contextual sources of PPDs were investigated in four fear-conditioning experiments with rats. In Experiment 1, as the number of reinforced trials increased, conditioned responding decreased, even when testing occurred outside the training context. Experiment 2 revealed opposing influences of context on the PPD based on trial spacing, which interacted with whether testing occurred in the training context. This finding reconciles Experiment 1??s results with previous data (Bouton, Frohardt, Sunsay, Waddell, & Morris, Journal of Experimental Psychology. Animal Behavior Processes, 34, 223?C236, 2008). Experiment 3 suggested that extended training with these parameters did not lead to habituation to conditioned or unconditioned stimuli. In Experiment 4, few or many massed training trials were followed orthogonally by context extinction or no context extinction. After many pairings, context extinction reduced the PPD (i.e., enhanced responding), suggesting a competitive role of the context. These results, together with prior data suggesting that context modulates expressions of the PPD, are consistent with the view that contexts can play two distinctly different roles.