Differential second-order aversive conditioning using contextual stimuli

Two experiments were conducted to determine if contextual stimuli used as S₂ in a higher-order differential conditioning procedure would control the performance of rats. Discrete stimuli were first paired with footshock in a separate training context. During second-order training, a shock-associated discrete stimulus was presented in one of two discriminable observation chambers. Over 4 days of training, subjects engaged in more freezing in the context associated with an excitatory discrete S₁, relative to a context in which no discrete stimulus, or a stimulus that had been explicitly unpaired with shock delivery, was presented. After acquisition of the second-order discrimination, animals were returned to the original training context where they received a “signaled inflation” treatment designed to change the current value of S₁, and the US. This postconditioning manipulation did not selectively affect performance of defensive freezing or conditional analgesia in S₂.     

Chemosensory-based contextual conditioning inHermissenda crassicornis

In two experiments, the marine molluskHermissenda crassicornis was exposed to context discrimination training. In one context, defined by the presence of a diffuse chemosensory stimulus (shellfish extract A), brief, unsignaled, unconditioned stimuli (USs; high-speed rotation) were presented; in a second context, defined by the presence of shellfish extract B, no USs were presented. Animals were then tested (at both 1.5 and 24 h) by exposing them to small pieces of the shellfish meat used to define the two contexts. The latency to strike at the meat served as an index of the context-US association. In Experiment 1, the latency to strike at the cue associated with rotation was reduced relative to both preconditioning strike latencies and the associatively neutral cue. However, in a two-choice test where the animals could approach the conditioned or neutral stimulus, the animals regularly avoided the stimulus paired with rotation. Moreover, if, following conditioning, the animals were presented with an unsignaled rotation in the conditioned context or the neutral context, the animals exhibited more effective defensive clinging (an unconditioned reflex normally elicited by rotation) in the conditioned context, suggesting that it “prepared” the animal for the aversive US. In total, these results demonstrate thatHermissenda is capable of making associations to diffuse background (contextual) stimuli. Moreover, the results suggest that pairing the chemosensory cue with an aversive US elicits a strike response inHermissenda when the animal is placed in forced contact with the cue and an active avoidance response when the animal can choose between that cue and a neutral cue.     

Second-order conditioning: Different outcomes in fear and eyelid conditioning

Second-order conditioning has been frequently observed with the fear response but not with the eyelid response. The present experiments manipulated the temporal relationship between the second-order and first-order stimulus on second-order conditioning trials. Our results indicated that a trace second-order procedure is not effective with either response system. Second-order fear conditioning was most prominent when the second-order CS terminated at the onset of the first-order CS. This arrangement, however, did not produce second-order eyelid CRs. In eyelid conditioning, the second-order CS appears to inhibit responding to the first-order CS which immediately follows it.     

Second-order conditioning of the rabbit’s nictitating membrane response as a function of the CS2-CS1 and CS1-US intervals

Three experiments investigated conditioning of the rabbit’s nictitating membrane response (NMR) in a second-order conditioning procedure which intermixed first-order trials (CS1-US) and second-order trials (CS2-CS1) from the outset of training. Experiment 1 provided a controlled demonstration that substantial levels of second-order conditioning can be obtained with the NMR preparation. Experiment 2 showed that the level of CR acquisition to CS2 was an inverse function of the CS2-CS1 interval over the values of 400, 800, and 2,400 msec. Experiment 3 found that CR acquisition to CS2 and CS1 in second-order conditioning varied in a parallel fashion across CS1-US intervals. Similarly, Experiment 3A found that the level of CR acquisition to the two components of a serial compound (CSA-CSB-US) varied in a parallel fashion as a function of the CSB-US interval. The results of the CS2-CS1 and CS1-US interval manipulations were all predictable from the known CS-US interval effects in NMR conditioning with a single CS. The present results are discussed with regard to their implications for accounts of serial compound conditioning and second-order conditioning.     

Second-order conditioning of the pigeon’s keypeck

Pigeons learned to peck a keylight (S2) when it was paired with a stimulus (S1) that already evoked keypecking. Control procedures showed that S2 acquired control over responding because it was paired with S1 and because S1 had a conditioning history, thereby supporting the claim that S2 was a second-order conditioned stimulus. Second-order conditioning occurred as rapidly when S1 was a keylight as when it was a tone. Test procedures showed that after second-order conditioning, responding to S2 was markedly debilitated by the extinction of responding to S1, indicating that the ability of S2 to evoke a response importantly depends upon the continued ability of S1 to do so. Our demonstration that directed motor action in the pigeon is susceptible to second-order conditioning suggests a new interpretation of conditioned reinforcement in instrumental learning. Our demonstration that the effectiveness of S2 depends upon the continued effectiveness of S1 indicates that S-S associations are formed in this version of the second-order conditioning experiment.     

Normalization between stimulus elements in a model of Pavlovian conditioning: Showjumping on an elemental horse

Harris and Livesey. Learning & Behavior, 38, 1-26, (2010) described an elemental model of associative learning that implements a simple learning rule that produces results equivalent to those proposed by Rescorla and Wagner (1972), and additionally modifies in "real time" the strength of the associative connections between elements. The novel feature of this model is that stimulus elements interact by suppressively normalizing one another's activation. Because of the normalization process, element activity is a nonlinear function of sensory input strength, and the shape of the function changes depending on the number and saliences of all stimuli that are present. The model can solve a range of complex discriminations and account for related empirical findings that have been taken as evidence for configural learning processes. Here we evaluate the model's performance against the host of conditioning phenomena that are outlined in the companion article, and we present a freely available computer program for use by other researchers to simulate the model's behavior in a variety of conditioning paradigms.     

The CS− effect in simple conditioning and stimulus selection during development

Changes in affect toward a particular stimulus can take place very rapidly through Pavlovian conditioning, if presentation of the conditioned stimulus (CS+) paired with the unconditioned stimulus (US) is accompanied by presentation of a “CS?,” another value of the same dimension as the CS+ but not paired with a US. This effect has considerable generality. It has been observed in terms of both olfactory and visual CSs, in terms of appetitive as well as aversive conditioning, and for adult as well as infant rats. The CS? effect has seemed especially important for infants, which may be related to the general tendency for infants to exhibit less stimulus selection than older animals. Finally, the CS? effect has enabled the development of a simple test of short-term retention that can quite effectively assess memory for either incidental or target events. These tests so far have indicated a clear ontogenetic decrease in rate of forgetting over short intervals, corresponding to the well-known development-related decrease in forgetting over long intervals (infantile amnesia). The tests also have shown that short-term forgetting of intentional and target events is surprisingly similar, with some indication of more rapid forgetting for the incidental events. Alternative interpretations of the CS? effect and some preliminary tests of these interpretations are discussed.     

Reward sequence and reinforcement level as determinants of S− behavior in differential conditioning

In two differential conditioning experiments, groups of 10 rats each differed with respect to average reward and schedule of reward received in S+. Nonreward (N) occurred on all S? trials. In both experiments, extinction of responding to S? (resistance to discrimination) was extensively regulated by reward sequence and was largely independent of average reward. In Experiment 1, resistance to discrimination was a function of transitions from N to rewarded (R) trials (N-R transitions). In Experiment 2, resistance to discrimination was increased by large reward on the R trial of N-R transitions and decreased by large reward on the R trial of R-N transitions. These schedule effects on resistance to discrimination parallel the effects of comparable schedules on resistance to extinction following partial reinforcement. The results are discussed in terms of sequential theory, reinforcement level theory, and their implications for various schedule manipulations that have previously shown S? behavior to be inversely related to average reward in S+.     

Food as a contextual cue in counterconditioning experiments: Is there a counterconditioning process?

In three experiments, counterconditioning was found to reduce fear less effectively than extinction. In Experiments 1 and 2, the resistance to extinction of avoidance was greater if food was given during extinction of fear to the CS than if no food was given, even when exposure to the CS and numbers of food and no food confinement trials were equated. It is suggested that these results could be attributed to contextual control of fear extinction by the food cue and/or to frustration produced by removing food for the counterconditioning group. Experiment 3 also found counterconditioning to be less effective than extinction and provided evidence that this difference occurs because of contextual control of fear extinction by the food cue. Measuring conditioned suppression of licking, in a test with no food present, less fear was shown if no food had been present during fear extinction, and greater fear was shown if no food had been present during fear conditioning. These results indicate that food is an important part of the context controlling fear and fear extinction. It is suggested that there may be no unique counterconditioning process. Rather, when counterconditioning procedures are employed, rules governing interference paradigms in general may apply. Thus, in a test for fear following counterconditioning, fear will be shown to the extent the test situation is similar to that in which fear conditioning occurred rather than that in which fear reduction occurred.     

Changes in stimulus salience as a result of stimulus preexposure: Evidence from aversive and appetitive testing procedures

In two experiments, rats received preexposure to three compound flavor stimuli, AX, BX, and CX, where X represents a saline solution. AX and BX were presented in alternation; CX, on a separate block of trials. The value of X was then modified, being devalued by aversive conditioning in Experiment 1, and rendered valuable by the induction of a state of salt need in Experiment 2. When given a choice between BX and CX, the rats consumed more of BX than of CX in Experiment 1, and more of CX than of BX in Experiment 2, suggesting that B and C differed in their ability to modulate the response governed by the X element. It was suggested that blocked preexposure to CX reduces the salience of the C stimulus but that the salience of B is maintained by preexposure in which BX is alternated with AX. The implications of this result for the phenomenon of perceptual learning are discussed.     

Discriminative stimulus control in instrumental electrodermal conditioning in the monkey (Cebus albifrons)

FourCebus albifrons monkeys received 24 sessions of multiple avoidance-punishment conditioning of the skin conductance response (SCR) with no discriminative stimuli, followed by 24 additional sessions with visual discriminative stimuli identifying the avoidance and punishment components. Four other monkeys that had previously been conditioned with the discriminative stimuli were given 24 additional sessions without them. Yoked controls were run with this group and received the electric shock noncontingently. The presence of the discriminative stimuli clearly facilitated acquisition and maintenance of higher SCR frequencies in avoidance as compared with punishment. Acquisition was retarded with the stimuli absent, and higher overall response levels resulted. Adding the stimuli improved differentiation and resulted in lower overall rates. Removing the stimuli likewise resulted in higher response frequency. When the stimuli were absent initially, higher shock frequencies were administered, and when they were removed, shock frequency increased. The yoked controls increased in response frequency but did not differentiate between the avoidance and punishment conditions. Overall, the presence of the stimuli appeared to facilitate differentiation and reduce trauma, as compared with when they were absent.     

Evaluating conditioning of related and unrelated stimuli using a compound test

Three experiments used a compound test procedure to evaluate whether superior conditioning results from the pairing of stimuli that are related to each other. In each case, a stimulus compound was tested after its component conditioned stimuli (CSs) had been conditioned by the same unconditioned stimuli (USs) arranged such that either related or unrelated CSs and USs were paired. Experiment 1 explored auditory and gustatory stimuli conditioned by LiCl or shock, using rats. Experiments 2 and 3 used second-order conditioning in pigeons to pair stimuli that were similar by virtue either of qualitative features or of shared physical location. In each case, the compound test provided clear evidence that pairing related stimuli produces superior associative learning.     

Resistance to discrimination and subsequent resistance to extinction as a function of the sequence of partial S+ reward in differential conditioning

The effects of transitions from nonrewarded (N) to rewarded (R) trials (N-R transitions) on discriminative behavior in differential conditioning and subsequent resistance to extinction were investigated in two experiments. In Experiment 1, groups given N-R transitions within S+ were more resistant to discrimination (ran fast in S?) and extinction than were groups given a partial reinforcement (PRF) schedule in S+ devoid of N-R transitions. Experiment 2 indicated that N-R transitions that occur when an N trial in S? is followed by an R trial in S+ are as effective in increasing resistance to discrimination, but not resistance to extinction, as are N-R transitions that occur within S+. The sequential effects obtained here were highly similar to those in conventional PRF and support the view that differential conditioning and PRF are highly interrelated phenomena. The results are discussed in terms of the extension of sequential theory to differential conditioning and the importance of internal reward-produced cues in discrimination learning.     

Differential generalization of habituation across contexts as a function of stimulus significance

Orienting to one of two levels of stimulus significance (a distress squeal or a simulated mimic squeal) in female hooded rats was measured by suppression of ongoing drinking. Subsequent generalization tests with the same stimulus presented in different contexts showed that generalization of habituation across contexts was a function of stimulus significance: Habituation to the distress squeal was restricted to the context in which it first had been presented, whereas habituation to the mimic squeal generalized across the different contexts.     

Independent effects of stimulus and cycle duration in conditioning: The role of timing processes

Rats received delay conditioning procedures with a white-noise conditioned stimulus (CS), a food unconditioned stimulus (US), and head entries into the food cup as the conditioned response. The stimulus duration (S) and the interval between food deliveries (C) were varied between groups:S=15, 30, 60, and 120 sec;C=90, 180, and 360 sec. The stimulus/cycle duration ratio was negatively related to the asymptotic level of conditioning but had no effect on the rate of acquisition. Conditioning and timing of responses emerged together in training. Timing occurred during the CS-US interval (ISI) and the US-US interval (ITI), as evidenced by increasing response rate gradients that were steeper for shorter intervals. The effects of the stimulus/cycle ratio on conditioning were attributed to independent timing of theS andC durations. Serial-, parallel-, and single-process accounts of conditioning and timing are compared.     

Blocking in eyelid conditioning: Effect of changing the CS-US interval and introducing an intertriai stimulus

Kamin’s three-stage blocking paradigm was investigated in rabbit eyelid conditioning, Two manipulations were examined. A change in the CS-US interval from Stage 1 to Stage 2 did not attenuate blocking. The introduction of a salient stimulus during the intertriai interval in Stage 2 also failed to attenuate blocking. The first result is not consistent with Kamin’s interpretation of the blocking effect in terms of US surprisingness. The second resuit is inconsistent with a prediction based on the Rescorla-Wagner model.     

Differential acquisition of discriminated autoshaping as a function of stimulus qualities and locations

In each of two experiments, different groups of pigeons were required to discriminate between one of two basic kinds of stimulus differences: stimulus quality or stimulus location. For stimulus-quality groups, a key was illuminated by one of two colors on trials ending with food delivery and by the other color on trials ending with no food. For stimulus-location groups, a key was illuminated at one of two locations on trials ending with food delivery and at the other location on trials ending with no food. The birds began to respond differentially to the stimuli (i.e., peck the keys on food trials and not peck the keys on no-food trials) earlier in acquisiton if the stimulus qualities served as the signals for trial outcomes than if the stimulus locations served as those signals. The results from both experiments are consistent with predictions from a hypothesis regarding interactions among the qualities and locations of stimuli and responses (the “quality-location hypothesis”). Furthermore, the present results support other recent demonstrations of the important role that spatial relations among stimuli can play in classical conditioning.     

一类二阶线性微分方程的解

给出一类二阶线性微分方程的解