The effect of noncontingent outcomes on extinction of the response-outcome association

The effect of noncontingent outcomes on an instrumental response-outcome (R-O) association was examined in four experiments using transfer tests. In each experiment, rats were first given instrumental discrimination training designed to establish different stimuli as signals (S+s) for different outcomes. Transfer responses were subjected to different treatments across the experiments and then tested with the S+s. In Experiments 1 and 2, two transfer responses were both initially trained with two contingent outcomes. Then, each transfer response was subjected either to the addition of noncontingent presentations of one of those outcomes (Experiment 1) or to the replacement of one of the contingent outcomes with noncontingent presentations of that outcome (Experiment 2). Transfer tests revealed no significant difference in the ability of an S+ to promote performance of a transfer response based on their shared association with either the contingent or the noncontingent outcome. These results suggest that a response reinforced with two outcomes remains equally well associated with both of those outcomes despite prolonged exposure to noncontingent presentations of one of those outcomes. In Experiments 3 and 4, the possibility that the noncontingent schedules of reinforcement used in Experiments 1 and 2 might be capable of establishing an association between a response and its noncontingent outcome was examined. Transfer responses were trained with one contingent outcome and a different noncontingent outcome. Performance of these transfer responses was augmented more by presentations of an S+ trained with the contingent outcome than with the noncontingent outcome. These results confirm previous reports that instrumental responses are sensitive to outcome contingencies in acquisition and that noncontingent outcome presentations do not weaken previously established R-O associations. Several explanations are considered for the failure of subsequent noncontingent presentations of an outcome to reduce the strength of its association with the instrumental response.     

Specificity of cue to consequence in aversion learning in the rat: Control for US-induced differential orientations

In four experiments, each using a single conditioning trial, rats avoided a light more than a saccharin solution after these stimuli had been paired with footshock, whereas saccharin was avoided more than the light after these stimuli had been paired with lithium injection. The use of a single conditioning trial precludes possible US-induced differential orientations from influencing which stimuli will be associated on the conditioning trial. This cue-consequence specificity effect was obtained even when subjects conditioned with lithium received a non-contingent footshock prior to the test session, and when subjects conditioned with footshock received a noncontingent lithium injection before testing (Experiments 2–4). Weak aversions to the light in rats given a light-lithium pairing and noncontingent footshock and to the saccharin in subjects that received a saccharin-footshock pairing and noncontingent lithium administration were obtained in Experiment 2. However, these weak aversions were not obtained when subjects were given three nonreinforced exposures to the test chamber before the test session (Experiments 3 and 4). These results indicate that US-induced differential orientations do not mediate the cue-consequence effect in aversion learning.     

Tests of two explanations of response elimination by noncontingent reinforcement

Two experiments are reported on the elimination of autoshaped keypecking in pigeons by introducing added feedings that have the effect of removing the contingency between keylight (CS) and feedings. In Experiment 1, added feedings were signaled, by an already conditioned stimulus, in one group but not in another. Contrary to the Rescorla-Wagner theory, but consistent with scalar expectancy theory, responding in these groups declined at equal rates. In Experiment 2, following acquisition, some groups were exposed to repeated sessions in which they received feedings alone prior to receiving both CS and feedings noncontingently. Although prior exposure to feedings did reduce the total amount of responding in subsequent noncontingent sessions, it did not, contrary to scalar expectancy theory, reduce the initial level of responding to the CS. It is suggested that a differential between reinforcing conditions in the CS as compared with neighboring non-CS periods is more fundamental to conditioning than is acknowledged in the Rescorla-Wagner theory or in scalar expectancy theory.     

Contextual conditioning during free-operant extinction: Unsignaled,signaled, and backward-signaled noncontingent food

Three experiments were designed to study the effects of contextual conditioning on the extinction of instrumental leverpressing that had been reinforced on a random-interval schedule. In Experiment 1, noncontingent food retarded extinction, but signaling food delivery, a treatment that should reduce contextual conditioning, reduced the interference. Experiment 2 replicated the results of Experiment 1 and demonstrated that if the food preceded rather than followed the signal, the retardation of extinction was not reduced but was enhanced. In Experiment 3, non-contingent leverpressing was used to directly verify that the three treatments—forward signaling, noncontingent food, and backward signaling—differentially influenced contextual conditioning. Forward signaling produced the least, and backward signaling produced the most, contextual conditioning. This monotonic relationship between contextual conditioning and interference with extinction was used as evidence to support the argument that context-food associations are important in controlling instrumental responding.     

Context effects on conditioning,extinction, and reinstatement in an appetitive conditioning preparation

Three experiments with rat subjects examined the effects of contextual stimuli on performance in appetitive conditioning. A 10-sec tone conditioned stimulus (CS) was paired with a food-pellet unconditioned stimulus (US); conditioning was indexed by the observation of headjerking, a response of the rat to auditory stimuli associated with food. In Experiment 1, a context switch following initial conditioning did not affect conditioned responding to the tone; however, when the response was extinguished in the different context, a return to the original conditioning context “renewed” extinguished responding. These results were replicated in Experiments 2 and 3 after equating exposure to the two contexts (Experiment 2) and massing the conditioning and extinction trials (Experiment 3). The results of Experiment 1 also demonstrated that separate exposure to the US following extinction reinstates extinguished responding to the tone; this effect was further shown to depend at least partly on presenting the US in the context in which testing is to occur (Experiments 2 and 3). Overall, the results are consistent with previous data from aversive conditioning procedures. In either appetitive or aversive conditioning, the context may be especially important in affecting performance after extinction.     

The influence of the information value provided by prior-cuing treatment on the reactivation of memory in preweanling rats

In two experiments, the influence of exposure to a CS? on the acquisition and retention of a conditioned odor aversion was examined. Preweanling rats were given exposure to the CS? either prior to (CS?/CS+) or following (CS + /CS?) the pairing of a second odor (the CS+) with footshock. The results of Experiment 1 indicated that subjects in both of the treatment conditions acquired aversions of comparable strength to the odor paired with footshock and that retention of the odor aversion was not affected by order of stimulus presentation during conditioning. Experiment 2 indicated, however, that the effectiveness of pretest exposure to various elements of the conditioning episode in reactivation of the memory for conditioningwas dependent on the order of stimulus presentation during conditioning. This differential effectiveness of the various reactivation treatments is discussed in terms of their relationship to the associative “status” of the stimuli present during conditioning and in terms of the information provided to the animal by the reactivation treatment.     

The Organization of Reactivated Memory in Infancy

The specificity of memory retrieval by 3-month-old infants was examined in 3 experiments. All infants were trained in the mobile conjugate reinforcement paradigm to kick their feet to produce movement in an overhead crib mobile and were tested 2 weeks later. 24 hours prior to the test, subjects received a 3-min reminder treatment. The results of Experiment 1 demonstrated that only the moving training mobile alleviated forgetting after the 2-week retention interval; forgetting was not alleviated by exposure to the stationary training mobile or to the mobile stands and ribbon alone. The results of Experiments 2 and 3 demonstrated that, once retrieved, the reactivated memory was highly specific to the conditions of original training. Furthermore, the memory attributes that were the last to be forgotten (e.g., the general or global features) were the first to be retrieved following the reminder treatment. Conversely, those memory attributes that were forgotten first (e.g., the specific or local details) were the last to be retrieved. These findings have important implications for infant memory retrieval, reminiscence, and infantile amnesia.     

Overshadowing and associability change: Examining the contribution of differential stimulus exposure

In two appetitive conditioning experiments with rats, we investigated the mechanisms responsible for demonstrations of the superior associability of overshadowed conditioned stimuli (CSs) relative to control CSs. In Experiment 1, we investigated whether previous demonstrations were a consequence of differences in the relationship between the CSs and the unconditioned stimulus (US) or of differences in the conditions of exposure to the CSs. Rats received trials with X, Y, and an AB compound, but no delivery of the US (X–, Y–, AB–). A subsequent AY–, AX+, BY + test discrimination revealed that the AY/BY component of the discrimination was solved more readily than the AY/AX component—suggesting the contribution of an exposure effect. In Experiment 2, we better equated the conditions of exposure between A and Y by using AB+, XY+, X– training in Stage 1. In Stage 2, instrumental responses were rewarded during an AY compound. A final test revealed that Y took better control of instrumental responding than did A. The results of these experiments are discussed in terms of classical and contemporary theories of learning and attention.     

Understanding Category Members as "the Same Sort of Thing": Explicit Categorization in Ten-Month Infants

Although it is often acknowledged that classification exists in the first year of life, it has been suggested that infants are capable only of implicit categorization, recognizing that something is or is not familiar. In contrast, older children are thought to compare the stimuli or objects they categorize and to explicitly equate different category members. 2 habituation experiments were conducted in an attempt to determine whether 10-month-old infants are capable of explicit categorization. The approach taken was to insert nonmembers into the familiarization sequence in a categorization task. The nonmembers were designed so as to have a predictable effect on infants' performance whether or not these stimuli were included as infants processed the categorical information. The results suggest that infants do explicitly equate category members. Infants appeared to disregard the nonmembers in the familiarization sequence, basing their categorization response instead on the set of instances that were "the same sort of thing."     

Positive and negative patterning in human classical skin conductance response conditioning

Three experiments on classical differential conditioning of the human skin conductance response to elemental and compound stimuli are reported. Subjects in Experiment 1 received both positive and negative patterning training, followed by either positive or negative patterning transfer tests on new stimuli. In positive patterning, a compound of two stimuli is reinforced and its elements are nonreinforced. In negative patterning, the elements are reinforced and the compound is nonreinforced. Subjects in Experiments 2 and 3 received either positive or negative patterning during training, followed by transfer tests on new stimuli. In Experiment 2, the transfer series began with new elements, after which their compound was presented; in Experiment 3, the new compound was presented first in the transfer series, and then the separate elements were administered. All three experiments provided evidence of the acquisition of positive patterning, while negative patterning was found only in Experiments 2 and 3. Positive patterning transferred to new stimuli, indicating that it was not attributable solely to summation of sub-threshold excitation conditioned to the elements on reinforced compound trials. This finding, coupled with the negative patterning found in Experiments 2 and 3, provided support for the unique cue hypothesis. It was concluded that the assumed unique cue constituted a learned “rule,” and that the actual elemental stimuli were neither perceptually nor otherwise modified during the conditioning process.     

Social contingency effects on subsequent perceptual-cognitive tasks in young infants

3 experiments with 3-month-old infants compared the effects of contingent and noncontingent adult-infant social interactions on subsequent infant-controlled habituation and choice tasks. Infants who experienced a prior noncontingent social interaction tended to adopt response strategies that reduced the density of stimulation during these subsequent nonsocial tasks. The results are discussed in terms of their generality and the types of mechanisms that might mediate these transfer effects from social to nonsocial procedures.     

Generality of US preexposure effects: Transfer from food to shock or shock to food with and without the same response requirements

A series of four experiments, employing mice, investigated the generality of the learned helplessness phenomenon. The first two experiments used preexposure to aversive stimuli (shock), while the other two used preexposure to appetitive stimuli (food). In all of the studies, subjects were preexposed to contingent, noncontingent, or no stimuli (except for Experiment 2) in a Skinner box. During the test, animals preexposed to shock were tested with food, and those preexposed to food were tested with shock. The test was conducted in a similar situation, a Skinner box (Experiments 1, 3), or a different situation—a runway (Experiments 2, 4). Performance decrements were evident when subjects that were preexposed to a noncontingent stimulus were compared with subjects preexposed to contingent stimuli. The differences between the contingent and the noncontingent groups were significant, as were the differences between the contingent and the nonpreexposed groups (except for Experiment 1). The effects cut across the different types of stimuli, situations, and response requirements of the preexposure and test phases.     

Contextual Constraints on Memory Retrieval at Six Months

In 3 experiments, 6-month-old infants learned to move a mobile by kicking and were tested 1 to 21 days later for retention of the newly acquired memory as a function of the training and testing contexts. In Experiment 1, decreasing the relative distinctiveness of the training and testing context did not impair retrieval of the newly acquired memory. In Experiment 2, however, testing in a different context completely eliminated retention after delays of 1 and 3 days, when retention was otherwise perfect; after progressively longer delays, retention improved paradoxically. The familiarity or novelty of the test context was not a factor in the failure of infants to recognize the mobile in the altered context after 1 day. In Experiment 3, the effect of an altered context was assessed in a reactivation paradigm. After the training memory was forgotten, infants were presented with the original mobile as a reminder and were tested for retention of the training memory 1 day later. When either the reminding context or the testing context was different, they exhibited no retention. These findings reveal that memory retrieval at 6 months is highly specific to the setting in which the memory is acquired. We propose that infants learn what specific events are associated with what specific places prior to the age when they can locomote independently and acquire a spatiotemporal map of the relations between those places.     

Habituation to illness: Effects of prior experience with the US on the formation of learned taste aversions in rats

Experiment 1 investigated the effects of US habituation on the acquisition and extinction of learned taste aversions in rats. Subjects receiving five noncontingent LiCl intubations prior to conditioning failed to develop a conditioned taste aversion, while control subjects experiencing a single saccharin/LiCl pairing displayed a pronounced taste aversion which weakened during subsequent poisonings. Experiment 2 examined whether habituation, defined as a waning of responses to repeated presentation of an illness stimulus, was a possible mechanism for explaining the results of Experiment 1. Subjects showed a decrease in motor activity following an initial LiCl intubation, but less attenuation of activity with successive intubations.     

The effect of mindfulness on extinction and behavioral resurgence

In the present experiments, we investigated the effects of mindfulness on behavioral extinction and resurgence. Participants received instrumental training; either they received FI training (Experiment 1), or they were trained to emit high rates and low rates of response via exposure to a multiple VR yoked-VI schedule prior to exposure to a multiple FI FI schedule in order to alter their rates of responding learned during Experiment 2. Participants were then exposed to either a focused- (mindfulness) or an unfocused-attention induction task. All participants were finally exposed to an extinction schedule in order to determine whether a mindfulness induction task presented immediately prior to extinction training affected extinction (Experiment 1) and behavioral resurgence (Experiment 2). During the extinction phase, the rates of responding were higher in the control group than in the mindfulness group, indicating that the mindfulness group was more sensitive to the contingencies and, thus, their prior performance extinguished more readily (Experiment 1). Moreover, rates of response in the extinction components less precisely reflected previous training in the mindfulness group, suggesting less resurgence of past behaviors after the mindfulness induction (Experiment 2).     

Some determinants of response summation

Response summation in pigeons was examined in four experiments. In Experiment 1, summation was not found with a compound of two visual stimuli on a television screen after they had individually been used for instrumental conditioning. In this experiment, the training and test trials were separated by an interval during which the television screen was dark. Summation was found in Experiment 2 for which the television screen was permanently white during the interval between trials and in the region that was not occupied by the experimental stimuli. These results were replicated using a within-subject design (Experiment 3) and autoshaping (Experiment 4). Experiment 2 also revealed summation with compounds of auditory and visual stimuli, but not with compounds of two auditory stimuli or two diffuse lights. The results can be explained by a variety of theories of learning, if they take account of generalization between the stimuli.     

Changes in inhibition during differential eyeblink conditioning with increased training

Three experiments examined inhibitory learning in rats, using Pavlovian and differential inhibitory eyeblink conditioning procedures. Experiment 1 was designed to compare summation and retardation effects following Pavlovian conditioned inhibition (A1/XA) or differential inhibition (A1/X) training using auditory and visual conditioned stimuli (CSs). After ten 100-trial sessions of training, both Pavlovian conditioned inhibition and differential inhibition produced a retardation effect. However, a summation effect was obtained only for rats given Pavlovian conditioned inhibition training. Experiment 2 showed that increasing differential inhibition training to twenty 100-trial sessions produced summation and retardation effects. In Experiment 3, rats were trained with either ten or twenty 100-trial sessions of intramodal inhibitory training with two tone CSs (2 kHz vs. 8 kHz). Summation and retardation effects were obtained after only 20 sessions of differential conditioning. The findings indicate that extensive training is needed to establish conditioned inhibition with intermodal or intramodal differential conditioning.     

Contextual control of first- and second-learned excitation and inhibition in equally ambiguous stimuli

In two three-phase experiments, rats received a final third excitatory (Experiment 1) or inhibitory (Experiment 2) phase of conditioning with a tone. The third phase came immediately prior to a test with the tone, either in the context where the tone was trained or in a different context. Groups differed in each experiment with respect to the first two phases. Rats in Groups EIE (Experiment 1) and EII (Experiment 2) received excitatory conditioning with the tone in Phase 1, followed by inhibitory conditioning with the tone. Rats in Groups IEE (Experiment 1) and IEI (Experiment 2) received inhibitory conditioning in Phase 1, followed by excitatory conditioning in Phase 2. Thus, the association being expressed in Phase 3 was consistent either with what was learned first about the stimuli or with what was learned second. Contrary to expectations, the association being expressed at the end of Phase 3, either excitatory or inhibitory, was affected by a context change, regardless of its consistency with what was learned first about the CS.     

Flavor evaluative conditioning and contingency awareness

The relationship between flavor evaluative conditioning and contingency awareness was examined in two experiments using flavored drinks. In Experiment 1, one flavor was always paired with sugar and the other with bitter tween (polysorbate20) during conditioning. In a subsequent test phase, participants tasted the two flavors, and their evaluative ratings indicated an overall preference for the sugar-paired flavor. Moreover, participants were generally able to report which flavor had been paired with sugar and which with tween. This finding was replicated and confirmed in Experiment 2A. Furthermore, in both experiments, evaluative conditioning was seen only in those participants who were aware of the contingencies. Experiment 2B demonstrated that evaluative conditioning does not occur to colors, although participants are contingency aware. The differences between the present findings and prior studies, in which apparently unaware flavor conditioning has been found, are discussed.     

Developmental changes in endogenous control of attention: the role of target familiarity on infants' distraction latency

This study evaluated the interactive effects of endogenous and exogenous influences on infants' attention allocation by assessing the role of target familiarity on distraction latency during object exploration. In Experiment 1 (N = 54), infants' distraction latencies as they investigated both familiar toys (ones they previously had seen in a familiarization procedure) and novel toys (ones they had not seen in the familiarization procedure) were assessed longitudinally at 6.5 and 9 months of age. In Experiment 2 (N = 32), infants' distraction latencies were assessed at either 6.5 or 10 months as they investigated either familiar or novel targets. In both experiments, older infants, but not younger infants, exhibited longer latencies as they investigated novel toys as compared with their latencies as they investigated familiar toys. These results are discussed in terms of developmental changes in the interactive effects of endogenous and exogenous factors controlling attention allocation.