Feature-negative effect in rats’ discrimination learning in the runway

In two experiments, rats were trained on a successive go/no-go discrimination problem in the runway in which the positive (S+) and negative (S?) discriminanda were differentiated by the presence or absence of a distinctive feature. The feature in Experiment 1 was a series of flashing lights over the runway. In Experiment 2, the feature was a pretrial reinforcement (Phase 1), or pretrial reinforcement versus pretrial nonreinforcement (Phase 2). The feature signaled S+ trials in feature-positive (FP) groups and S? trials in feature-negative (FN) groups. The original discrimination was reversed in Phase 2 of both experiments. With the exception of the pretrial nonreinforcement groups in Experiment 2, there was an asymmetry in discrimination learning in both phases of both experiments favoring superior discrimination learning by FN subjects over FP subjects, a feature-negative effect. Implications of the results for an information processing account of asymmetries in learning feature discriminations are discussed.     

The ontogeny of the feature-positive effect in young chicks

The wide generality of the feature-positive effect (FPE) has caused speculation that the FPE may represent innate biases in the stimulus control of discriminative responding. There is little experimental evidence to date ragarding this possibility. In the present study, 1- or 4-day-old chicks were trained on a feature-positive (FP) or feature-negative (FN) discrimination with heat reinforcement. After the acquisition phase, these subjects received extinction training followed by a reacquisition phase. The FP performance was superior to the FN performance in both age groups. Extinction resulted in improved discrimination performance in both the FP and FN conditions. Unmasking of FN learning by the extinction treatment suggests that the FPE represents a deficit in performance, rather than an inability to learn the FN task. These data demonstrate that adult-like performance on feature discriminations is evident as early as the first day post-hatch.     

Feature-positive and feature-negative discrimination learning maintained by negative reinforcement in rhesus monkeys

Rhesus monkeys were trained to press panels to escape or avoid shock. Escape and avoidance training were combined factorially with feature-positive (FP) and feature-negative (FN) discriminations. In the FP situation, S+ trials were characterized by one red and two green panel displays and S? consisted of an all green panel array. In the FN arrangement, S+ and S? arrays were reversed. When compared properly, FP discriminations were learned more readily than FN discriminations in both escape and avoidance training conditions. Positive tracking was associated with FP discriminations, and feature avoidance characterized the FN tasks. These data suggest that in primates, feature responses (i.e., tracking behaviors) are more a function of the operant contingency than of the Pavlovian correlation.     

Conditioned inhibition in feature negative discrimination learning with pigeons

Discrimination performance was investigated with pigeons using feature negative (FN) discrimination procedures which differed in the temporal arrangement of the stimuli on S? trials. In both procedures, a single common element was presented on reinforced (S+) trials. In thesimultaneous FN procedure, a distinguishing element was presented simultaneously with the common element of S? trials. In thesequential FN procedure, the distinguishing element preceded onset of the common element on S? trials. In two experiments, the sequential FN procedure yielded better discrimination performance. In Experiment 1, a summation test designed to separate learning and performance variables indicated that sequential FN subjects had learned the negative relationship between the distinguishing element and reinforcement while simultaneous FN subjects had not. In Experiment 2, summation and acquisition tests indicated that the distinguishing element developed inhibitory properties in the sequential FN procedure but not in the simultaneous FN procedure.     

Two-choice,observational learning and reversal in the rat: S-S versus S-R effects

In Experiment 1, male rats were trained to press both bars in a two-choice apparatus and were then given observational training of a go/no-go discrimination in which the observed operation of two inaccessible, dissimilar bars by a hidden experimenter constituted S+ and S?. After discrimination was established, individual rats were permitted access to the two bars. Six of the seven rats consistently pressed the S+ bar on 10 test trials, but failed to reverse bar preference after observational training was reversed. In Experiment 2, nine naive males received the same observational training as in Experiment 1, but without any pretraining to press either bar. All rats pressed the S+ bar on initial test and did so consistently throughout the 10 trials. Six of these rats received reversal training of the go/no-go discrimination after the 10 test trials. As in Experiment 1, all rats failed to press the new S+ bar. However, five of six rats in another group, which received reversal trainingprior to any test trials, did reverse and press the new S+ bar. In Experiment 3, controls for possible confounding effects of overtraining trials were conducted. These manipulations had no effect; the rats tested before reversal still failed to press the S+ bar, and the rats reversed before testing all reversed or pressed the most recent S+ bar. That is, S-R learning predominated over S-S learning if active, though unreinforced, responding to a particular bar intervened. In contrast, however, a cognitive (S-S) interpretation of directed response learning was supported by the results of Experiment 4, in which the rats that learned the go/no-go discrimination without responding (only by auditory and light cues) failed to press the S+ bar consistently.     

Effects of stimulus alternations on extinguishing a discrimination

Rats were trained in a light ON vs light OFF discrimination in operant chambers with food reinforcement. Following acquisition, extinction under conditions of no alternations between S+ and S? and under conditions of numerous alternations between S+ and S? were examined. In Experiment I, extinction in S+ or S? alone produced less responding to S+ and more responding to S? than extinction with regular alternations between S+ and S?. In Experiment II, 9, 39, or 79 alternations in extinction between S+ and S? produced no differences in responding. These results indicate that during extinction of a discrimination there is (a) sharpening of differential performance, (b) a difference between multiple- and single-stimulus procedures, and (c) little effect of different numbers of alternations.     

Effect of N-R transitions during partial reinforcement pretraining on subsequent resistance to discrimination

Three groups of 12 rats received 25 pretraining trials to each future discriminandum employed in a subsequent differential brightness conditioning problem. Groups NR and RN received partial reinforcement (PRF) pretraining either with or without, respectively, transitions from nonrewarded to rewarded trials (N-R transitions). Group CRF received consistent reinforcement during pretraining. A fourth group (n=12), Group NP, received no pretraining. During discrimination learning, one-half of the rats in each group received all their daily S+ trials preceding their daily S? trials (+? sequence); the remainder of the rats received an intermixed sequence of trials to S+ and S? (+?+ sequence). Discrimination learning was faster under the +? sequence than under the +?+ condition, and discrimination learning was retarded in Group NR relative to the other three groups, which did not differ from one another, under both the +? and +?+ discrimination sequence conditions. The results are discussed with Reference to previous experiments demonstrating N-R transition effects on discrimination learning, a theoretical extension of sequential theory to discrimination learning, and the effects of nondifferential reinforcement prior to discrimination learning on learned irrelevance.     

Reward sequence and reinforcement level as determinants of S− behavior in differential conditioning

In two differential conditioning experiments, groups of 10 rats each differed with respect to average reward and schedule of reward received in S+. Nonreward (N) occurred on all S? trials. In both experiments, extinction of responding to S? (resistance to discrimination) was extensively regulated by reward sequence and was largely independent of average reward. In Experiment 1, resistance to discrimination was a function of transitions from N to rewarded (R) trials (N-R transitions). In Experiment 2, resistance to discrimination was increased by large reward on the R trial of N-R transitions and decreased by large reward on the R trial of R-N transitions. These schedule effects on resistance to discrimination parallel the effects of comparable schedules on resistance to extinction following partial reinforcement. The results are discussed in terms of sequential theory, reinforcement level theory, and their implications for various schedule manipulations that have previously shown S? behavior to be inversely related to average reward in S+.     

Within-event learning contributes to value transfer in simultaneous instrumental discriminations by pigeons

Following simultaneous discrimination training with pigeons, in which responding to the S−was reinforced on half of the trials and responding to the S− was never reinforced, we examined the effect on the S− of presenting the S− by itself and the effect on the S+ of presenting the S− by itself (relative to an S− or an S− for which there had been no single-stimulus presentations). For Group A−, responding to the S− presented by itself was always reinforced, whereas for Group A−, such responding was extinguished. For Group B−, responding to the S− presented by itself was always reinforced, whereas for Group B+, responding was extinguished. Although both Group A+ and Group A−tended to avoid their associated S− (relative to a control S−), Group A+ avoided its associated S− less than did Group A−. In contrast, although for Group B−, presentation of the S− alone increased the pigeons’ preference for its associated S−(relative to a control S+), for Group B−, presentation of the S−alone had little effect on its preference for its associated S+. These results suggest that presentation of one stimulus from a simultaneous discrimination has two independent and sometimes opposite effects on the other discriminative stimulus. First, it reduces the strength of within-event conditioning between the S+ and the S−, and second, if the value of the singly presented stimulus has increased, some of its newly acquired value will transfer retroactively to the stimulus with which it was originally paired.     

Numerical discrimination by rats using sequential auditory stimuli

Three rats were trained under a discrimination procedure in which responding was reinforced only following the repeated presentation of three bursts of white noise (S+). S? consisted of presentations of either two or four bursts of noise. All animals responded significantly more in the presence of S+ and, in two cases, showed lower response rates to both “2” and “4” stimuli. Responding by the third animal revealed differentiation between S+ and the stimulus “2,” but no reliable suppression to stimulus “4.” The present instances of discriminative control by the stimulus “3” replicate Fernandes and Church’s (1982) demonstration of control by sequential auditory stimuli in the rat. Moreover, because the present procedure involves adjacent S? values both greater as well as less than S+, these results extend our knowledge of the rat’s abilities with sequential auditory stimuli: Rats are capable of making intermediate numerical discriminations based upon something other than a simple many-versus-few dichotomy.     

Processing of complex auditory stimuli (tunes) by rats and monkeys (Cebus apella)

The degree to which rats and monkeys base their discriminations of complex auditory stimuli (“tunes”) on frequency contours rather than on local features was investigated. In Experiment 1, groups of rats and monkeys trained with tunes as S+ and S? acquired a simple operant discrimination no faster than groups that received the same notes of each tune but in a new random order on each trial; neither did the groups differ on two transfer tests devised to detect learning of frequency contour in the tune-trained animals. Acquisition in the tune-trained and random-notes groups seemed to be based on the overall frequency difference between S+ and S?, which was about 1.5 octaves. In Experiment 2, S+ and S? were similar to each other with regard to overall frequency and individual notes, the most salient differentiating characteristic of the tunes being their tonal pattern. The tune-trained groups were clearly superior to the random-notes animals in acquisition, and an initial transfer test suggested that the former might have learned the discrimination on the basis of frequency contour. However, the detailed transfer tests of Experiment 3 strongly suggested that the tune-trained rats and monkeys based their discriminations primarily on local cues rather than on frequency contour. Based on the results of Experiment 4, the data of an earlier study that suggested frequency contour learning in monkeys and rats were reinterpreted in terms of control by local cues.     

Effects of postconditioning inflation on odor + taste compound conditioning

The within-compound association approach has been proposed as an account of synergistic conditioning in flavor aversion learning. One prediction from the within-compound association approach is that following taste + odor compound conditioning, postconditioning inflation of one element of the compound should increase responding to the second element. In four experiments with rats, the AX+/A+ design was used to determine whether postconditioning inflation of A would increase responding to X. In Experiments 1 and 3, responding to X was significantly stronger after AX+/A+ conditioning, as compared with AX+ conditioning. In Experiments 2 and 4, the specificity of the inflation effect was demonstrated, because AX+/A+ conditioning produced a stronger aversion to X than did AX+/B+ conditioning. Furthermore, it appears that the taste + odor association is symmetrical because inflation of the taste aversion increased responding to the odor (Experiments 1 and 2) and inflation of the odor aversion increased responding to the taste (Experiments 3 and 4).     

Representations of single and compound stimuli in negative and positive patterning

In four experiments, rats were trained on different patterning discriminations before being tested with compounds composed of novel combinations of the trained stimuli. In Experiment 1, rats were trained on a negative-patterning schedule (A+ B+ AB-) intermixed with reinforced presentations of a second compound (CD+). On a subsequent test, the rats responded more to two novel compounds, AC and BD, than to A and B, but less than to CD. In Experiment 2, rats were trained on two concurrent negative-patterning discriminations (A+ B+ AB-, C+ D+ CD-). On test, they responded more to AC and BD than to AB and CD, but less than to the single stimuli. In Experiment 3, rats were trained on two concurrent positive-patterning discriminations (A-B- AB+, C- D- CD+). On test, their response rates to AC and BD were not different from the response rates to the trained compounds (AB and CD). Finally, in Experiment 4, rats were trained on a positive- and negative-patterning discrimination concurrently. Once again, on test, response rates to AC and BD were not different from responding on reinforced trials of the trained discriminations (A+, B+, and CD+). We discuss the implications of these findings for elemental and configural models of stimulus representation.     

Spatiotemporal characteristics of serial CSs and their relation to search modes and response form

In four experiments, we examined how the spatiotemporal proximity to food of the two elements of a serial conditioned stimulus (CS) influenced the pattern of CS-directed versus food-site-directed behavior in rats. Experiment 1 showed that only temporal proximity affected responding when the serial CS consisted of two successive 4-sec presentations of either a spatially near or a spatially far lever (NN or FF). However, Experiment 2 showed that behavior depended markedly on whether rats received a near followed by a far lever (NF) or a far followed by a near lever (FN). Experiment 3 showed that the effects of Experiment 2 could be changed by increasing the duration of the second CS element, and Experiment 4 showed that these changes were not related to previous training. We concluded that behavior produced by the spatiotemporal qualities of the lever elements can be attributed to a mapping between the temporal qualities of the CS elements and an underlying sequence of search modes related to finding food.     

Additive summation by stimulus compounding irrespective of behavioral contrast during discrimination training: An investigation with positive reinforcement and avoidance schedules

The similarity in the discrimination training leading to behavioral contrast and that preceding tests producing response enhancement to combined discriminative stimuli suggested that the two phenomena might be related. This was investigated by determining if contrast indiscrimination training was necessary for this outcome of stimulus compounding. Responding to tone, light, and to the simultaneous absence of tone and light (T + L) was maintained during baseline training by food reinforcement in Experiment I and by shock avoidance in Experiment II. During subsequent discrimination training, responding was reduced in T + L by programming nonreinforcement in Experiment I and safety or response-punishment in Experiment II. In the first experiment, one rat exhibited positive behavioral contrast, i.e., tone and light rates increased while his T + L rate decreased. In Experiment II, rats punished in T + L showed contrast in tone and light, this being the first demonstration of punishment contrast on an avoidance baseline with rats. The discrimination acquisition data are discussed in the light of current explanations of contrast by Gamzu and Schwartz (1973) and Terrace (1972). During stimulus compounding tests, all subjects in both experiments emitted more responses to tone-plus-light than to tone or light (additive summation). An analysis of the terminal training baselines suggests that the factors producing these test results seem unrelated to whether or not contrast occurred during discrimination training. It was concluded that the stimulus compounding test reveals the operation of the terminal baseline response associations and reinforcement associations conditioned on these multicomponent free-operant schedules of reinforcement.

     

Generalization along the dimension of sound intensity in pigeons

Two groups of four pigeons each were trained on a discrimination between two intensities of white noise. The low-intensity group had a 60-dB intensity as the negative discriminative stimulus (S?) and a 70-dB intensity as the positive discriminative stimulus (S+): the high-intensity group had a 95-dB intensity as S? and an 85-dB intensity as S+. Generalization stimuli were all of higher intensity than S+ for the former group and all of lower intensity than S+ for the latter group. The rate of acquisition of the discrimination was faster for the Ss in the high-intensity group. In both groups, the maximum of the generalization function was shifted toward the middle values of the set of test stimuli, away from the training stimuli. Responding showed a decline at the far end of the range of test stimuli. Responding to the positive training stimulus was initially as great as it had been on the preceding training sessions, but became markedly depressed relative to responding to the other stimuli as the test progressed.     

Effects of memory reactivation treatments on postdiscrimination generalization performance in pigeons

In Experiment 1, it was shown that generalization testing following successive discrimination training between two closely spaced wavelengths results in a sharp gradient with a peak of responding shifted from S+ so as to be further removed from S?. Testing after a 24-h delay resulted in a flatter gradient with greater peak (and area) shift. A 5-min pretest exposure to S+, reinforced or unreinforced, or to S? (unreinforced) reinstated immediate test performance; free reinforcement with no discriminative stimulus present had no such effect. Experiment 2 replicated the flattening of generalization gradients and enhanced peak shift in delayed testing. Free feeding in a pretest treatment with a distinctive food uniquely associated with the wavelength discrimination problem failed to reinstate immediate test performance. Experiment 3 tested the hypothesis that free feeding failed as a reactivation treatment because it did not engender keypecking. Subjects were trained to peck a vertical line stimulus before being given wavelength discrimination training. Again, the enhanced peak shift and greater flattening with delayed wavelength generalization testing was found. A pretest exposure to the vertical line stimulus elicited pecking but had no effect on subsequent wavelength generalization. Thus, only a reactivation treatment that included one of the discrimination training stimuli was effective in producing delayed test performance comparable to that obtained in an immediate test.     

Evidence for the hierarchical structure of instrumental learning

In three experiments using rats, we examined the role of a discriminative stimulus (S) in governing the relation between a response (R) and an outcome (O) in an appetitive instrumental learning paradigm. In each experiment, we attempted to distinguish between a simple S-O association and a hierarchical relation in which S is associated with the R-O association. We used three variations on discriminative training procedures and three different assessment techniques-for revealing the hierarchical structure. In Experiment 1, we employed a training procedure in which S signaled a change in the R-O relation but no change in the likelihood of O. Although such an arrangement should not produce an excitatory S-O association, it nevertheless generated an S that controlled responding and transferred that control to other responses. In Experiment 2, we used a discrimination procedure in which two Ss each had the same two Rs and Os occur in their presence but each S signaled that a different R-O combination would be in effect. This design provided the opportunity for equivalent pairwise associations among S, R, and O but unique hierarchical relations. The subjects learned the hierarchical structure, as revealed by the specific depressive effect of a subsequent lithium-chloride-induced devaluation of O on responding only in the presence of the S in which that response had led to that outcome. In Experiment 3, one S signaled two different R-O outcomes. Then, two new stimuli were presented with the original S; the R-O relations were retained in the presence of one of the added stimuli but were rearranged in the presence of the other. The added S came to control less responding when it was redundant with respect to the R-O relations than when it was informative. Although all of the results were of modest size and each has an alternative interpretation, together they provide converging evidence for the hierarchical role of S in controlling an R-O association.     

Simultaneous discrimination learning: Stimulus interactions

Although considerable attention has been given to interactions between events serving as the positive (S+) and negative (S−) stimuli in successive discriminations, there has been little study of similar interactions in simultaneous discriminations. We propose that in a simultaneous discrimination, given what is typically relatively little experience with the consequences of responding to the S−, some of the value of the S+ transfers to the S− with which it was paired. Furthermore, the mechanisms responsible for this transfer of value appear to be the higher order Pavlovian association between the S− and the S+, as well as within-event associations between them. Although in typical simultaneous discriminations, negative value does not appear to transfer from the S− to the S+, when adequate experience is provided with the S−, contrast typically develops, reducing the value of the S− (negative contrast) and enhancing the value of the S+ (positive contrast). This model of stimulus interactions has implications not only for simple simultaneous discrimination learning, but also for research using combinations of discriminations (e.g., transitive inference in animals and humans). This model may also have implications for a number of human social psychological phenomena.     

Determinants of value transfer and contrast in simultaneous discriminations by pigeons

In a simultaneous discrimination involving a positive (S+) and a negative (S₋) stimulus, positive value appears to transfer from the S+ to the S₋. However, negative value does not appear to transfer from the S₋ to the S+. Instead, when sufficient experience with the contingencies associated with responding to the S₋ is provided, it appears that the presence of the S₋ enhances the value of the S+ (i.e., a contrast effect is found). The purpose of the present experiments was to further examine the influence of the S+ on the S₋ in a simultaneous discrimination (between subjects in Experiment 1 and within subjects in Experiment 2). In both experiments, we found that under typical training conditions, given little direct experience with the value of the S₋, value transfers from the S+ to the S₋. If sufficient experience with the value of the S₋ is provided, however, contrast between the S+ and the S₋ can be demonstrated. Thus, in a simultaneous discrimination, value transfer from the S+ to the S₋ depends on the animal’s having responded relatively little to the S₋.