Chunking,sorting, and rule-learning from serial patterns of brain-stimulation reward by rats

Three studies tested the notion that rats would treat brain-stimulation reward (BSR) as a stimulus alphabet from which rules could be abstracted to learn serial patterns. In Experiment 1, rats learned to track a serial pattern of 18-10-6-3-1-0 pulses of BSR, responding fast in anticipation of large quantities of BSR and slowly or not at all in anticipation of small quantities of BSR. In Experiment 2, rats learned to track a formally simple 18-6-1-0 pattern faster than a formally complex 18-1-6-0 pattern in a within-subjects procedure, indicating that rats can learn to discriminate between simple and complex pattern structures. Finally, in Experiment 3 rats learned either a formally simple 25-18-10-3-1-0 or a formally complex 25-3-10-18-1-0 pattern whose successive elements were separated by an embedded three-element 6-6-0 subpattern. Rats learned to “chunk together” the dispersed pattern elements, and rats receiving the simple pattern learned to track their pattern, whereas rats receiving the complex pattern did not. The latter results suggest that when simple pattern structure is available, rats can simultaneously track rule structures in at least two memory locations. The results of these experiments, using a new testing procedure and, presumably, a new stimulus alphabet, generalize and extend the idea that rats can abstract relational rules to learn serial patterns.     

Overshadowing by food of stimulus control by a keylight in a two-element serial compound

Pigeons were given successive discrimination training in which pecking during a choice period when the key was white was either reinforced or not, depending upon the prior presence or absence of a discriminative stimulus, which was a two-element serial compound. The compound consisted of a keylight and food, with food presented second or first in a forward or backward pairing for different groups of pigeons. In Experiment 1, the sequence was an S+ indicating reinforced trials, while in Experiment 2, the sequence was an S? indicating nonreinforced trials. Following acquisition of discriminated operant behavior, a sequence generalization test was administered during which all possible orders of the two stimuli were presented on test trials prior to the onset of the choice period. The results showed that food overshadowed stimulus control by the color of the light on the key on the sequence-generalization test, independently of whether food was presented first or second during training and independently of whether food was associated with reinforcement or nonreinforcement. The similarity of results for the two experiments suggests that overshadowing occurs independently of whether the compound is a discriminative stimulus for reinforcement or nonreinforcement. Simultaneous presentation of elements of a compound stimulus is not necessary for overshadowing because the phenomenon was captured with sequentially presented stimuli.     

An analysis of serial pattern learning by rats

When rats receive a sequence of rewards of different magnitudes for traversing a runway, they learn to “track” the sequence, showing anticipation of the forthcoming reward by appropriate running speed. There is disagreement as to whether this behavior depends on rats’ encoding and recalling a complete sequence of foregoing hedonic events or just the immediately preceding one. The present experiments showed that rats can remember more hedonic events than the most recent one. In Experiment 1, when exposed concurrently to the sequences 10-1-0 (pellets) and 0-1-10, they were faster on Run 3 of the increasing than of the decreasing sequence, a discrimination which cannot be made on the basis of the preceding (1-pellet) reward alone. Experiment 2 showed that this behavior reflects genuine anticipation of the Run 3 reward, not simultaneous contrast or other simple aftereffects of Runs 1 and 2. It is argued, however, that these results, together with related findings by Capaldi and Verry (1981), show merely that rats can recall a hedonic event other than the most recent one, not that a sequence of such events is fully recalled in order.     

Formal structure and pattern length in serial pattern learning by rats

When rats learn to anticipate a sequence of stimulus events, such as a serial pattern of different food quantities, they are sensitive to the rule-based formal structure relating the magnitude of successive stimuli. Earlier research has shown that if formal structure is simple (e.g., if a single “less than” rule relates the size of each successive quantity), patterns are learned faster than if formal structure is complex (e.g., if two or more rules such as “less than” and “greater than” relate successive pattern quantities). Two experiments tested the hypothesis that pattern length modulates the role of pattern complexity. We predicted that pattern length and pattern complexity interact in determining pattern difficulty. That is to say, long complex patterns should be learned more slowly than short complex patterns. However, long simple patterns should be learned faster than short simple patterns. In Experiment 1, rats ran a straight runway to receive repeated sequences of food quantities. The long-monotonic group received a formally simple 18-10-6-3-1-0 pattern, in which each number represents a quantity of food pellets. The long-nonmonotonic group received a formally complex 10-1-3-6-18-0 pattern. Similarly, the short-monotonic and short-nonmonotonic groups received 18-1-0 and 1-18-0 patterns. Pattern tracking—fast and slow running in anticipation of large and small quantities of food, respectively—was taken as an index of pattern learning. In Experiment 2, comparable patterns were used, but rats leverpressed in a discrete-trial procedure; response latencies measured pattern tracking. In both experiments, rats learned formally simple patterns faster than they did formally complex patterns. In Experiments 1 and 2, but less clearly in Experiment 2, the predicted interaction was obtained. The results support and generalize the idea that rats encode and use some representation of the formal rule structure of serial patterns as they learn them.     

Tracking the serial advantage in the naming rate of multiple over isolated stimulus displays

Reading and Writing - The serial advantage, defined as the gain in naming rate in the serial over the discrete task of the same content, was examined between grades and types of content in English...     

Ordinal position in the serial learning of rats

Rats were runway trained on each of two, three-trial series consisting of different varieties of reward (X, Y, and Z) and nonreward (N) serving as trial outcomes. The two series are represented as XNY and ZNN. Distinguishing the two series were different brightness and texture cues on the runway floor. Transfer tests, conducted after the rats had developed faster running for rewarded trials than for nonrewarded trials and slower running on Trial 2 of ZNN than on Trial 2 of XNY, provided evidence that trial position, rather than item memories, was controlling the discriminations. In Experiment 1, reversing the floor cues completely reversed the discriminations. In Experiment 2, transfer to NNN did not change the routine patterns of approach that had been established.     

Motivational cues as determiners of stimulus control in rats

Four rats were each trained to perform a light-intensity discrimination and a sound-intensity discrimination. For half of the subjects, light training sessions were preceded by food deprivation, and correct choices were reinforced with food. Sound training sessions, on the other hand, were preceded by water deprivation, and correct choices were reinforced with water. For the remaining subjects, light training sessions were associated with water deprivation, whereas sound sessions were associated with food deprivation. When the rats were tested in the presence of compounds of sound and light, choices tended to be controlled by light when testing was preceded by the deprivation condition associated with light discrimination task. Reliably fewer light-consistent choices were made under the other deprivation condition, though some preference for responding on the basis of light remained. Following extended training in the presence of all four combinations of light and sound stimuli, this preference was reduced somewhat. When additional testing sessions were preceded by combined food and water deprivation, the tendency to respond on the basis of either light or sound was shown to be related to both deprivation and reinforcement factors.     

Behavior patterns in pigeons during autoshaping with an incremental conditioned stimulus

Pigeons were trained on a variant of the autoshaping procedure in which a keylight stimulus of increasing brightness was used to signal the passing of a 30-sec interfood interval (IFI). Key-pecking developed in all subjects within the first session (65 trials). Within trials, pecking began midway through the IFI, increased throughout the remainder, and decreased just before food delivery. Other behavioral stereotypies were also recorded: Low light levels were associated with a retreat to the rear of the test chamber, and medium light levels (during the midportion of the IFI) were associated with high rates of pacing toward and away from the food source. Probe trials revealed that pecking, pacing, and retreat were all under strong stimulus control; that is, when the light was held constant at its lowest or highest brightness, or when the brightness ramp was presented in reverse order, the behavior pattern almost invariably remained tied to stimulus brightness. Results are discussed in terms of associative and nonassociative sources of the form and sequential characteristics of the behavior.     

Spatial pattern learning in rats: Conditional control by two patterns

Rats searched for food hidden on top of poles in a 4 × 4 matrix of poles. Before each trial, the location of the four baited poles was unpredictable. However, the poles were always baited in one of two spatial patterns, either a square or a line. The food hidden on the four baited poles was one of two types, and the food type determined the identity of the pattern. Thus, once one baited pole was discovered, the food type provided a cue for the spatial pattern in which the remaining food was hidden. The results showed that rats learned the two spatial patterns in which the food was hidden and used the conditional cue to determine which pattern was relevant on individual trials, thereby increasing the efficiency of spatial search.     

Serial pattern learning by rats: Transfer of a formally defined stimulus relationship and the significance of nonreinforcement

Two experiments with rats tested independent predictions from cognitive theories of serial pattern learning. The animals learned to anticipate, as measured by running times in a straight alley, different quantities of food pellets organized into formally defined, five-element serial patterns. In Experiment 1, for some animals the patterns were all formally structured according to a monotonic “less than” relationship in which any quantity was always less than its predecessor. For others, no consistent formal rule was applied. Results of a transfer test with a new pattern showed positive transfer if the formal structure of the new pattern was identical to that used initially, but negative transfer if the new pattern was formally different. In Experiment 2, two groups learned the monotonic patterns 18-10-6-3-1 or 18-10-6-3-0 food pellets, while two others learned the nonmonotonic patterns 18-3-6-10-1 or 10-3-6-10-0 food pellets. We asked if the difference in value of the terminal element, 1 or 0 food pellets, would affect the facility with which the patterns were learned. The results showed that learning rate and the qualitative response to the elements of the monotonie and nonmonotonic patterns were independent of the value of the terminal element. Both experiments lend additional support to the utility of using cognitive models of human serial-pattern learning for an analysis of the sequential behavior of nonhuman animals.     

Memory,serial anticipation pattern learning,and transfer in rats

Learning & Behavior - Three experiments tested hypotheses about whether rats respond appropriately to, or track, an orderly series of reward magnitudes terminating in nonreward by encoding the...     

Integration of cardiac responses to serial stimuli after Pavlovian conditioning in rats

The expression of cardiac responses to sequences of two sounds was studied in restrained rats following discriminative trace or delay conditioning. Stimuli paired with a tail shock 10 sec later (CS1) elicited conditioned bradycardia. Unpaired or neutral stimuli (CS0) elicited mostly tachycardia. Rats did not learn to suppress responding to nonreinforced sequences with an interval of 6 sec between sounds. Responses to the second stimulus were significantly augmented following a CS1 stimulus, but not following a CS0 stimulus. Real-time summation of simple responses provided a more complete and quantitative prediction of dual responses than did resetting or facilitation. These results extend the time range over which summation may be observed from less than 2 sec to at least 16 sec. They appear to be inconsistent with models involving competition between unitary representations of stimuli in short-term memory and suggest the existence of multiple stimulus traces with independent time courses.     

Difficult serial anticipation learning in rats: Rule-encoding vs. memory

Rats, trained in a runway, were asked to anticipate, while running slowly, the last two events in repeating series of .045-g food pellets. The series were either weakly monotonic (14, 5, 5, 1, and then 0 pellets/run) or nonmonotonic (5-5-14-1-0). While the terminal 0-pellet event was better anticipated in the weakly monotonic series, the reverse was the case for the next-to-last 1-pellet event. These findings were expected from a memory-discrimination learning hypothesis of serial learning, which suggests that the memory of one event in a series can be used to signal the next event. However, the better anticipation of the 1-pellet event by the nonmonotonic group was inconsistent with the recently stated rule-encoding position of Hulse (1980). According to that view, difficult series of the sort employed in the present investigation are learned by encoding the rule structure of the series, with events in the series with the simple rule structure (the weakly monotonic series in this investigation) being better anticipated than events in the series with the complex rule structure.     

Habituation and recovery of orienting in rats as a function of stimulus significance

Three experiments measured orienting of rats to stimuli varying in intrinsic significance. In the first, rats showed greater reactivity to a recording of a conspecific’s distress squeal than to a simulated mimic squeal when the stimuli were presented at 100 dB but not at 80 dB, and orienting to all stimuli habituated rapidly with repeated stimulus exposures. Experiment 2 showed that, following several stimulus exposures, recovery of orienting after rest periods of 1 and 7 days was a function of the stimulus: Orienting to the distress squeal presented at 100 dB recovered more rapidly than did orienting to the mimic squeal at 100 dB or to either the mimic or the distress squeal presented at 80 dB. Experiment 3 showed that habituation to the most significant stimulus, the distress squeal presented at 100 dB, was retarded at long (24-h) interstimulus intervals, presumably a consequence of less stimulus-to-stimulus transfer of habituation with this stimulus. The results are discussed in terms of biological constraints on habituation of orienting and on recovery of orienting following habituation.     

Poison-induced neophobia in rats: Role of stimulus generalization of conditioned taste aversions

Rats repeatedly injected with lithium chloride were subsequently tested drinking novel and familiar solutions of both casein hydrolysate and vinegar. Injections in the absence of edibles result in only a small, and sometimes not reliable, increased avoidance of the novel casein and vinegar solutions. In contrast, if subjects acquired an aversion to saccharin as a result of the lithium injections, this learned aversion generalized to casein hydrolysate, with the generalization greatly enhanced by novelty of the casein flavor. However, the saccharin aversions did not generalize to the novel vinegar solution nearly as much as to the novel casein flavor. These results suggest that previous observations of poison-induced neophobia were probably in part a result of the stimulus generalization of conditioned taste aversions and that in addition to test stimulus novelty some other factor, such as stimulus salience or similarity to the conditioned aversive flavor, is also involved in the generalization of learned taste aversions.     

The motor core of speech: a comparison of serial organization patterns in infants and languages

Comparison of serial organization of infant babbling and early speech with that of 10 languages reveals four movement-related design features reflecting a deep evolutionary heritage: (1) the cyclical consonant-vowel alternation underlying the syllable, a "Frame" for speech consisting of mandibular oscillation, possibly evolving from ingestive cyclicities (e.g., chewing) via visuofacial communicative cyclicities (e.g., lipsmacks); (2) three intracyclical consonant-vowel co-occurrence preferences reflecting basic biomechanical constraints-coronal consonants-front vowels, dorsal consonants-back vowels, and labial consonants-central vowels; (3) a developmental progression from above-chance to below-chance levels of intercyclical consonant repetition; (4) an ease-related labial consonant-vowel-coronal consonant sequence preference for word initiation. These design features presumably result from self-organizational responses to selection pressures, primarily determined by motor factors. No explanation for these design features is available from Universal Grammar, and, except for feature 3, perceptual-motor learning seems to have only a limited causal role in acquisition of any design feature.     

Integration and representation in rats’ serial pattern learning in the T-maze

Rats were exposed to three-trial series consisting of reinforced (R) trials and one nonreinforced (N) trial in a fixed order, RRN and RNR (Experiments 1 and 2) or NRR and RRN (Experiment 3), on extended visually distinct runways in a T-maze. When initially presented with the same sequence on each series in a session (separate presentations) with the same runway on all trials within a series (Experiments 1 and 3), all the rats developed slower running speeds on N than on R trials. When a runway was sometimes changed between the first and next two trials during separate presentations training (Experiment 2) or both sequences were later intermixed within each session in each experiment, only rats exposed to each sequence on a specific runway maintained these serial running patterns. Rats displayed serial running patterns on a test RNN sequence similar to that on the RNR sequence (Experiment 2), as would be predicted by an intertrial association model of serial pattern learning (Capaldi & Molina, 1979), but responded on test RRR and NRN sequences (Experiment 3) as would be predicted by an ordinal-trialtag/intratrial association model (Burns, Wiley, & Payne, 1986). Results from test series of free-choice trials in Experiments 1 and 2 failed to support a prediction of the intratrial association model that these rats would integrate RRN and RNR sequences. Rather than always selecting a baited runway on both the second and the third free-choice trials, the rats only selected a baited runway on the third trial on the basis of their choice on the second trial, as would be predicted by the intertrial association model. Only after experiencing all possible outcome sequences during forced-choice training in Experiment 3 did these rats predominantly select a baited runway on every free-choice trial.     

Spontaneous recovery evoked by a nonreinforced stimulus

Pigeons (nine groups of seven) were given one acquisition session of 20 trials. The following day their responding was extinguished, and after a 30-min rest period they were tested for residual response strength. The groups differed with respect to (1) whether a distinctive stimulus was presented during acquisition on the first trial, the 15th trial, or not at all, (2) whether or not responses to the distinctive stimulus were reinforced, and (3) whether a distinctive stimulus, a standard stimulus, or a completely novel stimulus was presented on the test trial. Results supported the position that a stimulus associated with the onset of an acquisition session, but not with the extinction session, evokes greater response strength on a spontaneous recovery test trial than do other stimuli in the acquisition session. This holds true even if responses to this stimulus are never reinforced. In addition, it was found that, unlike a previous study that invoked five daily acquisition sessions, pigeons did not demonstrate increased responding to a novel stimulus.     

Inhibitory control by one stimulus after an increase in the frequency of reinforcement associated with another stimulus

Pigeons were trained on a multiple variable-interval 5-min variable-interval 5-min schedule and then shifted to either a multiple variable-interval 1-min variable-interval 5-min or a multiple variable-interval 30-sec variable-interval 5-min schedule. A generalization test was subsequently administered along the dimension containing the stimulus associated with the variable-interval 5-min component. The generalization gradients for subjects that received multiple variable-interval 1-min variable-interval 5-min training were not consistent in shape. However, an incremental gradient was obtained from each subject that received multiple variable-interval 30-sec variable-interval 5-min training. Thus, a sufficiently large reduction in merely the relative frequency of reinforcement during a stimulus resulted in that stimulus’ acquiring inhibitory control over responding.