Retention period differentially attenuates win–shift/lose–stay relative to win–stay/lose–shift performance in the rat

Hungry rats were trained in a two-lever conditioning chamber to earn food reinforcement according to either a win–shift/lose–stay or a win–stay/lose–shift contingency. Performance on the two contingencies was similar when there was little delay between the initial, information part of the trial (i.e., win or lose) and the choice portion of the trial (i.e., stay or shift with respect to the lever presented in the information stage). However, when a delay between the information and choice portions of the trial was introduced, subjects experiencing the win–shift/lose–stay contingency performed worse than subjects experiencing the alternative contingency. In particular, the lose–stay rule was differentially negatively impacted relative to the other rules. This result is difficult for ecological or response interference accounts to explain.     

Ontogeny of persistence: Immediate extinction effects in preweanling and weanling rats

In Experiment I rats were trained for 21÷2 days under partial (PRF) or continuous reinforcement (CRF) conditions starting at 18, 22, 28, or 36 days of age and were then subjected to immediate extinction. At all ages there was a strong partial reinforcement extinction effect (PREE), and absolute size of PREE was greatest in the youngest rats. Rate of extinction increased as a function of age following both CRF and PRF. In Experiment II the youngest and oldest age groups of Experiment I were run under the two reward conditions of Experiment I and in a third condition, PRF with number of rewards rather than trials equated to CRF (PRF-R). The PRF-R and PRF groups were not different in extinction, and both were more persistent than CRF. The youngest rats were again more persistent than the oldest, particularly after PRF training. In Experiment III it was shown that the well-known paradoxical effect, greater reward in CRF acquisition leads to faster extinction, operates in our youngest and oldest animals, but is more pronounced in the oldest. The results are discussed in terms of whether they require different explanations than those often applied to extinction data from adult rats.     

The stimulus-response overshadowing phenomenon with VI versus FI schedules of reinforcement

Previous research has shown that response rates on a variable interval (VI) schedule of reinforcement decrease if a brief response-produced signal is given prior to reward. One explanation is that the signal overshadows the response because it is a better predictor of reinforcement. The S-R overshadowing effect does not occur with variable ratio (VR) schedules, however. Tarpy, Lea, and Midgley (1983) explained this fact by suggesting that the signal functions to enhance the salience of the temporal interval offset on the VI schedule (a characteristic not possessed by VR schedules), which then overshadows the response. In this experiment, the salience of the temporal interval was enhanced in another way: signaled or unsignaled reward was provided to rats responding on either a VI or fixed interval (FI) reward schedule. As predicted, rates were lowest for animals receiving signaled reinforcement on an FI schedule and highest for those receiving unsignaled reinforcement on a VI schedule.     

Differential development of 24-h retention capacities for two components of T-maze escape learning by infant mice

At 9 or 11 days of age, separate groups of Swiss-Webster mice received 12, 24, or 40 training trials to the goal opposite their first-trial choice in a shock-escape T-maze task. All groups were retested to the same goal for 25 trials 24 h following training, while maturation controls without prior exposure were trained to the goal opposite their first choice. All groups demonstrated increased escape proficiency during original training on two separate escape components: reaching the choice point and making the correct turn at the choice point. During retention testing, all groups at both ages exhibited better escape performance in terms of reaching the choice point than their maturation controls. However, when escape was measured in terms of choice, none of the groups trained at 9 days of age differed significantly from maturation controls when retested at 10 days of age. In contrast, retention of correct choice point turn varied directly with number of original training trials for mice trained at 11 days of age.     

Memories of reward events and expectancies of reward events may work in tandem

A common assumption is that expectancies of reward events in instrumental tasks are established on the basis of Pavlovian conditioning. According to the tandem hypothesis, tested in the four runway investigations reported here employing rats, memories of reward events may serve as the conditioned stimuli eliciting expectancies. In Experiments 1–3, rats were trained under a schedule of partial reward (P), which did not produce increased resistance to extinction, and subsequently shifted to consistent reward (C). According to the tandem hypothesis, the shift to the C schedule should result in increased resistance to extinction if, as hypothesized, under the P schedule the memory of reward, S^R, came to elicit the expectancy of nonreward,_EN. This hypothesis was confirmed under a variety of conditions. It was shown that increased resistance to extinction could not be attributed to the P schedule alone, to the rats receiving two schedules, P and C, to stimuli other than S^R eliciting E_N, or to the rats forgetting reward-produced memories when expecting nonreward (Experiment 4). It was shown that the tandem hypothesis could explain the divergent findings obtained in prior studies employing a shift from P to C as well as in the present study.     

Dissociation of patterned alternation learning and the partial reinforcement extinction effect in preweanling rats

Sprague-Dawley rat pups aged 14 or 18 days were trained on a patterned (single) alternation schedule with either an 8- or a 105-sec intertriai interval (ITI). At the 8-sec ITI, alternation learning was obtained at both ages, but the older age group learned more rapidly. There was no evidence of response alternation at the 105-sec ITI at either age. Continuously reinforced (CRF) and partially reinforced (PRF) groups trained and extinguished along with the patterned alternation (PA) group at the 105-sec ITI showed a robust partial reinforcement extinction effect (PREE) at both ages. Moreover, there was no difference in the rate of extinction of the PRF and PA groups at either age (i.e., no effect of N-length). A PREE can therefore be obtained in infant rats under conditions that apparently preclude the formation of sequential associations. The implications of this finding for the ontogeny of instrumental learning and extinction are discussed.     

Effects of preweaning environmental enrichment on later problem-solving behavior in rats

Two experiments investigated the importance of visual sensory modality in mediating enriched environmental effects during the preweaning period, and the importance of onset and duration of the enriched experience during the same period. Rat mothers and pups were exposed together in an enriched environment for either 7 or 11 days at different periods from Day 1 to Day 21. Also included was a group of rats which received only handling from Day 11 to Day 21 postpartum and another group in which the mothers were exposed to the enriched environment during the last trimester of pregnancy. Some rats were tested at 27 days of age, and others were tested at 64 days of age in the Hebb-Williams maze test. It was found that exposure in the enriched environment for a period of 7 days before the eyes opened improved rats’ problem-solving behavior above that of control rats and to the level of rats which received such experience after the eyes had opened. Handling of rats did not improve problem-solving behavior, nor did exposure during the gestation period. It was concluded that vision is not the most important factor in mediating effects during the preweaning period, since improvement in problem-solving behavior can occur before the visual system is fully developed. It was suggested that the beneficial enrichment effects might be mediated by the mother, who, in some way, transmits additional stimulation to the infant rat during this early stage of development.     

Facilitating stimulus effects of reward and punishment in discrimination learning

To demonstrate a facilitating stimulus effect, as opposed to an incentive effect, of food reward, rats were trained on an easy, light-dark discrimination with different amounts of reward for correct and incorrect responses (1-0, 2-0, 3-1, and 5-1 pellets, respectively), and with shock or no shock administered in the correct goalbox. Both errors and trials to criterion were fewer with a large reward differential (LRD: 2-0 and 5-1), as compared with a small reward differential (SRD: 1-0 and 3-1), but were not affected by the “base” reinforcement condition of either 1 or 0 pellets for the incorrect response. In addition, choice and arm speeds during early training were positively related to the combined, or average, number of pellets contingent upon both correct and incorrect responses, indicating a generalization of reward expectancies. Although shock uniformly suppressed arm speeds under all reward conditions, it facilitated discrimination learning in the SRD conditions. That such facilitation occurred only when the conditions of reward for correct and incorrect responses were relatively similar indicates that not only shock, but also food can function as a distinctive cue: As a stimulus selectively applied to one response, it can decrease the similarity of the alternatives, and, in this manner, it can faciltate performance.     

Incentive contrast: A review of behavioral changes following shifts in reward

The literature relevant to incentive contrast effects is reviewed, with emphasis on the data published since the reviews by Black (1968) and Dunham (1968). Contrary to the evidence available for the earlier reviews, the current literature indicates that positive contrast is a reliable phenomenon. Its occurrence is facilitated by use of a constant delay of reward, use of a long runway, or possibly by a shift while a negative contrast effect, resulting from a previous shift, is still present in the animals’ behavior. Positive contrast also occurs in consummatory behavior when sucrose or saccharin solutions are shifted. Conditions that are ineffective in producing positive contrast are reviewed, as are the effects of numerous variables on both successive and simultaneous contrast. In addition, positive and negative contrast effects resulting from shifts in delay or percentage of reward, contrast resulting from shifts in sucrose, saccharin, or ethanol solutions, contrast in choice behavior, and transsituational contrast are reviewed. The relationship of the data to several theoretical interpretations of contrast is also considered.     

Enhanced neophobia induced by incentive contrast

In two experiments, a successive negative contrast effect in licking was produced by shifting rats from 32% to 4% sucrose solution. Subsequent to the downshift in reward, the rats were tested for licking either a plain 12% sucrose solution or 12% plus a neutral flavor. Licking for the 12% solution was depressed in downshifted rats when a flavor was present, regardless of whether this flavor was novel or had been present in the shift solution. The results were interpreted in terms of an enhancement of neophobia by reward reduction.     

Hurdle-jump responding in the rat as a function of conspecific odor of reward and nonreward

A hurdle-jump escape response was employed to assess the laboratory rat’s aversion or attraction to different types of conspecific odor. Odorant donor subjects received 112 runway acquisition trials on a continuous reward schedule followed by 32 extinction trials, 112 acquisition trials on a 50% schedule of reward and nonreward followed by 32 extinction trials, or 144 “neutral” trials with no reward in the alley. Different groups of test subjects escaped from odor excreted by odorant subjects on (a) nonrewarded acquisition and extinction trials, (b) rewarded trials during continuous reinforcement, (c) rewarded trials during partial reinforcement, or (d) neutral trials; others escaped from a clean box. The principal findings were: (1) significant aversion to “odor of nonreward” appeared after the donor odorants had received 12 exposures to reward; (2) production of odor of nonreward by odorant subjects changed as a function of training experience with reward; (3) after repeated exposure to odor of nonreward, the escape response habituated; (4) greater or different odor excretion in extinction resulted from subjects trained on a continuous reward schedule than on a partial reward schedule. Relationships of the data to frustration theory were discussed, assuming that inferred differences in production of odor reflect differences in frustration reaction.     

Attenuation of the CS-preexposure effect after a retention interval in preweanling rats

The effects of flavor preexposure and retention interval were assessed in 6- and 12-day-old rats. Conditioned aversions to a flavor appeared at both ages. The conditioning of the younger pups was unaffected by conditioned stimulus (CS) preexposure and was not evident after a 10-day retention interval. For the 12-day-old rats, preexposure to either the flavor CS or a different flavor attenuated aversion strength when the rats were tested soon after conditioning. Other 12-day-old rats that were tested 10 days after conditioning also expressed substantial aversions, but with a retention interval of this length, the aversions were equivalent for animals preexposed to the CS and those not preexposed before conditioning. This loss of the CS-preexposure effect over a long interval, which has also been observed in adult rats, identifies the locus of this effect as postacquisition and perhaps at the stage of memory retrieval.     

Behavioral heat intake as a function of reward duration in rats

Animals working for heat in a cold environment increase responding when reward duration is reduced, but in many instances the increase in responding is not sufficient to prevent a decrease in the amount of heat obtained. Eight experiments were conducted to investigate the reason why rats’ barpress responses for heat are less efficient at short reward durations. The results show that a ceiling effect is not involved and also that improper response-topography or differences in whole-body heat absorptivity or in response effort cannot explain the phenomenon. Evidence was found for the hypothesis that response rate does not increase sufficiently at short reward durations because many short rewards produce a greater afferent signal than do few long rewards. This inequality seems to be caused by characteristics of the stimuli that result in a greater relative change in skin temperature (ΔT) or in the rate of change of skin temperature (δT/δt) for short-duration rewards.     

Effects of varying sucrose reinforcers and amobarbital sodium on positive contrast in rats

The effect of quantity and quality of reinforcement on performance change following a shift to uniform high reward was studied in four groups of rats. Twenty or 200 licks of a 5% or 20% sucrose solution constituted the four incentive conditions. Two additional subject groups were run in the high (20%–200 licks) and low (5%-20 licks) reward conditions to determine how amobarbital sodium, an emotional depressant, influences incentive shift performance. All six groups received 60 preshift runway trials (6/day), followed by 30 high reward trials. Twenty-four extinction trials contrasted drugged and normal performance relating to high and low reward Postshift positive contrast appeared in all nondrugged groups. An emotional base for positive contrast is considered.     

The effect of crying on long-term memory in infancy

The influence of crying on infants' long-term memory for a learned response was investigated in 3 experiments. In each, infants were trained to move a crib mobile containing 10 identical objects by means of kicking and were then exposed to a reinforcer containing only 2 of these components. This shift in component numerosity produced crying in 53% of the infants. Infants who cried in response to the reward shift evidenced no retention of the contingency 1 week later (Experiment 1) but did have excellent retention at 1 day (Experiment 2). In Experiment 3, a brief reactivation treatment alleviated forgetting at 3 weeks regardless of the presence of crying in response to the change in mobiles. An unexpected recency effect characterized the efficacy of the reactivation treatment. The results indicate that crying in response to the violation of a reward-expectation habit functions as an amnesic agent to produce accelerated forgetting.     

Effects of runway shift and stay rules on rats’ serial pattern learning in the T-maze

Rats received three-trial series on a T-maze consisting of extended visually distinct left-black and right-striped side runways. During the first phase of training, when allowed to select baited runways within these series, they predominantly alternated their choices. During the second phase, rats received forced-choice serial pattern training of series consisting of two rewarded (R) trials and one nonrewarded (N) trial in two fixed orders, RRN and RNR. In Experiment 1, the rats in the runway shift rule group always received the second R trial when forced down a runway opposite that on the preceding trial in the series and the N trial when forced down the same runway. The rats in the runway stay rule group always received the second R trial when forced down the same runway and the N trial when forced down the opposite runway. In Experiment 2, each rat was conditionally trained with both runway outcome rules as determined by the central alley lighting and the type of food in the side alleys. The rats took longer to reduce their running speed on the N trial within each sequence under the runway stay rule than under the runway shift rule. They also took longer to acquire serial pattern responding for the RNR than for the RRN series only under the runway stay rule condition. When subsequently reexposed to series of free-choice trials on the final phase, rats maintained spontaneous alternating choice patterns under the runway shift rule conditions but either seldom alternated their choices (Experiment 1) or greatly reduced choice alternations (Experiment 2) under the runway stay rule condition. We discussed these effects in terms of rats’ natural foraging strategies and as a factor that interacts with other within- and between-series variables that affect serial pattern behavior.     

The effects of requiring different response strategies following caching in Clark’s nutcrackers (Nucifraga columbiana)

Clark’s nutcrackers use spatial memory to recover stored food in the field and have performed very well in laboratory tests of spatial memory. During the present experiment, two groups of nutcrackers cached seeds every 4 days. Following each cache session, the stay group was tested with seeds in their caches; the shift group found seeds in novel sites. The stay group performed accurately throughout the experiment, but the shift group gave no indication of being able to learn to avoid sites where they had stored seeds. These results suggest that although nutcrackers can learn to shift away from remembered locations during some memory experiments, they cannot learn to shift away from cache sites. This raises interesting questions about the relationship between task characteristics, response strategies, and memory.     

Simultaneous discrimination reversal learning in pigeons and humans: anticipatory and perseverative errors

Pigeons were trained on a two-choice simultaneous discrimination (red vs. green) that reversed midway through each session. After considerable training, they consistently made both anticipatory errors prior to the reversal and perseverative errors after the reversal, suggesting that time (or number of trials) into the session served as a cue for reversal. In Experiment 2, to discourage the use of time as a cue, we varied the location of the reversal point within the session such that it occurred semirandomly after Trial 10, 25, 40, 55, or 70. Pigeons still tended both to anticipate and to perseverate. In Experiment 3, we required 20 pecks to a stimulus on each trial to facilitate memory for the preceding response and sensitivity to local reinforcement contingencies, but the results were similar to those of Experiment 2. We then tested humans on a similar task with a constant (Experiment 4) or variable (Experiment 5) reversal location. When the reversal occurred consistently at the midpoint of the session, humans, like pigeons, showed a tendency to anticipate the reversal; however, they did not show perseverative errors. When the reversal location varied between sessions, unlike pigeons, humans adopted a win–stay/lose–shift strategy, making only a single error on the first trial of the reversal.     

ADULT AGE DIFFERENCES IN SPEED AND ACCURACY OF MATCHING VERBAL AND PICTORIAL SIGNS

Young (mean age of 19 years) and older (mean age of 69 years) adults participated in a two‐choice, matching‐to‐sample reaction time experiment. Young adults responded more quickly than older adults; all subjects responded more quickly to a verbal standard sign than to a pictorial standard. However, there was an age difference in speed of performance only for those subjects in the stimulus order condition receiving first pictorial standards and then verbal standards. These data are interpreted within a model of dual memory processing systems (verbal and nonverbal). During adulthood there is an increasing tendency for verbal codes to elicit more general associations of both a verbal and a pictorial symbolic nature, while a pictorial code continues to activate only other pictorial stimuli. More generally, the implications of such a model for understanding aging and educational gerontology are discussed.     

How early maternal separation and juvenile experience with pups affect maternal behavior and emotionality in adult postpartum rats

To assess the effects of preweaning and juvenile experiences on adult maternal behavior, two experiments were completed. In Experiment 1, pups were separated for long periods or short periods or were left undisturbed over the 1st week. Following weaning, the rats were exposed to foster pups over a 5-day period or were left undisturbed. There were no effects of early experience on juvenile behavior. In adult postpartum maternal tests, short separations reduced latencies to express maternal behaviors, whereas long separations combined with juvenile exposure to pups increased latencies. In Experiment 2, pups were separated for long periods or were left undisturbed over the 1st week. Following weaning, the rats were exposed to foster pups for 4 days or 8 days or were left undisturbed. Long separation retarded maternal responding in juvenile animals but had no effect on the adults. Four days of juvenile experience had negative effects on adult behavior, whereas 8 days did not have an effect.