Effects of food deprivation on learning and expression of flavor preferences conditioned by saccharin or sucrose

In four experiments, food deprivation was varied during conditioning and testing of conditioning of flavor preferences by sweeteners. Conditioned preferences for a flavor associated with a more concentrated solution were enhanced by increased deprivation in training whether sucrose or saccharin was used when rats consumed solutions freely during training. When consumption of solutions was controlled and higher deprivation levels were used, preference for the higher concentration of sucrose was still enhanced by increased deprivation in training, but this did not occur with saccharin. We suggest that deprivation may enhance the reinforcing value of sweetness only when calories increase along with sweetness. We also suggest that deprivation can enhance flavor preference learning by increasing consumption and thereby increasing exposure to the flavored solutions.     

Proactive effects in pigeons’ timing behavior: Implications for an internal-clock model

We have found proactive effects in pigeons’ timing behavior, a finding inconsistent with internal-clock models of timing that assume a resetable working-memory component. Six pigeons were trained to discriminate between 2- and 10-sec illuminations of a white light; choice of a red pecking key was correct and rewarded after presentation of the short stimulus whereas choice of a green key was correct and rewarded after presentation of the long stimulus. During training sessions, there were 60 trials separated by a 20-sec intertriai interval; short and long light occurred in a randomized order and correct choices were reinforced with 5-sec access to grain on a partial (75%) schedule. During test sessions, there were 120 trials separated by a 2-sec intertrial inter val. Light presentations occurred in a fixed order throughout these sessions: 2, 6, 10, 10, 6, 2 2, 6, 10 sec, and so forth. Choice of either red or green after 6 sec was not reinforced. However, red continued to be correct after 2 sec and green continued to be correct after 10 sec. Of central interest was how the subjects classified 6 sec of light in ascending (2, 6, 10) and descending (10. 6, 2) sequences of durations: Subjects chose the short alternative on 42% of the 6-sec trials in ascending series but only 29% in descending series, a result most plausibly interpreted as show ing that duration information from a preceding trial affects duration classifications on the cur rent trial. Such proactive effects should not occur according to working-memory models that as sume that stored information is cleared at the end of a trial.     

Are “no-drug” cues discriminated during drug-discrimination training?

Rats were trained in a two-lever operant chamber to discriminate the presence versus the absence of a drug. During drug sessions, the training procedure involved reinforcing presses on lever 1 with saccharin-sweetened water but not reinforcing presses on lever 2. During no-drug sessions, only presses on lever 2 were reinforced. After this discrimination was learned, each rat was trained to discriminate presence versus absence of a second drug. All rats learned this second discrimination. Finally, the rats were tested to determine whether they could still discriminate the first drug, as well as other pharmacologically related compounds; most rats could. Training drugs were phenobarbital 30–35, nicotine 0.4, amphetamine 0.4, cyproheptadine 7, phencyclidine 4, cyclazocine 1.5, fentanyl 0.04, and scopolamine 0.2 mg/kg. The results indicate that drug versus no-drug discrimination training does not disrupt discriminative control previously established with a different drug. When considered in combination with the results obtained during substitution tests conducted after drug-versus-no-drug training, the data suggest that, instead of discriminating drug cues versus no-drug cues, rats discriminate presence versus absence of particular drug cues.     

Two-choice conditional discrimination performance of pigeons as a function of reward expectancy,prechoice delay,and domesticity

In a discrete-trial two-choice conditional discrimination task, pigeons which received food for a correct choice following the presentation of one cue and water for a correct choice following another cue performed better than pigeons which received food and water equally often in both cases when delays of several seconds intervened between the conditional cue and choice stimuli presentations. These results suggest that feedback properties of reinforcer-specific expectancies can be important in conditional discrimination learning in pigeons. An additional finding was that wild-caught pigeons regularly exhibited a higher percentage of correct choices than domestic subjects.     

Foraging on the radial-arm maze: Effects of altering the reward at a target location

Thirsty rats were trained to collect small water rewards from the end of each arm of an eight-arm radial maze. During these training trials and subsequent testing trials, the subjects were allowed to choose a maximum of eight arms. “Preference” for a target maze location was studied by noting when, in the sequence of eight choices, the target was selected. During testing, when one maze location was consistently devoid of water, rats decreased their preference for this arm over trials (Experiment 1). Similarly, rats that learned a saccharin-lithium association demonstrated lower preferences for a maze location that consistently held the conditioned saccharin solution. This was true for animals that received saccharin-lithium conditioning on the maze (Experiment 3A) and for animals conditioned to saccharin in a separate context (Experiment 3B). An increase in preference for a target maze location consistently containing a sweet chocolate milk solution was observed in animals that were water- and food-deprived (Experiment 2). These studies demonstrate that animals will modify their responses toward (preferences for) maze locations that predictably contain an altered reward.     

Contextual control of pavlovian feature-positive and feature-negative discriminations

Three pigeons were trained with a Pavlovian serial feature-positive (F-P) discrimination task in a light context, in which the houselight was on, and with a Pavlovian serial feature-negative (F-N) discrimination task in a dark context, in which the houselight was off. Three other pigeons were trained with the F-P task in the dark context and the F-N task in the light context. These two contextual conditions were changed randomly trial by trial. The former birds learned the tasks within 60 sessions, by responding exclusively to the target keylight after the feature tone in the light context and by responding exclusively to the target not preceded by the feature in the dark context. Two of the latter birds required separate training of the F-P and the F-N tasks to acquire the discrimination: responding exclusively to the target after the feature in the dark context and responding exclusively to the target not preceded by the feature in the light context. The third bird, however, failed to learn the discrimination even with separate training. These results indicate that the four-term contingency (the context-feature-target-food relationship) controlled the birds’ behavior in the Pavlovian setting. The insertion of a temporal gap between the feature and the target impaired the F-N discrimination, although it had little effect on the F-P discrimination.     

Flavor preferences conditioned with starch in rats

Rats were trained to associate artificial cherry or grape flavors with 1% starch suspensions. Conditioning was assessed by offering the rats a choice of the cherry versus grape flavors without starch. Conditioned preferences were moderately strong and persistent; 3 days of conditioning produced a preference that did not fully extinguish within 18 days. Food deprivation substantially increased intake of 1% starch suspension, However, the degree of preference conditioned was not influenced by the availability of food during the conditioning period; the rats that had been food deprived during training acquired as strong a preference as did those fed freely during training. The degree of preference obtained was similar in the rats given reinforcing and nonreinforcing fluids simultaneously or sequentially. Starch conditioned a slightly stronger preference than did the same concentration of glucose, even though these substances contain the same amount of calories. A statistically significant, but weak, preference was conditioned by 0.5%, but not by 0.25%, starch. It is proposed that the flavor of starch, independent of its calories, is reinforcing to rats.     

A comparison of the short-term memory performances of pigeons and jackdaws

Two experiments employed a delayed conditional discrimination procedure in which half the trials began with the presentation of food and half with no food; following a retention interval, subjects were presented with a choice between red and green keys, a response to one of which was reinforced according to whether the trial had started with food or no food. In Experiment 1, after 38 training sessions during which the retention interval was gradually increased, pigeons performed at a moderate level with intervals of 5 to 7.5 sec. A final test produced a steep forgetting function for food trials, but not for no-food trials; performance was unaffected by the duration of the intertriai interval (10 or 40 sec). Experiment 2 used the delayed conditional discrimination procedure to compare short-term memory in jackdaws (Corvus monedulus) with that in pigeons. Although the performance of the jackdaws was below that of the pigeons at the start of training, they showed more rapid learning over long delays, and, in the final test, a shallower forgetting function for food trials than that shown by pigeons. The results suggested superior short-term memory in jackdaws, which may help to explain the better performance of corvids in general when compared with that of pigeons in certain complex learning tasks.     

Sensitivity of instrumental responses to an upshift in water deprivation

The role of incentive learning in instrumental performance following an upshift in the degree of water deprivation was analyzed in three experiments. In Experiments 1A and 1B, rats trained to perform an instrumental action reinforced by either sucrose or maltodextrin solutions when in a low-deprivation state were shifted to a high-deprivation state and tested in extinction. This shift in water deprivation increased performance only if the animals had been exposed to the reinforcer in the high-deprivation state prior to testing. In Experiment 2, the role of the instrumental contingency in mediating the preexposure effect observed in the first two studies was examined by training rats to make two instrumental actions for different outcomes. The preexposure experience with the outcomes produced a relative increase in performance of the action reinforced with the incentive preexposed in the high-deprivation state when a choice between the two response alternatives was conducted in that state. These experiments support the conclusion that instrumental performance following revaluation of the reinforcer by an upshift in the level of thirst depends on a process of incentive learning.     

Time-place learning in the eight-arm radial maze

Rats (n=4) searched for food on an eight-arm radial maze. Daily 56-min sessions were divided into eight 7-min time zones, during each of which a different location provided food; locations were randomized across subjects before training. The rats obtained multiple pellets within each time zone by leaving and returning to the correct location. Evidence that the rats had knowledge about the temporal and spatial features of the task includes the following. The rats anticipated locations before they became active and anticipated the end of the currently active locations. The rats discriminated currently active locations from earlier and forthcoming active locations in the absence of food transition cues. After the rats had left the previously active location, they visited the next correct location more often than would be expected by chance in the absence of food transition cues. The rats used handling or opening doors as a cue to visit the first location and timed successive 7-min intervals to get to subsequent locations.     

Reductions in resistance to extinction and spontaneous recovery as a function of changes in transportational and contextual stimuli

Thirty rats received 10 sessions of baseline training in which leverpressing was reinforced according to a variable-interval (VI) 60-sec schedule. Twenty-four of the subjects were then assigned to one of four groups that received five sessions of extinction, with groups being differentiated in a 2 by 2 factorial design on the basis of: (1) changes in stimuli accompanying transportation of subjects from home cages to the laboratory and placement in the apparatus, and/or (2) changes in contextual stimuli within the apparatus. During the sixth session of extinction, the transportational and contextual stimuli previously associated with baseline training were reinstated. The remaining six rats experienced changes in both transportational and contextual stimuli but were maintained on the VI 60-sec schedule of reinforcement. Changes in either transportational or contextual stimuli reduced resistance to extinction and spontaneous recovery, and substantial increments in responding occurred upon reinstatement of the transportational and contextual stimuli associated with baseline training. Evidence for summation of the two sources of stimulus change was obtained. Changes in transportational and contextual stimuli produced only a brief disruption in responding when reinforcement of leverpressing was continued.     

Effects of discrimination training on stimulus generalization in pigeons: Role of resistance to extinction and response-produced stimuli

In Experiment 1, two groups (n = 10) of pigeons received 17 sessions of TD (true discrimination) or ND (nondifferential) training with line angles. Seventeen sessions of SS (single stimulus) training with a wavelength preceded this training and two followed it. Subsequent wavelength generalization testing in extinction revealed a sharper TD than ND gradient. This slope difference was evident from the very first test stimulus presentation and remained stable throughout testing. As a consequence of substantial overtraining, there was no reduction of response strength and no sharpening of generalization during testing for either group. In Experiment 2, two groups (n = 16) of pigeons received 10 sessions of TD or PD (pseudodiscrimination) training with line angles, followed by four sessions of SS training with a single wavelength. During this training and in subsequent wavelength generalization testing in extinction, brief blackouts separated stimulus presentations. Again, the TD group yielded the sharper gradient. Although responding weakened and the gradients sharpened during the test, these effects were comparable in the two groups. Furthermore, gradients based on the percentage of trials with at least one response showed the same TD-PD slope difference. This finding indicates that differential control over responding by response-produced feedback is inadequate to account for the TD-PD difference in generalization slope. Both experiments indicate that a purported difference in resistance to extinction is also an inadequate explanation.     

Food deprivation and conditioned flavor preferences based on sweetened and unsweetened foods

In four experiments, rats’ preferences for flavors consumed under high deprivation versus low deprivation were measured. In Experiment 1, rats preferred flavors received in unsweetened food under high deprivation to flavors received in unsweetened food under low deprivation. This preference did not vary with amount of food used to deliver the flavors (1-g vs. 16-g wet mash). Sweetening the food (0.10% saccharin) eliminated this preference when 16 g of mash was received, but not when 1 g of mash was received (Experiments 2 and 3). Sweetening the mash even more (0.15% saccharin) eliminated the preference when 1 g of mash was received, as well as when 20 g of mash was received. We suggested that the reinforcing value of sweetness is reduced by increasing deprivation level.     

Transfer of a taste aversion from food to water under various states of deprivation

The importance of ingestive contexts (feeding and drinking) and deprivation states to rats’ transfer of a taste aversion were examined, In Experiments 1 and 2, rats were trained with novel saccharin-treated foods while either food deprived or food and water deprived, They were then tested with a 1,0% saccharin solution while either water deprived or food and water deprived, Comparable aversions to the solution were displayed regardless of deprivation states, Two further experiments examined transfer to a .1% saccharin solution in conjunction with deprivation state change, When both stimulus properties and deprivation were widely discrepant from training to test, reduced transfer was noted. The results suggest that stimulus similarity was a stronger controlling variable than deprivation state similarity in facilitating the transfer of an aversion from a feeding context to a drinking context, The results were viewed as being consistent with the known parameters affecting generalization gradients.     

Incentive learning and the motivational control of instrumental performance by thirst

The role of incentive learning in instrumental performance following a shift in the degree of water deprivation was analyzed in three experiments. In Experiments 1A and IB, rats trained to perform an instrumental action reinforced with either sucrose or maltodextrin solutions when in a high-deprivation state were subsequently shifted to a low-deprivation state and tested in extinction. This within-state shift in water deprivation reduced instrumental performance only when the animals had been exposed to the reinforcer in the low-deprivation state prior to instrumental training. In Experiment 2, a concurrent training procedure was used to assess whether the change in the value of the reinforcer brought about by preexposurewas mediated by the contingency between the instrumental action and the reinforcer. Preexposure to the reinforcer under the low-deprivation state produced a selective reduction of the performance of the action upon which it was contingent during training when testing was conducted in extinction following a shift from the high- to the low-deprivation state. These experiments provide evidence that animals have to learn about the incentive value of a reinforcer in a particular motivational state through exposure to the reinforcer in that state.     

Proactive interference in the retention of “attentional sets” in pigeons

In Experiment 1, six groups of pigeons (n=8) were tested for wavelength generalization either immediately or 24 h after learning a successive discrimination, with 550 nm reinforced and a black vertical line extinguished. The groups differed in the stimulus present during single stimulus pretraining, which was 550 nm (pretrain S+), the vertical Une (pretrain S?), or a neutral dim white light (pretrain Sn), respectively. The three immediate generalization gradients were steep and indistinguishable, reflecting only the immediately preceding discrimination training condition. The three delay gradients were flatter, with the flattening particularly marked in the pretrain S? group. This was interpreted as proactive interference (PI) resulting from the memory that both the 550-nm and the line stimuli had previously been reinforced. In Experiment 2, two (TD) groups of pigeons (n=16) were given single stimulus training with a 555-nm keylight followed by eight sessions of discrimination training with two line angles, then one session of non-differential (ND) training with the same two lines, and then a wavelength generalization test either immediately or after a 24-h delay. Two other (hold) groups (n=16) received similar training, except for the TD Une angle training sessions, in these hold groups, the wavelength gradient was flatter in a delayed test; in the TD groups it was steeper, indicating PI from the prior TD training. These two experiments suggest that the “attentional sets,” which purportedly result from TD and ND training, may fruitfully be viewed as target memories subject to the principles of interference theory.     

Higher order occasion setting

Higher order occasion setting with serially presented stimuli was investigated in an appetitively motivated, discrete-trial operant study with rats. Reinforcement of barpressing during an occasion-setting light (a discriminative stimulus) was contingent on immediately preceding second-order occasion setters (i.e., a click train or a buzzer served as a conditional discriminative stimulus). Moreover, the meanings of the clicks and buzzer were themselves indicated by a third-order occasion setter that preceded them (i.e., a white noise acted as a second-order conditional discriminative stimulus). Subjects responded more frequently and had shorter latencies to the first response in the presence of the light on trials during which barpressing was reinforced than on trials during which barpressing was not reinforced. The likelihood that the subjects solved the problem by responding to unique compound stimuli was minimized by the insertion of a 5-sec gap between the different controlling stimuli presented on each trial. Thus, these subjects appear to have mastered a second-order conditional discrimination, which is equivalent to third-order occasion setting if the discriminative stimulus (light) is viewed as a first-order occasion setter. Although the subjects learned to respond appropriately to each of the compound stimuli, differences in responding to specific stimuli were consistent with a higher order feature-positive effect. Some implications of higher order occasion setting are discussed, including the issue of independence between the different levels of occasion setting signaled by a single stimulus.     

Additive summation by stimulus compounding irrespective of behavioral contrast during discrimination training: An investigation with positive reinforcement and avoidance schedules

The similarity in the discrimination training leading to behavioral contrast and that preceding tests producing response enhancement to combined discriminative stimuli suggested that the two phenomena might be related. This was investigated by determining if contrast indiscrimination training was necessary for this outcome of stimulus compounding. Responding to tone, light, and to the simultaneous absence of tone and light (T + L) was maintained during baseline training by food reinforcement in Experiment I and by shock avoidance in Experiment II. During subsequent discrimination training, responding was reduced in T + L by programming nonreinforcement in Experiment I and safety or response-punishment in Experiment II. In the first experiment, one rat exhibited positive behavioral contrast, i.e., tone and light rates increased while his T + L rate decreased. In Experiment II, rats punished in T + L showed contrast in tone and light, this being the first demonstration of punishment contrast on an avoidance baseline with rats. The discrimination acquisition data are discussed in the light of current explanations of contrast by Gamzu and Schwartz (1973) and Terrace (1972). During stimulus compounding tests, all subjects in both experiments emitted more responses to tone-plus-light than to tone or light (additive summation). An analysis of the terminal training baselines suggests that the factors producing these test results seem unrelated to whether or not contrast occurred during discrimination training. It was concluded that the stimulus compounding test reveals the operation of the terminal baseline response associations and reinforcement associations conditioned on these multicomponent free-operant schedules of reinforcement.

     

Blocking as a function of added cue intensity

Twelve rats were initially trained to leverpress for water in the presence of a tone. Responses in the absence of the tone were never reinforced. Following this pretraining, a novel light cue was simultaneously compounded with all presentations of the tone as a relevant but redundant predictor of reinforcement. For three different groups of subjects, the light cue was of either bright, moderate, or dim intensity. After compound training, all subjects experienced nonreinforced presentations of each of the two components of the compound. Results indicated that the relative degree of control exerted by the light over behavior increased with increases in light (added cue) intensity.     

Conditioned flavor preferences based on hunger level during original flavor exposure

In five experiments, rats’ preference for a flavor was greater if the flavor had previously been consumed under low rather than high deprivation. This preference was conditioned in as few as three flavor-deprivation pairings (Experiment 1), and persisted through 28 test days, half under each deprivation level (Experiment 2). Rats never preferred the flavor associated with high deprivation even when calories were increased by giving 40 ml of 8% sucrose or when caloric density was increased to the equivalent of 20% sucrose. The preference for the low-deprivation flavor was greater when saccharin solutions were used rather than sucrose solutions, but the preference did emerge when sucrose solutions were used as testing proceeded and when a lower concentration of sucrose was used. We suggest that these preferences may be a result of flavor-taste associations rather than associations between flavors and postingestive consequences, and that the taste of the solutions under low deprivation is preferred to the taste under high deprivation.