Autoshaping in the rat: Interposing delays between responses and food

Rats were exposed to an autoshaping procedure in which each lever-contact or leverpress delayed trial offset and, hence, food delivery. Yoked subjects received identical trial-food pairings as did delay subjects. This procedure was studied at two delay values (2.5 and 10.0 sec) in experimentally naive rats and those which had previously received 25 sessions of autoshaping. The delay procedure retarded the acquisition of autoshaped responding in naive subjects and reduced responding for experienced subjects. Yoked subjects responded at higher levels than did delay subjects throughout training.     

Extinction of rats’ barpressing in the presence of free food

In two experiments, hungry rats received four extinction sessions in the presence of free food. When the free food was removed for eight subsequent extinction sessions, the animals made significantly fewer responses than did control groups which received no intervening sessions. The results are contrary to those of Enkema et al (1972). From the results of additional groups of rats which received four intervening sessions of free food only, empty chamber, or time in home cage, it was concluded that the presence of free food caused the diminution in extinction responding.     

Unpredicted food produces a mode of behavior that affects rats’ subsequent reactions to a conditioned stimulus: A behavior-system approach to “context blocking”

The present experiments explored the relation between a mode of behavior produced by unpredicted presentations of an unconditioned stimulus (US) and subsequent interference with responding to a conditioned stimulus (CS) (the context-blocking effect). The US was food, the CS was a moving ball bearing, and the subjects were rats. The typical response to a moving bearing that predicts food is predatory interaction, and the behaviors that developed under unpredicted US presentations involved focused search and waiting oriented to the food tray. Experiment 1 manipulated the number of unpredicted food presentations and showed that the reduction in subsequent bearing contacts was more clearly related to the occurrence of initial food-tray behavior than to the number of prior food presentations. Experiments 2 and 3 manipulated the conditioning of food-tray behavior while holding constant the number of prior food presentations, and again showed a strong inverse relationship between initial food-tray behavior and ball-bearing contact. The latter experiments also indicated that the locus of interference with bearing-directed behavior was neither primarily central (associative or attentional) nor peripheral (motor interference), but resulted from the incompatibility of two modes of food-getting behavior, a more general predatory search mode versus a mode of focal search and waiting. A behavior-system account of these results does not preclude an associative basis for context-blocking effects, but it argues that such effects may occur at several levels and must function within appetitive structures underlying the animal’s food-getting behavior.     

Preference for food and water in rats as a function of delay of reward

In Experiment I, rats which were both hungry and thirsty were given a choice between a food reward and a water reward. The animals preferred food to water when the reward was delivered immediately, but preferred water to food when a 30-sec delay was imposed in the goalbox before the reward was received. Experiment II replicated the results of the first experiment and showed, in addition, that when the delay was imposed in a separate delay chamber devoid of differential goalbox cues, subjects preferred food to water, similar to the immediate group. The results were discussed in terms of an incentive value process and a competing response hypothesis.     

Effects of food primes on the operant behavior of nondeprived rats

After rats had been trained to press a lever for food reward, experimenter-initiated food “primes” increased the likelihood of subsequent responding during periods in which the subjects were nondeprived. No such priming effects were found after presentation of a stimulus that had previously been paired with food. In other experiments, nonreinforced leverpresses, as well as subthreshold components of the leverpress response (e.g., forepaw raising), were also found to be enhanced by food primes. Taken together with other reports in the literature, the present findings are consistent with a “motivational aftereffects” interpretation of priming, and also with the notion that all stimuli which possess reinforcing properties possess priming properties as well.     

Rats’ responses to a moving object related to food or water: A behavior-systems analysis

The present experiments compared rats’ responses to a moving object (a rolling ball bearing) related to either food or water under both Pavlovian and operant contingencies. In Experiment 1, food-restricted rats contacted food-related bearings more frequently and with more complex response patterns than water-restricted rats contacted water-related bearings. Food-related contacts occurred with shorter latency, longer average duration, and increased likelihood of dig, carry, and chew. Experiment 2 revealed that once contact with the bearing had been established, its form persisted despite changes in the type of reward and restriction. In Experiment 3, rats that were simultaneously food and water restricted learned to discriminate between painted and unpainted bearings related to food versus no food, water versus no water, and food versus water. Again, food-related bearings produced more complex, although not more frequent, interactions than did water-related bearings. In none of the experiments did rats lick the ball bearing related to water. The results supported a behavior-system approach, but not the stimulus-substitution or arbitrary-operant accounts of conditioned-response topography.     

Maze patrolling by rats with and without food reward

The effects of food reward on rats’ behavior in radial and Dashiell tunnel mazes were examined in two experiments. In the first, with animals at ad-lib body weights, food reward reduced speed of movement at the food locations, but did not affect the patterns of movement in either maze. Exploratory efficiency in the Dashiell maze was unaffected by food reward, and spontaneous patrolling of the radial maze by the nonrewarded animals was comparable to the behavior, reported by others, of rats running for food reward on elevated eight-arm mazes. In the second experiment, with subjects maintained at 80% of ad-lib body weights, there was some evidence for “winstay” learning: food-rewarded rats in the Dashiell maze were relatively more active near the food locations than were the nonrewarded animals, and more rewarded than nonrewarded rats revisited all food locations in the radial maze. Nonetheless, exploratory efficiency in the Dashiell maze was unaffected by food reward, as was patrolling efficiency in the radial maze, which was again comparable to that of rats on elevated mazes. The similarity in behavior of rewarded and nonrewarded animals in these mazes implies that the major determinant of their behavior, whether or not food reward is provided, is a spontaneous tendency to avoid places recently visited.     

Signal-directed behavior in the rat: Interactions between the nature of the CS and the nature of the UCS

Two experiments are described, which involved the investigation of interactions between the nature of the conditioned stimulus (CS) and the nature of the unconditioned stimulus (UCS) in producing signal-centered behavior. In Experiment 1, rats received response-independent heat reinforcement in a cold environment. For some groups, this heat UCS was signaled by presentations of a standard aluminum retractable lever; for other groups, it was signaled by a retractable lever covered in acrylic fur (furry lever CS). Only the subjects that received the furry lever CS paired with heat exhibited differential CS-contact behavior, when compared with unpaired, aluminum lever, and warm control subjects. In Experiment 2, hungry rats received pairings of either an aluminum or a furry lever with food (UCS). When compared with unpaired controls, only the subjects that received the aluminum lever paired with food showed differential signal-directed behavior; the subjects receiving the furry lever CS did not show differential contact with the CS, but instead exhibited differential food tray entry behavior during CS presentation. In the two studies, the signal-directed behavior exhibited by subjects resembled either thermoregulatory or feeding behaviors characteristic of rats. The results suggest that signal-directed behavior is determined by a complex interaction between the ecological relevance of the CS and the nature of the UCS—an interaction that can best be described in terms of a behavior systems model of conditioned responding.     

Resurgence of behavior during extinction depends on previous rate of response

In two experiments, food-deprived rat subjects leverpressed for food in three successive training phases. In the first phase of both experiments, rats were exposed to a multiple schedule, one component of which produced a high rate of response, and the other of which produced a lower rate of response (multiple random ratio [RR], random interval [RI] in Experiment 1, and multiple differential reinforcement of high rate, differential reinforcement of low rate in Experiment 2). Rats were then transferred to a multiple fixed interval (FI; 60-sec, 60-sec) schedule, until the effects of the first phase on response rate were no longer apparent and their response rates did not differ from those of rats responding on a multiple FI 60-sec, FI 60-sec schedule without previously experiencing a multiple RR, RI schedule. During the third stage oftraining, all rats were placed into extinction. During extinction, rates of responding were higher in the component previously associated with the high rate of responding in Phase 1, and they were lower in the component previously associated with low rates of responding in Phase 1. These results suggest that resurgence effects, like other history effects, are controlled by previous rates of responding.     

Intrinsic reinforcing properties of putatively neutral stimuli in an instrumental two-lever discrimination task

Four experiments examined the influence of a stimulus presented after one response in a two-lever choice task. In Experiment 1, food-deprived rats trained on a concurrent variable-interval extinction schedule responded more often on the extinction lever when such responding periodically produced a visual stimulus than when it did not. In Experiments 2 and 3, a similar signal-induced enhancement effect was found even when food was delivered randomly with respect to responding on both levers or when no food was presented. In Experiment 4, a response-contingent visual stimulus elevated responding to the lever on which it was presented, but an auditory cue suppressed responding. These findings indicate that visual stimuli may possess intrinsically reinforcing properties for rats.     

Stimuli associated with the cancellation of food and its cues enhance eating but display negative incentive value

Initially neutral conditioned stimuli paired with food often acquire motivating properties, including serving as secondary reinforcers, enhancing instrumental responding in Pavlovian-instrumental transfer procedures, and potentiating food consumption under conditions of food satiation. Interestingly, cues associated with the cancellation of food and food cues may also potentiate food consumption (e.g., Galarce and Holland, 2009), despite their apparent negative correlations with food delivery. In three experiments with rats, we investigated conditions under which potentiation of feeding by such “interruption stimuIi” (ISs) develops, and some aspects of the content of that learning. Although in all three experiments ISs enhanced food consumption beyond control levels, they were found to act as conditioned inhibitors for anticipatory food cup entry (Experiment 1), to serve as conditioned punishers of instrumental responding (Experiment 2), and to suppress instrumental lever press responding in a Pavlovian instrumental transfer procedure (Experiment 3). Furthermore, when given concurrent choice between different foods, an IS enhanced consumption of the food whose interruption it had previously signaled, but when given a choice between performing two instrumental responses, the IS shifted rats’ choice away from the response that had previously yielded the food whose interruption had been signaled by IS (Experiment 3). Thus, the effects of an IS on appetitive responses were opposite to its effects on consummatory responding. Implications for our understanding of learned incentive motivation and the control of overeating are discussed.     

Instrumental responding by rats on free-operant schedules with components that schedule response-dependent reinforcer omission: Implications for optimization theories

In two experiments, we assessed whether rats optimize the number of reinforcers per response. In Experiment 1, one group of rats was trained to leverpress for food reinforcement on a simple variable-interval (VI) 60-sec schedule. For another group, a negative fixed-ratio component was imposed on the VI schedule to produce a conjoint contingency in which reinforcement became available on the VI schedule but was omitted when the ratio criterion was satisfied. In Experiment 2, one group of rats responded on a VI schedule and also received response-independent food. For another group, responding above a certain rate canceled the response-independent food. Despite the negative contingency experienced by the groups in Experiments 1 and 2, responding was maintained at a level at which the number of obtained reinforcers was reduced substantially below the maximum number possible. In addition, in both experiments, the groups that experienced the negative contingency responded at a lower rate than did a yoked control group that experienced the same frequency of reinforcement but lacked the negative component. These results demonstrate that although rats do not optimize their behavior with respect to reinforcement, they are nevertheless sensitive to some aspect of the instrumental contingency in operation.     

Sign-tracking (autoshaping) in rats: A comparison of cocaine and food as unconditioned stimuli

A series of experiments was performed to determine whether sign-tracking would occur in rats with intravenous (i.v.) cocaine as the unconditioned stimulus. In Experiment 1, a retractable lever paired with food produced strong sign-tracking, but a lever paired with one of three doses of i.v. cocaine did not elicit any approach or contact behavior. Experiment 2 demonstrated that doses of cocaine that did not elicit sign-tracking would function as a positive reinforcer for a lever contact operant. In Experiment 3, an artificialconsummatory response was added to make the cocaine reinforcement episode more behaviorally comparable to that occasioned by food. Although the rats readily performed this response when it was required to receive cocaine infusions, they still did not contact a lever that signaled the availability of these infusions. It appears that cocaine is different from other positive reinforcers (e.g., food, water, warmth, or intracranial stimulation) in that it will not produce sign-tracking in rats.     

Instrumental response topographies of rats

Experiments 1, 2, and 3 showed that food-deprived rats responding for food pellets made significantly more long-duration leverpresses than water-deprived rats responding for water drops. These experiments further showed that this difference in instrumental response topography is long-lived, and depends neither upon idiosyncrasies of the experimental chamber nor upon severity of deprivation conditions. In Experiment 4, food-deprived rats responding for food pellets made significantly more long-duration leverpresses than did either food- or water-deprived rats responding for sucrose solution. Human judges in Experiment 5 were able to correctly identify instrumental leverpress responses by rats as being for food or water based solely on previous viewings of other rats drinking water or eating food pellets. It appears that instrumental response topographies in rats vary depending principally upon the reinforcer received, and that these instrumental response topographies resemble consummatory response topographies.     

Reinforcer and response specificity in appetitive transfer of control

Three experiments examine transfer from appetitive Pavlovian conditioning to appetitive instrumental responding by varying the similarity between conditions of Pavlovian reinforcement and instrumental reward. After conditioning with rats confined in a restraining device, a CS for electrical stimulation of the brain (ESB) produced substantial facilitation of operant responding for ESB, while a CS for food facilitated operant responding for food. However, no effects on rate of responding for food were seen during a CS for ESB. In a fourth experiment, four groups of rats were trained to barpress for rewarding electrical stimulation of the brain (ESB) and then given discriminative Pavlovian conditioning with ESB. The groups differed in the degree of similarity between the stimulus-response sequences present during Pavlovian conditioning and those occurring in instrumental responding. As similarity increased, so did the degree of conditioned facilitation in subsequent transfer tests. These results indicate that conditioned incentive responses or reinforcer-derived expectancies are specific to the conditions under which they develop, rather than generalized emotional or motivational responses.     

Amount of training and reversal learning with singly presented stimuli in the rat

In a discrete trials multiple reversal experiment with singly presented stimuli, rats were given either 10 or 20 training trials per day for 2 days on each problem. All subjects improved progressively over reversals, but subjects with more training on each problem showed greater inhibition of responding to S? during reversal than those having less training. For both groups, the S? within sessions curve became steeper over reversals. Inhibition of responding to S? was greater on Day 2 of a reversal than on Day 1. The rat data are discussed in relation to those obtained from pigeons and goldfish.     

Food deprivation and conditioned flavor preferences based on sweetened and unsweetened foods

In four experiments, rats’ preferences for flavors consumed under high deprivation versus low deprivation were measured. In Experiment 1, rats preferred flavors received in unsweetened food under high deprivation to flavors received in unsweetened food under low deprivation. This preference did not vary with amount of food used to deliver the flavors (1-g vs. 16-g wet mash). Sweetening the food (0.10% saccharin) eliminated this preference when 16 g of mash was received, but not when 1 g of mash was received (Experiments 2 and 3). Sweetening the mash even more (0.15% saccharin) eliminated the preference when 1 g of mash was received, as well as when 20 g of mash was received. We suggested that the reinforcing value of sweetness is reduced by increasing deprivation level.     

The role of response-reinforcer correlation in signaled reinforcement effects

In three experiments, we examined the effects of signaling reinforcement during operant responding in order to illuminate the factors underlying instrumental overshadowing and potentiation effects. Specifically, we examined whether signaling reinforcement produces an enhancement and attentuation of responding when the response-reinforcer correlation is weak and strong, respectively. In Experiment 1, rats responded on variable-ratio (VR) or variable-interval (VI) schedules that were equated for the number of responses emitted per reinforcer. A signal correlated with reinforcement enhanced response rates on the VR schedule, but attenuated response rates were produced by the signal on the VI schedule. In Experiment 2, two groups of rats responded on a VI schedule while the two other groups received a conjoint VI, negative fixed-ratio schedule in which the subjects lost the availability of reinforcements if they emitted high response rates. A reinforcement signal attenuated responding for the simple VI groups but not for the animals given the negative fixed-ratio component, although the signal improved response efficiency in both groups. In Experiment 3, a poor correlation between responding and reinforcement was produced by a VI schedule onto which the delivery of response-independent food was superimposed. A signal for reinforcement initially elevated responding on this schedule, relative to an unsignaled condition; however, this pattern was reversed with further training. In sum, the present experiments provide little support for the view that signaling reinforcement enhances responding when the response-reinforcer correlation is weak and attenuates responding when this correlation is strong.     

The rewarding effects of number and surface area of food in rats

Visual cues have an important role in food preference for both rats and humans. Here, we aim to isolate the effects of numerosity, density, and surface area on food preference and running speed in rats, by using a forced-choice maze paradigm. In Experiment 1, rats preferred and ran faster for a group of multiple smaller pellets rather than a single large pellet, corroborating previous research (Capaldi, Miller, & Alptekin Journal of Experimental Psychology: Animal Behavior Processes, 15(1), 75–80, 1989). Further experiments tested the prevailing hypothesis that multiple food pieces are more reinforcing because they occupy a larger surface area. Experiment 2 controlled for numerosity by utilizing a continuous food: mashed potatoes flattened to cover a larger surface area or rounded into a ball. The rats preferred and ran faster for the flattened potatoes, suggesting surface area plays a role in quantity estimations. Finally, in Experiment 3, rats displayed no preference or difference in running speed between a group of scattered and clustered pellets when number of pellets were kept constant. Taken together, these results suggest that density has an important role in food perception—that is, the rewarding effect of higher numerosity or larger surface area is removed when the food does not fill out the entire space. Alternative explanations and implications for human diet are discussed.     

Effects of the correlation between a positive and negative US on conditioned suppression in rats

For three groups of rats, an auditory CS, presented while the animals were responding on a variable-interval schedule for food reinforcement, was terminated on half of the trials with a noncontingent footshock. For two groups, half of the trials were also followed after 5 sec by the delivery of free food. In the positively correlated condition (PC) the free food was presented on shocked trials and in the negatively correlated condition (NC) on the nonshocked trials, while the remaining group (S) never received free food. In a fourth group the shock was omitted and free food delivered on half of the trials. Although all shocked groups showed a significant suppression, the magnitude was greater for Group PC than for Groups NC and S, which did not differ. Suppression did not result from the pairing of the CS with food alone. These results do not support the counterconditioning hypothesis that the pairing of a normally noxious stimulus with food reduces its aversiveness.