Habituation may contribute to within-session decreases in responding under high-rate schedules of reinforcement

Two experiments tested the hypothesis that habituation contributes to within-session decreases in responding. In Experiment 1, rats’ leverpressing was reinforced under a fixed ratio (FR) 4 schedule throughout the baseline sessions. During the dishabituation sessions, the first 21 min and the last 21 min were FR 4; dishabituating events occurred during the middle 3 min. The dishabituating events altered the manner of reinforcer delivery in four different ways. Response rates increased after all dishabituating events. In Experiment 2, rats responded on several FR and variable ratio (VR) schedules. The ratio requirement varied from 3 to 15. Within-session decreases in responding were steeper during FR schedules than during VR schedules. In addition, response rates were well described as linear functions of cumulative number of food pellets eaten within sessions. These results support the habituation hypothesis but do not rule out the possibility that other satiety variables might contribute simultaneously.     

Procedure for preventing response strain on random interval schedules with a linear feedback loop

An experiment examined the impact of a procedure designed to prevent response or extinction strain occurring on random interval schedules with a linear feedback loop (i.e., an RI+ schedule). Rats lever-pressed for food reinforcement on either a RI+ or a random interval (RI) schedule that was matched to the RI+ schedule in terms of reinforcement rate. Two groups of rats responded on an RI+ and two on an RI schedule matched for rate of reinforcement. One group on each schedule also received response-independent food if there had been no response for 60 s, and response-independent food continued to be delivered on an RT-60 schedule until a response was made. Rats on the RI and RI+ obtained similar rates of reinforcement and had similar reinforced inter-response times to one another. On the schedules without response-independent food, rats had similar rates of response to one another. However, while the delivery of response-independent food reduced rates of response on an RI schedule, they enhanced response rates on an RI+ schedule. These results suggest that rats can display sensitivity to the molar aspects of the free-operant contingency, when procedures are implemented to reduce the impact of factors such as extinction-strain.     

Schedule-induced behavior in rats: Pellets versus powder

Food-deprived rats develop polydipsia on an intermittent schedule (fixed time 60 sec) of food pellet delivery, but not on an identical schedule of food powder delivery. This result was demonstrated with separate groups receiving each type of food and was replicated using rats as their own controls. Powdered food not only prevented the development of polydipsia, but it abruptly terminated ongoing polydipsia in rats that were switched from the scheduled delivery of pellets to powder. Ethological analysis of the behavior showed that the rats receiving powder were not engaging excessively in some behavior other than drinking. After discounting several factors, we concluded that the amount of oral activity associated with feeding, which occurred immediately after food delivery, was reciprocally related to the level of drinking.     

Acquisition of schedule-induced polydipsia by rats in proximity to upcoming food delivery

Food-deprived rats that receive intermittent delivery of small amounts of food develop excessive drinking--specifically, schedule-induced polydipsia (SIP). A main characteristic of SIP is its occurrence at the beginning of interfood intervals. The purpose of this study was to demonstrate that SIP can be developed toward the end of interfood intervals, in closer proximity to upcoming than to preceding food delivery. In Experiment 1, two groups were exposed to a fixed-time (FT) 30-sec food schedule with water available during the first or the last 15 sec of each interfood interval. Two additional groups, which had access to water throughout, were exposed to FT 30-sec or FT 15-sec schedules of food presentation. The FT 30-sec group with free access to water developed the highest level of intake; similar and intermediate levels were induced in all the remaining groups. In Experiment 2, three groups of rats were exposed to an FT 90-sec food schedule with water available during the first, the second, or the last 30 sec of each interfood interval. One additional group with access to water throughout was exposed to the FT 90-sec schedule of food presentation. The group with free access to water developed a higher level of consumption than did the other groups, but by the end of training none of the four groups showed statistical differences in polydipsic drinking. Results show that adjunctive drinking can be developed in proximity to upcoming food delivery even with long interfood intervals.     

Effects of response-independent stimuli on fixed-interval and fixed-ratio performance of rats: a model for stressful disruption of cyclical eating patterns

Binge eating is often associated with stress-induced disruption of typical eating patterns. Three experiments were performed with the aim of developing a potential model for this effect by investigating the effect of presenting response-independent stimuli on rats’ lever-pressing for food reinforcement during both fixed-interval (FI) and fixed-ratio (FR) schedules of reinforcement. In Experiment 1, a response-independent brief tone (500-ms, 105-dB, broadband, noisy signal, ranging up to 16 kHz, with spectral peaks at 3 and 500 Hz) disrupted the performance on an FI 60-s schedule. Responding with the response-independent tone was more vigorous than in the absence of the tone. This effect was replicated in Experiment 2 using a within-subject design, but no such effect was noted when a light was employed as a disrupter. In Experiment 3, a 500-ms tone, but not a light, had a similar effect on rats' performance on FR schedules. This tone-induced effect may represent a release from response-inhibition produced by an aversive event. The implications of these results for modeling binge eating are discussed.     

Sustained attention: Stimulus control determined by schedule of cue production interacting with cue duration

In a study of sustained attention (“vigilance”), pigeons performed a conditional discrimination in a 3-key operant chamber. Pecking a white center key initiated a 0.2- or 2.0-sec cue (a red or green disk). The side keys then displayed white disks, and a peck on the right or left key was reinforced depending on whether the preceding cue was red or green. Pecks on the white center key initiated the cue according to one of two schedules of cue production (FR 1 or VI 7.5 sec). Control of side key choices by 0.2-sec cues was disturbed by transition from FR 1 to VI 7.5, and recovered after the schedule of cue production changed from VI 7.5 back to FR 1. Control of choices by 2.0-sec cues was not affected by changing schedules of cue production. Rates of pecking the cue were higher than rates of cue-producing responses.     

Response–food delay gradients for lever pressing and schedule-induced licking in rats

Eight food-deprived Wistar rats developed stable patterns of lever pressing and licking when exposed to a fixed-time 30-s schedule of food pellet presentation. The rats were trained to lever press by presenting the lever 10 s before the programmed food delivery, with the food pellet being delivered immediately upon a lever press. The operant contingency was then removed and the lever was inserted through the entire interfood interval, being withdrawn with food delivery and reinserted 2 s later. On successive phases of the study, a protective contingency postponed food delivery if responses (lever presses or licks) occurred within the last 1, 2, 5, 10, 20, or 25 s of the interfood interval. Lever pressing was reduced at much shorter response–food delays than those that reduced licking. These results demonstrate that reinforcement contributes to the maintenance of different response patterns on periodic schedules, and that different responses are differentially sensitive to delays.     

Schedule-induced polydipsia contrast in the rat

Schedule-induced polydipsia was studied using a behavioral contrast paradigm. Food pellets were delivered to food-deprived rats on a response-independent FT 1-min schedule. Licking on a tube produced water on a MULT FR 10 FR 10, MULT FR 10 EXT, or MIXED FR 10 EXT for three rats (Experiment 1) and on a MULT VI VI, MULT VI EXT, or MIXED VI EXT schedule for three other rats (Experiment 2). On the FR schedules, rats could drink more water by increasing lick rates, but on the VI schedules the amount of drinking was fixed by the schedule parameters and was relatively unaffected by lick rates. Relative to MULT FR FR, positive polydipsia contrast was clearly demonstrated on MULT and MIXED FR EXT; but relative to MULT VI VI, contrast was not demonstrated on MULT and MIXED VI EXT. These data suggest that polydipsia contrast occurs only if increased licking permits increased drinking.     

Duration of components and response rates on multiple fixed-ratio schedules

Pigeons were exposed to a two-component multiple fixed-ratio X fixed-ratio Y schedule of reinforcement in which X was always less than Y. Components were equal in duration and alternated at rates that varied between 2 sec and 23.5 h. Relative response rate in the FR X component: (1) increased as the duration of components increased between 2 sec and 15 min, (2) was at a maximum between 15 min and 6 h, and (3) decreased as the duration of components increased from 6 h to 23.5 h. The changes in relative response rate were attributable primarily to changes in absolute response rates during the FR Y schedule as absolute response rates during the FR X schedule were relatively invariant. These results pose complexities for several theoretical formulations.     

Generalization of fixed-interval response patterning in pigeons

Three pigeons were trained on a multiple schedule in which keypecking was reinforced on a fixed-interval (FI) schedule in the presence of a vertical line and on a variable-interval (VI) schedule in the presence of a horizontal line. Response rates in the former component were positively accelerated (the “FI scallop”), whereas response rates in the second component were relatively constant. In a subsequent generalization test on the line-tilt continuum, the index of curvature decreased systematically as the line was rotated from vertical to horizontal in 30-deg steps. Frequency distributions of indices of curvature suggested that intermediate average index values for intermediate generalization test stimuli were mainly the result of intermediate response patterns in the individual test stimulus presentation, rather than the averaging of VI-like patterns during some stimulus presentations with FI-like patterns during other stimulus presentations.     

Adjunctive drinking during variable and random-interval food reinforcement schedules

Rats were trained to leverpress for food and subsequently exposed to either arithmetic series or random variable-interval reinforcement schedules. Adjunctive drinking developed in all subjects exposed to arithmetic variable-interval reinforcement, but did not develop in six of the eight animals trained on the random schedule. The results suggest that adjunctive drinking is the result of an interaction between the tendency of rats to drink after eating and the ability of locally low probabilities of reinforcement within schedules to induce conditioned behavioral states.     

Functional differentiation of adjunctive drinking and wheel running in rats

Food-deprived rats were exposed to a schedule in which a brief stimulus was presented approximately once every 60 sec. The first leverpress to occur in the presence of the stimulus always turned it off, and produced a food pellet 50% of the time. When the rats were given concurrent access to water, a running wheel, or both, drinking predominated during intervals initiated by pellet delivery, while running predominated during intervals initiated without food. When allowed to obtain all of their food pellets at the beginning of a session, rats drank less and ran more than when the intermittent schedule was in effect, and most drinking occurred within the first half of the session, while running was distributed throughout the session. Adjunctive drinking and wheel running appear to be functionally different, drinking being schedule-induced and food-bound, running being neither.     

Excitatory and inhibitory effects of free reinforcers

Rats’ responding was maintained on a random-interval 1-min food schedule. In addition, non-contingent pellets were delivered, independently of the animals’ behavior, at either fixed intervals (Experiment 1) or at random intervals (Experiment 2). As the rate of delivery of the periodic and aperiodic free reinforcers increased, the rate of responding decreased. But these free reinforcers, in addition to having this inhibitory effect, had also a local excitatory effect upon responding: lever-pressing increased to a level above its mean rate following the delivery of a free food pellet. The time course of this behavioral aftereffect of free reinforcers, for both fixed and random intervals, was dependent upon the proportion of the interval between successive free food deliveries. The relation of these results to those obtained with response-contingent reinforcement, free punishment, and in schedule-induced phenomena is discussed.     

Stimulus control of foodcup approach following fixed ratio reinforcement

Rats were trained on fixed ratio (FR) schedules requiring either 5 or 10 leverpresses to produce reinforcement and an intertrial interval (ITI). Half of the Ss at each ratio requirement were extinguished on an FR 5 and half on an FR 10 schedule of ITI presentation. Fewer foodcup approaches were made on the FR 10 than on the FR 5 extinction schedule, regardless of acquisition FR. Leverpresses per approach were fewer on the FR 5 than on the FR 10 extinction schedule and were fewer following FR 5 than following FR 10 acquisition. Data suggested the existence of interoceptive as well as exteroceptive stimulus control of foodcup approach and were discussed in terms of their implications for a response-unit account of extinction.     

Factors affecting schedule-induced wood-chewing in rats: Percentage and rate of reinforcement,and operant requirement

In Experiment 1, rats were allowed to acquire either schedule-induced drinking or schedule-induced wood-chewing behavior under a fixed-interval (FI) 60-sec schedule of food reinforcement, following which food was omitted from 20% and then 50% of interreinforcement intervals. Omission of food severely disrupted induced drinking but had relatively little effect on induced wood-chewing. Experiment 2 investigated wood-chewing as a function of reinforcement rate, using a range of FI schedules from 5 to 180 sec in duration. Both the amount of chewing per session and the relative time spent chewing were bitonically related to reinforcement rate. In Experiment 3, schedule-induced chewing that had been acquired under a response-dependent schedule was found to persist under a response-independent schedule. Induced wood-chewing resembles other induced behaviors in important respects, but quantitative differences are also apparent.     

也谈由相对数或平均数计算平均数

在由相对数或平均数求平均数时,可以以这一相对数或平均数的分母或分子为权数,对这一相对数或平均数进行加权,利用加权算数平均数的频数公式或加权调和平均数公式求其平均值。     

Polydipsia and autoshaping: Drinking and leverpressing as substitutes for eating

Three experiments delivered food at fixed or random intervals independently of the rat’s behavior, always less than the amount eaten with food freely available. The results revealed a Polydipsie response to this experimental suppression of eating, and total drinking decreased as total eating increased. When we added a lever that signaled each food delivery, leverpressing and drinking rose far above their baseline levels; both responses decreased as total eating increased. When a similar schedule presented lever and food independently, rats still became Polydipsie, but showed no sign of autoshaped leverpressing. A fourth experiment revealed a hypophagic response to schedules that suppressed drinking; total eating increased with total drinking. As mutual substitutes in the economic sense, one behavior falls as the other rises; as mutual complements in the economic sense, the two behaviors rise or fall together. We discuss polydipsia and autoshaping in terms of drinking as an intrinsic substitute for eating, and leverpressing as a learned substitute for eating. The results suggest a revision of conservation theory, which views drinking and eating as substitutes when the schedule suppresses eating but as complements when the schedule suppresses drinking.     

Operant response topographies of rats receiving food or water reinforcers on FR or FI reinforcement schedules

Separate groups of food- and water-deprived rats pressed a lever for food or water, respectively, on continuous reinforcement and various fixed-ratio and fixed-interval reinforcement schedules. Food-reinforced rats on continuous, FR 2-, or FI 10-sec schedules showed consistently longer mean lever contact durations per leverpress than did water-reinforced rats on the same schedules. Mean lever-contact-duration differences between food- and water-reinforced rats were greatly attenuated or disappeared under FR 4-, FR 8-, FI 20-sec, and FI 30-sec schedules of reinforcement. These results are interpreted as supporting earlier hypotheses that there are respondent components of operantly conditioned and autoshaped leverpresses, but that these respondent components weaken with partial reinforcement and the leverpress topography comes under the control of operant contingencies.     

The role of predictability in preventing escape deficits following loss of control over food acquisition

The present experiment examined whether predictability of food acquisition would eliminate the impairment of subsequent escape performance that otherwise resulted from uncontrollability over food acquisition. In pretreatment, the yoked and the yoked-signal groups received response-independent food at the same times as the experimental group acquired it on an FR 5/20 lever-press schedule. However, a pellet presented for the yoked-signal group followed a 1.5-sqc tone, which served as a predictive signal of food. The naive control group received the same clumber of pellets in their home cages in this phase. Results of the escape latency in the subsequent FR 2 shuttling shock-escape test indicated that the predictability of outcome eliminated the escape deficits showed by the yoked-non signal group. This modulating effect of a predictive signal is hypothesized to be due to an overshadowing of uncontrollability by predictability.     

Serial pattern learning of temporal intervals

The problem was to determine how rats adjust the times of their lever responses to repeating sequences of interfood intervals. In Experiment 1, rats were trained on an interval schedule of reinforcement with a 12-element Fleshler-Hoffman series with a mean of 60 sec; the order was as follows: ascending, random with repetition, random with replacement, random without replacement. In Experiment 2, rats were trained with a 10-element ascending or descending series (from 2⁰ to 2⁹ sec), and in a ramp procedure in which these intervals increased and then decreased repeatedly. In the ascending, descending, and ramp conditions (but not in the random conditions), postreinforcement pause (PRP) was a function of the interval. PRP was most highly correlated with an interval later in the series. Theories of conditioning and timing based on the averaging of past experience must be modified to account for such anticipatory behavior.