Excitatory and inhibitory effects of free reinforcers

Rats’ responding was maintained on a random-interval 1-min food schedule. In addition, non-contingent pellets were delivered, independently of the animals’ behavior, at either fixed intervals (Experiment 1) or at random intervals (Experiment 2). As the rate of delivery of the periodic and aperiodic free reinforcers increased, the rate of responding decreased. But these free reinforcers, in addition to having this inhibitory effect, had also a local excitatory effect upon responding: lever-pressing increased to a level above its mean rate following the delivery of a free food pellet. The time course of this behavioral aftereffect of free reinforcers, for both fixed and random intervals, was dependent upon the proportion of the interval between successive free food deliveries. The relation of these results to those obtained with response-contingent reinforcement, free punishment, and in schedule-induced phenomena is discussed.     

Conjunctive schedules of reinforcement IV: Effects on the pattern of responding of changes in requirement at reinforcement

The effects of different schedule requirements at reinforcement on patterns of responding by pigeons were assessed under conjunctive schedules with comparable response-number requirements, Under one conjunctive schedule (conjunctive fixed-interval fixed-ratio schedule), a response was reinforced after a 6-min interval had elapsedand a specific minimum number of responses had been emitted, Under a second conjunctive schedule, a response was reinforced after the 6-min fixed interval and upon completion of a tandem schedule requirement (conjunctive fixed-interval tandem schedule), This schedule retained the same required minimum number of responses as the first conjunctive schedule, but responses were never reinforced according to a fixed-ratio schedule; the tandem schedule was comprised of a fixed-ratio and a small (.1 to 10.0 sec) fixed-interval schedule, Under the conjunctive fixed-interval fixed-ratio schedule, responding was characterized by an initial pause, an abrupt transition to a high response rate, and a second transition to a lower rate that prevailed or slightly increased up to reinforcement, Under the conjunctive fixed-interval tandem schedule, pauses were extended, response rates were lower, and the initial high rate of responding was generally absent, The above effects depended upon the size of the fixed interval of the tandem schedule, The distinct pattern of responding generated by conjunctive fixed-interval fixed-ratio schedules depends upon occasional reinforcement of fixed-ratio responding and not merely on the addition of a minimum number of required responses.     

Overshadowing of situational cues with variable but not fixed intertrial intervals

In two experiments, we examined the conditions under which signaling an unconditioned stimulus (US) with a nominal conditioned stimulus (CS) interferes with the conditioning of situational cues in defensive freezing in the rat. Subjects received footshock USs that were (1) either signaled or unsignaled and (2) either varied or fixed in their temporal location within the conditioning session. Experiment 1, with only one trial per session, yielded no evidence that signaling affected pretrial freezing using either a fixed or variable interval between placement in the context and shock onset. In a test in which no CSs or footshocks were presented, groups that previously had received footshock at a fixed temporal location showed greatest freezing at around that same time. For groups that had received footshocks at various times, freezing declined across the test session. Experiment 2 showed overshadowing of pretrial freezing after more extensive conditioning with many trials per session, but only if the intershock intervals were variable rather than fixed.     

Can a rat count?

A 2 × 2 factorial experiment was conducted in a licking-suppression situation to test if a rat could count the number of shocks given in a 5-min session under signaled and unsignaled shock conditions. Groups F received three .7-sec grid shocks per session throughout 80 sessions, whereas Groups V received, on any day, one, two, three, four, or five shocks, with a mean of three shocks. The rats’ counting ability was assessed in terms of the post-third-shock acceleration of licking. The results of this measure were compared between Groups F and Groups V on test days in which both groups received three shocks with the identical shock sequence. There was no evidence that rats could count under either signaled or unsignaled shock conditions. The basal rate of licking was less in groups run under the unsignaled shock condition than under the signaled shock condition. The effect of fixed/variable shock frequency upon basal rate of licking was not significant. The results are discussed with reference to the optimal shock density view of Davis and Memmott (1982).     

Effects of proximal unconditioned stimulus preexposure on ingestional aversions learned as a result of taste presentation following drug treatment

Taste aversions were conditioned by exposing subjects to a 1.0% saccharin solution 30 min after an injection of lithium chloride. The aversion learning was disrupted if subjects had also received an additional lithium injection some time earlier (Experiments 1–3). This interference effect of US preexposure was a decreasing function of the preexposure interval, beyond the optimal interval (105 min) for observing the phenomenon (Experiment 1), and was directly related to the dose of the preexposure injection (Experiment 2). No interference with conditioning occurred at short (e.g., 30-min) preexposure intervals (Experiment 1), probably because under these circumstances the preexposure injection itself conditioned a strong aversion (Experiment 4). At moderate (105-min) but not at short (30-min) preexposure intervals, the interference with aversions learned as a result of taste exposure following drug injection was comparable to the interference with learning in a more conventional forward conditioning procedure (Experiments 3 and 4). These findings are similar to previously documented effects of proximal CS- and US-preexposure and are consistent with recent stimulus rehearsal and opponent-process theories.     

Stimulus control of behavior during the postreinforcement pause of FI schedules

Pigeons were given the opportunity to terminate certain segments of fixed intervals by pecking a control key. When 30-sec segments of negative and positive stimuli alternated across the interreinforcement interval (Experiment 1), most birds terminated a large proportion of negative segments. However, few control-key responses were made during the negative segment immediately following food presentation. Under schedules during which only one negative segment was programmed, during the first 30 sec of 1-min intervals (Experiment 2), control-key responses, when they occurred at all, were made after several seconds of the interval had elapsed. Similar findings were obtained when a peck on the control key merely changed the color on the food key (Experiment 3). These findings suggest that the post-reinforcement extinction state (Schneider, 1969) during fixed-interval schedules consists of two phases: an immediate postreinforcement inhibitory phase, followed by a second phase during which a control-key response may occur. These two phases and their associated behavior may be related to Staddon’s (1977) distinction between interim and facultative activities.     

Resurgence of behavior during extinction depends on previous rate of response

In two experiments, food-deprived rat subjects leverpressed for food in three successive training phases. In the first phase of both experiments, rats were exposed to a multiple schedule, one component of which produced a high rate of response, and the other of which produced a lower rate of response (multiple random ratio [RR], random interval [RI] in Experiment 1, and multiple differential reinforcement of high rate, differential reinforcement of low rate in Experiment 2). Rats were then transferred to a multiple fixed interval (FI; 60-sec, 60-sec) schedule, until the effects of the first phase on response rate were no longer apparent and their response rates did not differ from those of rats responding on a multiple FI 60-sec, FI 60-sec schedule without previously experiencing a multiple RR, RI schedule. During the third stage oftraining, all rats were placed into extinction. During extinction, rates of responding were higher in the component previously associated with the high rate of responding in Phase 1, and they were lower in the component previously associated with low rates of responding in Phase 1. These results suggest that resurgence effects, like other history effects, are controlled by previous rates of responding.     

Long-term retention of fear-potentiated startle following a short training session

The permanence of aversive memories has been reported to vary when assessed with conditioned emotional response procedures (months) versus avoidance response measures (days). When evaluated with the potentiated startle paradigm, five light-shock pairings at a 2-min intertrial interval produced highly reliable potentiated startle, which was similar in magnitude from 1 to 28 days after training and maximal using a 0.6-mA footshock intensity. These results are consistent with such measures as conditioned emotional response procedures, in which aversive memories have been observed after months following originaltraining. The results obtained with various shock intensities are also discussed in the context of other indices of fear.     

The immediate-shock deficit and postshock analgesia: Implications for the relationship between the analgesic CR and UR

Rats received a 3-sec, 1-mA footshock either immediately or 3 min after placement in a chamber. Postshock pain sensitivity was assessed with the formalin test. The animals that received the 3-min delay between placement and shock showed an analgesic response compared with noshock controls. The immediate-shock animals did not. Thus the immediate-shock deficit, previously reported for freezing and defecation, also occurs for analgesia. This suggests that shock levels sufficient to condition analgesia are not necessarily sufficient to produce analgesia as an unconditional response. As with freezing, there is a dissociation between conditional and unconditional responses in the fear-conditioning system. Increasing immediate-shock levels to 6 sec, 2 mA produced a transient unconditional analgesia. For analgesia, a conditional response is more readily produced than an unconditional response.     

A concurrent assessment of the positive and negative properties of a signaled shock schedule

A choice and a conditioned suppression procedure were used to assess concurrently the positive and negative properties of stimuli within a signaled shock schedule, Occasional shocks were presented to Ss responding on a variable-interval food schedule. Ss could choose whether shocks occurred alone or whether they were preceded by a 1-min signal. All Ss chose the signaled shock condition over the unsignaled one, even though food reinforced responding in the presence of the signal was suppressed. Rate of responding for food varied across stimulus conditions, with the lowest rate in the presence of the signal and the highest rate in its absence. An intermediate rate occurred under the unsignaled shock schedule. A safety analysis was applied to the data.     

Measurement of current flow through the rat under signaled and unsignaled grid-shock conditions

The present experiment was run to test the hypothesis that, when shock was signaled, rats would develop effective coping responses so as to reduce the current flow through them. A 1-sec shock was delivered through a grid floor by a fixed impedance ac shock source. The current-flow measure was taken over the last 30 of 90 trials given over 3 days and indexed by “gross skin conductance” or GSC (shock). The rat under the signaled shock condition (n=15) showed higher GSC (shock) than did the rats under the unsignaled shock condition (n=14). Thus, the result contradicted the hypothesis. There was no indication that the rats developed any preparatory response during the 5-sec signal, in terms of either GSC (signal) or posture. The results were discussed with reference to the preparatory-response hypothesis and various other possibilities.     

Retention of a running response following appetitive acquisition,extinction, and discrimination

In Experiment 1, hungry rats received 30 rewarded runway trials and then either extinction trials followed by retention tests or just retention tests. Different groups were tested after retention intervals of 1 min, 1, 3, or 24 h, or 30 days. Retention of extinction training was a nonmonotonic, cubic function of time for the early portion of the response chain, with good retention at 1 min and 3 h and little retention at 1 h, 24 h, or 30 days. In the latter portions of the response chain, retention of extinction decreased monotonically with time. Retention following reward-only training varied little in time, though slight losses occurred after 30 days. Experiments 2–3 differed from Experiment 1 in imposing nonchoice discrimination training (reward vs. nonreward) instead of extinction following 30 rewarded trials. After different time intervals (.017, .75, 1.25, 3, and 24 h in Experiment 1; and .017, 1, and 3 h in Experiment 2), retention tests revealed poorest discrimination at intermediate intervals in the initial portion of the response chain, i.e., a Kamin effect appeared. The deficit seemed the result of a loss of response suppression to the cue that signaled nonreward. In latter segments of the response chain, a Kamin effect tended not to appear. Implications for a number of observations and theoretical views are noted.     

Inhibition of the startle reflex in the rat by prior tactile stimulation

In Experiment 1, three groups of rats received a tactile prepulse 0.5, 1, or 2 mA electric shock (to feet) .25, .5, 1, 5, 10, or 20 sec prior to an acoustic startle stimulus. The startle response was, maximally inhibited at the .25-sec interval and gradually recovered thereafter. Inhibition was larger with the intense stimuli, and for the .5-mA stimulus occurred reliably only in animals which responded to the prestimulus. In Experiment 2, the intensity of the prepulse was varied within subjects at intervals of .5, 1, and 2 sec. Inhibition was directly related to prestimulus intensity and was greatest at .5 sec. In Experiment 3, an EMG measure of startle reactivity allowed the use of shorter intervals. The maximal inhibitory interval between the prestimulus and startle stimulus was 40 msec compared with either a shorter 10-msec or a longer 250-msec separation.     

Simultaneous temporal and spatial processing

Rats searched for food that was contingent on time and place in an open field. One location was active at a time, the active location moved in a clockwise direction after each reward, and each location was repeated several times on each daily session. When a location was active, the first response after a fixed interval produced food. The intervals associated with each of the four locations were consistently 60, 30, 30, and 60 sec. For independent groups, inspecting an inactive location had no consequence (n = 7) or reduced the amount of food delivered at the active location (n = 6). The rates of inspecting active and inactive locations increased before the associated intervals elapsed, with preferential responding at the active locations. Rates of anticipation at active locations failed to superimpose when plotted as a function of proportional time. Simultaneous temporal and spatial processing contributed to the failure of proportional timing.     

The effect of modality on long-term recognition memory

Two experiments examined the effects of visual and auditory modes of input on long-term memory. In Experiment 1, 40 subjects learned a 40-word list presented in a blocked or random fashion. In the blocked conditions learners were presented half the nouns in one modality followed by the remaining 20 words in the other modality (See-Hear or Hear-See). Subjects in random conditions also received half the list in each modality, but the presentation was random (Mixed or Mixed Reverse). Following a 6-min delay, subjects completed an 80-item visual recognition test. Analysis of these data showed significantly (p < .05) greater recognition of words presented visually than those presented auditorily. Experiment 2 was designed to test the hypothesis that learners may visualize a “literal copy” of the stimulus item by controlling for the extent to which the recognition measure offered a visual cue. Two groups of 40 subjects were examined using the same procedure used in Experiment 1, with the exception that one group received a visual recognition test while the other was tested auditorily. These data showed that the lack of a visual cue hindered the recognition of visually presented words, while it had little effect on stimuli presented auditorily. The results of these experiments were interpreted as support for the hypothesis that physical characteristics of a stimulus may persist in memory well beyond immediate memory intervals. Subjects were seen to make modality-specific decisions by testing long-term memory for the presence or absence of a visual memory trace.     

公交车调度方案的一种优化设计

研究了公交车调度的最优策略问题,建立了分时段等间隔发车的综合优化调度模型。采用了时间步长法、等效法以及二者结合的等效时间步长法三种方法求解模型.给出了两个起点站的发车时刻表,得出了总共需要49辆车,共发440辆次,平均抱怨度对10%的随机干扰水平相对改变只有0.53%,能满足实际调度的需要.     

Shock intensity and warning signal effects on several measures of operant avoidance acquisition

Acquisition of both signaled and unsignaled operant avoidance learning was studied in 64 rats as a function of shock intensity, with three different warning signals used in the signaled procedure. In both signaled and unsignaled avoidance, overall response rate was a progressively increasing function of shock intensity. This was due to both an absolute and relative increase in the frequency of responses at shorter interresponse times with increasing shock intensity. Presence of an effective warning signal in the interval immediately preceding shock increased the probability of an avoidance response in this interval, decreased overall response rate, and reduced shock frequency. A buzzer signal proved most effective, followed by tone and light. However, once a warning signal occurred, the probability of an avoidance response to the signal was virtually independent of shock intensity. Also, an index of avoidance efficiency proved to be inversely related to shock intensity.     

Reinforcement contexts effects on fixed-interval responding

Three rats responding on fixed-interval schedules received either 1 or 4 pellets at the end of 2-min intervals. Five experimental conditions manipulated the relative probabilities of these two reinforcers. Response rates following the 1-pellet reinforcer were always higher than the rates following the 4-pellet reinforcer. The rates after the 1-pellet reinforcer were also highest in those experimental conditions where it was delivered with low probability. Contrast effects were observed when two sequential fixed intervals differed in reinforcer magnitudes. It was concluded that the context of reinforcement as well as the specific reinforcer magnitude affects responding under fixed-interval schedules.     

Pain-elicited aggression in the squirrel monkey: An implicit avoidance contingency

Squirrel monkeys were given either forward pairings of a bite-tube CS and shock US or backward pairings of these stimuli. Backward pairings produced stronger control of biting by the bite tube alone than did forward pairings. In a second experiment, subjects received backward pairings of US and CS with either a fixed ITI or a random ITI. Conditioned biting was obtained only when trials were presented with a fixed ITI. The magnitude of unconditioned biting was also significantly greater with the fixed ITI. It was argued that these results demonstrate that conditioning in this situation depends upon the degree to which biting predicts a relatively long shock-free period. When trials occur randomly in time, biting predicts no definite shock-free period; hence, it is not learned.     

Response-cost punishment with pigeons: Further evidence of response suppression via token loss

Four pigeons responded on a two-component multiple token-reinforcement schedule, in which tokens were produced according to a random-interval 30-sec schedule and exchanged according to a variable-ratio 4 schedule in both components. To assess the effects of contingent token loss, tokens were removed after every second response (i.e., fixed-ratio 2 loss) in one of the components. Response rates were selectively lower in the loss components relative to baseline (no-loss) conditions, as well as to the within-condition no-loss components. Response rates were decreased to a greater degree in the presence of tokens than in their absence. To control for the effects of changes in the density of token and food reinforcement, two parts consisted of additional conditions where food density and token loss were yoked to those in a previous loss condition. In the yoked-food condition, tokens were produced as usual in both components, but the overall density of food reinforcement in one of the components was yoked to that obtained during a previous token-loss condition. In the yoked token-loss condition, tokens were removed during one component of the multiple schedule at a rate that approximately matched the obtained rate of loss from a previous token-loss condition. Response rates in these yoked components were less affected than those in comparable loss components, despite similar densities of token, exchange, and food reinforcement. On the whole, the results support the conclusion that contingent token loss serves as an effective punisher with pigeons.