A time-series analysis of changeover performance on concurrent variable-interval schedules

Pigeons responded to concurrent variable-interval variable-interval schedules of food reinforcement. Interchangeover times and reinforcements were recorded in intact time series during acquisition following several schedule-density manipulations. Probability of a changeover, while constant as a function of time since the previous changeover, was found to be a nonmonotonically increasing function of time since reinforcement. Autocorrelation analyses of intact time series revealed the presence of statistically significant sequential dependencies in the time series during acquisition, but not during asymptotic performance. Lag transformations of actual interchangeover times revealed inhomogeneities in the time series not shown in the autocorrelations or in the overall distribution of interchangeover times.     

The maintenance of matching behavior when contrast occurs in multiple concurrent concurrent schedules of reinforcement

Pigeons were trained on a multiple schedule of reinforcement in which each component was a concurrent schedule. The concurrent schedules were programmed by the changeover-key procedure. The primary purpose was to determine if the relative behavior allocated to two response alternatives is affected when absolute changes in these behaviors occur; i.e., to determine if matching is affected when positive behavioral contrast occurs. Results showed that (1) relative behavior in the unaltered component of the multiple schedule is not disrupted when positive contrast occurs in that component, (2) positive contrast occurred when the overall frequency of reinforcement in the reinforcement-correlated component(s) was high, but not when it was low, (3) changeover behavior was susceptible to positive contrast effects, and (4) changeover contrast and food-key contrast are independent phenomena.     

Preference between fixed-interval and variable-interval schedules of reinforcement: Separate roles of temporal scaling and predictability

Pigeons’ preference between fixed-interval and variable-interval schedules was examined using a concurrent-chains procedure. Responses to two concurrently available keys in the initial links of the concurrent chains occasionally produced terminal links where further responses were reinforced under either a fixed- or variable-interval schedule. In previous studies, preferences for the variable schedule with such a procedure have been interpreted as reflecting atemporal scaling process that heavily weights the shorter intervals in the variable schedule. The present experiment examined whetherpredictability, i.e., the presence of external stimuli correlated with the reinforcement interval, might also influence preference in such situations. When the two intervals in a variable schedule were made predictable by being associated with different key colors, preference for that schedule increased. This increase was reliable but small in magnitude and transient when initial-link responses only occasionally produced terminal links; it was large in magnitude when only one response in the initial link was required to produce the appropriate terminal-link schedule. The results suggest that preference between fixed and variable schedules may be influenced both by temporal scaling and to a lesser extent by predictability of the reinforcement intervals.     

Sum of responding as a function of sum of reinforcement on two-key concurrent schedules

Four pigeons pecked for food reinforcers delivered by several two-key concurrent schedules. The sum of the rates of reinforcement provided by the component schedules varied from 25 to 300 reinforcers/h. The ratio of the rates of reinforcement remained constant at 1:4. The sum of the rates of responding generated by the component schedules increased with increases in the sum of the rates of reinforcement which the components provided. The increase in response rate was predicted by equations proposed by Catania (1963) and by Herrnstein (1970). But the data conformed more closely to Herrnstein’s equation.     

Effects of signaled reward in instrumental conditioning: Enhanced learning on DRL and DRH schedules of reinforcement

The effects of signaled reward were examined using DRL and DRH schedules of reinforcement. In each case, one group of rats received a brief cue between the reinforced response and the reward, and a second group received brief cues at random times. With the DRL schedule (Experiment 1), signaled reward decreased response rate, increased response efficiency (number of responses per reinforcer), and increased resistence to satiation relative to the control group. With the DRH schedule (Experiment 2), signaled reward increased response rate, efficiency, and resistance to satiation. These results refute an overshadowing explanation of the effects of signaled reward and suggest that food-correlated cues enhance learning of the reinforcement contingencies.     

Effect of intertrial interval on variable-interval discrete-trial barpressing

In seven experiments, an effect of the intertriai interval (ITI) duration on barpressing by rats was studied. A stimulus signaled a 15-sec variable-interval trial. The first response after the interval elapsed turned the stimulus off and was rewarded with food. Trials were separated by long (about 300 sec) or short (about 10 sec) ITIs. A within-subjects design established that response rate on trials after long ITIs was lower than that after short ITIs (Experiments 1 and 3–7). The effect was not cumulative (the effect of one and five consecutive short ITIs was the same). Response rate after short and long ITIs was the same when a between-subjects design was used (Experiment 2). Response rate was higher after 160-sec ITIs than after 300-sec ITIs, suggesting that the ITI duration at which all longer ITIs are treated the same (i.e., the upper limit) is greater than 160 sec (Experiment 3). When food, the trial stimulus, a novel stimulus, or a familiar stimulus never paired with food, was presented 10 sec before the next trial during some of the long ITIs, response rate on the next trial was similar to that found after 10-sec ITIs (Experiments 4–6). This similarity suggested that these events could mark the start of the ITI. However, the familiar stimulus did so only when it reliably predicted that the next trial would occur after a short interval. The effect of ITI duration on responding was apparently attributable to response latency. Response latency was greater after long ITIs, but once responding began, it was similar after long and short ITIs (Experiment 7).     

Effects of reward amount and reward omission on short-term retention

A series of four experiments studied the retention of the response made on a just-preceding trial as a function of the presence, and amount, of food reward given on that trial. Rats were trained to alternate arm choices in a T-maze, and then were tested for alternation with 5- or 30-sec delays between runs. When the subjects had received prior experience with the reward amounts used in testing, larger rewards led to better retention than did small or no rewards. However, when reward omission first occurred during the test phase, it produced more alternation on the following trial than did reward presence. The results suggest that both reward amount and surprisingness determine short-term retention of responses paired with the rewards.     

Microanalysis of variable-interval performance during stimulus compounding

Additive summation is observed when more responses are emitted to the simultaneous presentation (tone-plus-light) of independently conditioned stimuli (tone and light) than to either stimulus presented alone. The current experiment sought to determine if this increased rate during tone-plus-light was a function of a new modal interresponse time (IRT) or a differential mixing of pauses with a modal IRT characteristic of the responding in tone and light alone. Three rats were trained on a three-component multiple schedule where tone and light were each associated with a variable-interval 30-sec schedule while a variable-interval 100-sec operated in the simultaneous absence of these stimuli, tone-off and light-out. Baseline response rates were 2–4 times as high in tone or light as in their absence. In testing, more responses were emitted to tone-plus-light than to tone or light by all animals, but the modal IRT was in the 0.2–0.4-sec IRT bin for all test conditions. Tone-plus-light controlled fewer long IRT values and more responses in the short modal category than tone or light alone. These results support the response mixing hypothesis of stimulus control; i.e., no “new” behavior was observed during the novel combination of stimulus elements, only a mixture of previously reinforced behavior patterns in different proportions.     

Differential punishment of other behavior: Effects of pause-dependent shock on variable-interval performance

Three albino rats were exposed to a differential-punishment-of-other-behavior shock schedule superimposed on a variable-interval schedule of food presentation. With this arrangement, failure to barpress for a specified interval since the previous response resulted in delivery of shock. This procedure reliably decreased the number of specified pauses and was accompanied by increases in barpress rates and shifts in the distribution of responses. Subsequent exposure to noncontingent shock produced similar, but quantitatively smaller, changes for two of the three subjects. Training with barpress-dependent shock and reexposure to noncontingent shock further diminished these effects. This study demonstrates that pauses are conditionable units of behavior insofar as they are sensitive to a punishment contingency. In terms of the targeted unit of behavior, the current findings are similar to those obtained with barpress-dependent or interresponse-time-dependent shock schedules and suggest a continuum of response specification.     

Effects of varied and partial reward on discrete-trial patterning of rats

Rats were trained in the discrete-trial operant apparatus with single alternation of large reward and small reward or large reward and nonreward. followed by either transfer or extinction. The results showed that both groups acquired appropriate response patterning, that patterning is conditioned, and that the stimuli which control patterning are derived from reward conditions on immediately preceding trials. A modification of the sequential hypothesis of instrumental learning was proposed to account for the results.     

Adjunctive behavior in multiple schedules of reinforcement

A recent theory of timing (Killeen & Fetterman, 1988) suggests that adjunctive behaviors may act as discriminative cues for the passage of time and that the rate of transition between those behaviors is affected by the rate of reinforcement within the experimental context. Is the rate of transition between behaviors correlated with the rate of reinforcement? What is the context in which rate of reinforcement is calibrated? If rate of transition is correlated with reinforcement frequency, does this correlation change with extended training? Four pigeons were trained on multiple fixed-time schedules of reinforcement, with one component always FT 15 sec, the other either FT 15 sec, FT 45 sec, or FT 5 sec. Behavior was coded into one of 12 categories. Response distributions in the constant component shifted when rate of reinforcement was varied in the other component and eventually shifted back toward their original location.     

悬赏广告制度探究

悬赏广告是以广告方式声明对完成一定行为的人给予报酬的意思表示,它含以下四方面特殊要件：采取广告形式;声明给予报酬;指明期待完成的特定行为;对不特定的人为之。悬赏广告的性质为契约之要约。总结我国各时期的实践经验,参考国外成功之处,以一定方式对悬赏广告的适用范围及报酬额度于以国家干预是必要的。     

Sequences of reward magnitude and runway performance

Three groups of rats underwent 24 days of training and 12 days of extinction (three trials per day) in a runway under conditions of increasing (I), decreasing (D), and random (R) sequences of reward magnitudes (0, 45, and 500 mg). The I Ss ran faster over the daily trials, the D Ss slowed down, and the R Ss ran at approximately equal speeds on each trial. The patterned running observed in training persisted in extinction, with the R Ss running fastest and the I Ss next. The results were discussed in terms of Capaldi’s sequential theory and Amsel’s frustration theory.     

Effects of external reward on paired associate learning in a group setting

A study was conducted to determine the effects of external reward in the form of prizes on the performance of college students in a paired-associate learning task in which subjects were asked to recall a real word associated with a nonsense word. Two groups, one of whom was offered a prize, received the S-R pairs with no aid (no mediators); and two groups, one of whom was offered a prize, received the S-R pairs with a sentence-pictorial aid mediator. Results of two-way ANOVA supported the hypothesis that the No Prize/Aided and No Prize/NonAided groups would exhibit performance of higher quality than the groups offered prizes. The dependent measure was number of correct responses over six trials.     

Simultaneous and successive contrast with delay of reward

In Experiment I, rats showed no evidence of a successive negative contrast effect (NCE) when shifted from immediate reward to a 15-sec delay of reward. Experiment II provided a direct comparison of NCE in both successive and simultaneous paradigms. As in Experiment I, there was no evidence of a successive NCE, but a reliable simultaneous NCE was observed. These results add support for the view that simultaneous and successive NCEs are not due to a single, common process.     

Effects of partial vs consistent reward in noncontingent pairings of stimuli with reward: A noncontingently produced positive contrast effect

Rats received pairings of two stimuli with reward noncontingently in the Skinner box. During noncontingent pairings, the bar was immobilized. For Group CC 100% of the presentations of both stimuli were rewarded (S₁ ±, S₂ ±), for Group PP 50% of the presentations of each stimulus were rewarded (S₁, ±, S₂±), and for Group PC one stimulus was followed by reward on 50% of its presentations, while the second stimulus was followed by reward on 100% of its presentations (S₁ ±, S₂ ±). A fourth group received the stimuli and reward nonpaired. In a subsequent rewarded test phase, the response facilitating effects of the stimuli were evaluated. In the test phase all groups that received reward paired with S₁, and S₂ performed better in the presence of S₁ and S₂ than the group for which the stimuli were not paired with reward. For groups that received the stimuli paired with reward, a difference due to schedule of reward occurred when schedule of reward was varied within Ss (Group PC), but not when varied between Ss (Group PP vs Group CC). The specific form of this finding was that Group PC’s performance in the presence of S₂ ± was more vigorous than its performance in the presence of S₁ ± and was more vigorous than the performance of Groups PP and CC to S₂. Group PC’s performance to S₁ ± did not differ from that of Groups PP and CC to S₁.     

有奖解题擂台(48)

题设a、b、c∈(0,√2),且a2+b2+c2+abc=4,求证:abc≥(2-a2)(2-b2)(2-c2)≥(4a2-a4-2)(4b2-b4-2)(4c2-c4-2).     

有奖解题擂台(47)

题在△ABC中,证明或否定不等式:40/27＜sinA/sinA+sinB+sinB/sinB+sinC+sinC/sinC+sinA＜41/27.