Effects of reward amount and reward omission on short-term retention

A series of four experiments studied the retention of the response made on a just-preceding trial as a function of the presence, and amount, of food reward given on that trial. Rats were trained to alternate arm choices in a T-maze, and then were tested for alternation with 5- or 30-sec delays between runs. When the subjects had received prior experience with the reward amounts used in testing, larger rewards led to better retention than did small or no rewards. However, when reward omission first occurred during the test phase, it produced more alternation on the following trial than did reward presence. The results suggest that both reward amount and surprisingness determine short-term retention of responses paired with the rewards.     

Effects of forced-choice runway variations on rats’ T-maze serial pattern learning

Rats learned an ordered RNR/RNN serial pattern task in a T-maze where they were shifted to a different runway on Trial 3 only in the RNR series (shift-win/stay-lose group) or only in the RNN series (stay-win/shift-lose group). The shift-win/stay-lose group developed faster speeds on Trial 3 of the RNR than on Trial 3 of the RNN series more easily than the stay-win/shift-lose group. This difference occurred whether all rats were forced onto the same runway on the first two trials (Experiment 1) or onto a different runway on Trial 2 from that on Trial 1 in each series (Experiment 2). Posttraining probe tests revealed that the shift-win/stay-lose group in each experiment relied on the runway shift event in Trial 3 or on the series position to anticipate the second reward within a series. Such reward expectancies were greater when the runway shift occurred in the same series position as during training. These probe tests revealed that the stay-win/shift-lose group relied only on the series position in Experiment 2. Our findings do not support predictions based on an associative predictive validity model. Rather, they reflect rats’ predisposition to spontaneously alternate choices in the T-maze, a tendency corresponding to their inherent win-shift foraging strategy. Rats in each group also reduced their speeds less on the nonrewarded Trial 2 when it preceded a rewarded rather than a nonrewarded Trial 3. This effect suggests that rats were able to determine which series contained a second rewarded trial. We discuss the theoretical implications of this Trial 2 speed effect in terms of rats’ uncertainty about where this second rewarded trial might occur in the RNR series.     

Effects of intertrial reward and/or nonreward placements during a 20-second intertrial interval on single-alternation training in rats

Seventy male hooded rats received single-alternation runway training in which goalbox placements were interpolated during the 20-sec intertrial interval. Placements provided alternating reward/ nonreward, random reward/nonreward, continuous reward, or continuous nonreward. Relative to nonplaced controls, alternation performance was reliably facilitated only by intertrial alternation placements which re-presented the goal event of each immediately preceding instrumental trial. All other intertrial procedures reliably impaired alternation performance. Degree of impairment was graded from least to most as follows: intertrial alternation placements with the goal event opposite to that of each immediately preceding instrumental trial, intertrial placements with continuous non-reward, intertrial placements with continuous reward, and intertrial placements with random reward/nonreward.     

Spatial localization of a goal: Beacon homing and landmark piloting by rats on a radial maze

We performed six experiments in order to examine the ability of rats to use moving beacons and landmarks as cues to the location of reward on an eight-arm radial maze. In Experiments 1–4, the cues and goals were moved before each trial, and groups in which a single beacon was placed on the rewarded arm, a single landmark indicated that reward was on the arm immediately to the left of a landmark, or two landmarks were placed on each side of the reward arm were compared. The rats rapidly learned to track the reward in the beacon condition, failed to find the reward sooner than chance expectation with a single landmark, and did only slightly better than chance with two landmarks. In Experiments 5 and 6, the rats were trained in five trials per day, with the landmark and goal locations constant over daily rewarded trials, and in two extinction trials that were inserted among the rewarded trials. The rats found the goal arm at substantially better than chance expectancy with both one and two landmarks. Our results, in agreement with data from recent swimming pool experiments (A. D. L. Roberts & Pearce, 1998), show that rats will use the relationship between moving landmarks and a goal in order to find reward.     

Response variability in pigeons in a pavlovian task

Instrumental response variation is inversely related to reward probability. Gharib, Derby, and Roberts (2001) theorized that individuals behave more variably when their expectation of reward is low. They postulate that this behavioral rule assists the discovery of alternative actions when a target response is unlikely to be reinforced. This suggests that response variability may be unaffected in a situation in which an animal’s behavior is inconsequential to outcome delivery. We trained 6 pigeons in a within-subjects Pavlovian autoshaping procedure. On any given trial, the pigeons were presented with one of six colored discs on a touchscreen; each stimulus was associated with a particular probability of food, ranging from 100% to 0.6%. Pecking was more variable with low probabilities of food delivery, thus extending the rule relating variability and expectation to a Pavlovian situation.     

Anxiolytic-like effect of ejaculation upon frustration

In three experiments, we studied the consequences of ejaculation upon the frustrative or contrast response of male rats exposed to reward downshift situations (i.e., surprising changes from 32% to 4% sucrose solutions). Similar to what has been found after treatment with anxiolytic agents, consummatory suppression was partially reversed by previous ejaculations in a second postshift trial (Experiments 2 and 3), such a result not having been obtained in a first postshift trial (Experiment 1). Moreover, the effect of ejaculations upon males' behavior during a second postshift trial was transitory, disappearing when assessed during the third and fourth postshift trials (Experiment 3). These results are in accordance with both Amsel's (1958, 1992) frustration theory and Flaherty's (1996) multistage hypothesis of successive negative contrast; the diverse factors that are known to modulate contrast effects are considered, including an interpretation of the present data in terms of the anxiolytic-like effect of the ejaculation.     

Reward and learning in honeybees: analysis of an overshadowing effect

Previous experiments have shown that honeybees trained with colored targets baited with 5- versus 20-µl drops of sucrose solution fail to develop a preference for the 20-µl color when the location of the drop on each target is marked by a white dot (dot-color overshadowing) but that discrimination is not impaired by dots when the targets differ in odor rather than in color. In Experiments 1–3, dot-color overshadowing failed to appear with differences in concentration rather than amount of sucrose (50% vs. 20% or 0%), but it did appear in Experiments 4 and 5 with a difference in probability of reward (consistent vs. partial). Experiment 6 showed no dot-odor overshadowing with a difference in probability of reward. The results are not generally predictable from the Rescorla-Wagner principle of shared associative strength, but point instead (in conjunction with those of earlier experiments) to competition for visual attention.     

复合酸化剂对断奶仔猪抗腹泻效果和生产性能的影响

通过体外实验和断奶仔猪饲养试验研究了包被复合酸化剂(简称复合酸化剂)的抑菌效果及其对断奶仔猪抗腹泻效果和生产性能的影响.体外试验结果表明,采用抑菌圈法对不同浓度的复合酸化剂进行比较时,以0.2%的浓度显示出较强的抑菌效果,对大肠杆菌、沙门氏菌和乳酸杆菌的抑菌圈直径分别达到了15.0、16.8和13.0 mm.仔猪饲养实验结果表明:与不合酸化剂的对照组或有机酸化剂组相比,在基础日粮中添加了0.2%的包被复合酸化剂可以进一步提高仔猪的生长速度及饲料转化率,同时可以降低仔猪的腹泻率.     

Landmark use by squirrel monkeys (Saimiri sciureus)

Two squirrel monkeys searched for a reward buried in 1 of 144 holes that formed a 12×12 grid (48×50 cm). An array of vertical, colored landmarks was placed on the grid, and their locations on the grid were changed from trial to trial. During training trials, the mealworm reward was placed either in the center of a square array of landmarks (Experiments 1 and 3) or midway between two landmarks (Experiment 2). On nonrewarded test trials, the monkeys searched among landmarks placed in the same arrays as those used in training and among landmarks placed in an expanded array (Experiments 1 and 2) or in an array intermediate between the two arrays used in training (Experiment 3). Distributions of searches on test trials indicated that the monkeys searched mostly within the configuration of the landmarks but that they had not coded the location of the reward as being either in the middle of the landmarks or at a fixed distance and direction from an individual landmark.     

Short-term spatial memory in honeybees

Foraging honeybees were trained individually in two-choice spatial problems. Differentially rewarded for spatial alternation in Experiment 1 (“win-shift” training), they showed instead a clear tendency to perseverate—that is, to prefer on each trial the location of reward on the immediately preceding trial. On the basis of the results of Experiments 2 and 3, in which one location was rewarded over shorter or longer series of consecutive trials, an associative interpretation of the perseveration found in the first experiment was rejected in favor of an interpretation in terms of short-term spatial memory. Experiment 4, in which the animals were rewarded on each trial for choosing either location, also showed perseveration. Honeybees, like rats, seem to remember a rewarded location recently visited, but tend to return to it rather than, like rats, to avoid it.     

Discriminating between reward-produced memories: Effects of differences in reward magnitude

The greater the dissimilarity between exteroceptive stimuli, the easier it is to discriminate between them. To determine whether a similar relationship holds for memories produced by reward events, rats in three runway investigations received trials in pairs, the number of food pellets (0.045 g) occurring on Trial 1 indicating whether reward or nonreward would occur on Trial 2. In each investigation, discriminative responding on Trial 2 was better the larger the difference in reward magnitude on Trial 1. This finding was obtained under a wide variety of conditions: for example, when the larger of two reward magnitudes on Trial 1 signaled nonreward on Trial 2 (Experiment 1, 10 vs. 2 pellets); when the smaller of two reward magnitudes on Trial 1 signaled nonreward on Trial 2 (Experiment 2, 10 vs. 2 pellets); and when the same magnitude of reward on Trial 1 signaled nonreward on Trial 2 (Experiment 3, either 5 pellets or 0 pellets). The findings obtained here indicate that the greater the dissimilarity between reward magnitudes, the greater the dissimilarity between the memories they produced and, thus, the easier it is to discriminate between them. It is suggested that the present results may provide a basis for understanding findings obtained in other instrumental learning investigations in which reward magnitude is varied.     

美国课堂管理中的有效奖励与无效奖励

奖励是美国课堂管理中用得最多的技能之一.各种课堂管理理论流派及其模式在管理中都会自觉或不自觉地使用奖励.本文旨在探讨奖励的有效性,提高课堂管理的效能.本文在接受布罗菲关于有效表扬的12条建议的基础上,扩大了表扬的研究范围,提出了有效奖励的30条建议.     

Instrumental performance and time between reinforcements: Intimate relation to learning or memory retrieval?

According to scalar expectancy theory (SET), instrumental performance is determined by the ratio of the time between reinforcements in the trial (T _T) to the overall time between reinforcements (T _O). Groups for which theT _O|T _T ratio is the same should perform similarly. According to the sequential-memory view, the memory of nonreward becomes a signal for reward, and thereby promotes strong responding, when that memory is retrieved on a reward trial. In each of three runway investigations employing rats in a runway, two groups were compared that had the sameT _O |T _T ratio but that differed in the tendency to retrieve the memory of nonreward on a rewarded trial. In each investigation faster running on critical nonrewarded trials was associated with the group having the stronger tendency to retrieve the memory of nonreward on a rewarded trial. These findings are consistent with the predictions of the sequential-memory view, as well as with certain earlier findings, but are inconsistent with SET. It was indicated that the groups compared here were matched along a considerable number of dimensions—an unprecedented number for a varied reward investigation.     

Preexposure to situational cues produces a direct relationship between two-way avoidance learning and shock intensity

In Experiment 1, four groups of subjects (n = 16 each) were exposed to the situational stimuli of a shuttlebox apparatus for 4 h. Subsequently, 200 two-way avoidance trials were administered (100/day) with either .3- or 1.6-mA shock and with either small or large reward (presence or absence of visual stimuli following the response). Avoidance performance was directly related to shock intensity on both days and to magnitude of reward on the 2nd day. In Experiment 2, four groups of subjects (n = 24 each) were given 4 h of exposure either to the situational stimuli of the shuttlebox or to a neutral box. Then, 10 two-way avoidance trials were given with 1.6-mA shock. Subsequently, subjects were allowed to escape from one of the shuttlebox compartments to an adjacent safe box. Following preexposure to situational stimuli, avoidance performance was superior whereas escape-from-fear performance was inferior. This latter finding demonstrated that less fear of situational cues was present during avoidance training in the preexposed condition. All of these results support the effective reinforcement theory, an extension of two-factor theory, which emphasizes the importance for avoidance learning of the amount of fear of situational cues present following a response.     

Infant Chimpanzees Spontaneously Perceive Both Concrete and Abstract Same/Different Relations

We used a familiarization-novelty procedure to determine whether 4 infant chimpanzees spontaneously perceive the sameness of and the difference between both concrete objects and relations between objects. In Experiment 1, a single object was presented on the Familiarization Trial 1 and the animal's looking time recorded. On the Test Trial 2, an object was presented that was either identical to or different from that shown on Trial 1. Looking times on Test Trial 2 were less when the same item had been presented on the preceding familiarization trial. Novel items on Trial 2 were attended to longer, indicating that the infant chimpanzees perceived concrete objects were either the same or different. In Experiment 2, a single pair of objects was presented on the Familiarization Trial 1, and handling time was measured. The objects in a pair were either the same or different (e.g., AA vs. CD). On the Test Trial 2, a new object pair (e.g., BB vs. EF) was presented that instantiated either the relation shown on Trial 1 or the alternative relation. Handling time on Trial 2 was influenced by the relation instantiated on Trial 1. Handling times on Test Trial 2 were less when the identical relation had been presented on the preceding familiarization trial. Novel relations on Trial 2 were attended to relatively longer. This result indicates that infant chimpanzees perceive similarities and differences between abstract relations as well as between concrete objects. That is to say, they perceived relations between relations in Experiment 2. Despite this ability to perceive both concrete and abstract "same/different" relations, the same chimpanzees subsequently failed to use the latter knowledge in a matching-to-sample task in Experiment 3. Although they successfully matched single objects, they were unable to match object pairs instantiating the same relation (e.g., if AA then match BB; if CD then match EF). These results contradict claims that failure to learn an instrumental discrimination involving abstract relations reflects an inability to detect such relations. In every species there may be a disparity between the ability to perceive spontaneously a property of the world and the ability to use the concept instrumentally.     

Reward sequence and reinforcement level as determinants of S− behavior in differential conditioning

In two differential conditioning experiments, groups of 10 rats each differed with respect to average reward and schedule of reward received in S+. Nonreward (N) occurred on all S? trials. In both experiments, extinction of responding to S? (resistance to discrimination) was extensively regulated by reward sequence and was largely independent of average reward. In Experiment 1, resistance to discrimination was a function of transitions from N to rewarded (R) trials (N-R transitions). In Experiment 2, resistance to discrimination was increased by large reward on the R trial of N-R transitions and decreased by large reward on the R trial of R-N transitions. These schedule effects on resistance to discrimination parallel the effects of comparable schedules on resistance to extinction following partial reinforcement. The results are discussed in terms of sequential theory, reinforcement level theory, and their implications for various schedule manipulations that have previously shown S? behavior to be inversely related to average reward in S+.     

The use of local features and global spatial context for object recognition in a visuomotor task in the Mongolian gerbil

Mongolian gerbils were trained to jump across gaps of randomly varying width in order to obtain a food reward. During training, gerbils learned to jump to each of two landing platforms differing in width. These landing platforms were associated with unique spatial contexts (Experiment 1), local features (Experiment 2), or both (Experiment 3). In test sessions, a landing platform was substituted that was intermediate in width between the two training platforms of novel width, in order to determine whether gerbils could use retinal image size to calibrate distance. Experiments 1 and 2 suggested that gerbils used spatial context but not local feature information to identify the target platforms. In Experiment 3, when the probe platform was presented with the same local feature information and in the same context as seen in training sessions, gerbils over- or underjumped in a manner predicted if they were using the retinal image size of the target to calibrate the distance across the gap. When the probe trials contained a mismatch between context and local feature information, no systematic over- or under-jumps were seen, and jumping accuracy was decreased. Taken together, these results suggest that, in this task, objects are identified primarily on the basis of the spatial context in which they are seen and not on the basis of their local features.     

Learning in honeybees as a function of amount and frequency of reward

In a series of four experiments with free-flying honeybees, individual foragers were trained with targets of two different colors that contained 5 or 20 μl of 50% sucrose solution. The two targets were singly presented in quasi-random sequences on each visit, with the amount of reward to be found on each target perfectly predictable from its color. The number of training visits (4–32) was varied both within and between experiments, and so also was the relative frequency of trials with the 5- and 20-μl targets (1:1, 2:1, 3:1, and 9:1). At the conclusion of training under each condition, unrewarded responses to the targets were measured in a 10-min extinction test, with the targets presented either separately to two different groups of animals (Experiment 1) or as a pair (Experiments 2–4). When the number of training trials with each target was the same (Experiments 1 and 2), the animals responded more in extinction to the 20-μl target than to the 5-μl target, although there was a decline in the overall level of responding to both targets (an overlearning-extinction effect) as the number of training trials increased. After nine times as many, or only three times as many, training trials with the5- μl target as with the 20-μl target, the animals responded more in extinction to the 5-μl target (Experiment 3); after twice as many training trials with the 5-μl target as with the 20-μl target, there was equal responding to both (Experiment 4). The preferences shown in the choice tests of Experiments 2–4 could be simulated rather accurately on the assumptions of a model previously developed to deal with the discrete-trials choice behavior of honeybees and the further assumption that associative strength grows at a rate increasing with amount of reward to an asymptote independent of amount of reward.     

Sequences of reward magnitude and runway performance

Three groups of rats underwent 24 days of training and 12 days of extinction (three trials per day) in a runway under conditions of increasing (I), decreasing (D), and random (R) sequences of reward magnitudes (0, 45, and 500 mg). The I Ss ran faster over the daily trials, the D Ss slowed down, and the R Ss ran at approximately equal speeds on each trial. The patterned running observed in training persisted in extinction, with the R Ss running fastest and the I Ss next. The results were discussed in terms of Capaldi’s sequential theory and Amsel’s frustration theory.     

The representation of items in serial position

Four experiments with rats tested their ability to anticipate serial patterns made from elements of reward magnitudes (14, 7, 3, 1, or 0 food pellets). Anticipation was measured by the running time in a straight alley. Elements arranged in a monotonically descending pattern were more easily anticipated than were the same elements arranged in a nonmonotonic pattern. Better anticipation was also observed when training utilized four trials per day with short interrun intervals (10–15 sec), spent in the startbox of the runway, than when training utilized one trial per day with long interrun intervals (4–5 min), spent in the rat’s home cage. Anticipation of the monotonie sequence was also superior when training consisted of one trial per day with a short interrun interval relative to that observed with four trials per day and a long interrun interval. Following acquisition of anticipation of the monotonie sequence with a short interrun interval, transfer to the same sequence with a long interrun interval resulted in disruption of anticipation. Finally, anticipation of a well-learned monotonie sequence was not disrupted by replacement of individual rewarded elements in the sequence with a 0-pellet element. These experiments indicate that the duration between runs of a trial, but not that between trials or the number of trials per day, is important in the formation of serial expectancies. They also suggest that the rats come to represent the sequence as items in serial position.