Partial reinforcement effects on discrimination learning

Rats were trained on a series of reversals of a successive discrimination in which the percentage of S+ trials ending in food was varied. Changes in the discrimination index occurred more slowly with 50% reinforcement than with 100% reinforcement when the number of training trials was equated across conditions, but were approximately invariant when the conditions were equated with respect to the number of obtained reinforcements. Presentation of free reinforcement during the intertrial intervals reduced the overall rate of discrimination acquisition, but left this invariance unaffected. Invariance in reinforcements necessary to attain acquisition also occurred when different discriminations correlated with different percentages of reinforcement were intermixed within experimental sessions. The failure of the invariance effect to be disrupted by either manipulation suggests that previous accounts of the invariance effect in terms of “comparator” models of conditioning (e.g., Gibbon & Balsam, 1981) are inadequate.     

Latent discrimination learning under a regular schedule of partial reinforcement

In this investigation, which employed rats in a runway, discriminative responding consisted of faster running on the reinforced than on the nonreinforced trials of either the 4NR or R4N schedule, both schedules containing fixed, repeated sequences of nonreinforced and reinforced trials. Under the 4NR schedule, four nonreinforced trials preceded a reinforced trial each day, and under the R4N schedule, a reinforced trial was followed by four nonreinforced trials each day. The major finding obtained was that under the 4NR schedule, discriminative responding was improved very substantially by a shift to extinction. Rats maintained on the 4NR schedule did not show improved discriminative responding, nor did discriminative responding improve in extinction following training under either the R4N schedule or a schedule of consistent reinforcement. Latent discrimination learning was defined as discriminative responding which fails to reflect adequately the amount of discrimination learning accomplished. The present findings demonstrate latent discrimination learning for regular schedules of partial reinforcement, something already demonstrated for brightness differential conditioning and possibly DRL schedules, as well.     

Feature-positive and feature-negative discrimination learning maintained by negative reinforcement in rhesus monkeys

Rhesus monkeys were trained to press panels to escape or avoid shock. Escape and avoidance training were combined factorially with feature-positive (FP) and feature-negative (FN) discriminations. In the FP situation, S+ trials were characterized by one red and two green panel displays and S? consisted of an all green panel array. In the FN arrangement, S+ and S? arrays were reversed. When compared properly, FP discriminations were learned more readily than FN discriminations in both escape and avoidance training conditions. Positive tracking was associated with FP discriminations, and feature avoidance characterized the FN tasks. These data suggest that in primates, feature responses (i.e., tracking behaviors) are more a function of the operant contingency than of the Pavlovian correlation.     

Preference reversal and delayed reinforcement

Pigeons chose, in a two-key discrete-trial procedure, between 2- and 4-sec access to grain, with the larger amount always presented 4 sec later than the smaller. As the delay between the choice and the availability of the smaller reinforcement was varied from .01 to 12 sec, all subjects reversed preference from the small-early to the large-late reinforcement. The values of delay at which preference reversed were approximately consistent with the matching law as adapted for delayed reinforcement.     

Serial discrimination reversal learning in pigeons as a function of intertrial interval and delay of reinforcement

Pigeons learned a series of reversals of a simultaneous red-green visual discrimination. Delay of reinforcement (0 vs. 2 sec) and intertrial interval (ITI; 4 vs. 40 sec) were varied across blocks of reversals. Learning was faster with 0-sec than with 2-sec delays for both ITI values and faster with 4-sec ITIs than with 40-sec ITIs for both delays. Improvement in learning across successive reversals was evident throughout the experiment, furthermore, even after more than 120 reversals. The potent effects of small differences in reinforcement delay provide evidence for associative accounts and appear to be incompatible with accounts of choice that attempt to encompass the effects of temporal parameters in terms of animals’ timing of temporal intervals.     

Operant variability when reinforcement is delayed

Operant responses are often weakened when delays are imposed between the responses and reinforcers. We examined what happens when delayed reinforcers were contingent upon operant responsevariability. Three groups of rats were rewarded for varying their response sequences, with one group rewarded for high variability, another for middle, and the third for low levels. Consistent with many reports in the literature, responding slowed significantly in all groups as delays were lengthened. Consistent with other reports, large differences in variability were maintained across the three groups despite the delays. Reinforced variability appears to be relatively immune to disruption by such things as delays, response slowing, prefeeding, and noncontingent reinforcement. Furthermore, the small effects on variability depended on baseline levels: As delays lengthened, variability increased in the low group, was statistically unchanged in the middle group, and decreased in the high group, an interaction similar to that reported previously when reinforcement frequencies were lowered. Thus, variable operant responding is controlled by reinforcement contingencies, but sometimes differently than more commonly studied repetitive responding.     

Maintenance of responding when reinforcement becomes delayed

In four experiments with rats, we examined the persistence of behavior when reinforcement was switched from immediate to delayed. In Experiment 1, lever pressing elicited by instrumental training with immediate reinforcement continued when a 20-sec delay of reinforcement was introduced (easy-to-hard condition), whereas when the delay condition was introduced from the start (hard-to-hard condition), responding remained low throughout. A similar result was obtained in Experiment 2, in which lever pressing was elicited by a classical conditioning (autoshaping) procedure. In Experiment 3, rats initially trained with delayed reinforcement continued to respond at a low rate when switched to immediate reinforcement (hard-to-easy condition). By measuring magazine entry (goal tracking) as well as lever pressing (sign tracking) in Experiment 4, we confirmed that such transfer effects at least partly involve the persistence of whatever type of behavior was initially dominant.     

Facilitation for professional learning community conversations in Singapore

Abstract

Professional Learning Community (PLC) has steadily grown in importance over the last decade. The growing importance of PLCs lies in its potential to act as a lever for school-based curriculum development and innovation so as to provide diverse learning experiences to satisfy broader learning outcomes beyond academic achievements (e.g., the twenty-first century skills). The growth in PLCs implies greater time investment for teachers to come together to develop new curricula that engage students to meet these broadened set of learning outcomes. However, this also implies that new competencies need to be acquired to productively participate in PLCs. One essential competency is facilitating PLC conversations. This paper describes key findings drawn from participant observations with three Grade 5 PLC facilitators’ involvement in an intervention to explore how PLC facilitators can support teachers’ collective learning with one another on matters of teaching and learning. The findings from the study served to aid in generating a proposed intervention framework consisting of processes, principles, and practices that facilitators can use in PLC conversations.     

基于视觉注意机制深度强化学习的行人检测方法

结合视觉注意机制,并用深度强化学习训练视点选择模型,模拟人类视觉搜索局部关键部位,提出了新的行人检测方法,通过视点选择模型生成聚焦图像,不断地叠加搜索关键区域,由检测网络对关键区域进行行人判别,并通过信息熵度量检测结果的可信度,作为奖赏通过深度强化学习优化视点选择模型。视点选择模型和检测网络协同迭代训练,使该方法具有很强的局部关键区域选择和判别能力,减少了形变和遮挡的影响。与经典的基于部位的行人检测方法在公开的行人检测数据集进行对比实验,结果表明,所提出的行人检测方法可以有效地提高行人检测精度。     

Simple delayed discrimination of tastes in the rat

Although taste memory has been extensively studied within the context of long-delay taste aversion learning, little attention has been devoted to taste memory within more traditional memory designs, for example, simple delayed discriminations. This was examined in the present experiment. Specifically, following taste discrimination training during which responding was reinforced following exposure to only one of two tastes, delays were imposed between sampling of the initial taste and the opportunity to respond. On the average, subjects were able to perform the simple delayed taste discrimination with an accuracy of 80% or better at a delay of 45 sec. Discrimination performance returned to chance at an average delay of 58 sec. Taste memory within the simple delayed discrimination paradigm is discussed and compared with other assessments of short-term memory in the rat and other species.     

Conditioned inhibition in feature negative discrimination learning with pigeons

Discrimination performance was investigated with pigeons using feature negative (FN) discrimination procedures which differed in the temporal arrangement of the stimuli on S? trials. In both procedures, a single common element was presented on reinforced (S+) trials. In thesimultaneous FN procedure, a distinguishing element was presented simultaneously with the common element of S? trials. In thesequential FN procedure, the distinguishing element preceded onset of the common element on S? trials. In two experiments, the sequential FN procedure yielded better discrimination performance. In Experiment 1, a summation test designed to separate learning and performance variables indicated that sequential FN subjects had learned the negative relationship between the distinguishing element and reinforcement while simultaneous FN subjects had not. In Experiment 2, summation and acquisition tests indicated that the distinguishing element developed inhibitory properties in the sequential FN procedure but not in the simultaneous FN procedure.     

Reward pretraining and discrimination learning set

Pigtailed monkeys were trained on discrimination problems involving objects that had been previously paired with reward, previously paired with nonreward, or objects not associated with any pretraining. In two separate studies, no differences on these various problem formats were observed, but performance improved considerably with practice. These results are contrary to the theories for learning set formation of Spence and Medin.     

Simultaneous discrimination learning: Stimulus interactions

Although considerable attention has been given to interactions between events serving as the positive (S+) and negative (S−) stimuli in successive discriminations, there has been little study of similar interactions in simultaneous discriminations. We propose that in a simultaneous discrimination, given what is typically relatively little experience with the consequences of responding to the S−, some of the value of the S+ transfers to the S− with which it was paired. Furthermore, the mechanisms responsible for this transfer of value appear to be the higher order Pavlovian association between the S− and the S+, as well as within-event associations between them. Although in typical simultaneous discriminations, negative value does not appear to transfer from the S− to the S+, when adequate experience is provided with the S−, contrast typically develops, reducing the value of the S− (negative contrast) and enhancing the value of the S+ (positive contrast). This model of stimulus interactions has implications not only for simple simultaneous discrimination learning, but also for research using combinations of discriminations (e.g., transitive inference in animals and humans). This model may also have implications for a number of human social psychological phenomena.     

Contrast effects in simultaneous discrimination learning

Pigeons were trained on a form discrimination that alternated across trials with an already-learned color discrimination, which was associated with different probabilities of reinforcement for different groups. The rate of acquisition of the form discrimination varied inversely with the rate of reinforcement for the color discrimination, thus demonstrating a “contrast effect” in simultaneous discrimination learning.     

The nature of discrimination learning in pigeons

The results from five experiments are considered in relation to two of Spence's (1937, 1938) proposals concerning discrimination learning. In Experiments 1 and 2, we investigated whether his ideas about the interaction between excitatory and inhibitory generalization gradients can be used to understand how animals solve a complex patterning discrimination. The results supported a development of his proposals as put forward by Pearce (1994), provided a modification was made to Pearce's rulefor determining the shape ofthe generalization gradient. In Experiments 3, 4, and 5, we examined whether animals would pay more attention to stimuli that are relevant, rather than irrelevant, to the solution of a discrimination. The results supported this proposal for stimuli comprising visual patterns, but not for those comprising plain colors. The results also indicated that change of attention was a consequence of preliminary receptor-exposure acts, as envisaged by Spence, and not of more central changes in attention.     

Partial reinforcement delayed extinction effect after regularly alternating reward training

When extinction is delayed very long, the superior resistance to extinction of the random schedule group relative to the alternating schedule group disappears (partial reinforcement delayed extinction effect, PRDE). Two experiments assessed the effects of reinforcement/nonreinforcement on Trial 1 on the PRDE. Following extended partial reinforcement acquisition training in a runway, rats received extinction training after a short (1-day) or long (23-day) retention interval. The schedules used in Experiment 1 were: a single-alternation (SA) schedule beginning each day with a rewarded (r) trial, for Group r-SA; an SA schedule beginning with a nonrewarded (n) trial, for Group n-SA; and a random (Rd) schedule, for Group Rd. The schedules and group names used in Experiment 2 were r-SA, Rd, and r-Rd. The results were that (1) rats given r-SA schedules yielded considerable resistance under delayed extinction, (2) those given Rd and r-Rd schedules showed a decline in resistance to extinction over a long retention interval, (3) those given the n-SA schedule showed relatively low resistance at both retention intervals, although retention deficit was not greater than in the case of the Rd schedule, and thus, (4) the PRDE was found in both experiments, although only weakly in Experiment 1. The results indicated that a regularly alternating reward pattern was a more important determinant than was type of reward on Trial 1 for the PRDE. The PRDE due to differential retention deficits among schedules is discussed on the basis of dual-process associative sequential mechanisms and cognitive rule-encoding mechanisms.