Partial reinforcement effects on discrimination learning

Rats were trained on a series of reversals of a successive discrimination in which the percentage of S+ trials ending in food was varied. Changes in the discrimination index occurred more slowly with 50% reinforcement than with 100% reinforcement when the number of training trials was equated across conditions, but were approximately invariant when the conditions were equated with respect to the number of obtained reinforcements. Presentation of free reinforcement during the intertrial intervals reduced the overall rate of discrimination acquisition, but left this invariance unaffected. Invariance in reinforcements necessary to attain acquisition also occurred when different discriminations correlated with different percentages of reinforcement were intermixed within experimental sessions. The failure of the invariance effect to be disrupted by either manipulation suggests that previous accounts of the invariance effect in terms of “comparator” models of conditioning (e.g., Gibbon & Balsam, 1981) are inadequate.     

Fluid intelligence and discriminative operant learning of reinforcement contingencies in a fixed ratio 3 schedule

Although intelligence has traditionally been identified as the ability to learn (Peterson, 1925), this relationship has been questioned in simple operant learning tasks (Spielberger, 1962). Nevertheless, recent pieces of research have demonstrated a strong and significant correlation between associative learning measures and intelligence ( [Kaufman et al., 2009] and [Williams et al., 2008] ). The present paper aims to examine the relationship between intelligence and learning, complying with the experimental conditions of discriminative conditioning in a relatively complex free operant task. To that end, a sample of 1600 subjects applying for an ab initio Air Traffic Control training course was tested. The task is expected to allow identifying the specific influence of intelligence on the discrimination between stimulus dimensions. The results show how the relation among learning and intelligence strengthen on those trials which are critical in terms of discrimination.     

Signal properties of reinforcement and reinforcement omission on a multiple fixed-ratio schedule

A series of experiments used food-deprived pigeons to examine several parameters of reinforcement omission in an attempt to control changes of keypeck response measures on a subsequent schedule. In Experiments 1 and 2, the pigeons were tested with a multiple fixed-ratio schedule on which reinforcement was occasionally omitted at the completion of the first component. The duration of the delay occurring in lieu of reinforcement was systematically varied. In Experiment 3, the stimulus that signaled the second component of the schedule was altered to appear either more or less similar to the stimulus that signaled the first component. Two principal results are reported: (1) Response latency decreased and, to a much lesser extent, terminal response rate increased as the delay occurring in lieu of reinforcement decreased; and (2) both latency decrease and response-rate increase were enhanced by a second component stimulus which was similar to the first. The results are evaluated in terms of Amsel’s frustration theory and an analysis by Staddon which suggests that reinforcement inhibits responding. The data appear to support Staddon’s argument that rate increases and latency decreases following reinforcement omission are largely a function of an attenuation of the inhibitory influence of reinforcement, an effect that is enhanced by stimulus generalization. Accordingly, it is proposed that an animal’s response to reinforcement omission is determined by a stimulus complex that minimally includes the omission event and component cues.     

Effect of N-R transitions during partial reinforcement pretraining on subsequent resistance to discrimination

Three groups of 12 rats received 25 pretraining trials to each future discriminandum employed in a subsequent differential brightness conditioning problem. Groups NR and RN received partial reinforcement (PRF) pretraining either with or without, respectively, transitions from nonrewarded to rewarded trials (N-R transitions). Group CRF received consistent reinforcement during pretraining. A fourth group (n=12), Group NP, received no pretraining. During discrimination learning, one-half of the rats in each group received all their daily S+ trials preceding their daily S? trials (+? sequence); the remainder of the rats received an intermixed sequence of trials to S+ and S? (+?+ sequence). Discrimination learning was faster under the +? sequence than under the +?+ condition, and discrimination learning was retarded in Group NR relative to the other three groups, which did not differ from one another, under both the +? and +?+ discrimination sequence conditions. The results are discussed with Reference to previous experiments demonstrating N-R transition effects on discrimination learning, a theoretical extension of sequential theory to discrimination learning, and the effects of nondifferential reinforcement prior to discrimination learning on learned irrelevance.     

Serial discrimination reversal learning in pigeons as a function of intertrial interval and delay of reinforcement

Pigeons learned a series of reversals of a simultaneous red-green visual discrimination. Delay of reinforcement (0 vs. 2 sec) and intertrial interval (ITI; 4 vs. 40 sec) were varied across blocks of reversals. Learning was faster with 0-sec than with 2-sec delays for both ITI values and faster with 4-sec ITIs than with 40-sec ITIs for both delays. Improvement in learning across successive reversals was evident throughout the experiment, furthermore, even after more than 120 reversals. The potent effects of small differences in reinforcement delay provide evidence for associative accounts and appear to be incompatible with accounts of choice that attempt to encompass the effects of temporal parameters in terms of animals’ timing of temporal intervals.     

Instrumental escape learning in the rat at 24-hour intertriai interval: Effects of magnitude and schedule of reinforcement

Three experiments investigated the effects of magnitude and schedule of reinforcement and level of training in instrumental escape learning at a 24-h intertriai interval. In Experiment I, two magnitudes of reinforcement were factorially combined with two schedules of reinforcement (CRF and PRF). Under PRF, large reward produced greater resistance to extinction than did small reward, while the reverse was true under CRF. In Experiment II, two levels of acquisition training were factorially combined with three schedules of reinforcement (CRF, single-alternation, and nonalternated PRF). Patterned running was observed late in acquisition in the single-alternation extended-training condition. Resistance to extinction was greater for the nonalternated PRF condition than for the single-alternation condition following extended acquisition, and the reverse was true following limited acquisition. Experiment III confirmed the extinction findings of Experiment II. The results of all three experiments supported an analysis of escape learning at spaced trials in terms of Capaldi’s (1967) sequential theory.     

The effects of practice schedule on learning a complex judgment task

The effects of practice schedule on learning a complex judgment task were investigated. In Experiment 1, participants' judgment accuracy on a retention test was higher after a random practice schedule than after a blocked schedule or operational schedule. Experiment 2 demonstrated that judgment on a transfer test was also better after a random practice schedule than after a blocked schedule. Both experiments failed to show any effects of practice schedule on performance during learning. These findings show that benefits of random practice for retention and transfer apply to learning a complex judgment task, and may be achieved without performance degradation during practice.     

Latent semantic analysis as a tool for learner positioning in learning networks for lifelong learning

As we move towards distributed, self‐organised learning networks for lifelong learning to which multiple providers contribute content, there is a need to develop new techniques to determine where learners can be positioned in these networks. Positioning requires us to map characteristics of the learner onto characteristics of learning materials and curricula. Considering the nature of the network envisaged, maintaining data on these characteristics and ensuring their integrity are difficult tasks. In this article we review the usability of Latent Semantic Analysis (LSA) to generate a common semantic framework for characteristics of the learner, learning materials and curricula. Although LSA is a promising technique we identify several research topics that must be addressed before it can be used for learner positioning.     

Extensive training,partial reinforcement,and temporal gaps do not affect S-S learning in second-order autoshaping

A second-order autoshaping procedure was used to examine the effects of three variables on the amount of information that could be learned about the stimulus properties of a reinforcer. All three experiments paired several keylight S2s with different keylight S1s and then carried out discriminative autoshaping with those S1s. Learning about the stimulus properties of S1 was inferred from changes in the response to its paired S2 when that S1 was changed in value. The sensitivity of S2 to changes in S1 was investigated as a function of number of S2-S1 pairings (Experiment 1), partial reinforcement (Experiment 2), and temporal distance between S2 and S1 (Experiment 3). Each experiment found evidence of a selective change in responding to an S2 as a function of the treatment of its S1. However, the amount of that change was not affected by any of the three variables studied. Those results imply that, within the ranges used here, none of these variables changes the degree of learning about the stimulus properties of a reinforcer.     

Response sequence learning as a function of primary versus conditioned reinforcement

Two groups of pigeons were required to generate a fixed sequence of responses on three keys, for example, middle-left-right. One group received a small food reward (S^Food) following each correct response except the terminal one, which was followed by a large food reward. The second group received conditioned reinforcement from an overhead light (S^Light) for each correct response, with the terminal correct response followed by both S^Light and the large food reward. We manipulated length of sequence (3 or 7 responses) and duration of required interresponse interval (IRI; 1 to 9 sec). S^Light contingencies generated more accurate performances than did S^Food when sequence length was 3 responses but not when it was 7 responses. IRI duration influenced accuracy under the S^Light contingencies but not under S^Food. These results show that conditioned reinforcers sometimes generate more accurate sequence learning than do primary reinforcers, and that schedule contigencies influence which type of feedback will optimize performance. The results parallel those from the matching-to-sample and conditional discrimination literature.     

The nature of discrimination learning in pigeons

The results from five experiments are considered in relation to two of Spence's (1937, 1938) proposals concerning discrimination learning. In Experiments 1 and 2, we investigated whether his ideas about the interaction between excitatory and inhibitory generalization gradients can be used to understand how animals solve a complex patterning discrimination. The results supported a development of his proposals as put forward by Pearce (1994), provided a modification was made to Pearce's rulefor determining the shape ofthe generalization gradient. In Experiments 3, 4, and 5, we examined whether animals would pay more attention to stimuli that are relevant, rather than irrelevant, to the solution of a discrimination. The results supported this proposal for stimuli comprising visual patterns, but not for those comprising plain colors. The results also indicated that change of attention was a consequence of preliminary receptor-exposure acts, as envisaged by Spence, and not of more central changes in attention.     

An elemental model of associative learning: I. Latent inhibition and perceptual learning

This paper presents a brief, informal outline followed by a formal statement of an elemental associative learning model first described by McLaren, Kaye, and Mackintosh (1989). The model assumes representation of stimuli by sets of elements (i.e., microfeatures) and a set of associative algorithms that incorporate the following: real-time simulation of learning; an error-correcting learning rule; weight decay that distinguishes between transient and permanent associations; and modulation of associative learning that gives high salience to and, hence, promotes rapid learning with novel, unpredicted stimuli and reduces the salience for a stimulus as its error term declines. The model is applied in outline fashion to some of the basic phenomena of simple conditioning and, in greater detail, to the phenomena of latent inhibition and perceptual learning. A detailed account of generalization and discrimination will be provided in a later paper.     

Reversal of spatial discrimination learning in a water maze by previously undernourished rats

The development of the hippocampus in rats may be vulnerable to undernutrition during the fetal and suckling periods. Hence the behavioral effects of early growth restriction may resemble those of hippocampal lesions. This suggestion was investigated by testing previously undernourished rats for reversal learning, an ability badly affected in hippocampectomized rats. Developing rats were undernourished by feeding their mothers a restricted quantity of a good quality diet during pregnancy and lactation. All rats were fed ad lib from weaning. Reversal of spatial discrimination learning was tested in adult animals using a water T-maze. Previously undernourished rats learned the initial spatial discrimination more quickly than controls. However, there was no effect of early treatment on serial reversal learning in Experiment I or on performance of a single reversal after prolonged initial training in Experiment II.