Reinforcement expectancy and trial spacing effects in delayed matching-to-sample by pigeons

Four experiments assessed the role of reinforcement expectancies in the trial spacing effect obtained in delayed matching-to-sample by pigeons. In Experiment 1, a differential outcome (DO) group received reinforcement with a probability of 1.0 for correct comparison responses following one sample stimulus and a probability of 0.2 for correct comparison responses following the other sample stimulus. The nondifferential outcome (NDO) group received reinforcement with a probability of 0.6 for correct responses to either stimulus. While matching accuracy was higher for the DO group than for the NDO group, both groups showed an equivalent decline in accuracy as the intertriai interval (ITI) duration was decreased. However, within the DO group, ITI duration affected performance on low-probability-of-reinforcement trials but not on high-probability-of-reinforcement trials. In Experiment 2, delay interval (DI) duration was 5, 10, or 15 sec and accuracy was higher for the DO group than for the NDO group at all DI durations. In addition, accuracy decreased similarly on high- and low-probability-of-reinforcement trials for the DO group as DI was increased. In Experiment 3, all birds were studied under DO conditions and ITI duration was manipulated along with DI duration. At the short DI duration, decreasing ITI duration had a detrimental effect on low-probability-of-reinforcement trials but no effect on high-probability-of-reinforcement trials. At the long DI duration, decreasing ITI duration had detrimental effects on both types of trials. In Experiment 4, unsignaled ITI reinforcers disrupted accuracy when the DI was long and when the ITI was short. The applicability of scalar expectancy theory to these data is discussed.     

Negative priming and occasion setting in an appetitive Pavlovian procedure

Rats received training in which two auditory target stimuli, X and Y, were signaled by two visual stimuli, A and B, and followed by food (i.e., A-->X+, B-->Y+). The test consisted of presentations of X and Y preceded either by the same signal as during training (same trials: A-->X, B-->Y) or by the alternative signal (different trials: A-->Y, B-->X). After 8 training sessions, the animals responded less on same trials than on different trials; this effect was significantly reduced after 24 training sessions. In two additional experiments, animals that had also experienced presentations of A and B alone, either before or during training, showed the opposite pattern of results, responding more on same trials than on different trials. These results are interpreted as being due to the interaction between the effects of occasion setting and negative priming (see Wagner, 1981).     

Perceptual learning transfer in an appetitive Pavlovian task

In two experiments, rats were given intermixed or blocked preexposure to two similar compound stimuli, AX and BX. Following preexposure, conditioning trials took place in which AX (Experiment 1) or a novel compound stimulus NX (Experiment 2) was paired with a food-unconditioned stimulus in an appetitive Pavlovian preparation. Animals that were given alternated preexposure showed lower generalization from AX to BX (Experiment 1) and from NX to a new compound, ZX (Experiment 2), than animals that were given blocked preexposure, a perceptual learning and a perceptual learning transfer effect, respectively.     

US duration and local trial spacing affect autoshaped responding

The acquisition and maintenance of signal-directed pecking was examined in week-old Leg-Horn chicks responding to a keylight stimulus paired with heat. In contrast with previous studies using pigeons with food as the US, both speed of acquisition and asymptotic level of keypecking were a direct function of US duration. Experiment 2 examined responding using a within-subject design to isolate the effects of trial spacing on performance during the immediate trial from the effects on performance during a following trial of fixed length. These comparisons revealed a significant effect of intertriai interval (ITI), with less responding after shorter intervals. The effect of different temporal spacing was apparent in responding on the immediate trial, but not on the following trial. These local ITI effects were better predicted by a recent autoshaping model based on relative waiting time (Jenkins, Barnes, & Barrera, 1981) than by a model based on relative US expectancy (Gibbons & Balsam, 1981). However, neither model predicted the effect of US duration. A reexamination of the US-duration literature suggested that the diversity of previous findings is consistent with the assumption that conditioned responding is an inverted U-shaped function of US duration.     

Memory span, IQ, and memory aids effects on learning of logico-conceptual rules

A set of forward and backward digit, letter, and color-form span and IQ scores were obtained from 144 10th-grade students. Subsequently, each student learned a bi- or triconditional rule with zero, three, or six memory aids. Forward-letter, forward-digit, backward-letter-digit, and color-form span memory factors emerged from the factor analysis of the span scores. Only the color-form (coding) span memory factor and IQ substantially predicted rule-learning proficiency. The predictive power was traced to the similar combinatory coding process shared by both (a) rule-learning and (b) color-form span tests and also to certain information-free operations shared by both (a) and intelligence tests. The observed facilitative effect of memory aids was interpreted as resulting from their availability as a dependable base for rehearsing coded information while inducing a conceptual rule. The external memory aids appeared to be more effectively utilized by students with long rather than short color-form spans.     

Transient variations in responding to Pavlovian conditioned stimuli have implications for the mechanisms of “priming”

Conditioned responding to a well-trained conditioned stimulus (CS) was assessed in an eyelid conditioning situation under three conditions of prior stimulation: when preceded by recent presentation of the same CS, when preceded by recent presentation of a different CS, and when preceded by no recent stimulation. As compared to the latter condition, prior presentation of the same CS depressed responding, while prior presentation of a different CS augmented responding. Both effects diminished as the interval separating the test stimulus from the preceding CS was lengthened over the range of 2.5 to 10 sec. The results were discussed in terms of the interaction of short-term memory representations with subsequent stimulation, and a specific theory concerning the effects of “priming.”     

Memory for everyday information in students with learning disabilities

This study compared students with and without learning disabilities (LD) on their recall of academic information and information encountered in the students' everyday lives. The academic recall measures included a sentence listening span test, a rhyming words working memory test, and a visual matrix working memory task. Students' cued recall of all the tasks was also measured. The everyday working memory tasks included a dance episode event recall test; a library procedure recall test; and recall tests of commonly found objects, such as a coin, a telephone, and a McDonald's sign. Compared to students without LD, students with LD performed poorly on both the academic recall tasks and the everyday recall tasks. These results support the notion that some students with LD may have working memory problems that affect their performance on tasks other than reading. The results of the cued recall showed that the availability of cues significantly decreased the ability group differences on many of the academic and everyday tasks. This result replicates prior research findings that students with LD do not use retrieval strategies effectively and that some students with LD may have a production deficiency that affects their retrieval of previously encoded information.     

Memory,serial anticipation pattern learning,and transfer in rats

Learning & Behavior - Three experiments tested hypotheses about whether rats respond appropriately to, or track, an orderly series of reward magnitudes terminating in nonreward by encoding the...     

Arousal and short-term memory: Effects of caffeine and trial spacing on delayed-alternation performance

Two experiments tested the prediction of Kesner’s (1973) parallel memory-stores theory that arousal reduces retention in short-term memory. Using rats as subjects, the effect of caffeine on delayed-alternation performance in a spatial discrimination was investigated. Trial spacing was also manipulated, both alone and in combination with the drug variable. The results showed that, with massed trials, caffeine facilitated alternation at the short delay and inhibited it at the longer delays tested. Using spaced trials, caffeine decreased alternation at all delays. Spaced trials produced overall superior performance as compared with massed trials. This pattern of results is consistent with the view that caffeine reduces short-term retention but, paradoxically, can also increase performance under massed trials by decreasing proactive interference (i.e., retention) from earlier trials.     

Signaling and affective functions in Pavlovian conditioning

The present study employed a Pavlovian-instrumental-transfer paradigm to investigate the role of conditioned fear in appetitive discrimination learning. Each of three Pavlovian training procedures was used to establish a conditioned fear excitor (CS+), a “neutral” CS (CSo), and a conditioned fear inhibitor (CS?). Then, the CSs were administered to rats in the three groups contingent upon the rewarded response in a difficult visual discrimination. In addition, half of each group received shock punishment for each incorrect response. Relative to CSo, CS+ facilitated performance in contrast to the usual interfering effect of conditioned suppressors; conversely, CS? retarded performance even when its reinforcing action (fear inhibition) was potentiated by punishment for the incorrect response. These results, together with other findings showing a reversed outcome when the CSs are administered for the incorrect response, indicate that Pavlovian conditioning comprises both general signaling and affective functions, the former reflecting a basic “expectancy” or nominal type of cognitive processing in the rat.     

Overexpectation in appetitive Pavlovian and instrumental conditioning

In three experiments that used appetitive preparations with rats, we examined the effects of reinforcing a compound consisting of two previously reinforced stimuli on subsequent responding to those stimuli. Experiment 1 showed that a Pavlovian conditioned stimulus given this treatment evoked fewer magazine entries when presented alone than did a reinforced stimulus that did not receive the compound treatment. Experiment 2 examined inhibition of delay and generalization decrement accounts for the results of Experiment 1. Experiment 3 extended this finding to an instrumental learning paradigm.     

Pavlovian contingencies and anticipatory contrast

Pigeons were trained on a four-component multiple schedule in which two target components with identical reinforcement schedules were followed by other components with either higher or lower reinforcement rates. The Pavlovian signal properties of the target-component stimuli were varied by changes in their duration relative to the following components, and by whether the two following components were cued by the same or different stimuli, When different stimuli occurred in the following components, response rates were higher in the target component preceding the following component with the lower reinforcement rate, and these contrast effects were larger with shorter relative durations. But with nondifferential stimuli in the following components, contrast consistently occurred only with the longer durations of the target components. Moreover, several subjects with the shorter duration target stimuli had higher response rates in the target followed by the richer schedule—that is, Pavlovian conditioning occurred to the target stimuli. This interaction suggests that the processes underlying anticipatory contrast and Pavlovian conditioning are in opposition, and that the Pavlovian effect can dominate ifthe signaling properties of the target components are sufficiently enhanced.     

Pavlovian aversive to instrumental appetitive transfer: Evidence for across-reinforcement blocking effects

Rats received Pavlovian aversive (shock) conditioning in which white noise was established for different groups as a CS+, CSO, or CS?. Then, in an appetitive T-maze discrimination, the CSs were presented contingent upon a designated correct response for which food reinforcement was factorially varied at 0, 1, 2, or 4 pellets. Although the CS+ suppressed and the CS? facilitated speed of running in the correct arm at the start of discrimination training, these effects extinguished rapidly and did not interact with reward magnitude. Furthermore, choice learning was faciltated by the CS+ and retarded by the CS?, with these effects being comparable for the 1- to 4-pellet reinforcement conditions, but absent for the 0-pellet condition. These findings are difficult to reconcile with a transfer interpretation positing a general signaling property of the CS and are better interpreted as across-reinforcement blocking effects: By predicting a preferred outcome (safety) comparable to the preferred outcome of food reinforcement, the CS? blocks (retards) the association of reinforcement and the S^D; conversely, by predicting a nonpreferred (shock) outcome discrepant from the preferred food outcome, the CS+ “counterblocks” (enhances) the association of reinforcement and the S^D.     

Contrast effects in simultaneous discrimination learning

Pigeons were trained on a form discrimination that alternated across trials with an already-learned color discrimination, which was associated with different probabilities of reinforcement for different groups. The rate of acquisition of the form discrimination varied inversely with the rate of reinforcement for the color discrimination, thus demonstrating a “contrast effect” in simultaneous discrimination learning.     

Differential effects of phonological priming on Chinese character recognition

We report two experiments investigating the effect of phonological priming on the recognition of two types of Chinese characters: compound targets which contain separate radical components; and integrated targets which do not contain separate radicals. We used a masked priming paradigm with varying prime-target exposure durations. In Experiment 1, phonological priming effects on compound target recognition were found following a 50 msec SOA. However, there was no evidence of phonological priming on integrated target recognition at this SOA. In Experiment 2 we investigated the time course of phonological priming effects at three prime-target SOAs (30, 50 and 80 msec) in a between-subjects design. Semantic priming effects were also investigated. Phonological priming effects on compound target recognition were found following the 50 msec and the 80 msec SOAs. However, there was no evidence of phonological priming on integrated target recognition at any SOA. Semantic priming effects on both compound and integrated target recognition were found in the 50 msec and the 80 msec SOA conditions suggesting that phonological and semantic activation are co-incidental during compound character recognition. We conclude that character type constrains the activation of phonology during Chinese character recognition.     

Secondary extinction in Pavlovian fear conditioning

Pavlov (1927/1960) reported that following the conditioning of several stimuli, extinction of one conditioned stimulus (CS) attenuated responding to others that had not undergone direct extinction. However, this secondary extinction effect has not been widely replicated in the contemporary literature. In three conditioned suppression experiments with rats, we further explored the phenomenon. In Experiment 1, we asked whether secondary extinction is more likely to occur with target CSs that have themselves undergone some prior extinction. A robust secondary extinction effect was obtained with a nonextinguished target CS. Experiment 2 showed that extinction of one CS was sufficient to reduce renewal of a second CS when it was tested in a neutral (nonextinction) context. In Experiment 3, secondary extinction was observed in groups that initially received intermixed conditioning trials with the target and nontarget CSs, but not in groups that received conditioning of the two CSs in separate sessions. The results are consistent with the hypothesis that CSs must be associated with a common temporal context during conditioning for secondary extinction to occur.     

The effects of Pavlovian CSs on two food-reinforced baselines— with and without noncontingent shock

Two experiments explored the effects of Pavlovian (tone-shock) CS+, CS?, and truly random control (TRC) contingencies on two different food-reinforced instrumental baselines. One food-reinforced baseline contained noncontingent shock, while the other did not. In the first experiment, a TRC contingency was shown to produce suppression of food-reinforced responding, while a CS? contingency did not. When noncontingent shock was added to the baseline, however, the TRC stimuli failed to produce suppression, and the CS? contingency increased response rates over baseline level. In a second experiment, the effects of TRC and CS+ contingencies were compared on these same two baselines. While the CS+ produced suppression on both shock and no-shock baselines, the TRC contingency again produced suppression on only the no-shock baseline.     

Memory modality differences in children with Attention Deficit Hyperactive Disorder with and without learning disabilities

This study assesses information processing and memory functioning in 50 children diagnosed with Attention Deficit Hyperactive Disorder (ADHD) with and without learning disabilities (LD). Mode of presentation (visual vs. auditory), type of memory processing (immediate, short-term, and long-term), and order of recall (ordered vs. unordered) were assessed using the Learning Efficiency Test-II (LET-II). Both groups demonstrated difficulty with auditory ordered recall and lost substantial information from immediate memory to short-term and long-term memory stores. The ADHD/LD group also demonstrated more difficulty with ordered recall than the ADHD only group. While there were no differences between the two groups in regard to immediate recall, the ADHD/LD group demonstrated more problems transferring information into short-term and long-term memory stores than the ADHD only group. Verbal interference effects significantly decreased retention for both visual and auditory processing. Results indicate that ADHD alone presents significant problems in information processing, but the comorbid effects of a learning disability further intensify the negative impact of ADHD. © 1996 John Wiley & Sons, Inc.     

Serial order anticipation learning in rats: Memory for multiple hedonic events and their order

Many characteristics of a series of discrete independent hedonic events may be remembered by rats in terms of, for example, how many events were rewarded and how many were nonre-warded. Such memory for multiple hedonic events, which has been shown to be a potent factor controlling instrumental responding, was examined here in five investigations employing serial anticipation learning in a runway. It was found that the ability of rats to remember the hedonic events reward and nonreward is highly developed, accurate, and quite resistant to forgetting and interference. Rats not only remembered a rewarded event and a nonrewarded event, but they also remembered the order in which the two events occurred. Rats remembered how many nonrewarded events there had been accurately enough to suggest that they were using some form of a counting mechanism. Rats exhibited little forgetting of eight prior discrete hedonic events, one rewarded followed by seven nonrewarded, even when these occurred over an interval of 20 min and involved considerable potential interference. In the serial learning situation employed here, marked primacy effects were obtained, earlier nonrewarded trials in a series being better anticipated than later ones. The primacy effect was found to depend upon the type of series employed. By assuming that stimulus generalizations occur between the multiple hedonic events remembered by rats, all anticipatory learning obtained here could be explained in considerable detail.     

Development of morphological priming effects in reading aloud in the biscriptal Bosnian orthography

Reading and Writing - A substantial body of research has noted morphological priming effects in visual word recognition in deep orthographies, but it is still unclear whether similar effects exist...