In a daily time–place learning task,time is only used as a discriminative stimulus if each daily session is associated with a distinct spatial location

It is difficult for rats to acquire daily time–place (TP) learning tasks. One theory suggests that rats do not use time of day as a stimulus signaling a specific response. In the present study, we tested rats’ ability to use time of day as a discriminative stimulus. A fixed-interval procedure was used in which one lever provided reinforcement on a FI-5-s schedule in morning sessions, and the same lever provided reinforcement on a FI-30-s schedule in afternoon sessions. Because only one place was used in this paradigm, the rats could only use time of day to acquire the task. Mean responses during the first 5 s of the first trial in each session indicated that the rats did not discriminate between the two sessions. In Phase II, a different lever location was used for each of the two daily sessions, which meant that both spatial and temporal information could be used to acquire the task. The rats readily acquired the task in this phase, and probe trials indicated that the rats were using a combination of spatial and temporal information to discriminate between the two different trial types. When the spatial cue was removed in Phase III, rats no longer discriminated the two sessions, suggesting that time can only be used as a discriminative stimulus when each daily session is associated with a distinct spatial location.     

The effects of response cost and species-typical behaviors on a daily time–place learning task

Two theories that have been hypothesized to mediate acquisition in daily time–place learning (TPL) tasks were investigated in a free operant daily TPL task: the response cost hypothesis and the species-typical behavior hypothesis. One lever at the end of one of the choice arms of a T-maze provided food in the morning, and 6 h later, a lever in the other choice arm provided food. Four groups were used to assess the effect of two possible sources of response cost: physical effort of the task and costs associated with foraging ecology. One group was used to assess the effect of explicitly allowing for species-typical behaviors. If only first arm choice data were considered, there was little evidence of learning. However, both first press and percentage of presses on the correct lever prior to the first reinforcement revealed evidence of TPL in most rats tested. Unexpectedly, the high response cost groups for both of the proposed sources did not perform better than the low response cost groups. The groups that allowed animals to display species-typical behaviors performed the worst. Skip session probe trials confirmed that the majority of the rats that acquired the task were using a circadian timing strategy. The results from the present study suggest that learning in free operant daily TPL tasks might not be dependent on response cost.     

Intrinsic reinforcing properties of putatively neutral stimuli in an instrumental two-lever discrimination task

Four experiments examined the influence of a stimulus presented after one response in a two-lever choice task. In Experiment 1, food-deprived rats trained on a concurrent variable-interval extinction schedule responded more often on the extinction lever when such responding periodically produced a visual stimulus than when it did not. In Experiments 2 and 3, a similar signal-induced enhancement effect was found even when food was delivered randomly with respect to responding on both levers or when no food was presented. In Experiment 4, a response-contingent visual stimulus elevated responding to the lever on which it was presented, but an auditory cue suppressed responding. These findings indicate that visual stimuli may possess intrinsically reinforcing properties for rats.     

Rats in a levered T-maze task show evidence of time–place discriminations in two different measures

It is difficult for rats to learn to go to an arm of a T-maze to receive food that is dependent on the time of day, unless the amount of food in each daily session is different. In the same task, rats show evidence of time–place discriminations if they are required to press levers in the arms of the T-maze, but learning is only evident when the first lever press is considered, and not the first arm visited. These data suggest that rats struggle to use time as a discriminative stimulus unless the rewards/events differ in some dimension, or unless the goal locations can be visited prior to making a response. If both of these conditions are met in the same task, it might be possible to compare time–place learning in two different measures that essentially indicate performance before and after entering the arms of the T-maze. In the present study, we investigated time–place learning in rats with a levered T-maze task in which the amounts of food varied depending on the time of day. The first arm choices and first lever presses both indicated that the rats had acquired time–place discriminations, and both of these measures became significantly different from chance during the same block. However, there were subtle differences between the two measures, which suggest that time–place discrimination is aided by visiting the goal locations.     

Spatial matching and nonmatching in male and female Wistar rats: Effects of delay-interval duration

Male and female Wistar rats were trained in a delayed matching-to-position procedure in which one of the two levers (sample) was presented. Pressing this lever resulted in its retraction and began a delay interval of random variable duration, which terminated with the occurrence of the first nose poke in the pellet retrieval unit after the delay interval had expired. Both levers were then inserted into the chamber, and food became available when the subject pressed the lever that had previously been pressed (matching response). When the subject failed to make a matching response, time out (5 sec) was presented. In the next experimental condition, nonmatching was reinforced. Males and females required an equal number of trials to attain 80% accuracy during three consecutive sessions under matching and nonmatching conditions. Response accuracy decreased as the delay interval increased, during both conditions. Differences between the sexes were not observed, suggesting that memory functions in male and female rats may only differ when other behavioral differences between the sexes are allowed to interfere with the assessment of memory functioning.     

Stimulus control in multiple temporal discriminations

In multiple fixed interval (FI) schedules, rats are trained to discriminate different FIs that are signaled by different stimuli. After extensive training, the different stimuli often acquire control over performance, observed by an earlier increase in responding for stimuli that signal shorter FIs, as compared with stimuli that signal longer FIs. The order in which the different FIs are trained, either intermixed across cycles or in blocks of several cycles, may seem irrelevant given that average performance at asymptote may be similar. In this study, rats were trained in two procedures with multiple FIs presented intermixed within sessions or in blocks of one interval per session. Similar performance was observed at asymptote, but an inspection of early cycles in each session revealed that different stimuli acquired control over performance only when trained intermixed within each session. Although the stimuli reliably signaled the upcoming FI, when trained in successive blocks of 60 cycles, rats rapidly adjusted performance early in the sessions on the basis of the temporal aspects of the task, and not on the basis of the stimulus presented in the current cycle. These results are discussed in terms of overshadowing of the stimuli by temporal cues and in terms of conditions under which a stimulus acquires control over performance.     

Time-place learning in the eight-arm radial maze

Rats (n=4) searched for food on an eight-arm radial maze. Daily 56-min sessions were divided into eight 7-min time zones, during each of which a different location provided food; locations were randomized across subjects before training. The rats obtained multiple pellets within each time zone by leaving and returning to the correct location. Evidence that the rats had knowledge about the temporal and spatial features of the task includes the following. The rats anticipated locations before they became active and anticipated the end of the currently active locations. The rats discriminated currently active locations from earlier and forthcoming active locations in the absence of food transition cues. After the rats had left the previously active location, they visited the next correct location more often than would be expected by chance in the absence of food transition cues. The rats used handling or opening doors as a cue to visit the first location and timed successive 7-min intervals to get to subsequent locations.     

Rats acquire a low-response-cost daily time-place task with differential amounts of food

Gallistel (1990) theorized that when animals encounter a biologically significant event, they automatically form a tripartite code consisting of the time, place, and nature of the event. Recent research examining such time-place learning (TPL) has shown that rats are reluctant to perform TPL tasks and appear to do so only under high-response-cost situations (Thorpe, Bates, & Wilkie, 2003; Widman, Gordon, & Timberlake, 2000). In the present study, we trained rats on a low-response-cost daily TPL task, in which the amount of food varied with the spatiotemporal contingencies. It was found that rats readily learned this task. We hypothesize that, rather than automatically encoding a tripartite code when faced with a biologically important event, rats instead automatically encode bipartite codes consisting of time-event and event-place information.     

Time-of-day discrimination by pigeons,Columba livia

Pigeons were trained to discriminate between four keys. One provided food in the mornings, another provided food in the afternoons, and two never provided food. Three experiments were performed to determine whether pigeons could track food availability over a 24-h period. All the subjects appeared to demonstrate time-place associative learning. A fourth experiment was designed to investigate the mechanisms underlying the timing behavior. Lights-on time was shifted back by 6 h, and no decrease in performance was found during the first session following the phase shift. This suggests that a circadian type of timing mechanism with a self-sustaining oscillator mediates time-place learning over a period of 24 h. Further support for this notion was found in a fifth experiment, in which the subjects were tested in constant dim light. In that experiment, the subjects’ continued correct responding provides additional support for a self-sustaining circadian timer.     

The influence of context-reinforcer associations on instrumental performance

In each of two experiments, rats were trained to press the lever in a Skinner box, food reinforcement being available on a variable-interval 60-sec schedule (VI 60). There followed an “exposure phase” for which the levers were removed from the boxes, and then a final test with the levers replaced to assess the effects of the intervening treatment on instrumental responding. Experiment 1 showed that simple exposure to the box reduced the vigor of instrumental performance in comparison with a condition in which food was made available during the exposure phase. Animals which received no exposure treatment also showed a relatively high rate of response. Experiment 2 demonstrated that an exposure treatment in which the occurrence of food is signaled by a light stimulus also leads to a decline in instrumental responding. These results are held to support the notion that associations between the context and the reinforcer serve to energize appetitive instrumental behavior.     

The influence of temporal spacing on time-place discrimination

The conditions under which circadian and interval-timing mechanisms are used in time-place discrimination were investigated. Rats earned the first daily meal by pressing a lever beginning 3.5 h after the start of the session and a second daily meal by pressing another lever. The second meal started 3.5 or 7 h (Experiment 1) or 0.75 or 1.75 h (Experiment 2) after the start of the first meal, using independent groups. In Experiment 1, approximately half of the rats used an interval-timing mechanism, and the other half used a circadian mechanism. In Experiment 2, the rats timed two intervals, one from the start of the session until the first meal and the other from the first to the second meal. A circadian mechanism is relevant to timing intervals in the range of 1.75–3.5 h, and an interval-timing mechanism can be used to time intervals from 0.75–7 h.     

Effects of changeover contingencies on auditory stimulus control of two responses

Rats were exposed to a procedure in which auditory stimuli signaled which of two levers was associated with a variable-interval 60-sec schedule of food presentation. Presses on the lever that was not associated with the variable-interval schedule (“errors”) postponed availability of reinforcement on the other lever by either a fixed number of responses or a fixed amount of time. Increasing the number of responses by which “errors” postponed food availability enhanced the level of stimulus control, and. alter a relatively high degree of control had been achieved, reduction of the requirement had no effect. Control experiments ruled out extended exposure to the discrimination procedure as a factor in the increase in stimulus control and suggested that the time of introduction of a changeover contingent is an important determinant of its effect.     

Motivational cues as determiners of stimulus control in rats

Four rats were each trained to perform a light-intensity discrimination and a sound-intensity discrimination. For half of the subjects, light training sessions were preceded by food deprivation, and correct choices were reinforced with food. Sound training sessions, on the other hand, were preceded by water deprivation, and correct choices were reinforced with water. For the remaining subjects, light training sessions were associated with water deprivation, whereas sound sessions were associated with food deprivation. When the rats were tested in the presence of compounds of sound and light, choices tended to be controlled by light when testing was preceded by the deprivation condition associated with light discrimination task. Reliably fewer light-consistent choices were made under the other deprivation condition, though some preference for responding on the basis of light remained. Following extended training in the presence of all four combinations of light and sound stimuli, this preference was reduced somewhat. When additional testing sessions were preceded by combined food and water deprivation, the tendency to respond on the basis of either light or sound was shown to be related to both deprivation and reinforcement factors.     

Rats exhibit asymmetrical retention functions for hedonic and nonhedonic samples in many-to-one symbolic delayed matching to sample

Rats were initially trained in a symbolic delayed matching-to-sample task either to discriminate hedonic samples that consisted of food or no food or to discriminate tone samples that differed in frequency and location. The retention functions for both the hedonic and tone samples were asymmetric, with forgetting of the food sample or the high-frequency tone occurring more rapidly than forgetting of the no-food sample or the low-frequency tone. Next, many-to-one (MTO) training was given in which tone samples were added for the rats initially trained with hedonic samples, and hedonic samples were added for the rats initially trained with tone samples. For both groups, a food sample and a tone sample (tone-F) were associated with responding to one lever (e.g., stationary), and a no-food sample and a different tone sample (tone-NF) were associated with responding to the alternative lever (e.g., moving). During retention testing, we found equivalent forgetting for the food and no-food samples, but forgetting of the tone-F sample occurred more rapidly than forgetting of the tone-NF sample. This is the first MTO study to suggest that rats, like pigeons, may use hedonic samples as the basis for the common coding of nonhedonic samples in MTO delayed matching.     

Effects of forced movements on learning: Findings from a choice reaction time task in rats

To investigate how motor sensation facilitates learning, we used a sensory–motor association task to determine whether the sensation induced by forced movements contributes to performance improvements in rats. The rats were trained to respond to a tactile stimulus (an air puff) by releasing a lever pressed by the stimulated (compatible condition) or nonstimulated (incompatible condition) forepaw. When error rates fell below 15%, the compatibility condition was changed (reversal learning). An error trial was followed by a lever activation trial in which a lever on the correct or the incorrect response side was automatically elevated at a preset time of 120, 220, 320, or 420 ms after tactile stimulation. This lever activation induced forepaw movement similar to that in a voluntary lever release response, and also induced body movement that occasionally caused elevation of the other forepaw. The effects of lever activation may have produced a sensation similar to that of voluntary lever release by the forepaw on the nonactivated lever. We found that the performance improvement rate was increased by the lever activation procedure on the incorrect response side (i.e., with the nonactivated lever on the correct response side). Furthermore, the performance improvement rate changed depending on the timing of lever activation: Facilitative effects were largest with lever activation on the incorrect response side at 320 ms after tactile stimulation, whereas hindering effects were largest for lever activation on the correct response side at 220 ms after tactile stimulation. These findings suggest that forced movements, which provide tactile and proprioceptive stimulation, affect sensory–motor associative learning in a time-dependent manner.     

Multiple-pattern learning by rats on an eight-arm radial maze

Rats were trained over a number of sessions on an eight-arm radial maze with eight trials on each session. Each of four arms on the maze contained a different pattern formed by sequences of reward (two pellets) or nonreward (no pellets) over successive trials within sessions. The patterns were single alternation, double alternation, and two patterns in which four rewards or four nonrewards were preceded and followed by two nonrewards or two rewards, respectively. The other four arms on the maze served as control arms and always contained one pellet. It was found that rats tracked all of these patterns when they were required to climb over barriers to enter and leave arms. However, rats showed no ability to extrapolate patterns beyond the training trials. These findings, and a further analysis of arm-choice stereotypy, led to the conclusion that rats tracked by using a trial-number strategy.     

Are “no-drug” cues discriminated during drug-discrimination training?

Rats were trained in a two-lever operant chamber to discriminate the presence versus the absence of a drug. During drug sessions, the training procedure involved reinforcing presses on lever 1 with saccharin-sweetened water but not reinforcing presses on lever 2. During no-drug sessions, only presses on lever 2 were reinforced. After this discrimination was learned, each rat was trained to discriminate presence versus absence of a second drug. All rats learned this second discrimination. Finally, the rats were tested to determine whether they could still discriminate the first drug, as well as other pharmacologically related compounds; most rats could. Training drugs were phenobarbital 30–35, nicotine 0.4, amphetamine 0.4, cyproheptadine 7, phencyclidine 4, cyclazocine 1.5, fentanyl 0.04, and scopolamine 0.2 mg/kg. The results indicate that drug versus no-drug discrimination training does not disrupt discriminative control previously established with a different drug. When considered in combination with the results obtained during substitution tests conducted after drug-versus-no-drug training, the data suggest that, instead of discriminating drug cues versus no-drug cues, rats discriminate presence versus absence of particular drug cues.     

The effects of explicit timing on middle‐school students’ writing production across 5‐ and 15‐min sessions

Enhancing rates of accurate, active, academic responding can enhance learning. Both temporal manipulations (i.e., reducing time to work on assignments) and providing multiple distributed temporal cues (MDTC), sometimes referred to as explicit timing, have been shown to enhance rates of accurate mathematics responding. The current study was designed to evaluate the effects of session length (i.e., 5 vs. 15 min to write) and temporal cues (i.e., a single initial temporal cue vs. MDTC) on seventh‐ and eighth‐grade students writing assignment rates and writing accuracy. Results showed that the 5 min writing sessions did result in significantly greater rates of accurate responding than the 15 min sessions; however, explicit timing did not significantly alter writing rates or accuracy. These findings suggest that educators can enhance rates of accurate writing by reducing writing session lengths. Discussion focuses on applied implications of providing briefer writing sessions and future research investigating the interaction between multiple temporal cues and assignments.     

Response–food delay gradients for lever pressing and schedule-induced licking in rats

Eight food-deprived Wistar rats developed stable patterns of lever pressing and licking when exposed to a fixed-time 30-s schedule of food pellet presentation. The rats were trained to lever press by presenting the lever 10 s before the programmed food delivery, with the food pellet being delivered immediately upon a lever press. The operant contingency was then removed and the lever was inserted through the entire interfood interval, being withdrawn with food delivery and reinserted 2 s later. On successive phases of the study, a protective contingency postponed food delivery if responses (lever presses or licks) occurred within the last 1, 2, 5, 10, 20, or 25 s of the interfood interval. Lever pressing was reduced at much shorter response–food delays than those that reduced licking. These results demonstrate that reinforcement contributes to the maintenance of different response patterns on periodic schedules, and that different responses are differentially sensitive to delays.     

Spatiotemporal characteristics of serial CSs and their relation to search modes and response form

In four experiments, we examined how the spatiotemporal proximity to food of the two elements of a serial conditioned stimulus (CS) influenced the pattern of CS-directed versus food-site-directed behavior in rats. Experiment 1 showed that only temporal proximity affected responding when the serial CS consisted of two successive 4-sec presentations of either a spatially near or a spatially far lever (NN or FF). However, Experiment 2 showed that behavior depended markedly on whether rats received a near followed by a far lever (NF) or a far followed by a near lever (FN). Experiment 3 showed that the effects of Experiment 2 could be changed by increasing the duration of the second CS element, and Experiment 4 showed that these changes were not related to previous training. We concluded that behavior produced by the spatiotemporal qualities of the lever elements can be attributed to a mapping between the temporal qualities of the CS elements and an underlying sequence of search modes related to finding food.