Tests of Behavioral-Economic Assessments of Relative Reinforcer Efficacy II: Economic Complements

Journal of The Experimental Analysis of Behavior, 1991

Four experiments examined the effects of increasing the number of food pellets given to hungry rats for a lever-press response. On a simple variable-interval 60-s schedule, increased number of pellets depressed response rates (Experiment 1). In Experiment 2, the decrease in response rate as a function of increased reinforcement magnitude was demonstrated on a variable-interval 30-s schedule, but enhanced rates of response were obtained with the same increase in reinforcement magnitude on a variable-ratio 30 schedule. In Experiment 3, higher rates of responding were maintained by the component of a concurrent variable-interval 60-s variable-interval 60-s schedule associated with a higher reinforcement magnitude. In Experiment 4, higher rates of response were produced in the component of a multiple variable-interval 60-s variable-interval 60-s schedule associated with the higher reinforcement magnitude. It is suggested that on simple schedules greater reinforcer magnitudes shape the reinforced pattern of responding more effectively than do smaller reinforcement magnitudes. This effect is, however, overridden by another process, such a contrast, when two magnitudes are presented within a single session on two-component schedules.

Journal of the Experimental Analysis of Behavior, 1993

The relation between molar and molecular aspects of time allocation was studied in pigeons on concurrent variable-time variable-time schedules of reinforcement. Fifteen-minute reinforcer-free periods were inserted in the middle of every third session. Generalized molar matching of time ratios to reinforcer ratios was observed during concurrent reinforcement. Contrary to melioration theory, preference was unchanged during the reinforcer-free periods as well as in extinction. In addition to this long-term effect of reinforcement, short-term effects were observed: Reinforcers increased the duration of the stays during which they were delivered but had little consistent effect either on the immediately following stay in the same schedule or on the immediately following stay in the alternative schedule. Thus, an orderly effect of reinforcer delivery on molecular aspects of time allocation was observed, but because of its short-term nature, this effect cannot account for the matching observed at the molar level.

2002

Journal of the Experimental Analysis of Behavior, 1994

This experiment examined the relationship between two qualitatively different reinforcers and the parameters of a quantitative model of reinforced responding, referred to as the response-strength equation or the Herrnstein equation. A group of rats was first food deprived and later water deprived. An 11.5% sucrose solution served as the reinforcer in the food-deprivation condition, and water was the reinforcer in the water-deprivation condition. Each experimental session consisted of a series of seven variable-interval schedules, providing reinforcement rates that varied between 20 and 1,200 reinforcers per hour. The response rates increased in a negatively accelerating function in a manner consistent with the response-strength equation. This equation has two fitted parameters, k and R,. According to one theory, the k parameter is a measure of motor performance, and R, is indicative of the relative reinforcement efficacy of the background uncontrollable sources of reinforcement in relation to the experimentally arranged reinforcer. In this study, k did not change as a result of the different reinforcers, but R, was significantly larger in the sucrose-reinforcement condition. These results are consistent with the interpretation that k and R, measure two independent and experimentally distinguishable parameters and provide further evidence that absolute response rate is a function of relative reinforcement rate, as implied by the derivation of the response-strength equation based on the matching law.

Animal Learning & Behavior, 1990

In three experiments, we examined the effectsof signaling reinforcement during operant responding in order to illuminate the factors underlying instrumental overshadowing and potentiation effects. Specifically, we examined whether signaling reinforcement produces an enhancement and attentuation of responding when the response-reinforcer correlation is weak and strong, respectively. In Experiment 1, rats responded on variable-ratio (VR) or variable-interval (VI) schedules that were equated for the number ofresponses emitted per reinforcer. A signal correlated with reinforcement enhanced response rates on the VR schedule, but attenuated response rates were produced by the signal on the VI schedule. In Experiment 2, two groups of rats responded on a VI schedule while the two other groups received a conjoint VI, negative fixed-ratio schedule in which the subjects lost the availability of reinforcements if they emitted high response rates. A reinforcement signal attenuated responding for the simple VI groups but not for the animals given the negative fixed-ratio component, although the signal improved response efficiency in both groups. In Experiment 3, a poor correlation between responding and reinforcement was produced by a VI schedule onto which the delivery of response-independent food was superimposed. A signal for reinforcement initially elevated responding on this schedule, relative to an unsignaled condition; however, this pattern was reversed with further training. In sum, the present experiments provide little support for the view that signaling reinforcement enhances responding when the response-reinforcer correlation is weak and attenuates responding when this correlation is strong.

1978

In the first experiment, two rhesus monkeys earned their entire ration of food and water during daily sessions with no provisions to ensure constant daily intakes. Two variableinterval schedules of food presentations were concurrent with one variable-interval schedule of water presentations; the maximum rate of food presentations arranged by one food schedule was varied. As the rate of food presentations was increased, the absolute level of responding on the two food schedules combined decreased, while responding on the water schedule increased. The preference for the variable food schedule compared to the other food schedule approximately matched the proportion of reinforcers obtained from it. The preference for the variable food schedule compared to the water schedule did not match, but greatly decreased, as the proportion of reinforcers from the food schedule increased. When Experiment I was replicated, with provisions to ensure constant daily intakes of food and water (Experiment II), the absolute response rates under the two food schedules combined and under the water schedule no longer changed with increases in the rate of food during the sessions. On the other hand, choice between the two food schedules remained proportional to the distribution of obtained food pellets. These results were interpreted as indicating that behavior to obtain nonsubstitutable commodities, such as food and water, is strongly controlled by the economic conditions of daily consumption, while choice between substitutable commodities is independent of these factors.

Journal of the Experimental Analysis of Behavior, 2010

Humans discount larger delayed rewards less steeply than smaller rewards, whereas no such magnitude effect has been observed in rats (and pigeons). It remains possible that rats' discounting is sensitive to differences in the quality of the delayed reinforcer even though it is not sensitive to amount. To evaluate this possibility, Experiment 1 examined discounting of qualitatively different food reinforcers: highly preferred versus nonpreferred food pellets. Similarly, Experiment 2 examined discounting of highly preferred versus nonpreferred liquid reinforcers. In both experiments, an adjusting-amount procedure was used to determine the amount of immediate reinforcer that was judged to be of equal subjective value to the delayed reinforcer. The amount and quality of the delayed reinforcer were varied across conditions. Discounting was well described by a hyperbolic function, but no systematic effects of the quantity or the quality of the delayed reinforcer were observed.

Journal of the Experimental Analysis of Behavior, 1995

A behavioral economic model that explains the choice and allocation of work rate is used to predict performance patterns in three contexts: with single schedules, with concurrent schedules when total reinforcement is low, and with concurrent schedules when reinforcement increases. Performance in the three contexts is predicted to change in orderly ways depending on how the subject evaluates the reinforcers earned. Quadrant diagrams are used to generate reinforcer demand functions, workrate supply functions, and reinforcement-rate expansion paths. Preference between reinforcers is viewed as being a variable, with preference reversing in some situations.

Journal of Applied Behavior Analysis, 2008

Previous research has suggested that the availability of high‐preference stimuli may override the reinforcing efficacy of concurrently available low‐preference stimuli under relatively low schedule requirements (e.g., fixed‐ratio 1 schedule). It is unknown if similar effects would be obtained under higher schedule requirements. Thus, the current study compared high‐preference and low‐preference reinforcers under progressively increasing schedule requirements. Results for 3 of the 4 participants indicated that high‐preference stimuli maintained responding under higher schedule requirements relative to low‐preference stimuli. For 1 participant, high‐preference and low‐preference stimuli were demonstrated to be equally effective reinforcers under increasing schedule requirements. Implications with respect to rate of performance and response patterns are discussed.

Journal of the Experimental Analysis of Behavior, 1974

The lever pressing of four foodand water-deprived rats was reinforced on concurrent variable-interval schedules. Food reinforced one response, and water reinforced the other. Response rates in baseline were higher in the food component than in the water component. After response patterns and body weights had stabilized, the animals were given access to either food only, water only, both food and water, or neither food nor water (baseline) before daily sessions. Giving food before a session decreased per cent time in the food component, decreased overall response rates for food, and increased overall response rates for water. Giving water before a session increased per cent time in the food component, increased overall response rates for food, and decreased overall response rates for water. Giving both food and water before a session resulted in a combination of prefeeding and prewatering effects. More food and more water were consumed when both were available than when only one was available before a session.

Journal of Applied Behavior Analysis, 2008

We evaluated behavior exhibited by individuals with developmental disabilities using progressive‐ratio (PR) schedules. High‐ and low‐preference stimuli were determined based on the results of a paired‐stimulus preference assessment and were evaluated in subsequent reinforcer and PR assessments using concurrent and single schedules of presentation. In Experiment 1, results showed that for 2 of 3 participants, stimuli determined to be low‐preference functioned as reinforcers when evaluated independent of high‐preference stimuli. Further, the results from Experiment 2 showed that low‐preference stimuli also functioned as reinforcers under gradually increasing PR requirements. Results suggest that for cases in which a high‐preference stimulus is unavailable or impractical, the contingent delivery of relatively less preferred stimuli may maintain appropriate behavior, even as schedule requirements increase.

Journal of Applied Behavior Analysis, 2003

Reinforcers lose their effectiveness when they are presented repeatedly. Traditionally, this loss of effectiveness has been labeled satiation. However, recent evidence suggests that habituation provides a more accurate and useful description. The characteristics of behavior undergoing satiation differ for different stimuli (e.g., food, water), and these characteristics have not been identified for the noningestive reinforcers often used by applied behavior analysts (e.g., praise, attention). As a result, the term satiation provides little guidance for either maintaining or reducing the effectiveness of reinforcers. In contrast, the characteristics of behavior undergoing habituation are well known and are relatively general across species and stimuli. These characteristics provide specific and novel guidance about how to maintain or reduce the effectiveness of a reinforcer. In addition, habituation may lead to a better understanding of several puzzling phenomena in the conditioning literature (e.g., extinction, behavioral contrast), and it may provide a more precise and accurate description of the dynamics of many different types of behavior.

Journal of the Experimental Analysis of Behavior, 1988

After training under short or long fixed-interval schedules, humans responded under a modified fixedinterval schedule in which magnitude of reinforcement (X or 2X) was minimally correlated with response frequency. Response frequencies that equaled or exceeded a minimum response criterion were followed by the larger reinforcer at the end of the interval; otherwise, the smaller reinforcer was delivered. The modified schedule alternated with the baseline schedule across conditions. In a control condition, the reinforcer magnitudes produced by control subjects were yoked to those of experimental subjects. Experimental subjects, but not control subjects, showed increased responding. In addition to the baseline and modified fixed-interval schedules used in Experiment 1, subjects in Experiment 2 also responded under a second modified fixed-interval contingency in which increases in reinforcer magnitude were more highly correlated with response frequency. Experimental subjects, but not control subjects, showed increased responding under both procedures. Direct comparison of these two procedures showed that the high-correlation procedure produced greater increases in responding than did the low-correlation procedure.

Journal of Applied Behavior Analysis, 2007

Journal of Applied Behavior Analysis, 2008

Consideration of reinforcer magnitude may be important for maximizing the efficacy of treatment for problem behavior. Nonetheless, relatively little is known about children's preferences for different magnitudes of social reinforcement or the extent to which preference is related to differences in reinforcer efficacy. The purpose of the current study was to evaluate the relations among reinforcer magnitude, preference, and efficacy by drawing on the procedures and results of basic experimentation in this area. Three children who engaged in problem behavior that was maintained by social positive reinforcement (attention, access to tangible items) participated. Results indicated that preference for different magnitudes of social reinforcement may predict reinforcer efficacy and that magnitude effects may be mediated by the schedule requirement.