Term
| Ainslie-Rachlin principle |
|
Definition
| A principle which states that reinforcement value decreases as the delay between making a choice and obtaining the reinforcer increases. The principle predicts preference reversal when a delay precedes the choice between a small, immediate reward and a large, deferred reinforcer. That is, at some time prior to the choice the large, deferred reinforcer becomes more valued than the small, immediate reward. |
|
|
Term
|
Definition
| The use of economic concepts (price, substitute commodity, etc.) and principles (e.g., marginal utility) to predict, control, analyze the behavior for organisms in choice situations. |
|
|
Term
|
Definition
| For the generalized matching equation, bias is indicated by variation in the value of k from 1. Generally, bias is produced by some unknown asymmetry between the alternatives on a concurrent schedule that affects preference over and above the relative rates of reinforcement. |
|
|
Term
|
Definition
A control procedure that is used to stop rapid switching between alternatives on concurrent schedules of reinforcement.
The COD contingency stipulates that responses do not have an effect immediately following a change from one schedule to another. After switching to a new alternative, a brief time is required before a response is reinforced.
The COD contingency operates in both directions whenever a change is made from one alternative to another. |
|
|
Term
|
Definition
| On a concurrent schedule, a response that the organism emits when it switches from one alternative to another. |
|
|
Term
|
Definition
| From a behavioral view, it is the distribution of operant behavior among alternative sources of reinforcement (e.g., concurrent schedules of reinforcement). |
|
|
Term
|
Definition
| Some behavior emitted at a time prior to the choice point that eliminates or reduces the probability of impulsive behavior. |
|
|
Term
| Concurrent Schedules of Reinforcement |
|
Definition
| Two or more schedules of reinforcement (e.g., FR, VR, FI, VI) that are simultaneously available. Each alternative is associated with a separate schedule of reinforcement, and the organism is free to distribute behavior to the schedules. |
|
|
Term
|
Definition
Delay discounting involves deciding between small, immediate rewards and large, delayed ones.
The large benefit in the future is devalued or discounted. |
|
|
Term
|
Definition
A mathematical curve showing how consumption decreases with price.
When consumption of a commodity (reinforcer) rapidly decreases with price, the commodity is said to be elastic.
Consumption of necessities does not change much with price and is said to be inelastic. |
|
|
Term
| Extraneous sources of Reinforcement |
|
Definition
All non-programmed sources of reinforcement that regulate alternative behavior - reducing the control of behavior on a specified schedule of reinforcement.
These include any unknown contingencies that support the behavior of the organism. |
|
|
Term
|
Definition
| An experimental method used to present concurrent schedules in the operant laboratory. Separate schedules are programmed on a single key, and the organism may switch schedules (and associated Sds) by making a response on a changeover key. |
|
|
Term
|
Definition
A generalized form of the ratio equation may, however, be used to handle the situation in which unknown factors influence the distribution of behavior. These factors produce systematic departures from ideal matching, but may be represented as two constant (parameters) in the generalized matching equation.
Ba/Bb = k(Ra/Rb)^a
The coefficient k and the exponent a are values that represent two sources of error for a given experiment.
When these parameters are equal to 1, the equation is the simple ratio form of the matching law. |
|
|
Term
| Hyperbolic Discounting equation |
|
Definition
A delay discounting equation by Mazur (1987) that shows a hyperbolic decay:
Vd = A/1+kd |
|
|
Term
|
Definition
| When a person (or other animal) selects the smaller, immediate payoff over the larger, delayed benefits, we may say that the person shows this behavior. |
|
|
Term
| Log-linear matching equation |
|
Definition
To write the matching law as a straight line we use this:
log(Ba/Bb) = log k + [ a x log(Ra/Rb)] |
|
|
Term
|
Definition
When two or more concurrent-interval schedules are available, the relative rate of response matches (or equals) the relative rate of reinforcement.
More generally, the distribution of behavior between (or among) alternative sources of reinforcement is qual to the distribution of reinforcement for these alternatives. |
|
|
Term
|
Definition
| In this economic view of behavior, humans and other animals are like organic computers that compare their behavioral distributions with overall outcomes and eventually stabilize on response distribution that maximizes overall rate of reinforcement. |
|
|
Term
|
Definition
| An explanation of how organisms come to produce matching on concurrent schedules of reinforcement. In contrast to overall maximizing of reinforcement, Herrnstein (1982) proposed a process of doing the best at the moment. Organisms, he argued, are sensitive to fluctuations in the momentary rates of reinforcement rather than to long term changes in overall rates of reinforcement. |
|
|
Term
|
Definition
| In the generalized matching equation, a value of a greater than 1 indicates that changes in the response ratio are larger than changes in the ratio of reinforcement. This outcome occurs because relative behavior increases faster than predicted from relative rate of reinforcement. |
|
|
Term
|
Definition
| Generalized Matching law is also known as _____. |
|
|
Term
|
Definition
| When several schedules of reinforcement are available concurrently, one alternative may be chosen more frequently than others. When this occurs, we say that the organisms shows _____ for that alternative. |
|
|
Term
|
Definition
| When equated for differential outcomes, humans and other animals show a preference for options that allow them to make choices compared with options that limit or restrict the opportunity to choose. |
|
|
Term
|
Definition
| The change in value of a reinforcer as a function of time to the choice point (as in self-control). |
|
|
Term
| Quantitative law of effect |
|
Definition
| This law states that the absolute rate of response on a schedule of reinforcement is a hyperbolic function of rate of reinforcement on the schedule relative to the total rate of reinforcement (both schedules and extraneous reinforcement). |
|
|
Term
| Relative rate of reinforcement |
|
Definition
When two or more sources of reinforcement are available (as on a concurrent schedule), refers to the rate of response on one alternative divided by the sum of the rates of reinforcement on all sources of reinforcement.
It is a measure of the distribution of behavior between or among alternatives. |
|
|
Term
| Relative rate of response |
|
Definition
When two or more sources of reinforcement are available (as on a concurrent schedule), refers to the rate of response on one alternative divided by the sum of the response rates on all other alternatives.
It is a measure of the distribution of behavior between or among alternative sources of reinforcement. |
|
|
Term
|
Definition
| From a behavioral perspective, it occurs when a person emits a response that affects the probability of subsequent behavior -- giving up immediate gains for greater long-term benefits, or accepting immediate costs for later rewards. When people (or other organisms) manage their behavior in such a way that they choose the more beneficial long-term consequences, they are said to show this. |
|
|
Term
|
Definition
| This term is used to denote that a change in price of one reinforcer alters the consumption of a second reinforcer, holding the income constant. |
|
|
Term
|
Definition
| On a concurrent schedule of reinforcement, the alternative schedules are presented on separate response keys. |
|
|
Term
|
Definition
In the generalized matching equation, the exponent a takes on a value less than 1. This occurs when changes in the response ratio are less than changes in the reinforcement ratio.
This effect is interpreted as low sensitivity to the programmed schedules of reinforcement. |
|
|
Term
|
Definition
| After obtaining 7 or 8 indifference points over the range of the delays, the indifference point at each delay is plotted on a graph and a mathematical curve is fitted to the points. |
|
|
Term
|
Definition
| As the rate of reinforcement on the schedule increases, the rate of response also rises, but eventually further increase int eh rate of reinforcement produce less and less of an increase in the rate of response ) |
|
|
Term
|
Definition
The rise in rate of response with increasing rate of reinforcement is modified by Re.
Reduces the rate of response on the reinforcement schedule.
One implication is that control of behavior by a schedule of reinforcement is weakened by this. |
|
|
Term
| Quantitative Law of Effect Equation |
|
Definition
Relates the absolute response and reinforcement rates, using alternative sources of reinforcement as the context. The equation may be derived from a restatement of the proportional matching law and is written:
Ba / (Ba+Be) = Ra / (Ra + Re), where
Be = behavior directed to extraneous sources of reinforcement
Re = extraneous sources of reinforcement
Ba = Rate of response on the programmed schedule
Ra = Rate of schedules reinforcement |
|
|
