Term
|
Definition
Behaving when more that one response
option is available; Each selection is another instance of choice |
|
|
Term
Concurrent operant
arrangements |
|
Definition
| How choice is studied; Two schedules in effect at the same time and responding can only occur on one schedule at a time |
|
|
Term
| Choices will always _______, _______ and ______. |
|
Definition
| Maximize reinforcement Minimize punishment Minimize effort |
|
|
Term
|
Definition
| Offering two reinforcements of different amounts; subject will always take the choice with more. |
|
|
Term
|
Definition
| Offering two different choices that are available after two different intervals. (E.g. one is 30 seconds and the other is 120); the subject can then select the 30 second then select the 120 second, so it is obtaining the maximum reinforcement. |
|
|
Term
|
Definition
When an organism consistently chooses the same
response option / reinforcement arrangement, we
call it a preference; choice is a behavior, whereas preference is not. |
|
|
Term
|
Definition
Systematic evaluations of reinforcer / behavior preference; Accomplished by setting up a series of choice-
making opportunities and recording behavior |
|
|
Term
| Common preference assessments |
|
Definition
| Paired-Stimulus (PSPA) Multiple Stimulus without Replacement (MSWO) Free Operant |
|
|
Term
|
Definition
| The video of the child picking an option; the therapist then presented her with every except what she had previously picked. |
|
|
Term
|
Definition
| The dog choosing between two treats; the tortoises choosing between two reinforcements |
|
|
Term
| FACTORS THAT AFFECT RESPONSE ALLOCATION |
|
Definition
| Quality of Reinforcer Magnitude of Reinforcer Delay to Reinforcement Response Effort Concurrent Punishment |
|
|
Term
|
Definition
| Moving from one response option to another |
|
|
Term
| Competing Operant Schedules |
|
Definition
Small immediate SR vs. Large delayed SR ~Watch tv now vs. get a good grade on the exam later
Small immediate SR vs. (avoid) Large delayed SP
~Get your nicotine fix now or avoid lung cancer later
(Avoid) Small immediate SP vs. Large delayed SR
~Avoid writing your paper now or graduate later
(Avoid) Small immediate SP vs. (avoid) Large delayed SP
~Avoid flossing now or avoid tooth decay later |
|
|
Term
|
Definition
| The more delayed the delivery of a reinforcer, the less value it represents. |
|
|
Term
| Variables that affect discounted rate |
|
Definition
| Price for immediate access Length of delay Impulsivity (k value) – mathematical constant, different for different people |
|
|
Term
| Delay Discounting Equation |
|
Definition
|
|
Term
|
Definition
| Perceived value of the reinforcer |
|
|
Term
|
Definition
| Starting (or objective) amount of the reinforcer |
|
|
Term
|
Definition
|
|
Term
|
Definition
| Constant; measure of impulsivity |
|
|
Term
| Two models of discounting |
|
Definition
| Hyperbolic Discounting (behavior) and Exponential Discounting (economics) |
|
|
Term
|
Definition
Value decreases by fixed proportion per unit time
Accounts for impulsivity
Does not account for loss of control (preference reversal)
Demonstrated mathematically, not empirically |
|
|
Term
|
Definition
Value decreases by smaller proportions at longer delays
Accounts for impulsivity
Accounts for loss of control (preference reversal)
Demonstrated empirically in humans and animals |
|
|
Term
|
Definition
| Study of behavior in the context of consumption,availability of resources, demand and supply |
|
|
Term
|
Definition
Reinforcers are available from
outside sources |
|
|
Term
|
Definition
Reinforcers are available from a
single source |
|
|
Term
|
Definition
| Demand changes at different unit prices; affected by necessity, dependence, substitutability, complementary items, and availability outside the economy |
|
|
Term
|
Definition
When physical dependence on a substance is
strong, demand for it becomes more inelastic |
|
|
Term
|
Definition
| The relative rate of one response alternative will “match” the rate of reinforcement available for that response alternative. Choice is governed by consequences. In concurrent arrangements, the PROPORTION of responses on one option will match the PROPORTION of reinforcers available for that option |
|
|
Term
|
Definition
B1/B1+B2 = r1/r1+r2
B (R) = Behavior
r = Reinforcement |
|
|
Term
|
Definition
| log(R1/R2) = alog(r1/r2)+logb |
|
|
Term
|
Definition
| Represents bias; affects the y intercept |
|
|
Term
|
Definition
Represents how sensitive the
organism is to changes in the reinforcement schedules; affects the slope |
|
|
Term
| Single alternative matching |
|
Definition
| The relative rate of a single behavior (as opposed to doing anything else) will match reinforcement available for that behavior |
|
|
Term
|
Definition
Applied generalized matching equation to rates of problem and alternative behavior in children DURING experimental manipulation of reinforcement rates
Demonstrated that changing the
rates/probabilities of reinforcement did alter rates of behavior
Expanded application of GME to human behavior in clinical contexts |
|
|
Term
| Types of alternating schedules |
|
Definition
| Multiple Schedule and Mixed Schedule; the main difference is that in multiple, the subject is signaled when the schedule changes, whereas in mixed, the only indication is the change in reinforcement. |
|
|
Term
|
Definition
| two+ schedules of reinforcement in succession, change on time-based schedule, associated Sd for each component |
|
|
Term
|
Definition
| same as mult but with no associated Sd |
|
|
Term
| Types of linked schedules |
|
Definition
| Chain Schedule and tandem schedule; the main difference is that in chain, the subject is signaled when the schedule changes, whereas in tandem, the only indication is the change in reinforcement. |
|
|
Term
|
Definition
| two+ schedules of reinforcement in succession, change based on completing prior schedule, associated Sd for each component |
|
|
Term
|
Definition
same as chain but with no
associated Sd |
|
|
Term
| S-S Account of Conditioned SR |
|
Definition
| Establishing a conditioned reinforcer uses the same process as establishing a conditioned stimulus (CS) in respondent conditioning |
|
|
Term
| Discriminative-Stimulus Account |
|
Definition
Sd = antecedent stimulus correlated with
reinforcement being available for responding
Because the stimulus is associated with behavior being reinforced, it acquired reinforcing value even though it has never directly been paired with the primary reinforcer (intervening behavior interrupts the pairing) |
|
|
Term
|
Definition
| A stimulus that provides information about the availability of reinforcement acquires conditioned reinforcing value (Bad news is better than no news) |
|
|
Term
| Delay-Reduction Hypothesis |
|
Definition
Conditioned reinforcing effect is stronger the more temporally linked the stimulus is to reinforcer delivery (or aversive-event avoidance)
A stimulus that functions as a reinforcer can cut down on the delay to reinforcement by bridging the delay to the primary reinforcer |
|
|
Term
| Concurrent-Chain Schedules |
|
Definition
Two chain schedules available; animal mustchoose one
In the typical preparation, the initial links are identical
Choice reflects preference for terminal link |
|
|
Term
| Delay Reduction & Concurrent-Chains |
|
Definition
| Even though the initial links are identical (30s), the overall delay to reinforcement differs; Animals reliably choose the initial link that produces the shorter delay to reinforcement. |
|
|
Term
|
Definition
| Delivering conditioned reinforcers (i.e., secondary reinforcers) that can then be exchanged for backup reinforcers |
|
|
