Term
Theory of motivation
Drive-reduction theory
Clark Hull |
|
Definition
Goal of behavior is to reduce biological drives -- reinforcement occurs when a drive is reduced. |
|
|
Term
Classical conditioning
(Respondent conditioning)
Ivan Pavlov |
|
Definition
Learning connections between different events |
|
|
Term
Unconditioned stimulus (UCS) |
|
Definition
A stimulus that can reflexively elicit a response. |
|
|
Term
Unconditioned response (UCR) |
|
Definition
A response reflexively elicited by an unconditional stimulus. |
|
|
Term
Conditioned stimulus (CS) |
|
Definition
A neutral/new stimulus that, AFTER CONDITIONING, is able to elicit response. |
|
|
Term
Conditioned response (CR) |
|
Definition
Response to conditioned stimulus--may be same as unconditioned response. |
|
|
Term
|
Definition
CS presented before the UCS (ex. The bell ring was presented before food powder) |
|
|
Term
|
Definition
The period during which an organism is learning the association of the stimuli. |
|
|
Term
|
Definition
Repeatedly present the CS (bell) without the UCS (food powder). The CR will stop appearing eventually. |
|
|
Term
|
Definition
After a period of rest, presenting CS (bell) without the UCS (food powder) will elicit a weak CR (salivation) |
|
|
Term
|
Definition
Tendency for stimuli similar to the CS (the bell) to elicit the CR (salivation). Ex. bells of a diff. pitch, chimes, etc.
** Evidence in phobias |
|
|
Term
|
Definition
Presenting the CS (bell) without the UCS (food powder).
** Generally unsuccessful |
|
|
Term
Second-order conditioning |
|
Definition
Neutral stimulus is paired with CS (bell) rather than a UCS (food powder).
* Stage 1: CS (bell) -> UCS (food)
* Stage 2: New UCS (light) -> CS (bell)
After several trials, CR (salivation) to 2nd UCS. |
|
|
Term
|
Definition
Two neutral stimuli paired together and then one of them paired with a UCS (food).
* Stage 1: Neutral 1 (light) -> neutral 2 (bell)
* Stage 2: Neutral 2 (bell) -> UCS (food)
Test for neutral 1 (light) w/o any other stimulus
neutral elicits CR
|
|
|
Term
Contingency explanation of classical conditioning
Robert Rescorla |
|
Definition
Classical conditioning is only a matter of learning signals for the UCS (food). So long as CS (bell) is a good signal that tells when UCS will appear, classical conditioning will occur. |
|
|
Term
|
Definition
CS is a good signal for UCS AND provides nonredundant information about the occurrence of the UCS.
Ex. Rats w/ hissing noise (CS), light (CS), and shock (UCS). Can pair hissing noise but not light. Light provides no info about shock. |
|
|
Term
Operant conditioning
(Instrumental conditioning) |
|
Definition
Learning the relationship between one's actions and their consequences. |
|
|
Term
Law of effect
E.L. Thorndike |
|
Definition
If a reponse is followed by an annoying consequence, the animal will be less likely to emit the same response in the future. |
|
|
Term
Positive reinforcement
B.F. Skinner |
|
Definition
Increasing probability of desired response by providing a reward whenever response occurs. |
|
|
Term
Negative reinforcement
B.F. Skinner |
|
Definition
Increasing probability of desired reponse by taking away or preventing something undesirable whenever response is made. |
|
|
Term
Escape (Neg. reinforcement) |
|
Definition
The behavior removes something undesirable.
Ex. Fastening your seatbelt (desirable behavior) will remove the buzzer reminder (undesirable thing) in your car |
|
|
Term
Avoidance (Neg. reinforcement) |
|
Definition
Organism gets a warning that an aversive stimulus will soon occur and appropriate response will allow organism to avoid it.
Ex. Stop sign warns you before aversive stimulus (potential crash) |
|
|
Term
|
Definition
Probability of response decreased by giving organism something undesirable when response is made. |
|
|
Term
|
Definition
Stimulus condition that indicates the organism's behavior will have consequences.
I.e., a stimulus will tell if a reward or punishment occurs, such as a light. |
|
|
Term
Partial reinforcement effect |
|
Definition
Longer to extinguish behavior in which reinforcement was occasional or intermittent.
Ex. gambling |
|
|
Term
Fixed-ratio
(Partial reinforcement) |
|
Definition
Receives reinforcement after a fixed number of responses
Ex. Food pellet after every five lever presses |
|
|
Term
Variable-ratio
(Partial reinforcement) |
|
Definition
Receive reinforcement after a varying number of responses
Ex. VR 5 schedule - Food pellet after, on average, every five lever presses
** Very resistant to extinction
** Elicits most rapid response rate |
|
|
Term
Fixed-interval
(Partial reinforcement) |
|
Definition
Reinforced on 1st response after fixed period of time.
Ex. FI-45 sec schedule, food pellet appears every 45 seconds. |
|
|
Term
Variable-interval
(Partial reinforcement) |
|
Definition
Reinforced for first response made after an average amount of time has elapsed since last reinforcer. |
|
|
Term
Shaping
(Differential reinforcement) |
|
Definition
Reinforce successive approximations of desired behavior until desired behavior is achieved. "Baby steps" |
|
|
Term
Flooding
(Behavior therapy/modification) |
|
Definition
Client experiences CS (phobia) without the US that originally elicited fear. |
|
|
Term
Implosion
(Behavior therapy/modification) |
|
Definition
Client imagines fearful situation, intensely concentrating and realizing nothing will happen. |
|
|
Term
Systematic desensitization
Joseph Wolpe |
|
Definition
Uses hierarchy of anxiety-provoking situations coupled with use of relaxation techniques
* Starts with relaxation w/ low-anxiety, baby stepping up to using relaxation w/ high-anxiety
* Also called counter-conditioning |
|
|
Term
|
Definition
Stimulus that attracts the client becomes paired with an aversive UCS assoc. w/ punishment.
** Used w/ alcohol, smoking, fetishes |
|
|
Term
Behavioral contract
(Contigency management) |
|
Definition
Negotiated agreement between two parties that explicitly state the change that is desired and indicates consequences of certain acts.
* Mutual desired behaviors by parties in contract |
|
|
Term
Time-out
(Contingency management) |
|
Definition
Removing client from potentially reinforcing situation before he can receive reinforcement for undesirable behavior |
|
|
Term
|
Definition
Tokens given for desirable behavior and taken away for undesirable behavior. Tokens can be exchanged for rewards and privileges.
* Used in mental hospitals |
|
|
Term
Premack principle
(Contingency management) |
|
Definition
Using a more preferred activity to reinforce a less preferred activity.
Ex. Parents telling child they can play if they do their homework. |
|
|
Term
Law of effect & puzzle box
E.L. Thorndike |
|
Definition
Cat stuck in box jail, food just outside. Eventually finds its way out.
Thorndike argues it was only by trial-and-error learning. |
|
|
Term
Insight learning
Wolfgang Kohler |
|
Definition
Used chimpanzees in play areas w/ food in sight. Chimps would find novel ways to solve problems after observing situation.
* Evidence for insight |
|
|
Term
Rats and cognitive maps
Edward Tolman |
|
Definition
Rats were able to form cognitive maps of various mazes. If familiar route was blocked, rat used map to adopt an alternative route. |
|
|
Term
|
Definition
Different species have different inborn predispositions to learn different things in different ways.
* Affects both types of conditioning |
|
|
Term
Garcia effect
John Garcia |
|
Definition
G1 - Rats w/ sweet water and shock
G2 - Rats w/ sweet water and drug
G3 - Rats w/ bright-noisy water & shock
G4 - Rats w/ bright-noisy water & drug
* Conditioning occurred between 2 and 3
* Preparedness - assoc. illness with ingestion and sights/sound w/ pain |
|
|
Term
Instinctual drift
Keller & Marion Breland |
|
Definition
Instinctual ways of behaving are able to override behaviors learned through operant conditioning
Ex. Raccoons w/ coins and crayfish |
|
|
Term
Fixed-action patterns (FAP)
Niko Tinbergen |
|
Definition
A stereotyped behavior sequence that does not have to be learned by animal
Ex. Rolling an egg back to a nest, courtship rituals |
|
|
Term
|
Definition
Features of a stimulus sufficient to bring about a particular FAP |
|
|
Term
|
Definition
A sign stimulus that triggers social behavior between animals |
|
|
Term
Supernormal stimulus
Niko Tinbergen |
|
Definition
A model more effective at triggering an FAP than the actual sign stimulus in nature
Ex. Painted red bellied models of male stickelbacks |
|
|
Term
Innate releasing mechanism (IRM) |
|
Definition
A mechanism in the animal's nervous system that connects sign stimuli with correct FAPs |
|
|
Term
Reproductive isolating mechanism |
|
Definition
Behaviors that prevent animals of one species from attempting to mate with animals of a closely related species.
Ex. Species-specific calls
* Found only where closely related species share an environment |
|
|
Term
Waggle dance
Karl von Frisch |
|
Definition
|
|
Term
Natural selection
Charles Darwin |
|
Definition
1: Genetic differences must exist
2: If a specific genetic variation increases chances of reproduction, it will tend to be passed down.
3:Over time, more members of species will have genetic variation that increases chance of reproduction |
|
|
Term
|
Definition
Takes into account the number of offspring that live to be old enough to reproduce.
* Altruism is problematic |
|
|
Term
|
Definition
"Helping" another member of species at danger of self, decreasing reproductive fitness |
|
|
Term
|
Definition
Animals act to increase inclusive fitness, not reproductive fitness.
Takes into account # of offspring who live to reproduce & number of other relatives who live to reproductive age. |
|
|
Term
|
Definition
Behavior is due to a complex and dynamic interplay between genetics and environment. |
|
|