Term
|
Definition
Operant Conditiong: R -> S(c)
Respondent Conditioning S -> R |
|
|
Term
Operant Conditioning
3 Laws of Association |
|
Definition
Contiguity
Frequency
Effect (Most Important for Skinner) |
|
|
Term
Hendonism/ Epicurus
Hendonistic Principle |
|
Definition
An organism will do whatever necessary to max pleasure and min pain.
Pleasure-Reinforcer (skinner)
Pain-Punisher (Skinner) |
|
|
Term
| Respondent Conditining (1) |
|
Definition
|
|
Term
| Respondent Conditioning (2) |
|
Definition
Elicited by environment S-(elicits)->R
Tap on knee -(elicits)-> knee jerk |
|
|
Term
| Respondent Conditioning (3) |
|
Definition
| Fixed Topography "Form or shape of behavior" "reflexive/stereyotypical" |
|
|
Term
| Respondent Conditioning (4) |
|
Definition
MEASURED BY:
1.Amplitude- More Practice=LGR amp
2.Latency- Rx time- Time between presentation of stimulus and the appearence of the S-(RT)-> R
3. Resistence to extinction (US)- Once CR is formed, we can drop the US but we have to occasionlly use the US to avoid extinction |
|
|
Term
| Respondent Conditioning (5) |
|
Definition
| Origins of Unconditioned Reflex (food producing salvation is built in reflex) |
|
|
Term
|
Definition
| Voluntary Behavior (Skinner does not believe in INvol behavior) |
|
|
Term
|
Definition
Emitted by environment
R-(emits)-> S(c) (operating on environment) (max pleasure min consequences of pain) |
|
|
Term
|
Definition
Variable Topography
personal- Skinner box
Variable- critera has to be met- push button to get food |
|
|
Term
|
Definition
MEASURED BY:
Frequency- # of responses per unit of time
Punish- freq low//reward freq high |
|
|
Term
|
Definition
Origins of:
Skinner "Pool of random behavior" Thorndike "Law of mult responses"
*Organism has to be active (Salvatic bables)
*environment has to reinforce/punish |
|
|
Term
|
Definition
Father of Educational Psychology
1.Applied things to real world
2. Connectionist (opposite Skinner) looked into the brain to see whats happening during S->R connections.
3.Trail and Error Learning |
|
|
Term
| E L T: 3. Trial and Error learning |
|
Definition
| Keep trying until it works 99/100% of time will not work |
|
|
Term
|
Definition
Trial and Error Learning
Trap cat in box, cat has to experiment with things in the box until they found a way out.. milk outside door (reinforcer) |
|
|
Term
Trial and Error Learning
1.Law of Mult Responses |
|
Definition
| Cat starts becoming very active- multiple actions = "Pool of random behavior" |
|
|
Term
Trial and Error Learning (ELT)
2.Law of Effect |
|
Definition
(Emphasis on Error) Behaviorist that didn't open the door caused the cats NOT to repeat the same behavior
ANNOYER/SATISFYER |
|
|
Term
|
Definition
Anything an organism actively tries to avoid and does nothing to maintain (Skinner calls Punishers) "STAMP OUT"
S->R connections |
|
|
Term
|
Definition
| Anything an organism does nothing to avoid often doing things to obtain or preserve it. (Reinforcer) (Cat finds something to make door open) "STAMP IN" S->R connections |
|
|
Term
|
Definition
| "I WAS WRONG" annoyers do not weaken S->R relationships and do not STAMP OUT S->Connections |
|
|
Term
Trial and Error Learning (ELT)
3.Law of Frequency/Exercise |
|
Definition
| Probability of behavior will increase over trials or exercise, practice (More cat tries to get out, he will know by 3rd or 4th time) |
|
|
Term
|
Definition
1.contiguity
2.Frequency
3.Effect |
|
|
Term
Skinner Operant Laws
1.Contiguity |
|
Definition
| Stimulus and Response that occur together tend to form a relationship. Skinner says this should be implied |
|
|
Term
Skinner Operant Laws
2.Frequency |
|
Definition
| Practice is not enough. S->R needs to be a REINFORCED practice |
|
|
Term
Skinner Operant Laws:
3.Effect - Maintains escape and avoidance behavior |
|
Definition
1.Reinforcer- Any stimulus Consequence that INCREASES the frequency of the response that follows S->R :)(satisfier)
2.Punisher- Any stimulus consequence that DECREASES the frequency of the response that follows. S->R :( (annoyers) |
|
|
Term
|
Definition
| Time out S(TO) the removal of all potentional reinforcers from the environment |
|
|
Term
Contingent Withdrawl (or response cost)
S(CW) |
|
Definition
The removal of a specific reinforcer, but not the one that is maintaining the behavior.
DIFFERENT FROM EXTINCTION- removal that IS maintaining the behavior. |
|
|
Term
|
Definition
| Presenting an aversive stimulus |
|
|
Term
|
Definition
SRT(pos reinforcers), when we use neg reinforcers we do not feel good about what we are doing, even though its effective.
Skinner AVOIDS punishers because they do not weaken S->R relationships, all they do is supress behavior (speeding-cop-slam on breaks-speed back up) |
|
|
Term
|
Definition
1.primary reinforcer (SRT)- naturally occuring reinforcers (Food, Sex, Drink, Touch **most common)
2.secondary rein- Srt (CONDITIONED reinforcer) a prev. neutral stimulus that takes on reinforcing properties because it can be EXCHANGED for a PRIMARY reinforcer |
|
|
Term
| Schedules of Pos.Reinforcement (Skinner) |
|
Definition
| indicates how often a correct response is followed by a reinforcing consequence. |
|
|
Term
| 1.Continuous Schedule- CRF |
|
Definition
| an organism that is reinforced after every correct response (important when estab. a new behavior) |
|
|
Term
|
Definition
Only reinforced occasionally. Once CRF- we estab.
1.more practical and less $$
2.Satiation- only reward so much, before gets old
3.Partial reinforcement effect (PRE)** |
|
|
Term
| PRE- Partial Reinforcement effect |
|
Definition
| a behavior maintained by an intermittent schedule is more resistent to extinction |
|
|
Term
|
Definition
| Skinner used to measure change in frequency of behavior |
|
|
Term
Cumulative Recorder
Shallow slope
Steeper slope
Pos skewed line
Neg skewed line |
|
Definition
slower response
faster response
reinforcement/organ is responding more and more frequent
punishers or extinction |
|
|
Term
| Ratio Sch. Type of Int. Sch |
|
Definition
Reinforcement is based on the number of correct responses
1.Fixed ratio- (FR_)_=# of responses- Organism is reinforced after a fized # of correct responses. FR#=stair step pattern in cumulative record |
|
|
Term
| Post reinforcement pause- Strongest |
|
Definition
| Time out betwen reinforcment (time inbetween steps) |
|
|
Term
|
Definition
| Move too quickly from a small to large fixed ratio sch= Extinction |
|
|
Term
| (VR) Variable Ratio- Int sch- Most effective |
|
Definition
The organism is reinforced after a variable # of correct responses (never knows when reinforcer is going to come)
3 + 6 + 4 + 7/4 = 20/4= 5
Most effective
Cumulative recorder- very steep slope showing rapid responses- very consistent |
|
|
Term
|
Definition
Reinforcement is based on passage of time.
1.Fixed Interval (FI)
2.Variable Interval (VI) |
|
|
Term
| Fixed interval (FI) interval sch. |
|
Definition
| the organism is reinfroced for the first correct response after a fixed amount of time has passed |
|
|
Term
| Variable interval (VI) Interval sch |
|
Definition
Organism is reinforced for the first correct response after a variable amount of time has passed
Cumalative recorder- Consistent but not as rapid |
|
|
Term
| Transfer- Identical elements model used |
|
Definition
| Prompting and Fading Prompting is the act of helping a behavior to occur. This is a useful way to start teaching a behavior. A coach who helps a small child hold a baseball bat, to teach a proper swing, is using prompting. Fading is said to occur when the trainer gradually withdraws the prompt. |
|
|
Term
| Law of associative Shifting (Thorndike)- Prompting and fading |
|
Definition
| A transfer of responses to new stimuli takes place by their pairing with stimuli already connected to those responses. |
|
|
Term
| ERRORLESS LEARNING- Terrace |
|
Definition
| is a procedure introduced by Herbert Terrace (1963) which allows discrimination learning to occur with few or even with no responses to the negative stimulus (abbreviated S−). A negative stimulus is a stimulus associated with undesirable consequences (e.g., absence of reinforcement). In discrimination learning, an error is a response to the S−, and according to Terrace errors are not required for successful discrimination performance. |
|
|
Term
|
Definition
1.Extinction (Pavolv)
2.Response Competition
3.Situational variation
4.Disuse/Decay - Ruled out |
|
|
Term
|
Definition
| The removal of a specific reinforcer that IS maintaining the behavior (you have to find out what is the reinforcer to modify behavior) |
|
|
Term
|
Definition
| Removal but not the one maintaining the behavior (we dont know what the reinforcer is so we take the indirect approach) |
|
|
Term
|
Definition
| Removal but not the one maintaining the behavior (we dont know what the reinforcer is so we take the indirect approach) |
|
|
Term
Loss:Extinction:
Baseline/Operant behavior |
|
Definition
Pre reinforcement frequency of behavior (can be 0)(ex.shoe tieing)
Rats in Skinner box lever pressing 3x before reinforcement- So frequency=3 |
|
|
Term
Loss:extinction
Frustration Effect (FE) |
|
Definition
| A temporary rise in the frequency of a response along with emotional concomitonts that occurs immediatley following the onset of extinction (a tempertantrum) (breaking up) |
|
|
Term
|
Definition
| The ability to respond to stimuli differently S(d/delta)->R->S(c) |
|
|
Term
|
Definition
S(D) A stimulus that proceeds a response and in the case that a specific consequence will follow.
If S(d)-(u can expect->R- this will happen S(C) |
|
|
Term
|
Definition
When you understand the consequences of the S(D) you are under....
Whatever it takes to max pleasure and min pain- avoid punishers gain reinforcers |
|
|
Term
|
Definition
A stimulus that proceeds a response in the case that NO consequence will follow. Associated with Extinction.
S(delta)->R->No consequence=extinction
Potentional Stimulus... |
|
|
Term
|
Definition
| Two or more responses held together by common stimulus. A series of S->R->S components |
|
|
Term
|
Definition
Horizontal
Vertical- SD and S(delta) are sensory verbs (sees,hears) and R should be action verbs (walk, look, tell)
Reciprocal "2 person" chain |
|
|
Term
| Contengencies of (POS) reinforcement |
|
Definition
| the realtionship between a behavior and the reinforcer that follows it. |
|
|
Term
|
Definition
| must immediatley follow the response R occurs and immediatley following S(RT) must occur |
|
|
Term
|
Definition
design the environment to pair with the response in a stimulus.
Skinner box:Rat presses button and immediatley following, gets a pellot of food. |
|
|
Term
|
Definition
| Did something and out of nowhere you are reinforced. R will increase in frequency. (Bowling, Pitching a strike) |
|
|
Term
| Accidental contengencies leads to... |
|
Definition
| Superstitious behavior- behaviors established thru accidental contengecies of reinforcement. "Miracles" |
|
|
