Term
|
Definition
|
- highly familiar stimulus is habituated
- makes the stimuli less effective when used later as a CS in Pavlovian conditioning
o ex.) tone presented alone during repeated trialsàhabituated
o tone then paired w/ food US
§ development of conditioned response to tone takes much longer
|
|
|
Term
|
Definition
|
- unconditioned stimulus is unpleasant, aversive (pain)
|
|
|
Term
|
Definition
- higher order stimulus relation
- A+ and AB- trials
- B becomes signal for absence of US, conditioned inhibitor
|
|
|
Term
|
Definition
- developed by BF Skinner w/ Skinner Box
- permits subject rather than experimenter to decide when to start next trial
- permits investigation into how quickly response completed, how frequently subject engaged in activity as well
|
|
|
Term
|
Definition
- processes that counteract, oppose each other
- used to regulate each other, maintain homeostatic level
o habituation and sensitization are opponent processes
o regulate: vigor of elicited behavior
|
|
|
Term
Retardation of Acquisition Test
|
|
Definition
- based on assumption that conditioned inhibitory properties will interfere w/ learning to associate excitatory properties w/ the stimulus
- trials carried out to create a conditioned inhibitor
o B stimulus is paired w/ US that it had been conditioned to signal inhibition of
o Novel stimulus C also paired w/ US
§ Association of US w/ B will develop much slower
§ Signals successful conditioned inhibition
|
|
|
Term
|
Definition
- American psychologist, founder of behaviorism
- Developed the free operant method for studying behavior
- Free operant method used in his Skinner Box learning experiment devices
|
|
|
Term
| Temporal Factors and Conditioned Responding |
|
Definition
|
- time is critical factor in conditioning
- important variable: interval b/w successive trials
o more conditioned responding observed when trials far apart
|
|
|
Term
|
Definition
- sudden movement or flinch caused by novel stimulus
- easily measuredàused to look at habituation, sensitization
- intensity determines habit/sens effects
o soft/mild stimulus: quick habituation
o more intense stimulus, harder to habituate
§ sensitization at first, then switches to habituation
o very intense, repetitions may result in sustained sensitization
|
|
|
Term
|
Definition
- Thorndike w/ puzzle boxes
- participant only has opportunity to perform instrumental response at certain times
- experimenter determines the times
- subjects can only go about puzzle-box behaviors when inside puzzle box
- after they do behavior, removed, cannot do behavior again until put back in for next trial
|
|
|
Term
|
Definition
- consequent outcome of instrumental behavior
|
|
|
Term
|
Definition
|
- unconditioned stimulus is desirable, appetitive (food)
|
|
|
Term
Attentional Models of Conditioning
|
|
Definition
- For conditioning to occur, subjects must pay close attention to CS
- assumptions on what determines salience of CS on a given trial
- salience: how noticeable something is, how attention grabbing it is
|
|
|
Term
Behavior Systems & their 4 Notable Features
|
|
Definition
- divisions of elicited behavior sequences
1.) consist of sequence of 3+ modes of behavior (not just appetitive, consummatory)
2.) sequence of response modes is linear (can’t handle food w/o finding it)
3.) response may be linear but is not one-directional
a. animal may go forward or backwards in sequence depending on circumstances
b. if squirrel not successful finding nuts in focal search, will return to general search
4.) each response mode involves characteristic responses AND increased sensitivity to particular stimuli
a. ex.) general search: bee looks for general flowering bushes
b. focal search: bee looks for flowers on the bush
c. food handling: focus on part of flower with nectar
|
|
|
Term
|
Definition
- CS presented w/ another cue that already predicts US
o CS is redundant: little conditioned responding will develop
- Example: shrimp makes you sick but you sometimes eat it to be polite
o At dinner party, have shrimp and a vegetable you have never eaten before
o Get ill after meal
o Likely will attribute illness to shrimp, not to new CS of vegetable
- What individuals learn about a CS is influenced by presence of other cues previously associated w/ the US
|
|
|
Term
CS-US Contingency
- Definition
- Probabilities/Types
- How it affects US-CS learning
|
|
Definition
- “contingency”=extent to which presence of one stimulus can serve as a basis for predicting another
- defined by two probabilities:
o p(US/CS)àprobability that US will occur given that CS occurred
§ when US always occurs w/ CS, never just itself:
· Perfect Positive Contingency
· Ex.)smoke only occurs when something is burning
o p(US/noCS)à probability that US will occur given that CS didn’t occur
§ when US occurs only when CS is absentàCS signals US absence
· Perfect Negative Contigency
· Ex.) presence of sun-block on skin signals absence of sunburn
- situation in which US occurs equally often w/ and w/o CS: zero contingency
o CS provides no useful info about whether US will happen
o Characteristic of random control procedure
- contingency predicts how much conditioned learning will develop
|
|
|
Term
|
Definition
- interval b/w when the CS begins and the US is presented
- does not reveal whether it was a trace or delay condition
- learning is best seen when ISI is above zero (not simultaneous conditioning)
o longer the ISI delay, more learning tends to decline
|
|
|
Term
CS-US Relevance/Selective Association:
|
|
Definition
- effectiveness of a CS in Pavlovian conditioning depends selectively on the unconditioned stimulus that is used
- more likely to learn aversion to food if dev’p gastrointestinal illness than other types of stimuli encountered before illness
- not absoluteàlearning can occur but will be more difficult to condition
|
|
|
Term
|
Definition
|
- CR depends on what happens during CS AND what happens during experimental situation in general
- If excitatory value of context greater than that of target CS: inhibitory responding
- If excitatory value of target CS greater than context: excitatory behavior
|
|
|
Term
|
Definition
- trials w/ US: AB-->US
- trials w/o US: A-->no US
- associate B w/ excitatory stimulus’ presence
o Ex.) Sidewalk sign “Slippery when wet”
o Sidewalk itself not slippery; presence of water “B” makes it slippery
|
|
|
Term
|
Definition
- certain instrumental behavior rate is well established, reinforced
- aversive conditioning trials are introduced
o aversive conditioning stimulus elicits fear response
o w/in a few trials, results in suppression of previous rates of instrumental behavior
§ many animals’ response to fear is to freeze
|
|
|
Term
Conditioned/Secondary Reinforcer
|
|
Definition
- stimulus associated with primary reinforcer
o Delivery immediately after target response overcomes ineffectiveness of delayed reinforcement
|
|
|
Term
DUAL PROCESS THEORY OF HABITUATION AND SENSITIZATION
|
|
Definition
- proposed by Grove & Thompson
- based on two underlying habituation and sensitization processes
o the processes are different from the phenomena
o processes: underlying events that are presumed to be responsible for the behavioral sensitization habituation effects
- habituation and sensitization processes occur in different parts of nervous system
- habituation takes place in S-R System
- Sensitization takes place in state system
- Habituation & sensitization processes act as opponent models
o When habituation stronger, net effect is decline in behavior
o When sensitization is stronger, net effect is increase in behavior
|
|
|
Term
|
Definition
- gives best evidence for associative learning
- conditioned stimulus presented slightly before unconditioned stimulus on each trial
|
|
|
Term
|
Definition
- two types of trials occur in random alternation
o CS+ trials paired w/ US
o CS- trials presented w/o US
§ For ½ participants, A used as CS+ and B used as CS-
§ For other ½, A is CS-, B is CS+
- Stronger conditioned responding to CS+ than CS- evidence of associative learning, not responding a certain way to a certain stimulus
|
|
|
Term
Effects of Stimulus Change w/ Habituation
|
|
Definition
- habituation is stimulus specific
- if new stimulus presented, habituated response will recover
o degree of recovery depends on how similar new stimulus is to habituated stimulus
|
|
|
Term
|
Definition
- happens once animal has identified potential source of stimulus
- concentrates on that found provider
o food handling & ingestion: similar to consummatory behavior
|
|
|
Term
|
Definition
|
- first part of behavior system
- animal reacts to general enviro features in a way that will enable contact w/ potential source of desired stimulus-provider
|
|
|
Term
Habituation and Sensitization Related to :
- stimulus frequency
-stimulus intensity
-exposure to Second Stimulus
|
|
Definition
- Stimulus Frequency: higher frequency, more rapidly declining responding
- Stimulus Intensity: responding declines slower if stimulus is very intense
- Exposure to Second Stimulus: exposure to second stimulus can result in recovery of previously habituated stimulus: dishabituation
|
|
|
Term
Higher-Order Stimulus Relations
|
|
Definition
- signaling or modulation of simple CS-US pairing
- one of elements of relation is CS-US associative unit
|
|
|
Term
Hydraulic Model (relates to MAPs)
|
|
Definition
- assumption that certain factors lead to buildup of particular type of motivation, drive
- hydraulic b/c compared to buildup of pressure w/in hydraulic engine
|
|
|
Term
|
Definition
- ratio b/w Inter-trial Interval (I) and CS-duration (T)
- greatly affects levels of conditioned responding
|
|
|
Term
IMPLICATIONS OF DUAL PROCESS THEORY
(one relates to habituation effect, one to sensitization effect)
|
|
Definition
- S-R system active every time eliciting stimulus is present
o Habituation is universal feature of elicited behavior
o Habituation process activated whenever stimulus present
- State system is not essential for occurrence of elicited behavior
o Elicited behavior can occur in S-R alone
o Sensitization doesn’t occur during all stimulus presentation situations
o Sensitization NOT universal property of elicited behavior
o Only activated when stimulus is particularly intense or significant
§ Sensitization represents arousal
|
|
|
Term
In what ways are Instrumental or Operant Responses Established?
|
|
Definition
- Learning WHERE and WHAT to run for: already know how to run or do some sort of innate behavior-->need to learn where to go and why (eg. End of runway=food)
- Constructing Responses from Familiar Components
o Lever press: consists of number of familiar components: balancing on hind legs, raising paws, extending paw forward, bringing paw down with sufficient force
o Instrumental conditioning: construction/synthesis of new behavioral unit made up from preexisting response component
- Shaping New Responses: instrumental conditioning helps form responses an individual would never perform otherwise
|
|
|
Term
|
Definition
|
- particular response is required to obtain specific stimulus or consequent outcome
- b/c response instrumental in producing outcome, called instrumental behavior
|
|
|
Term
|
Definition
- instrumental learning doesn’t involve learning to associate response w/ the reinforcer
o Does not involve establishment of an R-O association or learning about the reinforcer
o Results only in the establishment of an S-R association
§ Reinforcer outcome O only significant as catalyst for learning S-R association
|
|
|
Term
|
Definition
- evident even after long periods w/o stimulation
|
|
|
Term
|
Definition
- not a conditioned reinforcer, doesn’t provide info about future opportunity for primary reinforcement
o Brief visual or auditory cue that distinguishes target response from other activities participant is likely to perform during delay interval
o Makes instrumental response more memorable
o Helps overcome deleterious effect of reinforce delay
|
|
|
Term
|
Definition
- instrumental behavior defined in terms of particular operation or manipulation of environment
o pushing lever in cage hard enough to activate microswitch, maybe will end in getting food or some other reward
|
|
|
Term
Problems w/ Rescorla-Wagner Model
|
|
Definition
- predicts that repeated presentations of conditioned inhibitor (CS-) by itself will lead to loss of conditioned inhibition
o does not occur
o opposite found: repeated non-reinforcement strengthens conditioned inhibitory properties
- extinction viewed as reverse of acquisition (return of associative value of CS to zero)
o extinction actually involves learning new relationship b/w CS and US
- difficult to explain how in certain conditions, same CS may have excitatory AND inhibitory properties
o R-W model only allows for CS to have one associative value
|
|
|
Term
|
Definition
- relationship b/w response and reinforcer (Response: R, Reinforcer: O)
|
|
|
Term
|
Definition
- developed by Rescorla
- CS and US presented repeatedly @ random times in relation to each other
o Random timing meant to prevent formation of association b/w CS & US w/o interfering w/ sensitization
- Problems:
o Random CS-US presentationsàoccasional instances where CS presented in conjunction w/ US àmay devp conditioned responding
o When US presented w/o CS, can be conditioned to be associated w/ background cuesàdecrease effectiveness of CS
|
|
|
Term
|
Definition
|
- how often subject initiated operant response
o Primary measure of behavior in experiments using the free-operant method
|
|
|
Term
Relative Wait-Time Hypothesis
|
|
Definition
- explanation for why conditioned responding is so strongly determined by I/T ratio
- CS is informative about US only if CS waiting time is substantially less than context waiting time
o low I/T, CS waiting time similar to context waiting time
o CS provides little new info about when US will occur
o Not too much CR
- w/ high I/T. CS waiting time much shorter than context time
o CS highly informative about when US will occur
o CR more vigorous
|
|
|
Term
Rescorla-Wagner Math Model
|
|
Definition
[TRIANGLE]V=k(“lambda”-V)
- “lambda” = asymptote of learning possible with the US being used
- V= associative value of stimuli that precede US
- Amount of learning will be proportional to “lambda”-V
o Learning stood for by [TRIANGLE]V
|
|
|
Term
Rescorla-Wagner Over-expectation Study
|
|
Definition
|
- - phase 1: subjects receive stimuli A and B, each paired individually w/ US (one food pellet)
o continued until A & B each conditioned to asymptote
- phase 2: stimuli A & B presented together
o create over-expectation of the one-pellet US
o associative values of A & B decrease
|
|
|
Term
Rescorla-Wagner Theory of Learning
|
|
Definition
- effectiveness of US is determined by how surprising it is
o “surprising”=how different it is from what’s expected
o expect a small gift for bday; get caràSURPRISE!
- Assumes expectation of US related to conditioned or associative properties of all stimuli that precede US
- Strong conditioned response: strong expectation of US
- Weak: low expectation it will occur
- Predicts blocking effect b/c of lack of surprise for second CS predicting US
|
|
|
Term
|
Definition
- instrumental response R results in deliver of reinforcer O in presence of contextual learning cues S
o Thus, S is paired with O; S-O association learned
o Establishment of S-O association presumably results in Pavlovian conditioned responses being elicited by the S
|
|
|
Term
|
Definition
|
- relationship b/w contextual stimuli & response
o Thorndike believed this was only thing learned in instrumental conditioning
|
|
|
Term
|
Definition
- one possible mechanism responsible for classically conditioned response
- indicated that CS elicits CR directly
|
|
|
Term
|
Definition
- shortest path in nervous system b/w eliciting stimulus and resulting elicited response
- consists of 3 neurons:
o Sensory Neuron
o Interneuron
o Motor neuron
- Eliciting stimulus affects sensory neuronàinterneuronàMotor neuron
o Motor neuron forms synapse w/ muscles involved in elicited response
o Triggers behavioral response
§ This is the reflex arc
|
|
|
Term
|
Definition
- classical conditioning leads to association b/w CS and US
o presentation of CS activates neural representation of US
o reminder of US results in response
|
|
|
Term
Sensitization and Stimulus Specificity
|
|
Definition
- sensitization is NOT stimulus specific
- ex.) rats sensitized by pain, then show increased reactivity to wide range of auditory cues
|
|
|
Term
|
Definition
- used to condition instrumental responses that are not in participant’s existing behavioral repertoire
o Response criteria: gradually Take participant from starting behavioral repertoire to target response
§ Final performance must be clearly defined
§ Existing behavioral repertoire must be well documented to form baseline
§ Sequence of training steps: successive approximations to final response
|
|
|
Term
|
Definition
- decays as a result of time w/o stimulation
|
|
|
Term
Simultaneous Conditioning
|
|
Definition
- CS and US presented at the same time
- Does not yield strong evidence of learning
|
|
|
Term
|
Definition
- loss of habituation due to a period without stimulation
- Short Term Habituation: substantial spontaneous recovery occurs
- Long Term habituation: significant spontaneous recovery does not occur
|
|
|
Term
|
Definition
- all neural processes that are not integral to S-R but influence responsivity of S-R
o neural pathways that ascend and descend up to brain
|
|
|
Term
Stimulus Generalization Habituation
|
|
Definition
|
- if new presented stimulus very similar to habituated stimulus, responding will not increase very much
- ex.) baby habituated to light in one area, new light stimulus presented right next to habituated areaàbaby does not respond much
|
|
|
Term
|
Definition
- way to test for conditioned inhibition
- A+ presented w/o US-->measure response
- AB- presented w/o US-->measure response
- A presented w/ novel stimulus C and no USàmeasure response
o Response to A-C may go down a little bitàshows how new stimuli are distracting
o Responding should dramatically reduce for AB condition if B is conditioned inhibitor
|
|
|
Term
|
Definition
- novel taste followed w/ postingestional illness
- organism learned aversion to novel taste
o only takes ONE exposure
o demonstrates high effectiveness of taste cues as CS’s
|
|
|
Term
|
Definition
|
- Pavlovian conditioning teaches organisms when US will occur in addition to CS-US association
|
|
|
Term
|
Definition
- American psychologist at Harvard
- Developed the “puzzle box” for observing learning in animals, kittens
- Puzzle box used the discrete trial method
|
|
|
Term
|
Definition
- good for when reinforcer deliver immediately after behavior not practical
- Ex: kid must do math problems, wants to go to playground
o Give kid token for each completed problem
o kid can cash them in for playground time
- Primary reinforcer is delayed after instrumental response
- Still, instrumental response immediately followed by stimulus assoc. w/ primary reinforcer
|
|
|
Term
|
Definition
- presenting gap between CS and US presentations
- gap b/w stimulus called trace interval
o gap can dramatically reduce degree of conditioned responding that develops
- involves a different memory system than delayed conditioning
|
|
|
Term
US Devaluation & S-R,S-S Learning
|
|
Definition
- experiment to test which type of learning occurring
- motivation to respond to US reduced
o S-R prediction: if US devalued, no change in CR
o S-S prediction: if US devalued, decline in CR b/w response based on mental responsiveness to US
|
|
|
Term
|
Definition
- similar experiment to devaluation, except motivation to respond to US increased
o w/ S-R, no effect in response
o w/ S-S, should increase response
|
|
|
Term
Unpaired Control Procedure:
|
|
Definition
- CS & US presented repeatedly
- Stimulus presentations deliberately timed to CS & US never occur together on same trial
- Administered on control group; control group compared to experimental group where US and CS were paired
|
|
|
Term
What is the best timing for reinforcement?
|
|
Definition
- Reinforcement immediately after desired or target response is critical
- Delayed: other activity may be reinforced instead of target behavior
|
|
|
Term
|
Definition
| learning to associate one event w/ another |
|
|
Term
|
Definition
- a relatively enduring change
- change in potential to engage in a particular behavior
- change is result of experience with environmental events specifically related to behavior
|
|
|
Term
| Fundamental Learning Experiment |
|
Definition
- to conclude that a behavioral change is the result of learning, must compare behavior of individuals under two conditions:
-->experimental condition: subjects are provided w/ experience or training
-->control condition: subjects do not receive training but are treated identically in all other respects |
|
|
Term
|
Definition
| decrease in vigor of elicited behavior |
|
|
Term
|
Definition
- physiological levels of balance where body likes to hang out
- warm-blooded animals like to keep a certain body temperature, etc |
|
|
Term
|
Definition
| increase in responsivity levels to elicited behavior |
|
|
