49. • neutral stimulus
• unconditioned stimulus and unconditioned response
• conditioned stimulus and conditioned response
49
50. The metronome is initially a neutral stimulus—
not associated with a particular response
Neutral
stimulus
Unconditioned
stimulus
Unconditioned
response
50
51. The food and salivation are called unconditioned.
They are innate rather than conditioned over time.
Neutral
stimulus
Unconditioned
stimulus
Unconditioned
response
51
52. Over time, the metronome is conditioned to evoke
salivation—and is called the conditioned stimulus
Conditioned
stimulus
Conditioned
response 52
53. Yet, the metronome produces less salivation than food
Conditioned
stimulus
Conditioned
response 53
54. We distinguish the conditioned & unconditioned response
Conditioned
stimulus
Conditioned
response 54
184. Initially, if she exceeded 20 dB, she was rewarded
“Excellent”21
184
185. Then, if she exceeded 25 dB, she was rewarded
“Excellent”21
“Excellent”28
185
186. Eventually, if she exceeded 50 dB, she was rewarded
“Excellent”21
“Excellent”28 “Excellent”
“Excellent”32 “Excellent”“Excellent”
“Excellent”52
186
187. Did you know when people speak louder and act
extraverted their mood, & thus social skills, improve
187
188. Shaping has also been shown to overcome stuttering
Aim Prompting & fading New behaviours
Habits Openness Transfer188
189. Person is reinforced for increasing rate of speech
Aim Prompting & fading New behaviours
Habits Openness Transfer189
236. Many states resemble death
…. … …
… … …
Each time salespeople sell 5 home
loans, they receive a $100 bonus
Fixed rate
Fixed interval
Variable rate
Variable interval
236
237. Many states resemble death
…. … …
… … …
So, the act is the sale, and
the reinforcement is the bonus
Fixed rate
Fixed interval
Variable rate
Variable interval
237
238. Many states resemble death
…. … …
… … …
called fixed rate 5 or FR 5
Fixed rate
Fixed interval
Variable rate
Variable interval
238
239. Many states resemble death
…. … …
… … …
Slot machines pay a bonus after
about 10 lever presses on average
Fixed rate
Fixed interval
Variable rate
Variable interval
239
240. Many states resemble death
…. … …
… … …
The behaviour is pressing a lever;
the reinforcement is the money
Fixed rate
Fixed interval
Variable rate
Variable interval
240
241. Many states resemble death
…. … …
… … …
called variable rate 10 or VR10
Fixed rate
Fixed interval
Variable rate
Variable interval
241
242. Many states resemble death
…. … …
… … …
To teach children to be quiet, you
serve food only when they are quiet
Fixed rate
Fixed interval
Variable rate
Variable interval
7.00 am 1.00 pm 6.00 pm
242
243. Many states resemble death
…. … …
… … …
but only after an interval of at least 5
hours from their previous meal
Fixed rate
Fixed interval
Variable rate
Variable interval
7.00 am 1.00 pm 6.00 pm
243
244. Many states resemble death
…. … …
… … …
Called fixed interval 5 or FI5
Fixed rate
Fixed interval
Variable rate
Variable interval
7.00 am 1.00 pm 6.00 pm
244
245. Many states resemble death
…. … …
… … …
Or, if the minimum delay varied
but was 5 hours on average
Fixed rate
Fixed interval
Variable rate
Variable interval
7.00 am 1.00 pm 6.00 pm
245
246. Many states resemble death
…. … …
… … …
the schedule is VI5 instead
Fixed rate
Fixed interval
Variable rate
Variable interval
7.00 am 1.00 pm 6.00 pm
246
251. Many states resemble death
…. … …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction Variable interval generates
the most responses
FR VR
FI VI
251
252. Many states resemble death
…. … …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction Why?
FR VR
FI VI
252
253. Many states resemble death
…. … …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction If fixed interval, bc of the delay, frequent
responses are not always reinforced
FR VR
FI VI
253
254. Many states resemble death
…. … …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction So rate of responses diminishes
FR VR
FI VI
254
255. Many states resemble death
…. … …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction If variable, reinforcement may be
very soon—enhances energy
FR VR
FI VI
255
256. Many states resemble death
…. … …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction For fixed, we may know the reward
will not arrive until 6 actions later256
257. Many states resemble death
…. … …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction For variable, the reward could be
sooner, igniting anticipation257
258. Many states resemble death
…. … …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction Could explain why some
people gamble so often
FR VR
FI VI
258
259. Many states resemble death
…. … …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction because any moment
they could enjoy a reward
FR VR
FI VI
259
260. Many states resemble death
…. … …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction For rate schedules, the responses
are evenly distributed over time
Time
260
261. Many states resemble death
…. … …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction For interval schedules, the responses
escalate just before the delay ends
7.00 am 1.00 pm 6.00 pm
261
262. Many states resemble death
…. … …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction rather than earlier
7.00 am 1.00 pm 6.00 pm
262
263. Many states resemble death
…. …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction
FR VR
FI VI
If fixed, often refrain from response
immediately after the reward263
264. Many states resemble death
…. …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction
FR VR
FI VI
If variable, still respond
immediately after the reward264
265. Many states resemble death
…. …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction
FR VR
FI VI
because, in these settings, an
immediate reward is still possible265
266. Many states resemble death
…. …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction
FR VR
FI VI
Finally, after you withdraw
reinforcement altogether 266
267. Many states resemble death
…. …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction
FR VR
FI VI
responses will not vanish or
extinguish as immediately if variable267
268. Many states resemble death
…. …
… … …
Rate of
response
Pause after
reinforcement
Distribution of
responses
Extinction
FR VR
FI VI
Because of the variability, not as sure
the reinforcement has vanished268
272. Operant conditioning : People learn only if they
receive a reward or punishment themselves
272
273. Overview Bobo 1961 study Bobo 1963 study
Role of attention Ubiquity
Albert Bandura
challenged
this assumption
Role of motivation 273
274. Overview Bobo 1961 study Bobo 1963 study
Role of attention Ubiquity
He showed that people—and even many animals—can
learn merely by watching other individuals
Role of motivation 274
275. Overview Bobo 1961 study Bobo 1963 study
Role of attention Ubiquity
Observing and participating in some activity is more
effective than either of these modes alone
Role of motivation 275