Reinforcement schedules shape behavior in fascinating ways. Continuous reinforcement leads to quick learning but easy extinction, while intermittent schedules create more persistent behaviors. This explains why slot machines are so addictive and why some habits are hard to break.

Different schedules produce unique response patterns. Fixed-interval schedules cause "scalloping," where responses increase as reinforcement nears. Ratio schedules can lead to pauses after reinforcement and even "ratio strain" if requirements get too high.

Reinforcement Schedule Effects

Impact on Response Rate and Extinction Resistance

• Different reinforcement schedules produce varying response rates
• Continuous reinforcement (CRF) results in the fastest acquisition of behavior but the least resistance to extinction
• Intermittent reinforcement schedules generally produce lower response rates compared to CRF but greater resistance to extinction
• The partial reinforcement effect states that behaviors acquired under intermittent reinforcement are more resistant to extinction than those acquired under continuous reinforcement
  • Organisms learn that reinforcement is not always available, so they persist in responding even when reinforcement is withdrawn
  • Gambling addictions can be explained by the partial reinforcement effect (slot machines)

Behavioral Momentum and Persistence

• Behavioral momentum refers to the tendency for well-established behaviors to persist even when reinforcement contingencies change
• Behaviors with a long history of reinforcement have greater behavioral momentum and are more resistant to change
• High-rate behaviors (those that occur frequently) are more resistant to disruption than low-rate behaviors
• Behavioral momentum can be beneficial in maintaining desirable behaviors (exercise habits) but problematic when trying to change undesirable behaviors (smoking)

Within-Session Patterns

Scalloping and Post-Reinforcement Pauses

• Scalloping is a pattern of responding seen in fixed-interval schedules where response rates are low immediately after reinforcement and gradually increase as the next reinforcement opportunity approaches
  • Produces a scallop-shaped curve when response rate is plotted over time
  • Occurs because organisms learn the temporal regularity of the reinforcement schedule
• Post-reinforcement pauses are periods of little or no responding that occur immediately after reinforcement delivery
  • Most prominent in fixed-ratio schedules but can also occur in fixed-interval schedules
  • Reflect the organism's "rest period" before resuming responding to obtain the next reinforcer

Ratio Strain and Schedule Limitations

• Ratio strain refers to the breakdown of responding that can occur when the response requirement of a ratio schedule becomes too high
  • Organisms may cease responding entirely or respond at a much lower rate
  • Indicates that there is an upper limit to the number of responses an organism will emit for a single reinforcer
• Ratio strain highlights the importance of selecting appropriate response requirements when using ratio schedules
  • If the ratio is too high, the schedule may become ineffective in maintaining behavior
  • Ratio strain can be mitigated by gradually increasing the response requirement over time (shaping)