Unit 4 · Learning Theory · Reading 9 of 13
The Four Schedules of Reinforcement
Before you read
You've had pop quizzes on some days this unit and not others. Could you predict them? Keep that in mind. This reading is about you.
Words you'll own by the end
- Fixed: the same number or the same amount of time, every time.
- Variable: a changing number or amount of time.
- Ratio: based on the number of responses.
- Interval: based on time passing.
1. Build the names from two choices
Every partial schedule answers two questions. Ratio or interval? Does the reward depend on how many times you act, or on how much time has passed? Fixed or variable? Is that number or time the same every time, or does it change?
2. Fixed ratio (FR)
Reinforcement comes after a set number of responses. A free flight after every 60,000 miles. Getting paid for every 7 toys you assemble. A sandwich card that gives you a free sandwich after a set number of purchases. People tend to work fast, since more responses mean more rewards.
3. Variable ratio (VR)
Reinforcement comes after a changing number of responses that the learner can't predict. On a "VR 5" schedule, reinforcement comes every fifth response on average, sometimes after 2, sometimes after 19. Examples: the lottery, selling door-to-door. The reward depends on acting: you can't win the lottery without buying a ticket.
VR is the most resistant to extinction. Since the next try might be the winner, people keep going. Compulsive gamblers often believe they're "due" to win, but on a VR schedule there's no way to predict the next payout.
4. Fixed interval (FI)
Reinforcement comes for the first response after a set amount of time. If the mail always comes at 1:00, you check around 1:00 and not much before. If a show drops a new episode every month, you start checking near the release date. Responses are slow, then speed up right before the reward is due. If you get a weekend treat every Saturday when your homework is done, you might slack all week and cram Saturday morning.
5. Variable interval (VI)
Reinforcement comes after a changing, unpredictable amount of time. If the mail comes at a different time every day, you check often. If your grandmother sometimes has your favorite dinner ready when you visit, the timing is unpredictable. VI produces slow, steady responding.
Try it: Name the schedule
First decide: does it depend on actions or time? Then: same each time, or changing?
A barista gets a bonus for every 50 drinks sold.
You check your email because an important reply could arrive at any time.
A fisherman catches a fish after an unpredictable number of casts.
Paychecks arrive every two weeks.
A teacher checks in at unpredictable times and gives points to students who are on task.
Marcie's mom checks her room every Saturday.
Behavior patterns to know for the AP exam
- Variable ratio: high, steady responding; the hardest to extinguish.
- Fixed ratio: high responding, often with a short pause after each reward.
- Variable interval: slow, steady responding.
- Fixed interval: little responding early, then a burst right before the reward is due.
Check-in: Pop quizzes in this class come on some days but not others, and you can't predict which. What schedule are you on, and what does it predict about your reading?
Am I ready for a pop quiz?
Check a box only if you can say the answer out loud without scrolling up.
Come back to your "before you read" question
Could you predict the pop quizzes? If not, you've been on a variable interval schedule the whole unit. Did it change how often you did the reading?