Extinction is the cessation of reinforcement. When you shape behavior, you start by reinforcing a tiny bit of behavior. When you make your criteria harder, you stop reinforcing the lesser offerings. Because these previously reinforced behaviors are no longer being reinforced, the dog stops offering them, choosing instead to offer the new behavior that is being reinforced.
Extinction is not punishment. Punishment is an event. When you punish, you either add something (positive punishment) or take something away (negative punishment) in order to suppress a behavior. Extinction is a non event. You didnt add or take away you simply did nothing. Lets look at an example.
Every day, a person drops a cookie outside a fence for the dog that lives there. One day, however, the cookie lands a bit further from the fence than normal. The dog tries to reach under, but he cant quite reach it. He tries to dig under, but the ground is rocky. He tries to climb over, but the fence is too high. He tries to go around, but the gate is locked. He will try harder and harder stretching to reach further, contorting his body for an extra millimeter. He will try a running start to jump higher. But if he never succeeds, he will eventually give up and quit trying. The next time hes there, he might try again, but hell give up more quickly.
This was an example of extinction. The fence didnt shock him when he reached under or tried to climb. The man didnt snatch the cookie and take it away. The behaviors he tried simply didnt work. When one thing didnt work, he changed his behavior. He tried again. He tried harder. He tried something different. These are characteristics of extinction bursts characteristics we count on when we increase our criteria during shaping. After he stopped trying to get the cookie, he occasionally tried again. Thats another characteristic of extinction called spontaneous recovery. Had he gotten the cookie during spontaneous recovery, the behavior would have bounced back, very strong. However, with continued lack of reinforcement, the behavior went away again.
So how do you use extinction? When you train, define the specific criterion you are looking for in your session. For example, when you begin training sit, you would reward the dog for putting his bum on the ground. If your dog offers anything else for example, if he lies down or backs up ignore it.
Once your dog is reliably offering sits, youre ready to increase your criteria. Instead of just any sit, you decide to reward only tucked sits sits where the back feet are drawn toward the stationary front feet. Suddenly some of the sits you used to reward arent being reinforced anymore. The dog has to experiment to figure out what will work. This experimentation is part of extinction try again, try harder, try something different. Gradually he begins to offer more and more tucked sits. Because you arent reinforcing non-tucked sits anymore, those sits will extinguish.
Extinction can also be helpful in solving some problem behaviors. For example, a dog jumps on someone to get attention. If people suddenly dont respond literally become a statue the dog will have to try something different to get the attention he wants. If the people instead reinforce sitting with lots of attention and doggedly refuse to reinforce jumping then the dog will begin to choose sitting for greetings instead.
However, for this to be true, the trainer must control the reinforcement. If a behavior is either self-rewarding or rewarded by the environment, extinction will fail unless the trainer can consistently offer a better reward. Barking is frequently a self-rewarded behavior. Waiting for a dog barking at passers-by to simply get bored from lack of reinforcement is an exercise in futility. When dealing with self-rewarding or environmentally-rewarded behaviors, a combination of management, positive reinforcement, and negative punishment are an alternative solution.
Comparison of extinction and negative punishment:
Copyright of all posts is the property of the original author. Please obtain permission from the original author before copying, quoting, or forwarding.
List and Site Owner: Melissa Alexander, mca @ clickersolutions.com