Clicker Training Research

For a while I kept telling Missy that if she didn't behave I was going to take her back to the breeder. Now I'm going to threaten to ship her off to a Mexican Circus.. jk..

I love that video. I completely forgot about it!
 
For your dogs, the click is referring to something they have done, for mine it refers to something they are doing.

How so? Wouldn't during phase A & C we be exactly the same click for click at precisely the same times but during phase B only I would actually be clicking 1 or 2 more times extra in the middle during what they are actually doing?

I also imagine your method is quicker, but possibly less presice? Again that would suit our owners because they are not concerned with presicion so long as they get the behaviour. (Presicion is also a very big de-motivator in my experience.)

Why would this method introduce inherant sloppiness in performance? If anything, forcing the dog to actually think about each sub-step and hit the mark precisely during the learning of a complex task by demanding correct position quite finitely with a click would introduce more precision rather than less. The dog wouldn't rush through some middle parts to get to the end position with a click/treat. Again, it's just during the learning phase but once imprinted as every sub-step is important to hit as a precise mark the dog would remember them in phase C and be more precise forever by knowing not to rush through parts just to get the click/treat at the end of the sequence. Not sure how a couple extra clicks during one portion of training inherantly equals lack of precision?
 
Re: Fine tuning the behaviour. That is how I would do it too. I used heeling as an example because I've had to put in a lot of work with Yogi to tighten up his heel position now he's in the more advanced obedience classes so it was a recent incident of sharpening a behaviour. (I have to say I found it much harder improving heelwork than getting it spot on from the outset.:razz:)


How so? Wouldn't during phase A & C we be exactly the same click for click at precisely the same times but during phase B only I would actually be clicking 1 or 2 more times extra in the middle during what they are actually doing?

C - "once the sequences were shaped and learned to near mastery or mastery, it went back to WHOLE sequence fluidly with one click/treat at the end. "

B - "The click was positive feedback that she did the right step (which she already knew how to do) and was in the right position for the next command. It also kept the focus. No treat, the exercise was not complete. End of sequence click/treat."

I interpretated this to mean you clicked once the action was complete? I only use the clicker to mark the action as it's occuring (as per A - learning phase) but where you use the click during B for feedback I would say yes and phases B & C would reward (jackpot/toy) at end instead of C&T. I will admit that until quite recently I was doing something very similar to you. So I would do a short stretch of heelwork with Yogi that might include a right turn and about turn and click at the end of perhaps 30-45 seconds. But that only gave him the information that the last step or two were correct, not the turns or the first few steps because the click for him is an indicator of correct behaviour in the present. I can't mark something he did 29 seconds ago because how will I communicate it was then rather than 15 seconds ago? When I changed to just using the clicker to improve one thing at a time rather than for getting several seperate actions right, I found progress to be far more rapid because the marker for sucess was more obvious for the dog. When I wanted to praise the correctly completed sequence I put the clicker away and just rewarded with a game/jackpot. Although one excersise, I would not click on the completion of a retrieve because it would only signify the final action of sitting at my side was right, not the waiting, or picking up etc.

Why would this method introduce inherant sloppiness in performance? If anything, forcing the dog to actually think about each sub-step and hit the mark precisely during the learning of a complex task by demanding correct position quite finitely with a click would introduce more precision rather than less. The dog wouldn't rush through some middle parts to get to the end position with a click/treat. Again, it's just during the learning phase but once imprinted as every sub-step is important to hit as a precise mark the dog would remember them in phase C and be more precise forever by knowing not to rush through parts just to get the click/treat at the end of the sequence. Not sure how a couple extra clicks during one portion of training inherantly equals lack of precision?

What I'm wondering is whether the click having a more ambiguous meaning would impact upon its message.
If the dog has learned the click means a treat every time and has understood his own actions trigger the click then he will try and replicate the action that got him the food. I was watching an experiment with sheep on TV yesterday and it was very interesting. The sheep had learned through trial and error that the letter X always meant food so when faced with a choice between X and O they chose X every time, therefore replicating the action that resulted in the reward.

But if the dog has learned that the click can also mean "that part was right, move onto the next excersise" how does he differentiate between which scenarios are going to result in a treat and merit a repeat performance and which need him to wait for further instruction?
I know the situation will obviously give some clues and probably most dogs are smart enough to know when they are learning as opposed to practicing. Also if the clicker meaning changes over time and goes from always meaning something to always meaning something else then the dog would just adapt to the new meaning. But if using the clicker one day to give feedback on a learned behaviour(phase B) and the following day used to shape a new behaviour (phase A) woudn't it cause some confusion? Possibly not, but when it comes to fine tuning a learned behaviour and the dog is used to the click representing feedback how does he know to up his game rather than wait for the next command?

I hope this post makes sense as I only had 3 hours sleep last night and kept :sleepy: while writing it!!

In summary, does using the clicker for feedback and for shaping cause conflict?
 
Last edited:
Oh, in phase A you are talking similar to when we learned paws up (for an example). Touch the block c/t, one paw c/t, two paws c/t, two paws stay c/t. It shapes them to learn the behavior by clicking them closer to mastery rather than just waiting to the end. Yes, I would be doing that too. However depending on the task being asked there is clicking them there, luring them there, positioning them there, and waiting it out til they do it naturally so what fits best for a task is used.

And yes, in the case of the heeling exercise doing the several steps only rewarded the end but saying yes or clicking along the way was a marker for the dog of success. An acknowledgement of some kind that is not a treat. I taught each maneuver first in isolation to mastery first though. Then I chained progressively longer sequences. They so hate heeling practice. In class we were encouraged to click and/or treat whenever we felt the dog needed feedback or incentive as long as they were in correct position at the time until pretty much the close to the final exam when it was chained so fast by call-out we had no time to do anything but march and react.

But if the dog has learned that the click can also mean "that part was right, move onto the next excersise" how does he differentiate between which scenarios are going to result in a treat and merit a repeat performance and which need him to wait for further instruction?

I think they pick up the body language. The dogs have no difficulty seeing you still in position or motion with a click but not reaching in the pouch for the treat. When they are done with a whole sequence the way you press the clicker is different, you are reaching for a treat, you smile or nod or something, you shift your weight, your pupils probably change. They know. However, shouldn't the dog regardless of whether you say yes, click, treat, or jackpot play shouldn't the dog always be waiting for the next command? So really no matter what you do you are indicating correctness pay attention for the next task until that is a "done"-type cue meaning session is over. I just saw the extra feedback as keeping it tighter and more encouraged for whatever reason the dog may need that (like my insecure shepherd or the dog fo example).

In studies, animals treated not every time exhibit far more drive and make more attempts at doing a known behavior to earn the treat. It's like a slot machine. It might not be every time, but it will come eventually. They learn that. I have had sheep, goats, and llamas. I grain trained them. I clap - they come from even the far corner of my 5 acres - there is grain. I reinforce that from time to time just to keep it up. However, there are times when I can clap and there is not grain. They come anyway, mill around, and wander off. That is enough time to get them close up if there might be a predator, to close a gate, or count to make sure there is no escapee. If I never re-treated sure the behavior would stop. However, if they never know if there is grain when I clap, they come every time. Just because they might choose the treat every time doesn't mean if there is sometimes no grain behind X (not behind O but just not there) they would still go to the X the next time hoping.
 
I believe it was AKC novice rally that the clicker was in. In reading the rules it seemed to indicate that was OK along with other verbal or physical cues. I personally wouldn't be clicking in competition

the following does not seem to allow clickers in the ring to me.........

from AKC Rally Regs:

Unless otherwise specified
in these regulations, handlers are permitted to talk, praise, encourage,
give additional commands and or signals using one or both arms, clap
their hands, pat their legs or use any verbal means of encouragement.
The handler must move in a natural manner. The handler’s arms need
not be maintained in any particular position. At any time during the
performance, loud or harsh commands, intimidating signals, touching
the dog (unless otherwise specified by these regulations) or any physical
corrections will be penalized.
 
Interesting thread. Especially seeing the difference between training rally and agility. Clicker training has been great and yet, drives me crazy. Learning to do it correctly is great. Me doing it, well, I have my moments of greatness and my moments of sheer stupidity. Someone needs to click me when I click at the right time. LOL. I find it to be a great tool.

For those dogs that are noise sensitive. It has been suggested to use a quieter item that makes a single click noise. Like a pen. If it's too much, like my friend's dog, then a verbal is good, although not as consistent (our tones change). For the deaf, it has been suggested to use a flash of a light. All you need is something short (light, sound, etc) that is consistent. Our voices do work, but again, we change our tone so much, it just takes longer. And for some reason, the clicking noises goes straight to the brain (I forget where/why, but there's a book explaining it all). C/T can be used for humans too. :) I was testing it on my nephews. It was working, if I was around them long enough, but I had to keep finding new "treats". :lol:

I have to say, Mom2Melli, I do understand what you're saying and why. I thought the exact same thing. So when I was working with distance in agility with Koji, I'd click, have him do something else, click, and treat at the end. I later found out, that yes, I was doing it incorrectly. The whole click/treat thing is really fascinating because it is pure science. I forget the book, but it talks about how clicker training first came about (back in the days of training wild dolphins at Marineworld - or Sea World, I dunno which one).

After doing a lot more research into clicker training, because hey, I felt I was right, I learned so much. Of course, I was wrong. The clicker should not be the reward. With Koji, he sees me with a clicker and he's at attention. He knows it means food.

The one thing I'd like to say is....remember, a reward can be almost anything. In agility, when Koji stops at the end of the dogwalk, while on the course, me saying yes is his marker. Me releasing him to go play (aka run the rest of the course) is his treat. And unless I walk off the course with him, he always gets a treat for running. In class, it's when you use the NRM and stop and redo if necessary. No treats.

In regards to this comment. I'll tell you how I learned it. And how I was taught to do the distance work, while C/T from far away.

So that follows with distance work. Let's say have the dog on her 20 foot lead and I am with her 19 feet from her rug. I send her to the rug. I click. She turns to face me. I say/sign down. She downs. I click. I say/sign stay. I walk the 20 feet, circle her, and return to the heel position. I click and treat while she is still down IN position. I release her and we heel off. How could I treat for each step occurring 20 feet away from me? The click is the confirmation the action was right and a treat is coming at the end of the sequence. It is a given that each of go to rug - down - stay were individually taught prior to mastery level with click/treat. Chained, the reward comes at the end of the treat but the clicks in between are a YES confirmation of correct action. I don't think everyone is making the distinction of one single basic task (such as sit or down) being taught and a chain of mastered tasks to form a more complex maneuver (such as send to rug/down/stay or call forward return right).

First you break everything down. And train until it's proofed. Actually, the 3 things I listed are overly simplified and would need to be broken down even further. When every item is proofed, you don't need individual clicks between.
-Send to rug
-Down
-Circle while in down

We taught "go to your mat". First you teach the dog, while on the mat, it's a good thing, C/T. Then you teach your dog down on the mat, C/T.Then you start moving away, 1 foot, 2 feet, etc. C/T by tossing it. When you get too far to toss or you can't toss it accurately, after you click, you WALK BACK, treat and walk away. THEN release dog from position. If the dog breaks the position, say as you're walking to them, you wait until they get back into it. WITHOUT giving another command of any sort, then treat. If the dog breaks position after you given the treat, same thing. Wait for dog to get into position, then release, WITHOUT an extra command. They have to learn that the ENTIRE sequence is the thing you want, not just parts. Once that's proofed, then you move onto say, the walking around the dog.

So, in your case, by the time you start walking around the dog, the dog should already know the commands to be sent out and down and STAY down until you release. You'd start out circling close by. C/T. Then further out, C/T, further out, C/T, just like the send to the mat. By the time you are circling 20 feet out, dog should know the send (no need for C/T), should know the down (no need for C/T), and know to stay until you release (no need for C/T). Obviously, the circling is the last thing, so once that is proofed, then you C/T for the ENTIRE sequence.

If you break things down and the items are proofed, you shouldn't have to C/T anymore. C/T is for training and reinforcing at times, but it shouldn't be needed all the time. That's like if I C/T for every obstacle my dog did in agility, when in truth, by the time he can do 20 obstacles, he shouldn't need the C/T anymore.

Here's a list of how I trained his dogwalk contact. Do you see how detailed it is? How much I broke it down? Truth be told, I probably should have broken it down even further. By the time he runs across a dogwalk and gets into position, everything leading up to that should be proofed. And therefore, not needing a click. Versus me clicking him running across, looking for his target, slowing down, stopping in position, waiting for me to give the next command, etc.

BTW, Koji knows he'll get a treat after his run. He pulls hard to get back to our area for just that. He has been trained that if he completes the course, he gets a treat. I don't need to C/T. If he doesn't do something I want, like the dog walk, I give him an NRM on the course, stop what I'm doing, pick him up and walk off. He gets no treats because he did not complete the course and didn't do what I asked. He knows what was not completed (this is akin to you stopping in a yes-no-yes sequence - as you said, go back and redo, no treats). But the difference is, I'm not clicking him for completing every obstacle. He should know what to do already.

I was told, when you click, the dog gets a reward. EVEN if you screwed up the click. You canNOT click and NOT give a reward (of any kind). You are teaching the dog the clicker has no meaning (or is making it confusing). Now, maybe that's not true for your 2 dogs, but I can guarantee if you did that with 100 dogs, there are going to be a lot of very confused dogs.

I hope you realize I'm not saying what you're doing isn't working, obviously it is. But there is a science behind clicker training and why it works, when done properly. Remember, a stopped clock is right twice a day. I learned that I was wrong. I mean, it was working, so what's wrong with it, right? But I decided that I wanted to learn correctly, for the next dog, and the next, and the next. Not because "it works" for Koji.

I hope you really do some of your own research into the science behind clicker training. It'll give you a new found respect to why it works and why it can work consistently with any animal (and even humans), if done correctly.
 
Then I watched some videos of Silvia Trkman's foundation class and it was like a revalation. The click was used with rapid rewards for holding a position. So as long as the dog stayed put, it was a case of clicktreat, clicktreat, every second. Not increasing periods without an indication of success or support as I had been doing then click, dog moves and gets reward five seconds later.

I tried this first with Epic's two on two off contact behaviour and the improvement was staggering. He very quickly got to the point that I could move away, click and return to treat while he held the position because he had learned the click didn't mean stop it meant treat and stay there for another c&t.

I have to say I was surprised to read this. When you jackpot (rapid rewarding), you don't keep clicking, you keep rewarding, one after another. Otherwise, you're rewarding the behavior Epic learned.....that rapid c/t meant another c/t, not stopping/distance. It means he's not learning the correct thing.

It's up there with Koji knowing clicking means food and he's foodie. So he'll do anything and everything to get a click. Not what I want. Unfortunately, my inexperience has taught him otherwise.
 
Since I see clicker as laser point or snapshot in case like seashell describes with rapid c/t for duration behavior I will only rapid treat after initial c/t. I will expect my dog to remain in the position till verbal release and only that. I will likely do some IYC/Its Your Choice/ at same time i.e. I will put treat close enough to the dog but out of reach or I will pump my hand several times pretending to throw etc. At any case it is RAPID rate of reinforcement that tells dog he is doing something right and the behavior gets to be VERY rewarding for the dog. So rapid rate c/t or just treat at this instance will not make that much difference IMHO.
When you account a training problem it always belongs in one of the categories- criteria, timing or rate of reinforcement. K9kreationz explained lumping very well and it is a biggie for just about anyone, me included, we inherently tend to want to do ¨sexy¨ stuff and miss details. By giving click and witholding rewards or waiting out until dogs scooches into correct position your rate of reinforcement drops and what do you reinforce? Scooching?
think they pick up the body language. The dogs have no difficulty seeing you still in position or motion with a click but not reaching in the pouch for the treat. When they are done with a whole sequence the way you press the clicker is different, you are reaching for a treat, you smile or nod or something, you shift your weight, your pupils probably change. They know. However, shouldn't the dog regardless of whether you say yes, click, treat, or jackpot play shouldn't the dog always be waiting for the next command? So really no matter what you do you are indicating correctness pay attention for the next task until that is a "done"-type cue meaning session is over. I just saw the extra feedback as keeping it tighter and more encouraged for whatever reason the dog may need that (like my insecure shepherd or the dog fo example).
You can not take ANYTHING but your charming personality with you into the ring if you planning to compete. Clicker considered to be a training tool and there is no training allowed in the ring, unless you doing fun matches or possibly FEO with judge permission... so if you build all those pouches and reaching for the treat and nods and clicks into your behavior chain they kinda hard to undo at trials where everything and everyone gets high or low...
Mom2Melli, if you reread your sentences about your shepherd training, I would encourage you to think how much of that insecurity have you built into that chain? It is ALWAYS a two way street, I am not debating whether your dog is insecure/ you obviously know your dog etc/ but all those ¨approvals,¨nods and clicks.... those are unwanted behavior chain additions...
Tawzerdog rental program is fairly inexpensive and has a LOT of dog training material. Kathy Sdao has great beginners and advance clicker training DVD I would highly recommend to anyone , experienced or beginner trainers
 
Last edited:
I have to say I was surprised to read this. When you jackpot (rapid rewarding), you don't keep clicking, you keep rewarding, one after another. Otherwise, you're rewarding the behavior Epic learned.....that rapid c/t meant another c/t, not stopping/distance. It means he's not learning the correct thing.

It's up there with Koji knowing clicking means food and he's foodie. So he'll do anything and everything to get a click. Not what I want. Unfortunately, my inexperience has taught him otherwise.

You could well be right there Cheryl - I will have to watch the videos again (I haven't used this technique to 'hold' a position since the spring and my memory is like a sieve :o). I certainly remember the rewards being rapidly dispensed. :yes: The 'jackpot' idea was one I struggled with initially. I must be a stingy person as till then a tub of treats would last several days rather than one training session! :eek2:

But the concept of the dog getting more treats for extending the duration of staying in a fixed position rather than extending the time between treats AND trying to extend the behaviour made a lot of sense. I was explaining this to someone just tonight who is also having stay issues. Double time = double pay! :wink2:

As you say, the reward can be anything, not just food. The first time I shaped anything apart from sendaway was the 2x2 weaves and it was so weird clicking and throwing the toy (which he loved) and not giving food. (That was a really hard behaviour to start out on but very good insight into how powerful and sucessful shaping can be. :yes:).

PS I loved the 'stopped clock' idea. Had to think about it for a while though! LOL
 
But the concept of the dog getting more treats for extending the duration of staying in a fixed position rather than extending the time between treats AND trying to extend the behaviour made a lot of sense. I was explaining this to someone just tonight who is also having stay issues. Double time = double pay! :wink2:

PS I loved the 'stopped clock' idea. Had to think about it for a while though! LOL

I can't recall how this works, so maybe someone can correct me.

When you're training an extended stay, you don't give more treats as they continue to stay. I believe SheltieChe said somewhere you click the action, treat the position. So, in agility, let's say my dogwalk contacts, where Koji is supposed to stop and stay until released. I will C/T when he gets into position and I will go back and treat him (assuming I ran beyond the dogwalk). I will wait him out and he should stay until released, because that is part of the entire command. If he breaks, I give an NRM and make him go back into position (w/o C/T and command). If he doesn't break, I release with an "okay" (and maybe me running past him, or not) and then I treat him for following the "okay" command (I don't C/T this because he should know this by now). I think when I first started, we were C/T the "okay" also.

The jackpot is to simply let them know that what they just did was the BEST EVER! Or if you just want to end on a positive note.

This is what I've learned and what I can remember reading about. Hey, I could be completely wrong! Let's discuss. :)

I had to laugh about your comment about the clock. :)
 
Back
Top