I had that problem. Then I started to be a bit more firm and tell him that I was going to watch him for 10 minutes (or whatever time frame you want to give) and then it was my turn to get something done. As long as I stuck to the time frame it worked for me.