When you ran lots of hot while hooked up, the larger volume of hot water running through the pipes also heated up the space around and anything the hot water line touched. This helps to keep the water in the line warm. When only running a little water, that doesn't happen and therefore you have to wait for new hot water to get to you. If you can get to your hot water line, go to the hardware store and buy some of the flexible water pipe insulation to use on them. This will keep the water in the hot water line hot, or at least warmer while you have the flow off for a couple of moments.
This idea may be easier said than done. I wanted to do mine, but gave up trying to get to enough of the hot water line to be worth while.
Bill