We use them a lot. It doesn't bother me to pay the tolls. Generally the toll roads are better maintained and less hassle than the non toll roads. Toll roads are the fairest form of taxation. You use it then you help pay for it. If you don't want to pay the toll then drive somewhere else.
We typically travel the most direct route that often puts us on toll roads. We did get an EZ-Pass that works most places in the northeast to minimize the hassle and it's even better where the states set up high speed lanes so you don't even need to slow down.