I believe that white hoses were originally designated as safe to drink from due to being free of lead... (although I have drank from many garden hoses years ago...)
If the hose is not white, I would read the label to see if it states that it is safe for drinking water, if not, well... Convenience or health, your choice. (Occasionally drinking would probably not be a problem, although lead does typically stay in the body and build up over time. When will your body hit the amount to cause brain/nerve damage, is the question...)