We live on a lake in a HOA where many of us have golf cars. For most, they are toys for sure. We actually have two...one is my 'work car' that is lifted, etc. and I use to haul gas to my boat dock, haul gravel, move boat trailers, etc. The second is DW's and is more of a standard golf car that we use to drive to a local marina cafe, cruise the neighborhoods with the dogs to deer watch, etc. DW also has RA so she sometimes uses it to haul groceries from the car to the house (house is uphill from parking space).
We don't take them with us on trips but we often rent one from the RV park when we visit Myrtle Beach. For us, it is fun to drive around the RV park with the pups and visit, etc. Many do it.
I don't use it as an excuse to not get some needed exercise. I always take my bike and ride daily along with us walking our dogs frequently.
So, for many, it is just a fun thing to do. I agree some folks take it to the extreme but they never bother us unless they let their sometimes unruly kids drive them around in a manner that may often ignore common sense and safety.