Is it bad to drive with trickle charger on chassis battery?

Y'all Tinkerers are going to be disgusted by this. But I have finite energy this summer, and too many demands on it.

One result: I have a milliamp drain in my chassis system which I have put some time into but not enough to track it down. Dug out a pair of little solar panels someone gave me years ago (when I was more of a tinkerer myself), set them on the dash and clipped them on. Since then, battery is full every time I check it.

But is it terrible if I don't disconnect them when driving? I have forgotten a couple of times. Nothing exploded. Can I stop trying to remember?

When I get tired I start looking for things I can eliminate from the 'to do' list.