Can I connect my charge controller to my panel?

Can you do it?
Yes with a few gotchas
Never disconnect the battery
You will have to disconnect or cover the solar panel up
Before even cleaning the battery posts, same rules with direct run to battery
But easier to forget when the wires are some place else
It may not charge as well, as with a direct connection to batteries
Depending on the wire gauge involved