The caveat of a hard side is it's height and low hanging branches, other than that, and maybe a slight weight penalty, I think they are very convenient not having to set anything up.
Branches attack pop-tops, too. If you don't have some branch scratches on the sides you haven't been offroad. You can find lighter weight hard sided campers, too.
But again, the notion of "more set-up time" for a pop-top is an extremely silly exaggeration (...and anyone who has ever done _real_ camping under a tarp or in a tent can testify to that for a fact). My 110 pound wife has the roof popped up before I can even lay down the chock blocks and get to the back door.
It boils down to what you find you prefer (mostly while you are on the move). Do you want lower wind resistance (albeit only a significant factor at high speed); do you want to lessen your chances of hitting 'low flying' objects (but even _I_ managed to 'take out' an historic National Park building with the air conditioner on my pop-up); or do you just want more headroom (which pop-tops generally have more of even if some people find the shorter entry doors on pop-tops more challenging) ???