Drones are a really interesting hobby, just like RC aircraft. However just like anything, there are too many stupid people... stupid people who drive, stupid people who hunt, stupid people who fish, stupid people who install electrical, stupid people who operate HAM radios and stupid people who drive RV's dangerously. Just like any new hobby, people come out in droves stating that it is great and our freedom to pursue it should be protected, while others come out stating that they are a danger and should be banned.
What is really needed is responsible drone pilots just like responsible drivers. You cannot fix stupid, and banning them is equally as stupid.
The FAA has made a good first step by forcing people in the US to register them. Although like anything the process will not be perfect, as this is a growing hobby, the laws will grow with it.
http://money.cnn.com/2015/12/24/technology/drone-faa-laws-registration/index.html
Also it was mentioned in a previous comment as you do not own the air over private property and shooting down a drone is a federal crime in the US, it is equal to shooting down a 747, regardless the reason, there is no distinction in the laws.
http://gizmodo.com/is-it-ok-to-shoot-down-your-neighbors-drone-1718055028
The most important thing we need is education, not just for those who use them, but also for those who think a quick ban will solve all the worlds problems.