I own a couple of quadcopters and a GoPro, so allow me to provide an owner's (aka dronehead) perspective. It is a rapidly evolving technology that has intersected with some other trends to create friction. Drones flew from a technological curiosity to front page headlines in no time. Some say 2015 is the "year of the drone."
First off, drone is popular but incorrect terminology. Technically speaking these are unmanned aerial vehicles or systems (UAVs or UASs). However, fighting common usage is rather pointless so I will go with drone. (These days people use phrases that get the most search hits.) Just understand that the devices encompass a wide range of size, complexity and use. Some fit in the palm of your hand and others are the size of regular aircraft. They may be radio or Wi-Fi controlled or they may be autonomous. They are used for fun, photography, videography, science, farming, fire fighting, surveillance, supply delivery, logistics, or killing--just to name a few existing activities.
Drones can do things we only imagined before. They are like extensions of our body. They allow us to see and visit difficult, dangerous or sensitive places through remote sensing that were previously out-of-reach. Volcanos, old nuclear power plants, remote peaks--the possibilities are endless. So is the commercial potential which throws a different light on the subject. Oregon has an economic development program called SOAR Oregon with the catchphrase, "Unmanned, Unlimited." There's a good article on this at
http://www.portlandmonthlymag.com/news-and-profiles/science-and-technology/articles/drones-are-set-to-conquer-oregons-skies-are-you-ready-december-2014.
So, what about the concerns of the average person who is buzzed by an annoying drone? Any human activity requires courtesy and restraint but, sadly, that is often lacking. We have a truck camper partly because campgrounds are frequently full of obnoxious groups with their barking dogs, screaming children, boom boxes and loud conversations. A drone is one more potential annoyance to put up with. (At least drone batteries typically last only 15 minutes or so.) As for privacy, there is little expectation of privacy in a public place and, realistically, our phones and internet use invade privacy far more than a drone can. But I get it.
What rules do drones follow? That's complicated and changing. For now you can fly them anywhere except where you can't. They are definitely prohibited in National Parks, around airports and military facilities, and in some local areas. For example, Smith Rock State Park in Central Oregon is out. Other than that, recreational use is restricted only by flight height: a maximum of 400 ft above the ground. Police use is also evolving because drones are much less expensive than helicopters, so you may want to think twice before blowing that drone out of the air.
There are voluntary, common sense guidelines that operators should follow such as staying away from noise-sensitive areas and not endangering people or animals. Part of the problem is the sudden popularity of drones by owners without any experience in the social implications. I liken it to off-road travel in the 70s before 4WD SUVs and pickups burst on the scene, or photography 10 years ago before smartphones became common. Social behavior has not caught up to the technology, assuming it ever will.
Hope that helps shed a little light on this interesting subject. I'll try to stay out of earshot.