No, for the same reasons you can’t stop manned airplanes and helicopters. We are also flying within the Public, National Airspace. Only the Federal government is able to place prohibitions, restrictions, or regulations on the airspace.
We usually don’t get too close unless it’s unavoidable, for safety, a search and rescue mission, or another type of emergency. This may include, but is not limited to, evasive action to avoid birds or manned aircraft, to perform an emergency landing, or to comply with Law Enforcement, or FAA limits/restrictions/orders.