Here in a conservative county in CA, all you legally need to do is be 150 yards from your neighbor's house and you are legal. Lot's of folks shoot .22s on 5 acre parcels. The real key is to be considerate of your neighbors. Explain to them that you have a good backstop, restrict shooting to daylight hours, etc. Folks who do that don't have any trouble.
Now if someone started shooting larger and louder I am sure their would be problems. BTW, more than a few deer are taken (with firearms) on these little 5-10 acre ranchettes.....