If you want to grow select items only, stay away from the ground sterilizers that make things burnt clean for several years. In this case use Round Up - Spray where practical, and you can brush weeds that are tangled in the good plants. Also, check with the nursery where you are buying the plants about pre-emerge herbicides like Treflan and Sencor to control grass and some broadleaf.
When we planted our new grove we put down Treflan/Sencor at a rate of 1 quart/.33 pound per acre prior to planting the trees. The next three years I used the same rate in a hand sprayer and hand raked it in at the base of the trees. Today the grove is natural, but I use Round Up around all the trees on the yard to give a clean area, so we don't need to worry about nicking the trunks with the mower deck.
To kill stumps that you have cut out: Round-Up (strongest label rate) + six ounces diesel fuel per gallon of water. For any stump larger than 1.5", drill holes down into the stump and apply liberally. Another trick I have used, but it may not be looked on kindly in city limits, is to drill the stumps, saturate them with waste oil for a week, then saturate with diesel fuel, and burn them.