People who care about their accuracy at all and dont hand load.

That's not entirely true. I buy in bulk to load in bulk, but I also have the equipment to load for accuracy. I just don't have a reason to do it that often.
When shooting competitively, it takes a lot of ammo to work out what your rifle/pistol is most accurate with. When you hand load for accuracy, you can make the subtle changes needed to improve that accuracy.
I have components and powder that I only use for hunting (accuracy) loads. When I make 20 rounds of high quality ammo, I go out to verify accuracy, then the rest last for 2 or 3 years.
I could go out and buy factory, but except for something unique like the "Leverevolution" ammo from Hornady, there is no real reason for me to do so.