I buy most of my groceries from Whole Foods. The problem here is that they tend to be more expensive than other stores of the ilk. The reason I go there is because I prefer organic food and their selection in this regard is superior to other stores. I can get things at Whole Foods that the folks at Trader Joe's or Fresh & Easy don't normally carry (i.e., buffalo, venison, etc.).
If you've got a Fresh & Easy in your neck of the woods, I'd check it out. Reasonably priced fare -- but quite a limited selection.
Also, as others have mentioned, if you've got a local farmers market... that would be a great place to go. They normally offer great prices.
Where I live, I've noticed that normal grocery stores are starting to carry more organic food (like Smith's/Kroger's and Albertson's). But in most cases, one could get the same stuff at Whole Foods for cheaper. Economies of scale ftw.