I've used black pepper sprinkled around the base of my potted peppers. You could actually see the ants racing to leave the pot. It's worked for me, maybe give it a try.
While this did keep them out of my pots, I had to also use Terro liquid ant bait as well to "control the population".
-