For a given container size, a plant can only get so large and if your plant is already loaded with fruit, that makes matters worse. Once a plant reaches it's "fruit load" any lucky pods that due set could be very small due to lack of available water and nutrients. If you pick them off, and the plant does flower again, you will only get small peppers again if anything. My advise, leave them be and wait for the plant to unload the current batch.
Other than that, a plant can stop growing due to insufficient nutrients or not enough light. If you have not fed them in a while (more than 2 weeks) it may be time to give them another feeding. If you suspect a deficiency, then apply the appropriate nutrient. If you can get the plant longer hours of direct sun, I'd try that also.
I have some plants that don't want to stop producing which seems to be genetic, but I suspect that eventually (given the chance to keep going all year without harvesting) they would all grind to a halt.
I pick my pods as soon as they are about 70% ripe, that is I don't wait until the whole batch has ripened to perfection on the bush, then harvest. I pick them one by one and put them plastic bins to ripen the rest which takes a few days. As soon as they are as ripe as I desire, I either freeze em, blend em, dry em, cook em or eat em. Anyway, you get the idea.