^ What does refusing to let new buds stick mean? It's not producing buds/blooms or they are withering or falling off?
If the latter I'd suspect high temperatures or a nutrient deficiency. Where is NWI, north west idaho?
I agree with the others, leave them on the plant with the one exception that if the branches are so heavy they are about to snap off and you refuse to stake and tie them for support. It's your call though, pick off one of the biggest and oldest and eat it... then decide if that's what you can accept, more less tasty peppers. On the other hand leaving peppers on mine to ripen doesn't appear to be slowing new pod rate much.