So out of 6 Cayenne plants I have 2 peppers that are ripe. What I am wondering is this. Is there such a thing as leaving a ripe pepper on the plant for to long? Im just trying to figure out if I have to take them off one by one as the ripen or if I can just wait until the whole plant (or close to it) is ripe to start pulling peppers off.