Also depends on the weather leading up to harvest (before the frost). Some peppers just ripen quicker than others as you said, but throw in some consistent cold and rain and that can halt things.
Did you just start the peppers this week? What is your first frost date?