My mature pepper plants from last year's garden, that have been growing in pots indoors all winter, had a young crop of baby peppers prior to me transplanting them outdoors last week. The habaneros are between the size of a pea and a small cherry and most of them are orange. Are they going to continue growing in size if they are already orange or are they stunted and should I remove them from the plant to make room for fresh buds?