"Ornamental" is subjective. I would consider a lemon drop to be "ornamental" as I don't like the flavor. Others would totally disagree with me. So just because a label calls a chile "ornamental" doesn't mean you will or won't like it - though there's a good chance most people don't like it or it wouldn't have earned that label in the first place. There is a large variety of chiles that are called "ornamental", and most have upright pods like yours. Sometimes the colors vary, sometimes they don't. If you're really curious, see if you can determine the source of the plant and call them.