I have a similar problem locating a decent supplier. Habaneros are one of the most ubiquitous varieties of hot peppers available. I have even had a difficult time locating whole cayenne peppers. You may want to probe a farmer's market or even a local flea market that has vendors that sell fresh produce. However, most of these are probably seasonal and will most likely only have produce available in the late summer.
i dont know of any (i have a local grocery store that has them year round but the price is too much) Scan the local grocery stores produce isles until you find one that has them
Winn Dixie in my home town sells orange hab (and congo red trinidad, neon yellow, and red carribean all as orange habs) 10 for a dollar... I have spent a few dollars needless to say