Dont worry, mine are doig the same thing, i have gotten 5 peppres of 3 plans since Jan. but it seems to reall pod up during the fall. But i think it just the heat and humidity down here. As the ghost pepper and brainstrains are the only ones i have promblems with.
Also, there could be from, to much nitrogen during the flower phase, which benifits the growth phase. You might want to try a fertilzer with lower N, but higher is the Phosphours (sp?), aka the middle number. That will encourage budding.
Also, i see you up in the wa up north, it could be getting to cold at night, and its preventing it from flowering.
Also, could be lack of polination, try hand fertlizeing it. Hope one these 3 help you, those are the 3 thrings i have been told about flower dropping