Gangaskan --
One of my Habanero plants and one of my Scotch Bonnet plants did the same thing. Both produced a ripe pod about the size of a nickel or so. The habby was earlier than the Scotch Bonnet by about ten days or so. I picked both to get them off the plant and froze them for a sauce I intend to make this year. Why waste them? I took it as a positive sign; almost like the plant was doing a little test run to show me how awesome it's going to be he he he. Both plants that provided early smallish pods are doing well and have average sized green pods growing very well. Also, I think location and your related climate will have something to do with early pods and of course over-all yield during and up to the end of your growing season. I'm in South-Western, Ontario, Canada and I planted around the second week of May. I had to bring the containers in a few times to dodge some spring frost but other wise my plants are well and healthy -- I should be able to grow into late October or so.
Hope that makes you feel a little better!
--SIS