Yes, there is a HUGE flavor variety amongst capsicums. And what you taste when you first put a particular chile in your mouth may be different from the after-taste.
Â
The capsicum baccatums that I've tried have all tasted "fruity" to me, but I can't really describe what that means very well. The Aji Habanero (not at all like "regular" habaneros) reminds me of the flavor of oranges, but clearly without the texture of oranges. Regular habaneros (orange, like you get in the grocery store) have a fruity taste at first, for me, but then have a strong ammonia-like aftertaste. Red rocotos (manzanos) taste very much like tomatoes. Fataliis.... I have no idea how to begin to describe the actual flavor. Some say they get "fruity" flavor from them, but I wouldn't quite describe them this way. So not only are chiles themselves different, but the person eating them may have a very different experience than the next person does.
Â
The term "fruity" may be more about the sugar content of a given chile. In general, chiles don't have fully developed their sugars until they are ripe, which is why many unripe chiles have a kind of grassy taste to them, like bells. On the other hand, I wouldn't describe unripe jalapenos as having a grassy flavor at all. But still, a fully ripe jalapeno, as salsalady already said, tastes completely different from an unripe one, largely because its sugars are more developed.
Â
I suspect the huge flavor variety is what gets a lot of us hooked. Once you've tried a few and found some you adore (yes, ADORE!), you will probably become consumed with hunting for more to add to your most-loved list.