In the plant, lack of vigor, susceptibility to disease.
In the fruit, I've had some chiles with a very unpleasant burn. TepinĀ x lemon drop seeds I grew out yielded a fruit that went straight to my stomach with no flavor or burn in the mouth.
Can you say a chile is objectively bad? Probably not...