Dear Shawn,
I am experiencing the same issue in my raised bed comprised of cayenne and jalapeno. Leaf drop on the bottom of the plant first, has spread to all the plants in the bed. Google searches for "fungus or bacteria leaf spot" are useless as the descriptions and pictures all look the same...