store near me don't carry fresh cayenne either. only cayenne powder / red pepper flakes in the spice section.
mexican stores have fresh jalapeno, serrano, poblano and dried ancho, arbol, guajillo, numex, morita
i have tons of cayennes if you want to buy a box from me, will cost more than a store because shipping though.