I grew my first Baccatum last year; a single Bishop's Crown . The pods took stupidly long to set fruit beyond two or three early pods. And those early pods took forever to turn red. By late August, the plant was festooned with zillions of pods. Those took forever to ripen, too. And when they did ripen, it seemed like they did it almost simultaneously, which was actually really convenient.
This year, I'm growing Brazil Starfish, Lemon Drops, and Sugar Rush Peach. The Sugar Rush set fruit very early, and the Lemon Drops followed close behind. But they are also taking forever to ripen. The Starfish are just now starting to set fruit.
So, yes, Baccatums take a long time.
But so do many Chinense. Some SuperHots are worse than others. To me, it seems like Ghost/Naga types take longer than 7Pot/Scorp types. Primos took particularly long for me, 2 years in a row.
But like 'DaSauce said, Aji Pancas take the longest..... They're a mild Chinense, but they take a long time to set fruit, and the ripening is extremely delayed. I rather like them, how they taste, and the plant becomes an impressively big tree, but I'll likely never grow them again. They just take too long.
My strategy has been to include early varieties (many annuums, even normal Habs are relatively early...) with the later stuff. Most of my favorites require plenty of patience, but having piles of Jalapeños to snack on while I wait for the late stuff makes it easier to tolerate.
Hth