Usually the smaller flowers set smaller pods, in my experience. Remember to start using a bloom fertilizer, it will help the blossoms to get bigger and more abundant.
do you need bloom fertalizers? my soil i just transplanted it into has bone meal, bat quano (P) not (N) bat guano and worm castins, along with mushroom compost, coir, and potting mix