This might be a little hard to explain but once a flower opens considering all aspects are correct will a flower guaranteed produce a pod or do some flowers might just never get pollinated???
Not all flowers get pollinated or set fruit. Even the most productive plants have some blossom drop.
Too much nitrogen and too much heat will decrease pod set.