They'll point down at first and then once the pepper is pollinated it will start to point upward as the pepper pod grows. They grow this way because most of the time the flowers self pollinate and if they were facing upward the pollen would fall to the base of the flower and never pollinate properly since gravity makes the pollen fall downward.