If it's in a pot, you can put the whole pot into a tub of water and let it sit for several hours to leach the fertilizer out. Or you might consider gently taking the plant out of the pot and brushing and washing away most of the old potting soil, then repotting.
Either way you're going to shock the plant a bit, so be prepared to lose more blossoms.