The plant will survive anything above freezing though if it frosts that may cause leaf loss and pod damage (they can be picked and used the next day but will rot if left on the plant much longer)., and if it stays in the roughly sub-60F range for most of the daytime several days in a row then it may drop leaves.
When it gets below 50F at night it will stunt the plant, new peppers will grow slow and little if any increase in plant size, though so long as it gets up above roughly 70F in the daytime the plant will recover some, only to be stunted again the next time temps drop below 50F.
I leave my plants out for about 4 frosts, at least the ones I have enough bedsheets to cover overnight for protection, and bring them all in once it gets below freezing. This seems to work fine for me though a primary reason is I have nowhere near enough grow lights or space to do much for a bunch of plants with a full season of growth, for me they get more benefit staying outside to get more light, more than they suffer from cold above-freezing nights, and I don't want to bother with/deal with bugs inside the house.
At this point if I were you, I would pick off most of the blooms with the hope that fewer peppers growing means the plant's energy can be put into growing them faster. If you get full sized pods before they are brought inside you have a much better chance of them maturing to a ripe state, unless as mentioned above you have nice big grow light setup inside... but I am thinking in terms of several plants, for only one plant a few dozen watts worth of fluorescent bulbs should suffice.
