Be careful telling a noob(not saying anybody here is) that peppers are "perennial". They most certainly are, but not if left outside in Toronto!
Also, I usually start my habaneros indoors, 1st week of March, and I have huge harvests, so it may not be too late. I must note that where I am we do have nice warm nights(but not hot) (65F) for more than 3 months, so if Toronto has significantly cooler nights (below 55F) throughout the Summer then you will be better off buying an established seedling somewhere. I think if you plant seeds before April, you may still have at least a small harvest of ripe pods before mid/late September. If you keep them in pots you could bring them inside to finish ripening and have a decent harvest.