Yes there is some that might not kill you, but there is a couple that will, I can't think of their names right off hand, but their not very common most though do have leaves that are quite toxic. I had read that mine should have fruited the first year also, but mine is now four years old and I have yet to have one flower on it. I would hate to have it die in another year or two with out ever getting any fruit. This year I didn't fertilize it at all to see if it might go ahead and bloom, but so far it hasn't. I do think though that some live a lot longer than reported and probably fruit later also. I have a little wild variety that will fruit in one season, it has small orange fruit that has a sweet musky smell and taste, the leaves also smell kind of like a wet dog when you crush them. It does makes a nice plant if you keep it contained and the flowers are pretty to look at, but if you let birds eat the fruits or just let the fruit fall on the ground you'll have the plant growing every where especially if your in a tropical zone.
George W.