I was looking into getting an olive tree specifically for trying the tea, but they just don't grow fast enough to be able to do it with any regularity, at least as a potted plant. I'd need to have a nice big tree planted outside, which is kind of difficult when you're living in a rental...
I have seen some potted plants heavily covered in leaves, but they were very old trees so yeah unfortunately it might be difficult to do it regularly. If you had a tree you could do it as a one off I'd guess?
@CraigZee
I wish it grew as a class B weed where I am