Yep. That's what I keep mine in. Shaker top regulates the flow pretty well. Yeah, you do have to cut them into slivers, but in my opinion, that only helps flavor the vinegar faster. If you want to leave the peppers whole or halved, you'll need something like an empty wine bottle, which I've also used, and had success with. I filled the bottle to the top with yellow and red bhuts, red habs, devil's tongues, and filled it with vinegar. Went GREAT with olive oil on a salad, but man, it was HOT!!! And you should top the bottle with one of those plastic booze regulator thingies that they use to pour shots in the bar.
Here's what I have here in my office