It isn't as hard as you think. It just seems that way from your current point of view. A habit is just a thought you keep thinking. You can't exclude or push it away, but you can change it by thinking about something else what you prefer when you find yourself "bothered". Once you get used to it, it becomes the new "standard".