You hate people who start talking to you, then notice that your expression says that you're not happy about it, then say something like 'I'm not annoying you. I'm just talking." And you're like "when did it become your decision whether or not i'm annoyed at you?", amirite?
But of course you can't say that because they have some kind of authority over you, or else you would have just told them outright to shut up.