that's exactly it for me too. it's like a building irritation that crescendos into a grumpy tsunami if not dealt with

though i find it's not just noises necessarily, it can be sensations like touch as well