I'm almost 100% sure it's psychosomatic and involving the middle ear muscles which in turn irritate the trigeminal Nerve.
Like you, if I hear a door slam etc, or anything I perceive as dangerously loud (even though it isn't), the ear closest to the sound becomes full and my face and jaw become...