I've tried doing a reverse Valsalva now. I know this isn't good long-term as it causes negative pressure, however, it mostly stops the noise. Do this at your own risk; however, basically, I held my nose and sucked in my eardrums.
Convinced this humming and weird noise is the middle ear muscle...