I think the lack of a calming medication won't be helping. You may not have been dependant but your body will have liked it.
As for anxiety coming out of nowhere it can, because despite your best efforts fight or flight is clever and just the mere fact you are aware you are in noise can be...