This may sound really strange, but it works.
I learned this from a "old school" iron worker.
Wear either pantie hoes or spandex as the 1st layer.
Its not the most manly thing in the world, but when your working out side in temps well bellow zero, several hundred feet in the air in a harness... you won't care, you're warm.