For those who wear Baffins, they seem to run small....how many sizes did you go up. I tried on pairs 1 size and 2 sizes bigger. The 2 sizes bigger seemed to fit the best but I'm curious how much the insulation inside the boot will mat down over time. I don't want to go 2 sizes larger only to have the insulation mat down and then they not fit.