I'm using it when we stop, not in the middle of climbing.
It's a pretty standard thing to do in cold weather. If you keep your camera inside a tent, lodge, house or whatever when it's cold out, you can put it inside a bag, wait until the camera and bag cool down and take it out. Same process if you go back inside a warm building, otherwise the lens and camera will get condensation.