I've done it before and I didn't break anything. Sometimes you get the right conditions where you are mostly downclimbing but you hit a couple of little 100m soft snow sections you can glissade, and you don't want to stop, take your crampons off, glissade, put 'em back on again for the next section of downclimbing. You just have to be extra super cautious.