sound like both you and your partner are persnickety as all hell.
transferring the whole rack to and from someones harness increases the odds of dropping something. and it takes longer. just ask the fucker to show up at your belay with the gear --all the gear: from his harness and cleaned-- on a sling so its ready to rerack.
my petpeeve is my partner arriving at the belay to hand me a cluster of webbing and gear expected me to sort the mess they made.