I try. I have $0 debt and house will be paid off in 11 years. (rate 4.75%) I plan on retiring early and enjoying the outdoors. Hate being in an office.
0 debt = 0 credit improvement
Obviously though, you have debt, otherwise your house would not have 11 years left on it.
Remember that your mortgage is one of your best writeoffs. And as Strumpett knows, you can write off two homes, not just one.