Ryland, your doctor was right.
Oxygen gets transported into your bloodstream as a result of the pressure gradients between the atmosphere and your bloodstream. As the pressure in the air decreases, the "push" of oxygen into the bloodstream decreases. The percentage of oxygen in the air at upper elevations is the same as sea level, but the pressure is less.