What makes a Wilderness Area different is that no "mechanized use" is allowed. The controversy (at least as far as wilderness vs. non-wilderness is concerned) is not so much that bolts have been placed, its that the bolts were placed using a power drill - obviously a mechanized tool.
Wilderness areas aren't exactly what I'd call arbitrary either as they have clearly designated boundary lines and it takes an act of congress to make them so.