I disagree. This year, I have only summited about 50% of my alpine climbs (3/6). The first was because I ran into my turn-around time, the second because the rope got stuck and we had to cut it out of the crack, and the third was because we didn't like the look of the last pitch.
Yeah, sure I'm a newbie and all, but when I tell people that I retreated, I never get any disrespect from people, nor feel any embarrasment or shame. In fact, I've always found that retreats are generally respected, when well-considered.
Likewise, I've never had a parnter try to talk me out of my decision to retreat. Or vice versa.
It's unfortunate that the climbers you hang out with don't seem to understanding. You should find new partners.