Since my first son was born, I don't think I've scaled anything back, but I have been much more careful about planning and learning about methods to keep me alive longer. Learning about new techniques and gear. Opening up your options when it comes to decision making time. Instead of cowboying myself up rock or across glaciers, I am thinking more.
You're asking a very personal question and you're going to have to put all the pieces together for your own situation. As usual, there's no right answer and someone will always think your approach is irresponsible or extreme. No matter how sweet and juicy the peach, there's always going to be someone who doesn't like your peaches.