It might be "terrible" if that thought was always in mind whenever you look at your kid(s), but I doubt that's the case.
I changed the chronology of my plans for marriage and family, moving things forward by fifteen years, when I looked seriously at the time-line concerning when the offspring might be out on their own. I decided I wanted to allow for a chance, later in life (should I survive the ordeal), to enjoy activities unencumbered by family commitments.