Tom,
Who you are has not changed. It does not matter what we learn about our past and our ancestors, we are still the same people. Perhaps older, hopefully wiser and with some luck a little more knowledgeable about ourselves, but still we are still the same person that started down the path that got us to the point that we are in today.
Learning about second marriages, extended affairs, illegitimacies does not change who we are, it can change what we know about ourselves but it does not change who we are.
If we have not learned about these things in our family history it simply means we have not looked far enough. Every family has them - often hidden, perhaps forgotten but always there.
This all leads us to who were my ancestors? How do I verify the information? Rule one: Never accept until you check for yourself. I keep coming back to the baptismal record for my grandmother that shows she was a boy, her name was unusual and in written material it was often assumed she was male.