In your new relationship if your children do not like the person you have chosen it could cause strife between you and your children; or if their children do not like you it may cause problems there as well. The same goes for friends and families of either person. These are the consequences of the choices we make.
God provides forgiveness and freedom from sin but the consequences remain. I would advise that when Scripture gives several warnings considering a particular topic, weigh the consequences carefully.