After a while you just get numb to the situation. I've had to put MY family (my kids, and DH) first and as long as you and your DH agree with that then don't worry about the rest. My family (mom, dad, sister, and BIL) are so super dysfunctional with a moral compass that points due south. They are always finding a way to make a buck even if it means doing the wrong thing. I'm in the middle of a major fallout because I quit my job and my sister and her husband were my boss. My BIL is a dentist and I discovered and confronted them about withholding refunds due to patients who overpaid for treatment. I told them it was insurance fraud, illegal. .then I reported them.
I also reported them to the city for opening a new practice and operating on patients without permits.
Needless to say my parents are royally pissed at me. I feel a twinge of guilt because I know I screwed them over by rat finking them out but I'd rather feel guilty about turning them in than feel guilty for not doing the right thing. Anyhow, . . . .you have to do what is right for you. There is a positive to this trust me. For me it is not having to stress out about it and having more time to focus on me, my kids, and DH.