I haven't chimed in at all yet, but since I've been in a similar situation, I just wanted to add my thoughts.
I stayed in a relationship for 5 years with an abusive, manic, manipulative, controlling jerk just like your husband. Previous posters were right - his reaction is a classic, textbook reaction. They THRIVE on making EVERYBODY ELSE the problem. They are ALWAYS the victim. Nothing they ever do is their own fault, and they're masters at manipulating us into believing it and feeling sorry for them.
It's complete and utter bullsh*t, and believe me when I say that you will not ever be happy as long as you stay with this man. He will not change, he does not want to change, and he wants complete control over you. I also must add that you are the only one allowing him to have control over you. I broke up with my boyfriend so many times, but I didn't know how to handle these reactions. I wasn't confident enough in myself to stand up to his crying, pleading, suicide threats, and I always ended up thinking maybe I was being unfair. He even somehow made me feel that I was responsible for him cheating on me, because I wasn't sexy enough!! And believe me, they won't ever let go, not even remotely because they're so in love with you, but because their ego will not let them accept that they don't have complete control over you. Anybody who actually loves and respects you does not treat you this way in the first place.
This is really sad to say, but it took me meeting another wonderful man that I developed feelings for to gather the strength to deal with this relationship. I wasn't cheating, and wasn't even thinking that I'd end up with this other guy in the end. I simply realized that there are other people out there that I am closed off from, because I'm in a relationship with a man I don't want to be with, AND I AM THE ONLY ONE TO BLAME. I suppose the control I actually had suddenly became clear to me, and I just did it. I made up my mind ahead of time that regardless of his reaction, it wasn't my problem. He brought all of this on himself. But I also realized that even if he were the most perfect man alive, I still have the right to leave him. I don't have to stay because he says so. And any normal human being will not want to force or coerce somebody who has made it clear they're not happy into staying. That is sick in and of itself, and once again a sign that they don't give a rat's a$$ about you or your feelings, it's all about their ego.
I'll also warn you that the next couple of years were hell. He was threatening suicide, stalking me, threatening to hurt me, to hurt my new boyfriend, spreading lies about both of us, trying to get us fired from our jobs, etc. I did not go anywhere by myself until I moved out of the state. I got restraining orders, got him convicted, sent him to jail, moved to another state, and he still won't leave me alone. You have to be strong, is all I can say, but I wouldn't change a single bit of it. The day I left him was the happiest of my life. I cried out of pure joy.
I guess my point is that you just have to realize that in reality, you are the only one responsible for what you do. Just as it's not right for him to blame you for his problems, you can't blame him for yours. If you feel like you need to leave, you just have to do it and accept that he's not going to "let" you. Of course he won't. You do it anyway. It's your right. And in my opinion, the only right thing to do for yourself and your children.
There are a lot of great things waiting for you out there, but you have to let it happen. A woman as beautiful, successful, and sensitive as you are will succeed. But you have to decide that you will. You deserve happiness. Good luck with everything.