Calee -
I think all your "fears" are normal. Financially, emotionally and physically it can be hard.
For me, financially, with each of my kids we were never in a good place. With the first, we weren't ready; the second, we weren't ready; and with the third, after finally getting ourselves...