I've been known to start exercising (on occasion) after 9pm. Sometimes on my husband's golf night, I will put my son to bed and turn on a Cathe DVD. This is not something I do often, but have done it several times!
As long as you can get to sleep after exercising, it should be fine!