I was diagnosed with osteoporosis at 25 (I am 26 now). At my last bone density exam (May) I went back to Osteopenia, which is less severe than Osteoporosis - it's kind of a precurser to it. All my blood work has come back perfect and like you, I keep fit. I am also a vegan - and much of what I've learned is that this doesn't have anything to do with it. The only explanation they had for me was that it was that I was anorexic for about a year during high school and in the recent past.
I've done a lot of studying on it, I recommend the book 'Bone Density Diet' by George Kessler.
some other things I've picked up here and there:
> only a small percentage of the calcium in supplements is actually absorbed
> your body can only absorb a limited amount of any vitamin/mineral at a time - it may help to space out your supplements.
> read up on calcium sources, some are better absorbed than others.
> alcohol, soda with phosphates, and caffeine can deplete your calcium supplies
> make sure you get your follow up bone density exam at the same place. it's the best way to compare your previous results. I've been told that you should get them no less than a year apart - your body takes a long time to change.
> make sure you get lots of good calcium sources in your foods - if you don't do dairy there are plenty of alternatives - fortified soy milk, rice milk, broccoli, almonds, sunflower seeds, fresh leafy greens, white beans.
Don't dispair, I've also read that damage can be reversible. I guess that my improved T-scores on my latest bone density exam can prove that to be correct.
Best wishes!