I hear ya...it kicks my butt, too!
I think it's because you go more at your own pace, than to the beat of the music, if that makes sense. I sometimes find that I get myself going faster on some moves, like the jump squats, than Tony and the crew without realizing it.