I think it's beneficial to put in a 'recovery' week every 4-6 weeks or so, focusing on functional fitness, core work, moderate cardio, etc. I think workouts like the TLT's would be very good to do for this kind of recovery, because they work the stabilizing muscles and core muscles, and give the larger superficial muscles a bit of a break, allowing you to come back stronger, as you say.
The importance of these recovery periods is one of the best lessons P90X taught me (I LOVE workouts that teach me something that is so beneficial and wide-ranging).