If you feel you need the week off, then take it. You won't lose any fitness in a week. If you think you may have a problem getting back in the groove again after the week off, consider doing easier workouts for a week, or cutting it down to less days for a week.
Andrea