Depends on how much 'a little bit' is. If it's really slight, then I'd say go ahead.
I've heard that working the muscles again can help alleviate the soreness, BUT not doing a full-out heavy workout.
Also, the soreness can indicate that the muscles have not repaired yet, so you are going to be breaking down the muscle tissue more (with the new workout) and not allowing for complete repair, which, depending on your goals, may be a bit counterproductive (if your goal is hypertrophy, I'd work muscles that aren't sore, or do another type of workout today).