I've never seen one, but I imagine it would get very heavy, not roll very well, and maybe risk damaging the floor (or your back).
If the weights are in 'another part of the room,' that doesn't sound so far away. Just consider setting up the weights pre-workout at part of the warm-up.