Hi Jennie,
I think it's worth it. Personally, I would chage jobs even if it's the same pay just to get away from the place that makes me miserable. I did just that a few years ago. The job I had was only 5 mins away from my house. Before that job, I didn't know the meaning of a migrain...