Maybe -- only you can tell for sure! If you wanted to, you could measure them now, do LL for a month, and measure them again. Not that this would be a perfect measurement because your diet could affect the size also. But if you eat like you have been, you could try and control for diet.
It is possible that if you are building muscle, but not losing fat, to appear a little bigger (in any muscle group). However, I don't think that this is a good reason to quit building muscle. In the long run, muscle will help you burn fat at rest.
Jeanne