Personally, that's why I strive toward balance, not deprivation. Maybe you can allow yourself one treat a day. For me, this works. For others it ends up a binge session. You have to figure out what works for you. In the meantime stop stressing--it only makes it worse ;-)