The excess calories do not matter if they are a one time event. You gain fat only through chronic calorie overconsumption.
Yes, the scale might show you heavier the next day but it is water weight and will go away if you go down to your regular calories. Fat does not grow from one day to the next.