Weekdays vs Weekends

My normal pattern is being really good on the weekdays (not eating at night, and working out) and then indulging on the weekends and eating w/e I want and not working out.  I weigh myself every morning and what ends up happening is that I gain 3-4 lbs over the weekend and then monday morning I feel like crap. 

I need a day or two to eat what I want so I dont feel restricted and go crazy.   I just ate like a total pig all memorial day weekend and I'm up 3 lbs and I feel like I need to go nuts this week to get my weight back to maintenance! What do you guys do that works better?

I don't restrict what I eat during the week.

UD