Milk supply and low calorie diet

Hi, my name is Shantyl and I have a 21 month old and a 2 month old plus the twin teenagers.....When I got pregnant with my 2 month old I hadn't lost all the baby weight from my almost 2 year old...so here I am 5ft5 and 204lbs. I noticed that when I cut my calories too far back my milk supply would also cut back and the little guy doesn't like that...on the other side of things when I did cut way back I lost weight...so I don't know the answer here...will my milk supply adjust to the low calorie diet after a week or two, or will I be on that slippery slope of loosing my milk supply?