In high school I had acne that was pretty bad. After trying every damn treatment out there, I finally said to hell with it and got Accutane. Got about 3/4 through the treatment and that shit has worked wonders 10 year later.
For me, if I eat fast food, shit with oils (like potato chips), chocolate, or dark colored soda, I can expect to see some zits a couple days later. I've never found any correlation in things like breads or milks, just foods that are essentially bad for me.
Individual differences are seriously strong with acne, but I'd say cut shit out of your diet first, don't worry about milk or what not. Don't wash your face 10x a day either, that will irritate your skin.
If I can offer any help, just PM me. I know it sucks though bro, so good luck with it.