Does nutrition really make you bigger?

I'm 23 and 6'5 230 lbs of muscle (I play football) and growing up I just ate a lot of candy and a few snacks every day (gummy bears, nerds, starbursts, ect). I never had a taste for meat or anything that has protein. Would I have grown bigger if I got better nutrition growing up?