Yes, I used to wean my foals at 4 months, and one year I was stunned by two mares who had already weaned their foals, when I went to separate them. This was their pattern apparently, as they did this each year they had foals at foot. Guess momma knows best!
As you say, by 4 months they're eating feed and hay, so all is well. No worries.