Why does my horse do this?

Was he able to eat gr at his previous home? This could be new to him and he wants to eat gr. The other possibility is that if others are riding him, and they let him eat while riding, then he has picked up a bad habit. He will then think it is fine to eat when you are riding him.