Replaced the battery, now starter just clicks?

I just put a new starter in and its doing the same thing. Turn the key and all you get is “click”. I just dont get it. If I push start the car, it turns over fine so I know its not the motor. What else should i check? What would prevent the starter from starting?