Rubber mallets are for little kids playing whack-a-mole at chuck-e-cheese’s. Get a real hammer. Seriously though, that rubber is cushioning the impact. You want to deliver a near inelastic collision that will jolt the bastard free.
Get a mini-sledge. Beat it like it owes you money.