Repainting Center Caps Question

I want to repaint the center caps on my new rims. This is probably a stupid question, but will paint stripper damage the rubber ring on the back of the center cap?

It might melt it if your using a really strong stripping solution. But then again if it does that its going to melt the plastic centercap for sure.