Sick drift truck build

I was looking at them on McMaster… it wont hurt the bearing rollers as you slide the shaft linearly? or since it spinning around say 200 times every 1 mm it slides it wont really do a thing?