It depends. The majority of mistakes in higher level math courses are algebraic. If you can brush up on your algebra, you will do fine with Calculus. I hadn’t taken a math course for a year and I managed a B in Calculus 3. You pick it back up very quickly.
AND good job switching majors.