When is switching to all business casual bad?

you can still where all the pants from your suits

Do button up shirts w/ nice pants no tie