When is switching to all business casual bad?

For the immediate future, pants and a button down or thin sweater will do.

Tho, yes, the situational change does suck.