If someone is willing to withdraw money and pay the necessary taxes on them, the IRS should have ZERO say in what I use the money for. It’s not like I’m trying to withdraw money I didn’t pay taxes on and not pay taxes still. Trying to loophole a withdrawal under a hardship is an entirely different matter and yes, that, I frown upon as well.
So yes, in my opinion, it is very unfair.