This is exactly the kind of logic that makes massive abuses of power possible. "Criminals" in this case is an arbitrarily defined category used capriciously by an uncaring and authoritarian government.
You could be a "criminal" tomorrow, if you look at the administration wrong.
They broke the law at the time they entered the country illegally. That they weren't held accountable before now is an error, but it's not like the administration changed any laws. They're simply upholding it as should've been the case all along.