This is fair. It can even be argued that the J6 insurrectionists were doing the correct thing (many asterisks given who some of them are, what they represented, etc) if they truly believed the democratic process was subverted. Of course, those were lies stoked by a conman who has never been held accountable for his behavior, but still.
That said, ICE is a questionable organization if we're being incredibly charitable and hasn't always been following the law and operates in an incredibly shady manner and I think a lot of anti-immigrant people don't understand the ramifications of allowing an organization like this to exist and operate in the manner it does, especially with comments like, "the homegrowns are next" and legal citizens being deported.
I don't make the moral argument with conservatives because they, *generally speaking*, don't care about morality and they really don't care about the rule of law considering the criminal regime that is in power and their repeated violations of the law, including court orders and the Constitution itself.
I forget who it was, but someone with Trump's cabinet during his first term even proposed something that would basically abolish ICE. It might've even not been his cabinet, it might've been someone involved with immigration, a woman IIRC. Fuck my terrible memory, it's on video though. They don't use those words but that was effectively what they were saying IIRC.