There is something more disturbing that Mr. Colbert is giving credence too.
What if someone in question was a Nazi's? In a free society, Nazi's are supposed to have rights and due process as well.
That is an important distinction that separates us from the Nazi's.
Even if someone were say, a Nazi, simply because we are used to mowing them down in video games, seeing them mowed down in movies ECT. is not a license to disenfranchise them, or as some have hinted literally "destroy" them for their stupid and destructive political beliefs. That is you know... being a Nazi...
The other problem? When someone wants to identify someone as a Nazi, the criteria for being a Nazi suddenly becomes "I disagree with you = fascism!" All of this does not make for a free or healthy society.