You guys aren't being honest with exactly what the complaint is then.
There's plenty of good reason to criticize someone for giving Alex Jones a space. I'm not talking about "random guy I disagree with", specifically talking about Alex Jones right now.
If you are going to have on a piece of shit person like him, and it's not to take him to task for the fucked up shit he has said, then what are you doing?
The criticism with Rogan, for me at least, is that he isn't some super political guy, he's not a grifter, or some far left or right wing ideologue, he isn't some provocateur or troll, and yet, he sometimes lets these people use his platform to spread their disinformation--and he's too dumb or uninformed to challenge them. This isn't about freedom of speech , it's about acknowledging the power he has. I think Joe is a good guy that is always well intentioned, so it's annoying when he contributes to this kind of negativity.
I'm not for censoring him or anyone, but I find what he does as largely irresponsible. People are very easily influenced and will take tweets and the words of some celebrity as gospel. Obviously, we shouldn't, but a lot people do. And you should be aware of that if you're in Rogan's position.
This isn't just about left/right wing stuff. He just had a podcast with Kanye West and was telling West that instead of taking medication, he should have just excercised. Rogan has no idea what Kanye's mental health is like.