You implied it. You literally said "Brazilian fans are the worst. They stay silent...". You could easily say "many" or "most" or "some" to show you don't mean everyone when you say "Brazilian fans".
If someone said "Americans are fat and lazy. They are so racist too!", you know you wouldn't assume or even think the person was not saying ALL Americans.
In any case, I don't find Brazilian fans even half as bad as you guys make it sound. As Conor said "They are very passionate fans of MMA. You see the same things when you come to Ireland! We are both countries with a lot of passion for the sport." -Paraphrased, but you get he gist of it.