This is why Political Spectrum is so helpful.
The X-axis is economic equality (perfectly equal to the farthest left, perfectly unequal furthest right)
The Y-axis is civil liberties (ultra authoritarian at the top, ultra libertarian at the bottom)
Fascism is one side of extreme rightism but not the only one. On the other side of the right spectrum are the right wing libertarians, who don't want to the state to infringe on your right to do pretty much anything. These guys are far less popular, but they do exist.