Unless "the man" avoids you like the plague and refuses to fight legitimate contenders. Then "the man" suddenly stops being "the man".
Which is exactly the reason why people recognize Whittaker as a more legitimate champ then Bisping or GSP.
Whittaker hasn't fought in a year, bisping didn't take a year off while he was champion. is Whittaker not the man any more?