We need something to ensure consistency, though. It needs to be grounded somehow, otherwise it's just whatever's expedient. This is what Kant and Rawls among others were trying to get around. Hobbes, Rousseau. In their varying ways. Kant once famously stood by the claim that he would not tell a lie even to hide a family member from a murderer because of his categorical imperative.