When Alfred is helping Bruce with the cipher, he mentions his, "days in the circus". That sounded odd to me until after the movie was over. Then I remembered that, "The Circus" is an old slang term for the British Secret Intelligence Service, MI6.
Later, when Alfred is recovering in hospital, he apologise to Bruce because, "I could teach you how to fight, but I couldn't be the father you needed". This implies that, unlike other versions of the Caped Crusader, it was Alfred and not Ra's al-Ghul who trained Batman. When Bruce makes a snarky comment about Alfred wearing cufflinks monogramed with the Wayne crest, Alfred shuts him down by stating that Thomas Wayne give them to him after Alfred saved his life.
So this movie's Alfred is a certified bad-ass, as much a bodyguard for the Waynes as their butler. He walks with a cane, indicating he's been injured either as a spy or in the service of the Wayne family.