He told them what he was going to do and asked if they minded, if they stayed that's consent.
Bit of a stretch to say the Louis CK held the fates of their careers in his hands. He's a stand-up comedian and produces his own small projects with small casts. He's not a Harvey Weinstein character birthing careers from atop his mountain of influence, distribution, respect and wealth. Harvey could make or break your career because his company was massive and produced big budget movies nonstop.
Louis never had anything close to that kind of power, he was just a popular comedian.