Tell them you're a nevernude... There are dozens of us!!!
I find religious people to be insufferable at the same rate as liberals, conservatives, atheists and anyone else.
The people that I know who've had issues with AA, it wasn't about the "higher power" it was that the community of particular groups had pivoted to, the simplest way to put it, is with us or against us. The reason for doing it didn't matter.
It's like having friends who go to church and you don't vs having friends who stop being your friend because you don't go to church.
It can happen in anything that goes from part of your life to defining your life.