With the qualifier that you're talking about North America, that's pretty close. Locally all the judo clubs but two have become much smaller. Those two are mine and another guy who also teaches non-IJF judo. Though actually its IJF judo from the 60's in terms of rule set ... meaning lots of ne-waza (I trade coaching with a BJJ coach - I teach a throwing/takedown class at his club, he teaches a ne-waza class, including leg locks (was part of judo until 1925 :icon_twis) at mine, no illegal grips except holding onto the belt, the throw counts against you if you over rotate etc.
We also have quite a few folks coming from the BJJ club to cross train, and several from two local MMA clubs for the throws/takedowns, so if anything the BJJ/MMA popularity has helped our club. I doubt those folks would go to a IJF based club though.
All the clubs trying to follow the IJF rules are getting smaller, because its become so rule oriented that its no longer fun. Basically the IJF drained the fun (creativity etc) out of judo with all its rules. Which is inevitable - if you try to enforce a style, you take away options.