You could also argue that they don't want anything taking focus away from the actual fighter. Colorful gear etc might draw attention to the gear instead of the fighter.
You have to be drooling idiot if colored gloves makes it hard for you to concentrate on the fight. Anyway, I personally don't care that much about it. I just sometimes wish that the fighters weren't so bland looking.