They already sort of do. I've seen tweets that make fun of certain women for being "trans passing" as if women who don't fit their idea of beauty are less of women

They see women of color as less female as well. Lots of comments like "if black women get to be considered women, then so do I!" God I hate these men, they really are the worst that that gender has to offer and they'e all forcing their way into our spaces. What a nightmare.