As a comparison, black and white identities and differenciations exist in our societies, but almost everyone thinks it's bullshit, because that's just skin. But when it comes to vagina and penis, so many people thinks the identities and differenciation is "natural". But that's just a vagina and a penis, that's no much more that skin color or heigh or else.
@Luuhann Not to discourse you or anything, but even disregarding biology, the mere fact that people think those matter is enough to make them matter. Height is positively correlated with wealth, for example. The taller someone is, the more likely they are to be wealthy. Also, all of these can give you numerous small advantages or disadvantages - people tend to pay more attention to tall people, for example. So while I agree that these things shouldn't matter as much as they do, I'm not terribly surprised, and I wouldn't expect things to change until we get to the point where people can change these details with relative ease.