This viewpoint is simplistic to the point of losing all sense. As another commenter pointed out, representation is the entire point of a republic. Countries have split and wars have been fought over this exact point. Hell, the United States only exists at all because of it.
Race and gender start to matter as soon as they become significant factors in our laws and that has been a constant from day one. I don’t care how much you think you know, you do not fully understand the perspective of someone with a radically different life than your own, because of what they have faced due to their race, gender, or any other distinguishing factor. They deserve representation so that their perspective is heard and factored into the laws that govern them.
This is the basis of what a republic is. You can’t take race and gender out. You can only over represent your own and ignore others while patting yourself on the back like you solved it. It’s intellectual, moral, and legal cowardice.