Unfortunately people who have X instead of M or F on their documents haven’t been able to get a passport at all, even with the wrong gender marker. They have functionally been banned from traveling.

If we are going to use binary, I vote for IEEE 754. The precision, accuracy, and lack of ambiguity of floating points is what we need for something with the simplicity of gender. /s