1:1 relationships are implemented by picking one side to be the simulated parent and the other to be the simulated child. The child side of every relationship in a relational database is the one with the foreign key.
So, if my drawing shows the FK in the table of Men and your drawing shows it in the table of Women, then you must have picked the "wrong" child. (Men are the children in my model; women are the children in yours.)
Just delete your reversed relationship, then re-create it by swapping the endpoints.