Infertile is NOT a lesser man at all, in my mind.
And it's not an absolute.
My father was told he and my mother would not have kids (so they adopted me and then my brother), and then... surprise!! They wound up with my youngest brother.
God can enable a man to be a good father NO MATTER what his biological reproduction status may be (same for mothers, as the doctors say I'll have a harder time than most getting pregnant), and that's what truly counts.
A God-fearing man who lives his live according to his beliefs and was willing to follow God's will with all his heart... down the biological path or not... would be the ultimate catch, "fertile" or not.
The only place of fertility that matters is the heart.