I am a single (widowed) man. Personally I don't go to church to look for or meet women, although I'm not against it happening.
I do not and really haven't felt this "sidelining" or "suspicion" in the churches I've been at. Maybe having children makes a difference. Maybe it's a regional thing...