I think you might consider there is a difference in the context and use of the word,knew.
In Genesis 4:1 it is used to tell us Adam had sex with Eve.
A totally different application of the word,knew, when Jesus says, I never knew you.
He isn't saying, I never had sex with you.