It doesn't matter unless people are trying to make it out as something that was definitely not true. If people are putting importance on the fact that Jesus was white, or if they have a problem with the fact that Jesus was almost certainly a dark skinned, not very attractive, Middle-Eastern man, I think that's a problem.