I’m asking about both cultural and language barriers.This wording is a bit confusing. If I understand correctly you're asking about cultural differences and not language differences?
It could affect me. Some culture differences are so drastic, for me, I couldn't even connect with someone among those differences.
The cultural differences would have to be minimal. But following another cultures rules and regulations would be tiresome after a while.