There are many reasons why some do not go to Church, like looking after elderly relatives so are unable, or working to pay their way without choice, etc.
But wanting to go is something else. I can give you a few examples of those in my lifetime who have given accounts of why they do not want...