What holds me back from repetitive church attendance, or just general fellowship, is my shame. I feel like I'm not pure enough to be around other believers. This is a lie of the devil. There's some truth to it though, Paul told the church he established not to tolerate people that live in sin, but I think he meant people that don't see sin as sin, ones who practice it in willful ignorance. Not ones who slip up, knowing it's sin, and repent.
Once I get over my shame and open up to fellowship with other Christians, I find that they are often plagued by the same fears and lies that I am. We comfort and reassure each other in Christ's grace, forgiveness, and his love.
My youth pastor, who I'm friends with now that I'm an adult(24), is not perfect at all, he's fallen just like me, in some of the SAME ways but we repent and we are forgiven constantly. We reassure and encourage each other.
It's a beautiful thing, I pray you will have the courage to humble yourself before God and others and receive his blessings.