Being around brothers and sisters in the Lord is awesome, you can not get along with all of them, but the friendship they will offer and the love(not all will) is awesome and can help one grow in faith.
Yet gathering is where i go to be filled with the Holy Ghost, taught about different biblical principles(as the Holy Spirit leads), encouraged, revived, renewed, warned, directed, get healed, and much that the word of GOD offers. If your gathering does not have this, then i suppose you should pray much that the Lord may lead you to one..
There is absolute NO denieing that there is an advantage in gatherings. Two are Better than One, plus Unity is a GODLY CHARACTER, JESUS said, HE and HIS FATHER ARE ONE.. Hallelujah..
God bless thee bro. and whatever is telling you not to go to a gathering where the True Gospel is preached and the Service is Filled with the Holy Ghost is not GOD...
Test every Spirit Hold to what is Good, And GOD is good.!!. Hallelujah!!..