If you are saying that those with the doma gifts listed above (apostle, prophet, evangelist, pastor, and teacher) are given to the saints for their edification and maturity I completely agree.
However, this is the full verse: "And He Himself gave some to be apostles, some prophets, some evangelists, and some pastors and teachers, for the equipping of the saints for the work of ministry, for the edifying of the body of Christ"
Notice that it is the saints who are the ministers. Anyone gifted with a measure of leadership and/or influence in the Body of Christ will, by the Holy Spirit, employ their grace to build up and equip the saints for the saints' work of ministry. Now, don't get me wrong: the grace of leadership is also a ministry but it is not one that co-opts the ministry of other saints for their own visions and plans. Too often church leaders (in name only) use the people to fulfill their own plans.
With that said, I have one man who watches over my soul. I know him personally and have so for many years. We've spent a lot of time together over the years. Also, I know several men I consider elders, saints who are mature, whose houses are in order. I can pick up the phone and call any of these men at any time. Because I walk in this grace, I can also provide this grace to others. So I watch over the souls of several saints. They, too, have direct access to me as their friend and as one who leads them in the Lord.
This is the organic nature of God's House because it is alive, not an institution. We may gather as a congregation but leadership is familial: the mature leading the younger, for men and for women.