Kicked out or "invited to leave" amounts to nearly the same thing. By leaving he kept his benefits. His politics are far beyond mainstream. While "his men" might treat him like royalty he has issues with authority that cannot be sanctioned. A black version of Custer.