Loving your brother (in deed and in truth) with this worlds goods when seeing them naked (to clothe them) or hungry (feed them) or in prison (even as John the baptist was in prison) and doing unto the least of these (whom he is not ashamed to call brethren) by giving them (out of your abundance) in what they need (whether food, drink, clothing or lodging for the body) even visiting them when cast in prison is good (because we care for them) but its not the same pampering kind of love (or rather demonstration of love) towards those who be called brothers but who continue on sinning and hang out with us. That kind of love is shown in Jesus who says those he loves he rebukes (and chastises)
Those who are hungry have need of food, those who are thirsty have need of drink, those who are cold have need of clothes and those who sin have need of being rebuked.
The needs are different and loving someone (in rebuking them) is just as much caring for their soul as loving someone while caring for the needs of the body (with your provision)
The world will not receive those who are Christ's but their own. This is even how the world is judged, even as by those (who are his) coming in some form of need (and what you have done unto the least of these my brethren)
Those who sin are to be rebuked, shunning is that which helps that which "is called" a brother even as Paul advises
1 Cr 5:11 But now I have written unto you not to keep company,
if any man that is called a brother be a fornicator, or covetous, or an idolater, or a railer, or a drunkard, or an extortioner;
with such an one no not to eat.
Therefore put away from among yourselves that wicked person.
Shunning (even putting away from ourselves) those who do the same is meant to make them feel ashamed (and aid them in changing their minds).