If you put yourself down and chastise yourself without giving yourself any compassion, you invite a negative way of thinking to yourself. You tally up against your flaws and your inner 'demons' and learn to almost condemn yourself in guilt for them, and that creates a spiral effect where the pressure to change and the guilt of 'being' in that state almost immobilizes you (it's not true for everyone, but it's what I've found). Now think, would you have that same outlook to others? and what good does it bring?
Where if you learn how to accept yourself as you are, then you can change for a reason better than guilt; you can change positively because you know that being different in some ways can benefit you and others. And you can learn to understand, that everyone has certain demons.
It's a process almost of 'letting go'. That phrase 'away from me' says it all. it's like 'I'm free of this'. You 'give up' your tendencies when you view them as a restriction rather than something to 'fight against'. They aren't really (for me) an exterior force that must be fought as such, but rather an internal pair of handcuffs, restraining you from being what you can be.
Let the shackles fall off, so to speak.