I get the feeling you're a sweet person, kind to others, humble. But one thing I get the feeling too is because of this willingness to be seen as polite and gentle, you are maybe passive in this situation.
Imagine different personalities in this situation. Would everyone deal with it in the same way? Some personalities are being advised here, although dangerously. Like threaten him. Or be aggressive.
The hardest thing most people have to deal with in any situation, whether home or work or out in the world, is being assertive, over reactive (outward) or passive (inward).
Be confident about what you want. a) you don't want him to treat you this way. Say how it is, not politely, not aggressively, just say 'this is how it is...etc' boldly, confidently, and firmly, with absolute faith. God is on everyones side when they crack what assertion is. Even a child has the power to be assertive, yet they are often the lucky ones (God is with them).
Even with yourself, what do you want? You want your own place, you want to move out, you want somewhere for your children to grow up in a good home, and a safe environment. Say how it is to yourself, and God is with you.
It is really about assertion.
Passive is worrying about the reaction and therefore doing nothing.
Aggressive is not worrying about the consequence and therefore causing reaction. Eg. you could take some of the dangerous advice on this thread and he could turn round and make your life a living hell. People are capable of that.
Assertive is a kind of faith, you know what is right, you stand by it, and you do it. It is the best option in all things. eg. 'Its not right what you do (assert), and you KNOW it is not right (truth), and I will not allow you to behave like this with me in future (assert). This is how it is (assert), please respect my decision (assert), and I will respect you more (mutual agreement). If you do that, we will get along better (mutual agreement). I hope I make myself clear (assert).'