One thing that can solve all your problems is communicating what you are feeling. We humans tend to make it more complicated than it needs to be. I know confrontation can be difficult and nerve-wracking, but it is key to resolution. You cannot blame someone for not knowing what you are feeling when you do not discuss it. Instead of waiting for him to speak up, how about you speak up? Afterall, you are the one experiencing these emotions.
Facial expressions and tone of voices usually will not show the accuracy of what a person may feel. Sure, you might think his face is changing and looks like he doesn't want you here, but you are jumping to a conclusion. I mean, he may want you there or he may not. You'll never know until you just ask. My facial expression usually do not show what I'm feeling, but people jump to conclusions about it all the time.
Don't be subtle, be upfront. Also, you can still be polite and be upfront at the same time. You can say something like, "I've been here for a few days. Is there a time that you'd like for me to leave?" Leave it open-ended, let him be the one to answer. He can either say "No, I want you to stay," or "Yes, how about in a week?" Leaving it open-ended gives him the opportunity to be honest with you. [/COLOR]