Indeed at the last supper just as Judas left to betray him1. The other 11 did not really know what was in the heart of Judas.
2. In any event they did not have the right "to throw him out". And Christ had him there for a very specific reason.
3. Christ did not even disclose the betrayal until the time for betrayal.