While my previous comment was on the fundamental nature of the problem, I like the idea of this being an option (when setting the space) with one further detail: it should be made clear when joining a space that access is unilaterally revokable by the space owner.