Welcome to the community @stevenlx
Trying this: Create a set/list querying everything, then use these filters (but you probably have to use one filter for each view, because OR logic is still on roadmap).
Depending on how you added the object into a collection, it should show under links or backlinks, then you could ask Anytype to filter out those linked to all or required collection object (by manually adding all collection to the filter criteria)
– “Is empty” logic won’t work because links/backlinks also show all object types
– Alternatively, create a relation for mimicking object’s connection to project (as projects/collection only - to mimic its belonging to collection), then create a set (not collection) with this relation, then you would be able to use “is empty” logic for this relation.