Hey,
this is kind of how Anytype works. Everything is its own object and “just” connected.
But I get the thought.
Here is a request, that is requesting a view that also would help with finding orphaned files.
Would that help in your case?
Otherwise feel free to create a feature request for an option to “delete linked files when deleting object”.