@Waylander: Think of the collections as simple 'tags' attached to a book. A single book can have multiple tags.
Removing those tags will in now way affect the book themselves

.
So, no, removing stuff from a collection will not actually delete said stuff, it'll just rip that tag off the file

.