[HarryT]

There's a much faster way to do it.

Highlight the collection name, press the right arrow, then select "add/remove items". You'll then be shown a list of all your books and can quickly add or remove them from the collection.