This is a slight inconsistency in the UI.

Instead, tap the checkmark icon in the top right corner of the Library, then tap each book you want to delete. Then tap the "Delete" button you'll see at the bottom of the Library screen.