Ich kopier's mal kurz aus den englischen FAQ.
To delete a book from your Library, first tap the Edit button in the upper right-hand corner. This will take you into Edit Mode. Select the circular red button with the horizontal line to delete the item from your Library. Please note that this is not a reversible action - the book will be removed from your Library and deleted from the device.