Select the book in the book list and hit the delete key. The book folder and the book's database records will be deleted, and if the author folder is now empty it will go too, along with its database records.
Maybe you changed the keyboard assignment for
Remove selected books from the default 'Del' to something else, if so it should display where I've drawn a green box.
BR