From the home screen, go to All Notes to see a list of highlights (highlighter icon), notes (drawing icon), and bookmarks (folded page icon). Then, click on the Options button. Then, select Delete Notes. The list changes to show check boxes to the left of each item. Check each item you want to delete and click on Done to proceed.
Not exactly one click, but you can delete all your bookmarks in one fell swoop.