Annotation import Kindle PW3

[davidfor]

Originally Posted by FrustratedReader

Hm...
I restarted Calibre twice after adding plugin
I added another annotation (and accidentally a bookmark)
There are three notes. All start with "Test". The first time no notes appeared, only highlights, so I ejected PW3, restarted the second time and reconnected after deleting previous annotations in Calibre.
It's now got location, but that's no use to me, I need Chapter text (and maybe % into it if possible) as I might not have highlighted a phrase unique in the book.

What you get in the annotations is what is in the "My Clippings.txt" file. Or the "notes.txt" for tolino devices and the database for Kobo devices. If the selected text is in the annotations source, it is in the annotation. And the location uses whatever is there. The plugin makes no attempt to fetch extra details from the actual book. And generally, there isn't enough information available to do this.

Copied from Custom Metadata tab for book:

Did you copy the text or the HTML? The HTML would be more useful and needs to be wrapped in code tags to be visible. As it is, when I reply to the post, the contents of any quote sections disappears.

It still seems to repeat the location & timestamp at the Note.

HERE is the "my clippings.txt" of relevant part:

The annotations all look to come from "Of North Blood Drawn (Magen) (Ciaran MacUaitéar)". There are nine in the file, and nine in your list. The first two have bad dates. I'm not sure what is happening there. A debug log during the fetch should help.

Exactly what is in the annotation text depends on the type. The ones with just the location and date are bookmarks - "Your Bookmark" in the file. The "Your Notes" shows the text you entered. The "Your Highlights" show the text you highlighted. It doesn't appear the file has any highlights with added text. I don't know if that is just that you didn't do them, or if Kindles don't store them this way. The code in the plugin does appear to suggest that they are either highlights or notes, not both. I'd have to check some of the other sample files that I have.

[Quoth]

I can't see how to remove the blank line, it's not shown in the CSS edit window.
Adding an HR adds it between the highlight and note as well as between each new annotation. Nor do I see why the location & date stamp is repeated.
An Annotation should be:
<location> <date>
<source text highlighted>
<note, if any>
<blank line>

I'm going to copy & paste all the annotations for a particular book into a plain text file, never actually use them in Calibre. That is then a tab in Notepad++ or Sublime Text editor along with cast, events, background etc. Then the source is edited in a window beside in Writer. Each annotation is searched for. A * is put at start of line of note on annotation entred, or it can have X if I decide it's OK after all, or a note.

The Annotations CSS edit window does let you change the order of the three items, or style, margin etc. The default order is fine. It doesn't let you remove the default blank line after the source highlight, adding HR adds it between hightlight and note too, no doubt because of the extra location+time stamp added before each note.

[Quoth]

I can see that all the important notes are imported. Don't worry about the couple of strange entries at the start or bookmarks.
The three notes I added for this example start with Test
Why is location and date repeated before each note as well as before the highlight?
Why is there only a location number rather than name of Chapter or is that impossible?
Why is there a blank line added after each highlight?
Here is the HTML source from Custom Tab

<div class="user_annotations" style="margin:0"><div class="annotation" genre="" hash="f0ba67761b40a3b527301ee60a984d39" location_sort="000000" reader="Kindle" style="margin:0 0 0.5em 0"><table cellpadding="0" width="100%" style="background-color:transparent;color:black;font-size:75%;margin:0em;" color="gray"><tbody><tr><td class="location" style="text-align:left"></td><td class="timestamp" uts="0.0" style="text-align:right">Thu 01 Jan 1970 01:00:00 AM </td></tr></tbody></table></div><div class="annotation" genre="" hash="cf5c0640d7edb453eb4a8547eb5f03e9" location_sort="000000" reader="Kindle" style="margin:0 0 0.5em 0"><table cellpadding="0" width="100%" style="background-color:transparent;color:black;font-size:75%;margin:0em;" color="gray"><tbody><tr><td class="location" style="text-align:left"></td><td class="timestamp" uts="0.0" style="text-align:right">Thu 01 Jan 1970 01:00:00 AM </td></tr></tbody></table></div><div class="annotation" genre="" hash="effc778b569b4d4f5e91f9f9390db3fb" location_sort="000107" reader="Kindle" style="margin:0 0 0.5em 0"><table cellpadding="0" width="100%" style="background-color:LightGray;color:black;font-size:75%;margin:0em;" color="Gray"><tbody><tr><td class="location" style="text-align:left">107</td><td class="timestamp" uts="1546953341.0" style="text-align:right">Tue 08 Jan 2019 01:15:41 PM </td></tr></tbody></table><p class="highlight" style="margin:1.4em;">Yet as one focused more and more on</p><p class="highlight" style="margin:1.4em;"></p></div><div class="annotation" genre="" hash="3af51fd8d02d27badd3fd136954b401a" location_sort="000107" reader="Kindle" style="margin:0 0 0.5em 0"><table cellpadding="0" width="100%" style="background-color:LightGray;color:black;font-size:75%;margin:0em;" color="Gray"><tbody><tr><td class="location" style="text-align:left">107</td><td class="timestamp" uts="1546953360.0" style="text-align:right">Tue 08 Jan 2019 01:16:00 PM </td></tr></tbody></table><p class="note" style="font-size:100%;margin:2.0;">Test pw3</p></div><div class="annotation" genre="" hash="d26505e0ef20b83445da8b818a22aa6d" location_sort="000585" reader="Kindle" style="margin:0 0 0.5em 0"><table cellpadding="0" width="100%" style="background-color:LightGray;color:black;font-size:75%;margin:0em;" color="Gray"><tbody><tr><td class="location" style="text-align:left">585</td><td class="timestamp" uts="1547130087.0" style="text-align:right">Thu 10 Jan 2019 02:21:27 PM </td></tr></tbody></table><p class="note" style="font-size:100%;margin:2.0;">Test 4</p></div><div class="annotation" genre="" hash="a3e516f69ae32f438c69754591e07d6d" location_sort="000585" reader="Kindle" style="margin:0 0 0.5em 0"><table cellpadding="0" width="100%" style="background-color:LightGray;color:black;font-size:75%;margin:0em;" color="Gray"><tbody><tr><td class="location" style="text-align:left">585</td><td class="timestamp" uts="1547130088.0" style="text-align:right">Thu 10 Jan 2019 02:21:28 PM </td></tr></tbody></table><p class="highlight" style="margin:1.4em;">“You’re an orphaned Solaran, from a remote village. You never knew your parents</p></div><div class="annotation" genre="" hash="d41d8cd98f00b204e9800998ecf8427e" location_sort="000668" reader="Kindle" style="margin:0 0 0.5em 0"><table cellpadding="0" width="100%" style="background-color:LightGray;color:black;font-size:75%;margin:0em;" color="Gray"><tbody><tr><td class="location" style="text-align:left">668</td><td class="timestamp" uts="1547130019.0" style="text-align:right">Thu 10 Jan 2019 02:20:19 PM </td></tr></tbody></table></div><div class="annotation" genre="" hash="e3831d52875ce264452abbe64cd38f25" location_sort="000696" reader="Kindle" style="margin:0 0 0.5em 0"><table cellpadding="0" width="100%" style="background-color:LightGray;color:black;font-size:75%;margin:0em;" color="Gray"><tbody><tr><td class="location" style="text-align:left">696</td><td class="timestamp" uts="1546953380.0" style="text-align:right">Tue 08 Jan 2019 01:16:20 PM </td></tr></tbody></table><p class="highlight" style="margin:1.4em;">had started innocently enough. He woke</p><p class="highlight" style="margin:1.4em;"></p></div><div class="annotation" genre="" hash="3d0c1f344cc2b4f4a5985bcb43206194" location_sort="000696" reader="Kindle" style="margin:0 0 0.5em 0"><table cellpadding="0" width="100%" style="background-color:LightGray;color:black;font-size:75%;margin:0em;" color="Gray"><tbody><tr><td class="location" style="text-align:left">696</td><td class="timestamp" uts="1546953398.0" style="text-align:right">Tue 08 Jan 2019 01:16:38 PM </td></tr></tbody></table><p class="note" style="font-size:100%;margin:2.0;">Test ch3</p><p class="note" style="font-size:100%;margin:2.0;"></p></div></div>

I would like to use the PW3 rather than the Kobo H2O as the source selection is FAR faster and more reliable, though at least the trick of the SD card has sorted the Kobo. I read 1/7th of the book last night and the notes add up to 97 pages on the Kobo, fortunately the Chapter txt is OK. Except sometimes the selection takes 3 sec to appear when you lift finger time before you can tap to add note. Even making the selection is massively slower on Kobo than PW3 The Kobo must have also frozen half a dozen times (start selection in last 1/3 of line and try to select 1st 1/3rd of next line often "freezes" it), closing sleep cover for 15s and reopen fixes it.
So I was proofing about 6 hrs last night. It's for the author of ONBD, not myself in this case.