|
|||||||
![]() |
|
|
Thread Tools | Search this Thread |
|
|
#1 |
|
Zealot
![]() Posts: 123
Karma: 10
Join Date: Dec 2010
Location: United States
Device: iPad Mini; iPhone; Kindle Paperwhite (10th gen)
|
difficulties encountered recovering annotations and highlights
Since my device got totally wiped (thanks Amazon!), I have been trying to find a way to recover my lost annotations and highlights.
I was able to recover most of the files on my device using file recovery software, but then came to realize some of the files are corrupted and cannot be used. I am doing my best to reassemble the books and their accompanying SDR folders. This is a very time consuming task because for whatever reason all the azw3r and azw3f files have long strings of letters and numbers attached to the book title like 33443jh342424h23h42gv. If I drop those in an SDR folder with the book, the Kindle cannot find the the SDR files because the names don't match. So I need to delete all of those added numbers and letters to make the file names match so my Kindle can find them and display the highlights and annotations. The good news is I have been successful in recovering some of my annotations to my device this way. The bad news is that I can't find any way to export them off of my device. I have been using the Kindle Reader Dashboard plugin for Calibre, which was recommended to me here. The dashboard registers the annotations, and gives me information about them, but does not offer me a way to export them to my computer. also, even though my Kindle lets me access these highlights and annotations on the device when I open a book, I notice it does not add them to the "my clippings" file. It's like they are all stuck in some weird limbo. I tried Kindle Mate software, but it does find the annotations for any of my recovered books, I assume because the only place it looks is in the "my clippings file," and my device is not adding them there. Is there any software that can export annotations directly from the azw3r files, instead of relying on the "my clippings" file? Or are all my recovered highlighted passages and annotations permanently trapped on my device? It's already taking so much time just to recover the files. I can't imagine how much longer it's going to take if I have to manually go through each ebook and find the annotations and type them all in myself. By the way, I also just jailbroke my device for the first time (wish I had done this before my Kindle decided to reformat itself) - so if there is some option that might enable me to do what I need to do not available for a standard device that would work on a jailbroken on, I should now be able to do it. Last edited by sovre; 11-06-2026 at 01:18 AM. |
|
|
|
|
|
#2 |
|
Wizard
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 1,216
Karma: 12360292
Join Date: Feb 2010
Location: Serbia
Device: Kindle PW5, Kobo Libra 2, Kindle PW1
|
MyClippings.txt file is just a simple historical log file of events that get raised when user does something using the UI. It's one way, it doesn't "sync" ( = removing highlight in the UI doesn't remove already existing "record" from that file). So you can't expect it to "repopulate" clippings file from old notes stored in SDR folder. Only new bookmark / highlight / note that you were to create now would get written into clippings file (if you Kindle still uses firmware file that still creates it, since IIRC that was recently removed?).
As for extracting the text you highlighted and notes text your best bet would probably be to ask very nicely the developer of that Kindle Reader Dashboard plugin to add export functionality. Of that's not an option you will probably need at least some basic knowledge of programming & scripting to do the extraction yourself. Either by snooping around and figuring out how (maybe inside a SQLite database?) that plugin stores the notes it imported and writing the code to extract the information yourself. Or alternatively try and use multiple existing scripts to do the job. IIRC you would need to use this to decode information stored in SDR folder into JSON output and then use another script written by @j.p.s to extract the actual highlighted text based on offsets in that previous JSON output? |
|
|
|
|
|
#3 |
|
Zealot
![]() Posts: 123
Karma: 10
Join Date: Dec 2010
Location: United States
Device: iPad Mini; iPhone; Kindle Paperwhite (10th gen)
|
Thanks for your reply Shaman. Unfortunately I have no knowledge of programming at all, even basic knowledge, so I am pretty much stumbling lost here.
I did, however, discover something that at least looks promising on the github page for the kindle reader dashboard. On the page it says this: To produce highlight files directly, no dashboard: python azw3text/assemble_azw3_text.py BOOK.azw3 # -> BOOK.dat (full book text) python azw3text/extract_highlights.py BOOK.azw3 # -> BOOK.highlights.md So apparently it is possible to produce the highlights, it's just that I don't know how to make use of that information. Where do I need to input those commands in order to export highlights for a book? Any guidance you could give me would be appreciated, as I have no idea what I'm doing here! |
|
|
|
|
|
#4 |
|
Grand Sorcerer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 6,129
Karma: 107552269
Join Date: Apr 2011
Device: pb360
|
Did you try viewing your highlights directly in Kindle Reader Dashboard?
|
|
|
|
|
|
#5 |
|
Zealot
![]() Posts: 123
Karma: 10
Join Date: Dec 2010
Location: United States
Device: iPad Mini; iPhone; Kindle Paperwhite (10th gen)
|
JPS, unfortunately kindle reader dashboard doesn't show highlights directly in the dashboard, just positions - it seems to be a limitation of the software. Based on what the developer says on the github page, there are ways to exact them, but they require a little more technical knowledge than I have, soI have been unable to figure out on my own what I need to do next.
The github page has this information provided by the developer ( I am trying to figure out how to use the second option, "produce highlights directly, no dashboard" because it seems like the simplest option, since it doesn't require installing any extra software. I just don't know where to enter the commands. I wish there was a video tutorial or something like that.): Highlight text (opt-in) Highlights are stored as positions only. To show the actual highlighted text, the book's text has to be assembled from the .azw3 (your own DRM-free copy). Set KRD_ASSEMBLE_AZW3=1 and the sync step will, for every book that has highlights and an unencrypted .azw3 within reach, assemble and cache its text (books without highlights are never fetched). Needs KindleUnpack — see azw3text/ for setup. KRD_ASSEMBLE_AZW3=1 python reader-dashboard/dashboard.py serve KRD_ASSEMBLE_AZW3=1 python reader-dashboard/dashboard.py serve --local D:/documents Or produce highlight files directly, no dashboard: python azw3text/assemble_azw3_text.py BOOK.azw3 # -> BOOK.dat (full book text) python azw3text/extract_highlights.py BOOK.azw3 # -> BOOK.highlights.md Command-line scripts (no dashboard) The reading-metadata/scripts/ folder has standalone CLI tools: python reading-metadata/scripts/krds.py <sidecar> # decode one sidecar to JSON python reading-metadata/scripts/reading_stats.py D:/documents # per-book time + pace table + CSV python reading-metadata/scripts/page_history.py D:/documents # reading sessions / timeline python reading-metadata/scripts/export_annotations.py D:/documents # highlights/notes -> CSV python reading-metadata/scripts/dump_sidecars.py D:/documents # decode every sidecar to JSO Last edited by sovre; 11-14-2026 at 03:50 PM. |
|
|
|
![]() |
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| copying annotations/highlights | franklekens | Kobo Reader | 6 | 08-11-2020 02:50 AM |
| recovering annotations from damaged Aura | rmarhi | Kobo Reader | 3 | 12-03-2019 05:06 PM |
| Clara HD Highlights/Annotations trasnfer to PC | pavelh | Kobo Reader | 34 | 02-07-2019 09:00 AM |
| Make annotations and highlights | Cjammi | Calibre | 5 | 03-07-2017 03:00 PM |
| Highlights, annotations etc. | Kumabjorn | Calibre | 0 | 02-10-2014 08:40 AM |