Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Readers > Amazon Kindle

Notices

Reply
 
Thread Tools Search this Thread
Old 07-28-2017, 01:21 PM   #1
Benjam
Junior Member
Benjam began at the beginning.
 
Posts: 1
Karma: 10
Join Date: Jul 2017
Device: Kindle voyage (2017)
Extract notes from "My Clippings.txt"

Hello,

I've read a lot about the export of notes and highlights in a Kindle (I’ know softwares like Clippings.io, Bookcision, Calibre) .
I know that I can find my notes online with Amazon but I would like to extract them directly from the text file « My Clippings.txt ». In fact this file is kind of a backup file, so when I change my note a new item is created and is not replaced with the original note (and I don’t have a way to know when a note is delete, in that file).

To bypass this problem I’ve found the internal file (*.yjr or .mbp1, depends on the book) that stores actuals highlights and notes. My idea was to match all the notes of My Clippings with the internal file of each book in order to know which file has been deleted (and kept)

But, Kindle uses two types of localisation for the notes : in the Clippings file it’s indicate the location and in the .yjr file it’s indicate a number (I guessed that was the number of word but at least it was not) : « [annotation.personal.note] [ASwAAAAvCwAA: 21660] ». And without the equivalent of these location I can’t know which highlights I’ve kept.

So, is someone know what is the number in the .yjr file and what is the equivalent with the locations.

Thanks for your help

Ps: I code something to execute this job, so I will not do it myself
Benjam is offline   Reply With Quote
Advert
Old 07-28-2017, 01:45 PM   #2
knc1
Analog Forever!
knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.
 
knc1's Avatar
 
Posts: 15,589
Karma: 17105749
Join Date: Feb 2012
Location: Central Texas
Device: No K1, PW2, KV, KOA
Quote:
[annotation.personal.note] [ASwAAAAvCwAA: 21660]
It looks like a byte displacement transliterated into Klingon.

= = = =

Seriously -
Search the "Kindle Developer's" sub-forum of this one.
I recall people have already dealt with the question(s) you ask. You should be able to find threads and posts with the information you need.
knc1 is offline   Reply With Quote
Old 07-28-2017, 04:21 PM   #3
jhowell
Wizard
jhowell ought to be getting tired of karma fortunes by now.jhowell ought to be getting tired of karma fortunes by now.jhowell ought to be getting tired of karma fortunes by now.jhowell ought to be getting tired of karma fortunes by now.jhowell ought to be getting tired of karma fortunes by now.jhowell ought to be getting tired of karma fortunes by now.jhowell ought to be getting tired of karma fortunes by now.jhowell ought to be getting tired of karma fortunes by now.jhowell ought to be getting tired of karma fortunes by now.jhowell ought to be getting tired of karma fortunes by now.jhowell ought to be getting tired of karma fortunes by now.
 
jhowell's Avatar
 
Posts: 1,847
Karma: 18399962
Join Date: Nov 2011
Location: Florida
Device: Oasis 2, iPad Air 2, Nexus 7
Here is some background information that may be useful for your project.

The "My Clippings.txt" file relates notes and highlights to "locations" within the book. These are approximate references, but have the advantage of being independent of the book format.

For internal use the Kindle needs to know the start and end positions of notes and highlights to the exact character. There are different methods for resolving these positions based on the format of the book.

For the original MOBI/AZW format the position number is an offset within the raw HTML content of the book. You can divide the offset by 150 and add one to produce the equivalent location number.

For KF8/AZW3 it is more complicated. There is an internal record (DATP) that can be used to translate from position/offset to location number. DATP has a header and two tables. The second table gives the number of raw HTML bytes for each location. Add them up successively to derive the offset that is equivalent to each location.

For books in KFX format there is no raw HTML. Position numbers are mapped to text using internal tables. You would have to break a lot of new ground to correctly map positions to locations for that format.

Good luck.

Last edited by jhowell; 07-28-2017 at 08:57 PM.
jhowell is offline   Reply With Quote
Reply

Tags
extract, locations, mbp1, note, yjr

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
How to extract all images in "Edit Book"? FatalFrame Editor 5 06-12-2017 12:05 AM
Getting highlights on personal docs from Kindle apps onto Kindle's "My Clippings.txt" jollino Amazon Kindle 4 02-25-2014 01:30 PM
Manipulate "My Clippings" through command line Aeris Kindle Developer's Corner 14 10-17-2013 03:08 PM
Where are my "Clippings"/Highlights on Kindle iOS app ? tado Amazon Kindle 0 11-15-2012 07:51 PM
"Exceeded" Allowable Clippings for a Book catsongs Amazon Kindle 37 07-08-2011 10:46 AM


All times are GMT -4. The time now is 11:48 PM.


MobileRead.com is a privately owned, operated and funded community.