Question about the "whispersync" file from AMazon user data

[Rellwood]

Ok, I don't know if anyone here can answer this question, but here goes.

I got my user data from Amazon and among the over 100 zip files, there is one titled whispersync.csv

This file is a goldmine of activity since 2014. Actually, it's only worth the most recent reads, but regardless, I am wondering if someone here can help me translate the file.

The headers are as follows:

Asin Annotation Type Customer modified date on device DSN ContentType Format Creation Date LastUpdatedDate Highlight Version Selection Type Note Is Deleted


The annotation types are:
kindle.last_read
kindle.most_recent_read
kindle.continuous_read
audible.bookmark
audible.last_heard
audible.note
kindle.bookmark
kindle.highlight
kindle.last_read
kindle.most_recent_read

Then the format types are
MOBI7
MOBI8
YJBINARY
AAX_22
AAX_22_32

The date/time is listed as follows
Thu Apr 14 05:17:55 UTC 2016

Now I am trying to figure out how to interpret these values.

The annotations regarding the read times, most recent, and last read don't make sense. Don't they mean the same thing? I am looking at the list and for the most part I can tell if I haven't read a book, but only opened it because the date/times are the same, but there are sometimes multiple "last read" and "recent read" times for the same book (read it multiple times).

Does anyone have any idea of what these mean?

[ApK]

Originally Posted by Rellwood

The annotations regarding the read times, most recent, and last read don't make sense. Don't they mean the same thing?

I'm speaking only from interpreting the language of your post, not from any actual knowledge of the data, so take it for what it's worth. It seems to me that "last read" would be the furthest you've read, while most recent would be where you most recently left it. E.g., read to page 10, then go back and read page 2, then last read is 10, most recent is 2. That would also mean that "last read" is what drives the "The furthest you've read on any device is...do you want to continue from there?" message, and "most recent" is where it picks up if you say "no." Does that seem to fit?


ApK

[Rellwood]

I would think that is the way, but the last read, and most recent read are both date/time data and not number data.

Maybe the last read is the last time I completed reading the book and most recent read is the most recent time I opened the book. There are date/times for created and last updated and most recent read.

There is only one way to manage this list and it's taking me forever to do it.
I have to separate each annotation type, and each format type.

It is a daunting list of over 10,000 entries and it includes every kindle Unlimited, Send to Kindle Doc and even audio books.

It lists every note (and the actual notes have their own column), highlight (what color I used) and bookmark. However, those bits of data are only given as a date/time and not a location. However, the created time, updated time, and most recent read info pertain to the dates/times of cretation and editing of said bookmark/highlight/note. It even shows the deleted ones by indicating if the annotation has been delted (t/f) - even audio clips get a column.

My goal is simple, but complicated. I want to break this list into understandable columns to import into Calibre for each book. I am having a hard time trying to figure out how to do this. The only thing I can think of right now is to just break each list down by format, annotation, and read-creation-edit date/time columns. So complicated.

I should just give up, but - I can't

LOL - if you have your own kindle/amazon you should get this data too!

Thanks for your help!

[Popup]

Fascinating.

Is there an easy way of getting hold of this?

Googles TakeOut is pretty nifty, but last time I tried to get hold of my data from Facebook it was a nightmare.

[Rellwood]

Originally Posted by Popup

Fascinating.

Is there an easy way of getting hold of this?

Googles TakeOut is pretty nifty, but last time I tried to get hold of my data from Facebook it was a nightmare.

Hi,

this link should take you to the export your data request page, but be warned, it will take a few days to a few weeks for them to email you the link to the results.

ALso, it's a HUGE export of some 200 individual zip files, so be prepared (I have my browser to automatically save zip files to a specific folder that I have named in preparation of this).

Also, the files are pretty much all .csv except for the emails, which are whatever the Microsoft email file is and all the "owned books" are .json files. However, you really have to do some extrapolating and have good excel (an excel addons) to make the file into anything importable into Calibre or any other user database that can make sense of it.

https://www.amazon.com/gp/privacycen...r/preview.html

[Popup]

Thanks!
That looks intriguing.