Amazon removed books from my Kindle

[Quoth]

BTW, it's 5.16.2.1.1 and the most ghastly yet, but I rarely ever use a Kindle now.
I don't know what the other PW3 has as it's gone flat. The ancient Sony PRS-350 is very much less likely to be flat.

[arturg]

Has anyone been able to provide Kindle logs to those who try to debug this issue on this thread?

[Fbone]

I have the logs but don't know how to get them from Kindle to Mobileread.

[arturg]

Originally Posted by Fbone

I have the logs but don't know how to get them from Kindle to Mobileread.

You would probably want to place them on google drive on a folder that you would then share and place the link here?

[DNSB]

Originally Posted by Fbone

I have the logs but don't know how to get them from Kindle to Mobileread.

I'd suggest packing the all_system_logs_as_of_*.txt file into a .zip file and attach it to a message here unless someone knows of any security reasons not to do so. There does not seem to be any username/password/etc. in my sample of the file.

[j.p.s]

Originally Posted by Fbone

I have the logs but don't know how to get them from Kindle to Mobileread.

Originally Posted by arturg

You would probably want to place them on google drive on a folder that you would then share and place the link here?

Originally Posted by DNSB

I'd suggest packing the all_system_logs_as_of_*.txt file into a .zip file and attach it to a message here unless someone knows of any security reasons not to do so. There does not seem to be any username/password/etc. in my sample of the file.

DNSB's suggestion is far better for sharing with the mobileread community.

If that isn't acceptable, then it would be best to work something out with jhowell.

[JSWolf]

It's been not long after a week since my PW3 has WiFi turned on. I'll turn on WiFi tomorrow and see if any of my side loaded books get lost.

[Sirtel]

Originally Posted by JSWolf

It's been not long after a week since my PW3 has WiFi turned on. I'll turn on WiFi tomorrow and see if any of my side loaded books get lost.

I don't think that's enough time. I would wait for a month, at least. Unfortunately I no longer have a modern Kindle to experiment on, only two ancient ones. They're slow, so it would be a pain to experiment with them.

[Fbone]

Here are my Kindle logs.

[arturg]

It seems like some kind of deletion is happening:

240207:172118 KindleContentDownloadManagerApplication: [5859] [TransportAdaptor:INFO] Invoking tododownload
240207:172118 KindleContentDownloadManagerApplication: [5859] [ContentDownloadManager:INFO] Starting DownloadContent
240207:172118 KindleContentDownloadManagerApplication: [5859] [TransportAdaptor:INFO] Feature is ON for experiment - EINK_YJFF_PROGRESSIVE_DOWNLOADS_297815
240207:172118 KindleContentDownloadManagerApplication: [5859] [ContentDownloadWorker:INFO] starting enqueue download thread.
240207:172118 powerd[3003]: I def:ipc_event_cb:Handling usb hal event = wanRing:
240207:172118 tmd[3034]: I conutils:shortcutEnsureCon::Using cached result for connection request
240207:172118 tmd[3034]: I conutils:queueEnsureConnection::returning cached result
240207:172118 tmd[3034]: I lipc_cb_cmd:Connect event received:event = 0:
240207:172118 tmd[3034]: I defer_active:redeferring:id=135,was=WAITING,wasby= NOTHING,now=DEFERRED,defby=HIGHER_PRIORITY_REQUEST ,qpos=9 of 130,pri=1600,toppri=110:
240207:172118 tmd[3034]: W get_resp_body:fopen_err:id=135,status=DEFERRED,res p=-1,errno=No such file or directory (2):
240207:172118 tmd[3034]: I sendstatus:server_said:id=135,code=-1,status=DEFERRED,body=" ¯\_(ツ)_/¯ ":
240207:172118 phd[3189]: I lipc_cb:noted_tphrigin=4 (UDP_TPH):
240207:172118 phd[3189]: I udp_tphv3:TPH_received:type=UDP_TPH,expected_type= UDP_TPH,mcc=0,mnc=0,last_pkt_seen_before=0:
240207:172118 phd[3189]: I udp_tphv3:acking_tph::Sending ACK
240207:172118 todo[2990]: W todo:ScheduleToDoIgnored:reason=todoAlreadyInProgr ess:Ignoring scheduling ToDo, already in progress
240207:172118 todo[2990]: I def:malloc_trim::start
240207:172118 todo[2990]: I def:malloc_trim:ret=1:end
240207:172118 cvm[5380]: I ContentToDoHandler:Information::CC lookup failed. Retrying with no GUID.
240207:172118 cvm[5380]: I ReaderSDKImpl:Information::Successfully deleted content
240207:172118 cvm[5380]: I ReaderSDKImpl:Information::Processing remove item
240207:172118 cvm[5380]: I AbstractSyncController:Information::Successfull dataset upload <private>
240207:172118 cvm[5380]: I AbstractSyncController:Information:: Upload list of dataset: syncStatus true
240207:172118 todo[2990]: I todo:ProcessingToDoItem:id=archive,topic=archive.s ync:
240207:172118 ADM[12750]: D HttpClient: Making request to https://device-messaging-na.amazon.com/GetMessages
240207:172118 archive[2987]: I archive:ProcessArchivedItemsToDo:status=processing ,id=archive,topic=archive.sync,processingReason=SP H,currentStatus=0:Processing archive items from ToDo
240207:172118 archive[2987]: I archive_lipc:isDeviceInFreeTimeMode:isFreeTimeMode =0:
240207:172118 cvm[5380]: I conutils:shortcutEnsureCon::Using cached result for connection request
240207:172118 KindleContentDownloadManagerApplication: [5859] [ClientDataGenerator:INFO] Generating Client details
240207:172118 ADM[12750]: I Main: Received TPH event: wanRing.
240207:172118 scan[5858]: I libload:loaded:glob=*.azw3,ep=load_mobi8_extractor :
240207:172118 scan[5858]: I NATIVE:dlopen:so=/usr/lib/ccat/libmobi8extractorE.so:loaded
240207:172118 scan[5858]: I extract_util:getSilentDeleteIndicatorFilePath : ::File does not exist or cannot form path
240207:172118 KindleContentDownloadManagerApplication: [5859] [UpdateMetadata:INFO] Metadata File does not exists for new book download exiting without reading
240207:172118 KindleContentDownloadManagerApplication: [5859] [ContentDownloadWorker:INFO] enqueue download for asset: 1976613628

[John F]

Originally Posted by arturg

It seems like some kind of deletion is happening:

I think Marge Gunderson would agree with you.

[Comfy.n]

Originally Posted by arturg

It seems like some kind of deletion is happening:

Silent deletion

[jhowell]

Originally Posted by Fbone

Here are my Kindle logs.

There are several interesting things in those logs.

The system log starts out on June 9, 2021 and goes up to November 15 of that year before reverting back to midnight on May 1, 2021. The clock being off by that much along with the backwards jump probably indicates multiple occurrences where the Kindle's battery ran down completely, resetting the internal clock. The clock advances again to May 3, 2021 and then changes suddenly to February 7, 2024 once it connects to Amazon.

The Kindle is running firmware version 5.13.7 which was released in 2021. As far as I know the book deletion problem started happening in 2023. So it seems that the change causing books being deleted probably occurred on Amazon servers rather than in the Kindle firmware.

I am not certain what exactly in the log corresponds to the deletion of books. The most likely is the pair of entries that occurs 16 times in the log:

cvm[5380]: I ReaderSDKImpl:Information::Processing remove item
...
cvm[5380]: I ReaderSDKImpl:Information::Successfully deleted content

Also suspicious are 24 occurrences of:

archive[2987]: I archive:ProcessArchiveItem:status=success,cdeKey=<private>,cdeType=EBOK,title=<private>,action=delete:Successfully processed archive item

I do not see any identification of which specific books were deleted and what triggered the deletion to occur.

I will continue to examine the logs. However at this point I do not expect to find anything that could be useful in pinpointing the exact cause or preventing this type of deletion from occurring in the future.

[BlackQueenKnight]

Processing archive items... Something to do with Quick Archive auto triggering if you haven't connected to the servers in the timeframe you have it set at, or perhaps shenanigans with Personal Document Archiving?

Been going over some threads after booting up my paperwrite the first time after about a year and trying to figure out what happened, so I stumbled across the thread. Didn't realize it was sort of a use or lose it situation when adding stuff to the Kindle. So annoying...

[arturg]

It would be interested to see if this behavior would persist if Calibre would mark the side loaded books as documents instead of books.