![]() |
#1 |
Going Viral
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 17,212
Karma: 18210809
Join Date: Feb 2012
Location: Central Texas
Device: No K1, PW2, KV, KOA
|
PW-3, FW-5.6.1.1, WiFi and OTA updates
Note that these findings **might** apply to only the combination mentioned in the title.
Although they are what are expected for any 5.6.x firmware. ![]() Note: This Kindle is not (yet) registered with my Amazon account. I.E: Leaving your Kindle un-registered will NOT protect you from OTA updates. I can't connect via WiFi to my local network without a connection to the Internet Connect Kindle to PC with USB cable - At the top of the USB mass storage file system tree (where the 'documents' folder is at) - Enter the file named: WIFI_NO_NET_PROBE All capitals, no extension, no contents. Be certain if using an O.S. on your PC that hides well known extensions that the file **really, really** does not have an extension! Now your Kindle can connect to your local network even when your local network does not have a connection to the Internet. Credits: https://www.mobileread.com/forums/sho...d.php?t=199951 - - - - Blocking OTA updates Ok - next, enable connection to the Internet from your local network. Note: You must eject from mass storage mode so the Kindle has access to the USB storage area. Watch lights blink for awhile (there will be some bursts while the Kindle connects to Amazon and transfers your recent logs) - Then after the communication lights have held steady for awhile - Disrupt things by switching into airplane mode. Note, you may have to tap the 'sync and check for new items' settings option to trigger things. Note, there is a re-try counter on the OTA updater so it doesn't get hung in a failing download loop - so you have to capture this information on the first try (of the day). Reconnect the USB cable and discover (attachment 1). A PW-3 on 5.6.1.1 is really hungry for a copy of 5.6.5 ![]() Delete the partially downloaded update file and create a directory of the same name. See attachment 2. Eject the Kindle storage, remove the USB cable, allow it to access the network again for a short while. Then: home -> search -> ;dm (the semi-colon is part of the command: "dump messages") **NOW** re-connect the USB cable so you can access user storage again. In the system logs (which you just created) you will find things like this: Code:
151019:152149 tmd[2525]: I def:malloc_trim:ret=1:end 151019:152149 tmd[2525]: I tq_mh:memory_reclaimed_trim:before=6952, after=6940, reclaimed=12: 151019:152149 OTAController[2489]: I ReleaseNotesDownloaderImpl:download:release notes already downloaded: 151019:152149 OTAController[2489]: E OSDownloaderImpl:updateDownloadCountExceeded:Failed to load conf file:Error:No such file or directory 151019:152150 tmd[2525]: I request_download:received:id=203,pri=1800,pc=,net=wifi,at=152150.80: 151019:152150 tmd[2525]: W qmgr:fopen_to_write:id=203,path=---,err=Is a directory(21): 151019:152150 tmd[2525]: I conutils:conEnsureConnectionInternal::setting cmd property 151019:152150 cmd[2472]: I def:req::Got a connection request:~: 151019:152150 tmd[2525]: I start_transfer:starting:id=203,dir=down,pri=1800,qpos=0 of 1,net=wifi,on=wifi,was=WAITING,try=1,ceh=0x43a70ce0: 151019:152150 rcm_main[2487]: I refreshcache:tryRefreshCacheRun:status=16:Unable to lock mutex 151019:152150 tmd[2525]: I conutils:conEnsureConnectionResponse::response=0 ***** 151019:152150 tmd[2525]: E qmgr:fopen_to_write:id = 203, path = ---, err = Is a directory (21): ***** (oh too bad, sorry about that) 151019:152150 tmd[2525]: W metrics:sync_error:id = 203 last=(tmd) recent start transfer (10),curr=(tmd) data end (19): 151019:152150 tmd[2525]: I end_transfer:FAILED:id=203,dir=down,pri=1800,net=wifi,on=wifi,curl=0,err=8,srv=200,try=1,resumes=0,declines=0,flags=515,mm=resolving,did=-1 (0+-1) of -1: 151019:152150 tmd[2525]: I rate_stats1:FAILED:id=203,t1_tmdreq=@152150.80,t2_enq=3ms,t3_actv=3ms,t4_hprt1=0ms,t5_hprt=@152150.81,t6_hpet1=7ms,t7_hpet=@152150.82,t8_start1=@152150.82,t9_start=@152150.82,t10_start=0ms,t11_work=0ms,t12_dns=0ms,t13_conn=0ms,t14_ssl=0ms,t15_reqsent=0ms,t16_respst=0ms,t17_eoh=0ms,t18_dstart=0ms,t19_dend=65ms,t20_end=@152150.88,try=1: 151019:152150 tmd[2525]: I rate_stats2:FAILED:id=203,session_time=65ms,chunk_time=65ms,chunk_len=-1 of -1,adj_len=-1,session_rate=0 B/sec,chunk_rate=0 B/sec,overall=0s,active=0s,lost=0s,type=(unknown),start_wss=-1,end_wss=-1,c1_redir=0ms,c2_dns=0ms,c3_conn=0ms,c4_ssl=0ms,c5_pret=0ms,c6_dstart=0ms,c7_dend=0ms,c8_total=0ms,try=1,mcc=,mnc=: ***** 151019:152150 tmd[2525]: I moreinfo:FAILED:id=203,curl=0 "No error",err=8 (The local file path is on a currently inaccessible filesystem): ***** (Kindle can't access USB storage while its in use by the pc) 151019:152150 OTAController[2489]: E OSTransferListenerImpl:onProgress:transferFailed:error_code=8 151019:152150 tmd[2525]: I obliterate:request_received:id=203: 151019:152150 tmd[2525]: I end_transfer:FAILED:id=203,dir=down,pri=1800,net=wifi,on=wifi,curl=0,err=8,srv=200,try=1,resumes=0,declines=0,flags=515,mm=resolving,did=-1 (0+-1) of -1: 151019:152150 tmd[2525]: I rate_stats1:FAILED:id=203,t1_tmdreq=@152150.80,t2_enq=3ms,t3_actv=3ms,t4_hprt1=0ms,t5_hprt=@152150.81,t6_hpet1=7ms,t7_hpet=@152150.82,t8_start1=@152150.82,t9_start=@152150.82,t10_start=0ms,t11_work=0ms,t12_dns=0ms,t13_conn=0ms,t14_ssl=0ms,t15_reqsent=0ms,t16_respst=0ms,t17_eoh=0ms,t18_dstart=0ms,t19_dend=65ms,t20_end=@152150.88,try=1: 151019:152150 tmd[2525]: I rate_stats2:FAILED:id=203,session_time=65ms,chunk_time=65ms,chunk_len=-1 of -1,adj_len=-1,session_rate=0 B/sec,chunk_rate=0 B/sec,overall=0s,active=0s,lost=0s,type=(unknown),start_wss=-1,end_wss=-1,c1_redir=0ms,c2_dns=0ms,c3_conn=0ms,c4_ssl=0ms,c5_pret=0ms,c6_dstart=0ms,c7_dend=0ms,c8_total=0ms,try=1,mcc=,mnc=: 151019:152150 tmd[2525]: I moreinfo:FAILED:id=203,curl=0 "No error",err=8 (The local file path is on a currently inaccessible filesystem): 151019:152150 rcm_main[2487]: I refreshcache:trySortClients:status=16:Unable to lock mutex 151019:152150 OTAController[2489]: W TransferStatusProcessorImpl:handleTransferStatusFailed:transfer_id=203:TransferListener not found, not calling onProgress Last edited by knc1; 10-20-2015 at 08:37 AM. |
![]() |
![]() |
![]() |
#2 |
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 95
Karma: 1699999
Join Date: Aug 2015
Device: Voyage
|
Good stuff. I'll definitely test this once the new update drops.
|
![]() |
![]() |
Advert | |
|
![]() |
#3 |
Going Viral
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 17,212
Karma: 18210809
Join Date: Feb 2012
Location: Central Texas
Device: No K1, PW2, KV, KOA
|
Transfer priorities
The transfer managing daemon handles prioritized transfers.
The lower number is serviced first: Spoiler:
Books on-order are transfered with PRI=600 Spoiler:
Updates are transfered with PRI=1800: Spoiler:
There are a surprising number of things being transfered, and many of them use different priorities than these two shown. The transfer manager is running multiple, concurrent, transfers (in both directions at times). Its a pretty sophisticated daemon. = = = = Almost bottom line - The system will **usually** download your books before downloading a pending update. **usually** If there is an available thread and no higher priority transfers **to start** (even though the higher priorities have not yet completed), it will start downloading the pending update. Bottom line - Even War and Peace (I have a Kindle copy) is smaller than an update. Your book downloads should beat the update download, even if they run concurrently (which they can). But that is not a guarantee. If your book is on a very slow server in the Amazon cluster - and Your update is on a very fast server in the Amazon cluster - Your screwed. So side-load your books. Last edited by knc1; 10-27-2015 at 05:23 PM. |
![]() |
![]() |
![]() |
#4 |
Ex-Helpdesk Junkie
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 19,421
Karma: 85397180
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
|
Or at least, only connect for less time than it takes an update to download -- and if that book doesn't download, bail the heck out and just sideload it.
Of course, as I said in the other thread, sideloading is a perfectly adequate solution, so why risk even marginal chances of getting hit by an OTA? It is a mere assumption (a fairly safe one, but still) that updates will continue to be in the hundreds of MB. |
![]() |
![]() |
![]() |
#5 |
Going Viral
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 17,212
Karma: 18210809
Join Date: Feb 2012
Location: Central Texas
Device: No K1, PW2, KV, KOA
|
One of the interesting things left behind on USB storage:
Code:
<?xml version="1.0" encoding="UTF-8"?> <response syncType="update" encryptedFionaAccountId="XXXXXXXXXXXXX"> <sync_time>2015-10-27T19:49:58+0000;softwareVersion:2634130033;SE:T;SC:F;ST:KB-15000000000054,Periodical-1445975398748,</sync_time> <annotation_sync_status>0</annotation_sync_status> <min_sync_metadata_request_interval>300</min_sync_metadata_request_interval> <min_todo_item_request_interval>300</min_todo_item_request_interval> <log_upload_status>0</log_upload_status> <collection_upload_interval_secs>45</collection_upload_interval_secs> <add_update_list/> <removal_list/> </response> |
![]() |
![]() |
Advert | |
|
![]() |
#6 |
Going Viral
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 17,212
Karma: 18210809
Join Date: Feb 2012
Location: Central Texas
Device: No K1, PW2, KV, KOA
|
My couple days of browsing log files (on a non-jailbroken PW-3) left me thinking that my Kindle was sharing a lot more information with Amazon than I like.
[rant] Not news, I have been upset since I posted my Chatty Kathy thread. [/rant] The browsing of log files plus using a disk forensics program on the USB storage area gave me a new "break it or fix it" idea. Some things are discovering if the USB storage area is writable by doing a test write to it, followed immediately by a delete of the test filename. Crude, but effective, at least until now. ![]()
Surprise, surprise, that does not break the Kindle. (I really thought it would). Things that are transferred by cvm still get transfered. **BUT** Things that are transferred by tmd (transfer manager daemon) are not transfered. tmd errors out with 'file system not writable' whenever it tries to setup a transfer (either upload or download). duh, stupid software. ![]() Enjoy your new privacy. The system no longer can upload your log files, reading metrics, ps-info on what processes are running, etc, etc, etc. BIG IMPORTANT NOTE Do not rely on this as your sole protection against OTA updates! At least not until people have a chance to test what this prohibits and what it allows. Just use this in addition to the other user storage entries mentioned in this thread. in honor of #83 83 Last edited by knc1; 10-28-2015 at 04:00 PM. |
![]() |
![]() |
![]() |
#7 |
Going Viral
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 17,212
Karma: 18210809
Join Date: Feb 2012
Location: Central Texas
Device: No K1, PW2, KV, KOA
|
Correction:
Books in your 'cloud' can still be downloaded, indexed, read, reading metrics remembered, last position remembered, dictionary look-ups performed. Not sure what else still works or what all has been blocked. I do know for certain that I haven't seen anything 'id=xxx', 'dir=up' in the logs from tmd yet. ![]() The Whispersync features are evidently all handled by cvm threads. |
![]() |
![]() |
![]() |
#8 |
Going Viral
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 17,212
Karma: 18210809
Join Date: Feb 2012
Location: Central Texas
Device: No K1, PW2, KV, KOA
|
Timestamp to Human
The conversion (in this example, 151027.000000 seconds, with TZ from the machine the command is being run on) is:
Code:
$ date -d @151027 +"%F %T %z" 1970-01-02 11:57:07 -0600 |
![]() |
![]() |
![]() |
#9 |
Going Viral
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 17,212
Karma: 18210809
Join Date: Feb 2012
Location: Central Texas
Device: No K1, PW2, KV, KOA
|
Mysteries - *.phl
Def: Popular HighLights
gzip'd xml, for instance: Code:
<popular update_id="9" timestamp="2015-10-13 04:15:46"> <content version="0" guid="CR!HPV0EY2C7H6FF41BF1QW7SKCD3MN:D8E1CE67" key="B00LODPL06" type="EBOK"> <annotation type="popular_highlight" num_users="8" end_pos="168009" start_pos="167442"/> <annotation type="popular_highlight" num_users="6" end_pos="244469" start_pos="244140"/> <annotation type="popular_highlight" num_users="16" end_pos="310510" start_pos="310231"/> <annotation type="popular_highlight" num_users="30" end_pos="310590" start_pos="310511"/> <annotation type="popular_highlight" num_users="35" end_pos="310993" start_pos="310591"/> <annotation type="popular_highlight" num_users="43" end_pos="311389" start_pos="311205"/> <annotation type="popular_highlight" num_users="5" end_pos="775936" start_pos="775857"/> <annotation type="popular_highlight" num_users="16" end_pos="1181296" start_pos="1181213"/> <annotation type="popular_highlight" num_users="31" end_pos="1181576" start_pos="1181422"/> <annotation type="popular_highlight" num_users="16" end_pos="1182514" start_pos="1182412"/> </content> </popular> |
![]() |
![]() |
![]() |
#10 |
Going Viral
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 17,212
Karma: 18210809
Join Date: Feb 2012
Location: Central Texas
Device: No K1, PW2, KV, KOA
|
Mysteries - *.asc
Def? Amazon Sales Code?
Minimized json, as in 'EndActions.data.<asin>.asc: PHP Code:
I don't see where the 'jbButtonVisible: true' entry goes, but maybe .... The timestamp is in ms: Code:
$ date -d @1445975397.394 +"%F %T %z" 2015-10-27 14:49:57 -0500 The image link is a nothing special (other than the escaping) http ref. link: (Served directly from the amazon image cloud server for your viewing pleasure.) ![]() Hmm... Now every view of this post will count as my hitting the 'end actions' panel. (Unless the Mobileread server is caching this lmage link, which it probably is.) Will be interesting to think of what their data mining routines think of all the sudden interest in this 'end actions' panel. ![]() Last edited by knc1; 10-29-2015 at 09:31 PM. |
![]() |
![]() |
![]() |
#11 |
Going Viral
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 17,212
Karma: 18210809
Join Date: Feb 2012
Location: Central Texas
Device: No K1, PW2, KV, KOA
|
Mysteries - *.asc
Def? Amazon Sales Code?
Minimized json. as in StartActions.data.<asin>.asc: PHP Code:
Next, see if this book chokes on an: "imageURL" : "file:\/\/mnt\/us\jb-script.sh" sort of entry. ![]() PS: This is a kf-8 not a kf-10 book, but its for-free in the Amazon store (Deep Crossing). Last edited by knc1; 10-29-2015 at 12:41 PM. |
![]() |
![]() |
![]() |
#12 |
Going Viral
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 17,212
Karma: 18210809
Join Date: Feb 2012
Location: Central Texas
Device: No K1, PW2, KV, KOA
|
Mysteries - *.asc
As in:
XRAY.entities.<asin>.asc This one is an SQlite3 database. |
![]() |
![]() |
![]() |
#13 |
Ex-Helpdesk Junkie
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 19,421
Karma: 85397180
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
|
New devices only (fw5.6.x)
Old devices still use json. Plenty of documentation on this in the X-Ray Builder application, if anyone is interested. |
![]() |
![]() |
![]() |
#14 | |
doofus
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 2,543
Karma: 13088847
Join Date: Sep 2010
Device: Kobo Libra 2, Kindle Voyage
|
Quote:
|
|
![]() |
![]() |
![]() |
#15 | |
Going Viral
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 17,212
Karma: 18210809
Join Date: Feb 2012
Location: Central Texas
Device: No K1, PW2, KV, KOA
|
Quote:
One note - This daemon is new, for the 5.6.x series firmware. To support the 'startActions' and 'endActions' (marketing pop-up panels), the 'social networking' of the 'Popular highlights', and a whole sh.. load of other extraneous things shipped as 'features' requires a lot of downloading and an increase in uploading. So that has been offloaded from cvm (the hardware assisted Java virtual machine) onto this new transfer manager. The todo handler has also been changed to use this new tmd thingy. - - - - - To be fair, it isn't something particular to Lab126. In my experience, error paths don't get anything near the amount of Q.A. work and testing as normal paths do. And now that it has been pointed out here, it will probably get fixed. ![]() Last edited by knc1; 10-29-2015 at 03:54 PM. |
|
![]() |
![]() |
![]() |
Thread Tools | Search this Thread |
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
PW1: How to disable OTA updates without jailbreak? | EbokJunkie | Kindle Developer's Corner | 2 | 03-06-2014 03:29 PM |
[Kindle Touch] Disable OTA updates [How To] | matejs | Kindle Developer's Corner | 21 | 02-24-2014 08:25 PM |
How to disable OTA updates on K4 NT SO? | mig_akira | Kindle Developer's Corner | 9 | 09-05-2012 07:24 PM |
9to5Mac: OTA Updates coming to iOS? | kjk | Apple Devices | 1 | 05-08-2011 08:21 AM |
Stealth OTA Nook Color updates to counter rooting? | RockdaMan | News | 3 | 12-17-2010 12:57 PM |