PW3 LibrarianSync on v5.12.4

[xdeeps]

I would have posted this in the LibrarianSync thread but it seems to be closed.

I have a Kindle PaperWhite 3 which I managed to successfully jailbreak. I have a few KUAL extensions running well alongside MR Installer and also have the ScreenShots hack working perfectly.

After I jailbroke I was under the impression the jb would stay even if updated. I manually updated to latest OS from Amazon and I guess the Collection Management tweak isn't working on it.

If anyone can assist it would be nice. I use Calibre and have the Kindle Collections plugin installed. I believe it's working fine and I've set it up properly. The issue is coming from LibrarianSync menus in KUAL. They say they updated the collections database but I dont see any updates. I have tried almost all kind of troubleshooting and have searched endlessly before making an account to post this for help.

Any insight will be helpful

Ps. Python and everything works fine, or else the ScreenSavers hack wouldnt work.

[knc1]

Originally Posted by xdeeps

. . . .

I have tried almost all kind of troubleshooting and have searched endlessly before making an account to post this for help.

Any insight will be helpful

Ps. Python and everything works fine, or else the ScreenSavers hack wouldnt work.

Did you try what is now the very topmost of the sticky threads?
Give the first post of the following thread a go:
https://www.mobileread.com/forums/sh...d.php?t=320564
When you reach the section titled: "Making sure your JB survives updates." read closely.
Of course, the rest of that first post might be of interest also.

[NiLuJe]

Sidebar: LS's thread is not closed, it's just old?

[xdeeps]

Originally Posted by knc1

Did you try what is now the very topmost of the sticky threads?
Give the first post of the following thread a go:
https://www.mobileread.com/forums/sh...d.php?t=320564
When you reach the section titled: "Making sure your JB survives updates." read closely.
Of course, the rest of that first post might be of interest also.

Hi. I did read that the first thing. I have applied the hotfix through an update, not MRPI. But LibrarianSync still doesn't work. It shows up inside KUAL and I can run commands in its menu, it shows catalog updated and how many seconds it took for it to be done. But when I exit out, there are no collections updated or made or deleted for the matter, if you run delete all collections option.

Originally Posted by NiLuJe

Sidebar: LS's thread is not closed, it's just old?

Apologies for assuming, I see that you are knowledgeable about these things and helped people actively in that thread, is there any light you can shed on this? Is there any way to manage Kindle PW3 Collections through Calibre or any other desktop based app?

[NiLuJe]

I have no experience with FW 5.12.x, so I can't tell you if something relevant to LS has changed there. I feel like, if it actually did, someone would have noticed earlier, though.

Is the time/date sane? Is the internal storage behaving properly? Is the device registered? Can you actually successfully create/delete collections manually?

[xdeeps]

Originally Posted by NiLuJe

I have no experience with FW 5.12.x, so I can't tell you if something relevant to LS has changed there. I feel like, if it actually did, someone would have noticed earlier, though.

Is the time/date sane? Is the internal storage behaving properly? Is the device registered? Can you actually successfully create/delete collections manually?

I understand its hard to troubleshoot a firmware you dont have, however I also agree that the collections management is a feature why people jailbreak mostly, so people would've reported otherwise.

If we can figure this out I can help others in the future with this firmware too.

Date and time is set properly, internal storage is working right, device is registered and the ads have been removed by Amazon, and I can make and delete collections manually.

Is there any kinda debug I can perform? Perhaps provide you with logs or anything which may help? I know you can run ;commands from search bar but I do not know what they are.

[mergen3107]

Generally, to debug you can start from looking at logs. You need USBNetwork to run “showlog -f > logs.txt” command from, for example, /mnt/us/ folder. However, since you say LibrarianSync does show you seconds, it means that it does it’s own job properly.

Hence, you should check whether there are changes in collections management on Kindle:
1) Collections’ structure is written to /mnt/us/system/collections.json file
2) LibrarianSync uses /var/local/cc.db database to fetch items’ ASIN and exact folders (p_location column). This is an sqlite3 database, so you can use command line or an sqlite GUI to look inside the file.

Look into LibrarianSync source code to see exactly what it tries to read.

[NiLuJe]

Might need a good ;debugOn first to actually ensure maximum output ;p

(Warning: Kindle logs are already fairly verbose. Debug logs veer into 'slightly insane' territory ).

[lrpirlet]

I have serial JB my PW3 recently. It was a success. My kindle displays the cover of the book I am reading...

The firmware version is Kindle 5.12.4 (360273 042) according to the version.txt file in the extensions/../system directory...

It looks like I have the same problem as the base note...

Using kterm I issued the following commands to extract the librariansync related messages...

showlog|grep ibrarian

To locate where/when to find librariansync related logs

showlog|grep 200727:19282|more>librarianfails

The result is (shortened to 2 lines before and after librariansync related)

200727:192821 Xorg: I GestureEngine:perfScenario::Sending button 1 up 1595870961.389353
200727:192821 framework: perfScenario CVM received X11 ButtonRelease button=1 time=1595870961.399401
200727:192823 system: I LibrarianSync:main:: Starting...
200727:192823 system: I LibrarianSync:rebuild_from_calibre_plugin_json:: Rebuilding collections (Calibre)...
200727:192823 system: I LibrarianSync:cc_update:: Sending commands...
200727:192824 cvm[4966]: E rc:request_callback:Unauthorized request!:
200727:192824 system: E LibrarianSync:cc_update:: Oh, no. It failed.
200727:192824 system: I LibrarianSync:main:: Done in 0.18s.
200727:192824 ADM[3189]: I HttpClient: Retry 2
200727:192824 ADM[3189]: E HttpClient: IOError: Couldn't resolve host name: Could not resolve: device-messaging-na.amazon.com (Could not contact DNS servers)

I will verify later if this comes from a python process as this does not look too *nix style... If that is the case, would increasing the the log level help?

I guess I could increase the log level with ;debugOn, but I want to be able to get back to normal...
So, would ;debuggoff decrease le log level back to normal??

Do I have to issue those commands at top level (accueil) search?

Last but not least, is there a list (documented?) of such nice commands?

[lrpirlet]

Sorry I forgot to mention that I was able to produce with librariansync a snapshot of the collections on the kindle and to modify calibre accordingly...

So I guess that librariansync is able to read the collection db...

[NiLuJe]

200727:192824 cvm[4966]: E rc:request_callback:Unauthorized request!:

That doesn't look very promising.

RIP, LS?

[lrpirlet]

Hi NiLuJe, thanks for your interest...
I fail to translate the acronyms...

• Does "RIP" means "Rest In Peace" (I hope not...)
• May I guess "LS" to mean "LibrarySync"?

BTW I found the answer to my question about the ;debugOn and debugOff (https://wiki.mobileread.com/wiki/Kindle_Touch_Hacking#Search_Bar_Shortcuts)

So I set the debugOn and got not much more info...

200728:134816 cvm[4966]: D KindleButtonUI:DebugInfo::painting button 18027209   com.mobileread.ixtab.kindlelauncher.ui.v2.KualButton[Rebuild collections (calibre plugin),0,384,782x123,layout=javax.swing.OverlayLayout,alignmentX=0.0,alignmentY=0.5,border=com.sun.java.swing.plaf.BorderUIResource$CompoundBorderUIResource@1359d65,flags=353,maximumSize=,minimumSize=,preferredSize=,defaultIcon=,disabledIcon=,disabledSelectedIcon=,margin=com.sun.java.swing.plaf.InsetsUIResource[top=11,left=26,bottom=11,right=26],paintBorder=true,paintFocus=false,pressedIcon=,rolloverEnabled=false,rolloverIcon=,rolloverSelectedIcon=,selectedIcon=,text=✓ Rebuild collections (calibre plugin),model=javax.swing.DefaultButtonModel[stateMask=ENABLED],defaultCapable=true]
200728:134816 winmgr[4070]: D lua:dbg::screen.damage rect 782 x 123
200728:134817 system: I LibrarianSync:main:: Starting...
200728:134817 system: I LibrarianSync:rebuild_from_calibre_plugin_json:: Rebuilding collections (Calibre)...
200728:134817 system: I LibrarianSync:cc_update:: Sending commands...
200728:134817 cvm[4966]: E rc:request_callback:Unauthorized request!:
200728:134817 system: E LibrarianSync:cc_update:: Oh, no. It failed.
200728:134817 system: I LibrarianSync:main:: Done in 0.16s.
200728:134824 Xorg: I GestureEngine:perfScenario::Sending button 1 down 1595936964.794262
200728:134824 cvm[4966]: D KindleInputMethod:DebugInfo::dispatchEvent

[NiLuJe]

That'd be a yes on both counts.

[lrpirlet]

OK NiLuJe Thanks a lot...

If I can find some more time, I'll try wireshark to see if a username/password is "protecting" the http://127.0.0.1:9101/change<whatever command>.

But I do not feel like it will magically help...

I guess this is, again, the result of a deep sense of "customer satisfaction" (as far as the said customer respectfully pays and pays)

[lrpirlet]

Hi NiLuJe

A request: where did you get that syntax to talk with cvm??? SDK??? Is that still available?

I went a little further... It seems that I can read access the cc.db file without any problem with sqlite3 (No I did NOT try to write anything). So I started to wonder if the error is really a password related issue (HTTP returning 401) as suggested by the Unauthorized request! message output by cvm...

So I mofified the cc_update.py so that it output the http request status.
It now reads :

log(LIBRARIAN_SYNC, "cc_update", "Oh, no. It failed. error: "+str(r.status_code), "E")

The answer is now:

200802:143003 system: I tinyrot:def:Removing /var/local/log/messages_00000808_*.gz to save storage space
200802:143003 system: I tinyrot:def::Rotating file /var/log/netlog with max size 256
200802:143004 syslog-ng[880]: SIGHUP received, restarting syslog-ng
200802:143004 system: I LibrarianSync:main:: Starting...
200802:143004 system: I LibrarianSync:rebuild_from_calibre_plugin_json:: Rebuilding collections (Calibre)...
200802:143004 system: I tinyrot:def::Rotating file /var/log/odotlite with max size 2048
200802:143004 system: I LibrarianSync:cc_update:: Sending commands...
200802:143004 system: I tinyrot:def::No file to rotate: /var/log/odotlite
200802:143005 syslog-ng[880]: new configuration initialized
200802:143005 system: I tinyrot:def::Rotating file /var/log/wpa_supplicant with max size 128
200802:143005 system: I tinyrot:def::No file to rotate: /var/log/wpa_supplicant
200802:143005 cvm[4966]: E rc:request_callback:Unauthorized request!:
200802:143005 system: E LibrarianSync:cc_update:: Oh, no. It failed. error: 403
200802:143005 system: I LibrarianSync:main:: Done in 0.29s.
200802:143005 system: I tinyrot:def::Rotating file /var/log/metrics_generic with max size 64
200802:143005 syslog-ng[880]: SIGHUP received, restarting syslog-ng
200802:143005 system: I tinyrot:def:Removing /var/local/log/metrics_generic_00000338_*.gz to save storage space

This seems to suggest that the request was refused (HTTP Status 403) probably because it expected a different environment...