[Librarian Sync] KUAL stuck at rebuilding collections

FiltroMan · 11-30-2016, 05:39 AM

Hi folks!

Yesterday night I managed to get my head around the whole jailbreaking process even for my KT3, and so far I'm quite happy with it. The only problem I encountered so far is concerning Librarian Sync; let me break it down so those gentle fellas that might want to be helpful won't beat me up for not describing the issue properly

.

I've installed Librarian Sync (not the full plugin, the standalone one of which I do not recall the name as for now) through MRPI.
I've installed Calibre 64-bit latest version on my Windows-based PC and enabled as well Collections' plugin.
I've created my collections through Calibre and push them to my KT3, which then asks me to perform an update of the collections from LS plugin itself.

Here's the deal: whenever I launch the plugin in order to update or rebuild the collections, I see at the bottom of the screen that it is working, but even after roughly six hours of "processing" KT3 collections are still messed up.

I'd like to point out that it could also be a problem on how I'm managing the collections within Calibre's plugin (which I didn't fully understand), and if I should actually install the full Librarian package on my device.

Please let me know if further information and/or troubleshooting steps are required

FiltroMan · 12-01-2016, 02:39 AM

I tried rebooting several times as well as reinstalling Librarian Sync but issue is still present

Any suggestion?

Marco77 · 12-01-2016, 04:59 PM

Can you (install&) enable usbnet via search ;un
then plug into pc and run via telnet
cd /mnt/us/extensions/librariansync
python generate_collections.py --rebuild-calibre

there should be text in special font displayed at the bottom (like when installing mrpi packages)

AFAICT, on my PW3 5.8.7 the KUAL 'KPV booklet' is dysfunctional (see latest posts in the KUAL thread) and you cannot launch actions from the booklet.
A (hacky) workaround would be to use a ;log action handler to launch things in the meantime, but it would require a tailored, special build of the mrpi package.
Or maybe personalize some json file

HTH

FiltroMan · 12-15-2016, 01:06 PM

Hi Marco,

Thanks for the help, but I'm encountering some problems when trying to run

Quote:

Originally Posted by Marco77

Can you (install&) enable usbnet via search ;un
then plug into pc and run via telnet
cd /mnt/us/extensions/librariansync
python generate_collections.py --rebuild-calibre

I'm using a Windows based PC, and not Linux (where the /mnt would have been totally cool), are you aware of some other variants of the command?

Please be aware that USBHacks have been installed and activated through KUAL

knc1 · 12-15-2016, 01:45 PM

Quote:

Originally Posted by FiltroMan

Hi Marco,

Thanks for the help, but I'm encountering some problems when trying to run

I'm using a Windows based PC, and not Linux (where the /mnt would have been totally cool), are you aware of some other variants of the command?

Please be aware that USBHacks have been installed and activated through KUAL

Did you also install Python?

The Kindle IS running Linux.
Once you have used a remote access program, such as telnet, you are working on the target machine, not the local machine.

For Windoze people - look into the set of programs: puTTY

FiltroMan · 12-22-2016, 04:34 AM

Quote:

Originally Posted by knc1

Did you also install Python?

The Kindle IS running Linux.
Once you have used a remote access program, such as telnet, you are working on the target machine, not the local machine.

For Windoze people - look into the set of programs: puTTY

Hi knc1,

You mean installing Python on the PC itself and/or the Kindle?
Apologies for reaching a whole new level of noobiness

knc1 · 12-22-2016, 07:43 AM

Quote:

Originally Posted by FiltroMan

Hi knc1,

You mean installing Python on the PC itself and/or the Kindle?
Apologies for reaching a whole new level of noobiness

On the Kindle.
That is where the problem is at, on the Kindle.

FiltroMan · 12-23-2016, 02:09 PM

Quote:

Originally Posted by knc1

On the Kindle.
That is where the problem is at, on the Kindle.

Hi,

I think Python is correctly installed on my Kindle, since when I connect it I can see in the root of the KT3 that there's a "Python" folder; which contains some other three folders.

Even when enabling USBNetwork via KUAL (nothing found using ;un via search box) I do not know the parameters to use in order to connect: I already tried to use the IP address that comes as a connected device from my router, but PuTTy says it is inactive

knc1 · 12-23-2016, 04:37 PM

Quote:

Originally Posted by FiltroMan

Hi,

I think Python is correctly installed on my Kindle, since when I connect it I can see in the root of the KT3 that there's a "Python" folder; which contains some other three folders.

Even when enabling USBNetwork via KUAL (nothing found using ;un via search box) I do not know the parameters to use in order to connect: I already tried to use the IP address that comes as a connected device from my router, but PuTTy says it is inactive

Alright - I think I follow.

I haven't had this problem myself, nor have I seen it described here before.

Some things I can clear up -

Search bar entries that start with the ';' semi-colon character are commands not search entries.
Nothing found is the expected result (plus some action other than a search happening).

The
;un
command toggles USBnetworking state on-off-on-off

I must assume that you have not touched (changed) the configuration file that was installed with USBnetworking.

The Kindle's IP address is not the same via USB cable and via Wifi.

Over the USB cable the Kindle end of the cable is: 192.168.15.244
The PC end of the cable can be set to almost anything else in 192.168.15.xxx network range.

To see if USBnetworking is running on the Kindle (since we can't trust the KUAL menu on a KT3) . . . .

Wake Kindle
Wake PC
Connect the two together with a known good USB cable.
Does the PC bring up a file manager view of the Kindle's USB storage?
Yes :: USBnetworking is disabled
No :: USBnetworking is enabled

Mention name/make/model/OS name/OS model of the PC you are using.
Anything that will help identify what the PC is and what it is running.

FiltroMan · 12-30-2016, 02:56 AM

Quote:

Originally Posted by knc1

Alright - I think I follow.

I haven't had this problem myself, nor have I seen it described here before.

Some things I can clear up -

Search bar entries that start with the ';' semi-colon character are commands not search entries.
Nothing found is the expected result (plus some action other than a search happening).

The
;un
command toggles USBnetworking state on-off-on-off

Thanks for the heads up mate, I honestly had NO clue about what that command was all about, therefore I'm trying to re-enable USBNetworking and re-plugging it in. But even after so the computer is still detecting the Kindle as attached storage.

Quote:

Originally Posted by knc1

I must assume that you have not touched (changed) the configuration file that was installed with USBnetworking.

The Kindle's IP address is not the same via USB cable and via Wifi.

Over the USB cable the Kindle end of the cable is: 192.168.15.244
The PC end of the cable can be set to almost anything else in 192.168.15.xxx network range.

To see if USBnetworking is running on the Kindle (since we can't trust the KUAL menu on a KT3) . . . .

Wake Kindle
Wake PC
Connect the two together with a known good USB cable.
Does the PC bring up a file manager view of the Kindle's USB storage?
Yes :: USBnetworking is disabled
No :: USBnetworking is enabled

Mention name/make/model/OS name/OS model of the PC you are using.
Anything that will help identify what the PC is and what it is running.

You're assuming everything right, I have not changed any of the configuration files loaded on the Kindle itself. As I said a column higher, using the ;un command isn't making any change whatsoever in the way it's been detected by the OS.

I know for sure that the USB cable I'm using is working, and the problem appears regardless if I connect the device via USB 3.0 or 2.0 ports.

My PC: Acer Aspire 5750 running Windows 10 Pro 64 bit up to date.

P.S.
Searching up into the "usbnet" folder on the Kindle I noticed a file called "DISABLED_auto" which, according to the "info.txt" file, can be renamed into "auto" in order to have the Kindle to connect as Ethernet over USB. Anyway, do you have any hints on where to find the proper configuration file in order for me to gather all the information I could need to connect to the damn KT3?

knc1 · 12-30-2016, 07:40 AM

First off -
Don't change anything.

If you missed the part in the readme file about the 'auto' file -
Do not put an 'auto' file on the device until all problems are solved.

The 'auto' file prevents the export of the USB storage as part of its function, and without another way to access the device, your toast if you need to take it off.

Sorry, I don't recall -
If you do not have it already installed, install KTerm.

A terminal program that will let you use the Kindle's command line interface if things get really worse.
In fact, it may come in handy while trying to find out what is wrong.

As of a few days ago - there is an updated Collections Manager.
Look for it by going to the most recent post of the thread and scroll up. There hasn't been many posts since it was posted, it is very near the end of the thread.

Of course, the first post of the thread has the description of how to use it.

= = = =

But on the actual topic here, I haven't any new ideas.
With kTerm installed, it may be possible to at least learn more of what is happening.

Marco77 · 12-31-2016, 11:37 AM

Hi, since the PC detects the Kindle as mass storage, you have to turn usb networking on.
I have found that after freshly installing this plugin, a complete reboot (not reset) makes enabling the SSH daemon more consistent. Can you try that?

Note: there are various "rescue packs" out there so that the kindle boots in diags mode when a wired link is detected. (it's a tad less relevant with downgrade methods nowadays, but a way to foolproof against "soft" bricks)

gwynevans · 01-16-2017, 06:38 PM

Hope no-one minds me jumping in here, but it's gone quiet and I've got the same issue...

I've got a KV and the collections have stopped updating... (possible since a 5.8.5 update, but I wasn't paying that much attention/updating them that often.)

I managed to install USB networking[Notes 1] and connect in but didn't have python in the path. (Not sure if it should be, but path was "/usr/local/bin:/bin:/usr/bin:/usr/sbin:/sbin" while the only thing in /usr/local/bin was usbnetwork.sh.

I found a copy in /mnt/us/python/bin/python2.7, which I used to run "/mnt/us/python/bin/python2.7 generate_collections.py --rebuild-calibre" - that completed with no messages, and appeared to work.

It looks to me as if it might be Python not being found where expected, but without knowing how it should be setup on the Kindle, I'm not 100% sure - comments?

- Later -
Did a re-install of python, which fixed things, in that I then got the messages from LibrarianSync as before.

[Notes 1] - As I'd forgotten all the bits & pieces from when I did install the jailbreak!
* Unzip the archive - it's not plug & play!
* Enable in the kv with ;un
* Set the Mac's System Prefs/Network/RDNIS gadget to 192.168.15.1
* ssh to the kindle at root@192.168.15.244

dmcritchie · 05-25-2017, 02:50 PM

Re gwynevans' post above, I thought I would mention that reinstalling python also turned out to be the solution for me to a similar problem.

I had downgraded my PW software from 5.6.1.1 to 5.3.3 so I could jailbreak it and install KUAL and library sync. This also required installing python. All worked well, but 5.3.3 does not have the extra search features that I was used to. So I upgraded back to 5.6.1.1 and found that librarysync got stuck on the "rebuilding collections" message, just like the original poster. Reinstalling librarysync did not help. But reinstalling python fixed the problem.

Perhaps the software upgrade changed the PATH variable so python could no longer be found?

In summary, jailbreak, MRPI, and librarysync were unaffected by the software upgrade, but python had to be reinstalled.

11-30-2016, 05:39 AM	#1
FiltroMan Junior Member Posts: 8 Karma: 10 Join Date: Nov 2016 Location: Poland Device: Kindle PaperWhite 2016 - KT3	[Librarian Sync] KUAL stuck at rebuilding collections Hi folks! Yesterday night I managed to get my head around the whole jailbreaking process even for my KT3, and so far I'm quite happy with it. The only problem I encountered so far is concerning Librarian Sync; let me break it down so those gentle fellas that might want to be helpful won't beat me up for not describing the issue properly . I've installed Librarian Sync (not the full plugin, the standalone one of which I do not recall the name as for now) through MRPI. I've installed Calibre 64-bit latest version on my Windows-based PC and enabled as well Collections' plugin. I've created my collections through Calibre and push them to my KT3, which then asks me to perform an update of the collections from LS plugin itself. Here's the deal: whenever I launch the plugin in order to update or rebuild the collections, I see at the bottom of the screen that it is working, but even after roughly six hours of "processing" KT3 collections are still messed up. I'd like to point out that it could also be a problem on how I'm managing the collections within Calibre's plugin (which I didn't fully understand), and if I should actually install the full Librarian package on my device. Please let me know if further information and/or troubleshooting steps are required

12-31-2016, 11:37 AM	#12
Marco77 Connoisseur Posts: 55 Karma: 8430 Join Date: Mar 2016 Device: PW3, Clara HD, PB740	Hi, since the PC detects the Kindle as mass storage, you have to turn usb networking on. I have found that after freshly installing this plugin, a complete reboot (not reset) makes enabling the SSH daemon more consistent. Can you try that? Note: there are various "rescue packs" out there so that the kindle boots in diags mode when a wired link is detected. (it's a tad less relevant with downgrade methods nowadays, but a way to foolproof against "soft" bricks) Last edited by Marco77; 12-31-2016 at 11:46 AM.

01-16-2017, 06:38 PM	#13
gwynevans Wizzard Posts: 1,402 Karma: 2000000 Join Date: Nov 2007 Location: UK Device: iPad 2, iPhone 6s, Kindle Voyage & Kindle PaperWhite	Hope no-one minds me jumping in here, but it's gone quiet and I've got the same issue... I've got a KV and the collections have stopped updating... (possible since a 5.8.5 update, but I wasn't paying that much attention/updating them that often.) I managed to install USB networking[Notes 1] and connect in but didn't have python in the path. (Not sure if it should be, but path was "/usr/local/bin:/bin:/usr/bin:/usr/sbin:/sbin" while the only thing in /usr/local/bin was usbnetwork.sh. I found a copy in /mnt/us/python/bin/python2.7, which I used to run "/mnt/us/python/bin/python2.7 generate_collections.py --rebuild-calibre" - that completed with no messages, and appeared to work. It looks to me as if it might be Python not being found where expected, but without knowing how it should be setup on the Kindle, I'm not 100% sure - comments? - Later - Did a re-install of python, which fixed things, in that I then got the messages from LibrarianSync as before. [Notes 1] - As I'd forgotten all the bits & pieces from when I did install the jailbreak! * Unzip the archive - it's not plug & play! * Enable in the kv with ;un * Set the Mac's System Prefs/Network/RDNIS gadget to 192.168.15.1 * ssh to the kindle at root@192.168.15.244 Last edited by gwynevans; 01-16-2017 at 07:00 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Collections confusion (no sync)	Ocicat	Amazon Kindle	10	11-28-2014 07:55 PM
How do I sync collections?	Dragoro	Amazon Kindle	1	07-23-2013 12:28 PM
PRS-T1 sync has doubled my collections	Falchetta	Sony Reader	2	07-08-2012 06:11 PM
Sync Collections To Kindle 3?	mbrown3	Calibre	4	10-01-2010 10:49 AM
New computer, now cant sync collections	Lora63	Sony Reader	3	03-08-2010 10:36 PM

12-01-2016, 02:39 AM	#2
FiltroMan Junior Member Posts: 8 Karma: 10 Join Date: Nov 2016 Location: Poland Device: Kindle PaperWhite 2016 - KT3	I tried rebooting several times as well as reinstalling Librarian Sync but issue is still present Any suggestion?

12-01-2016, 04:59 PM	#3
Marco77 Connoisseur Posts: 55 Karma: 8430 Join Date: Mar 2016 Device: PW3, Clara HD, PB740	Can you (install&) enable usbnet via search ;un then plug into pc and run via telnet cd /mnt/us/extensions/librariansync python generate_collections.py --rebuild-calibre there should be text in special font displayed at the bottom (like when installing mrpi packages) AFAICT, on my PW3 5.8.7 the KUAL 'KPV booklet' is dysfunctional (see latest posts in the KUAL thread) and you cannot launch actions from the booklet. A (hacky) workaround would be to use a ;log action handler to launch things in the meantime, but it would require a tailored, special build of the mrpi package. Or maybe personalize some json file HTH

12-30-2016, 07:40 AM	#11
knc1 Going Viral Posts: 17,212 Karma: 18210809 Join Date: Feb 2012 Location: Central Texas Device: No K1, PW2, KV, KOA	First off - Don't change anything. If you missed the part in the readme file about the 'auto' file - Do not put an 'auto' file on the device until all problems are solved. The 'auto' file prevents the export of the USB storage as part of its function, and without another way to access the device, your toast if you need to take it off. Sorry, I don't recall - If you do not have it already installed, install KTerm. A terminal program that will let you use the Kindle's command line interface if things get really worse. In fact, it may come in handy while trying to find out what is wrong. As of a few days ago - there is an updated Collections Manager. Look for it by going to the most recent post of the thread and scroll up. There hasn't been many posts since it was posted, it is very near the end of the thread. Of course, the first post of the thread has the description of how to use it. = = = = But on the actual topic here, I haven't any new ideas. With kTerm installed, it may be possible to at least learn more of what is happening.

05-25-2017, 02:50 PM	#14
dmcritchie Member Posts: 12 Karma: 10 Join Date: Jan 2017 Device: Samsung Galaxy Tab A	Re gwynevans' post above, I thought I would mention that reinstalling python also turned out to be the solution for me to a similar problem. I had downgraded my PW software from 5.6.1.1 to 5.3.3 so I could jailbreak it and install KUAL and library sync. This also required installing python. All worked well, but 5.3.3 does not have the extra search features that I was used to. So I upgraded back to 5.6.1.1 and found that librarysync got stuck on the "rebuilding collections" message, just like the original poster. Reinstalling librarysync did not help. But reinstalling python fixed the problem. Perhaps the software upgrade changed the PATH variable so python could no longer be found? In summary, jailbreak, MRPI, and librarysync were unaffected by the software upgrade, but python had to be reinstalled.