Calibre error connection to Kobo Libra 2

[asw22]

Hello!

I have a very annoying issue with the sending of books to my Libra 2 (4.38.23552) via Calibre 8.16.1:

I am sending books by batches of 500 to 1500, and from the Calibre standpoint everything checks OK...and the after disconnecting the reader, the "content importation" stops at various percentages, and many of the transferred books do not appear on the Libra 2 (they are physically present)...

I go back to Calibre after reconnecting, and Calibre now shows only the books whose content has been imported, so everything happens like the "not appearing" transferring books are not there anymore...except they are however physically present!!!
I then try to gather all these books and transfer them again, and I get some more but usually not all of them...It is extremely frustrating, and soooo Kobo!
And now, during my last transfer operation, I got this error 22 invalid argument! Argh!

Here is the traceback:

calibre, version 8.16.1
ERREUR : Erreur: Erreur pendant la communication avec le périphérique

[Errno 22] Invalid argument

Traceback (most recent call last):
File "calibre\devices\usbms\cli.py", line 55, in put_file
File "shutil.py", line 200, in copyfileobj
OSError: [Errno 22] Invalid argument

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre\gui2\device.py", line 110, in run
File "calibre\gui2\device.py", line 661, in _upload_books
File "calibre\devices\kobo\driver.py", line 2311, in upload_books
File "calibre\devices\usbms\driver.py", line 327, in upload_books
File "calibre\devices\usbms\cli.py", line 61, in put_file
OSError: [Errno 22] Invalid argument

What happens?

And I have a request for M. Goyal: would it be possible to not stop the book transfer when a book related error appears? It is not a big issue if you transfer 10 books, but at 1000 it becomes frustrating...

Funnily enough, I have zero issues with Pocketbook/Vivlio (and my library is very large).

Thanks a lot for reading me!

[theducks]

Update (manually) to 8.16.2
(notifications do not happen for fixes on installed levels eg 8.16)

[asw22]

Hello!

I did that but without change. Each time I try to transfer say 1000 files, 300 to 600 are in fine not transferred (or more accurately, they have been transferred physically, but not recognized in the "content import" procedure).
Only once did I see the procedure going to its 100% end!

By the way this recognition procedure starts only after physically removing the USB connection, otherwise I keep the "connected" black screen.

[kovidgoyal]

Kobo firmware is very buggy trying to maintain hundreds or thousands of books ona Kobo wont work well.

[asw22]

Unfortunately I have to agree with you Kovid...For now I transfer with a 30 % "efficiency"...Long will be the way!
One thing I did not try yet is to rollback the firmware.

I had tried some years before a Kobo Aura which had had its share of similar troubles...After the Libra 2 I will stay with PocketBook!

[JSWolf]

Originally Posted by asw22

Unfortunately I have to agree with you Kovid...For now I transfer with a 30 % "efficiency"...Long will be the way!
One thing I did not try yet is to rollback the firmware.

I had tried some years before a Kobo Aura which had had its share of similar troubles...After the Libra 2 I will stay with PocketBook!

Why do you want so many eBooks on your Reader in one go? That to me seems a bit silly.

[asw22]

Probably because I am silly myself...

I have always liked to have my full library with me to be able to choose, jump, come back to whatever book took my fancy...
To come back to Calibre, select and transfer few books is a hindrance for me, not to mention the mangas or comics....It works fine with PocketBook, I would like to do the same with Kobo!

[DNSB]

For what it may be worth, I just set up a Kobo Sage and copied 5,000 books to it in one pass. The import process went without issue. A couple of items is that those books have all passed epubcheck before being moved from my calibre Intake library to the main library and that I left the Sage connected to the computer/power until the import was done. Lucky? Possibly. Other people have reported issues copying over more than a few hundred books at a time. For them, copying in batches seems to work.

The only time I put my entire library on an ereader was a Kobo Clara HD with a 128GB card installed. It crashed around 6,000 books imported. I then triggered the import again from NickelMenu. Crashed around the 11,000 mark. Triggered the import again and it completed the 16,302 book import. An interesting experiment but since the database was quite a bit larger than that available RAM, searches and other operations slowed very noticeably.

[asw22]

Interesting...However: "I left the Sage connected to the computer/power until the import was done" is intriguing...in my experience, I have do disconnect physically to start the reboot then the import process...And I have seen other messages stating the same thing...
What do I do wrong?
I will also look into epubcheck. Does it work in batches?

[JSWolf]

Originally Posted by asw22

Interesting...However: "I left the Sage connected to the computer/power until the import was done" is intriguing...in my experience, I have do disconnect physically to start the reboot then the import process...And I have seen other messages stating the same thing...
What do I do wrong?
I will also look into epubcheck. Does it work in batches?

epubcheck is a one at a time via the calibre editor.

One thing you could do with your Libra 2 is to setup Dropbox and put books there and then download as you want/need.

[DNSB]

Once I safely eject from the computer, the Sage takes a few seconds but goes to the import screen/home screen depending on what I've been doing. I leave the USB cable connected due to paranoia about the Sage's battery depleting since I seldom check the battery level before connecting. To safely eject, I use calibre's SmartEject plugin since I use some of it's other features. The eject in the Device dropdown works as well if you are just looking to safely eject. Windows File Explorer eject also works but using the eject from the USB icon in the system tray does not.

The calibre Check Books plugin lets you run epubcheck on multiple books but I just use the epubcheck plugin in either Sigil epub editor or calibre's ebook editor to check one at a time since that allows me to correct errors. I tried Check Books but the number of errors and having to refer back to fix the errors was a pain. Sigil with the epubcheck and ACE plugins just made it easier for me (you don't need ACE if you are not checking for accessibility).

You might just want to install NickelMenu and re-trigger the import from there. Most of the errors that epubcheck finds don't seem to have that much effect on the reading experience.

[asw22]

OK Thanks! I will try all that!

[JSWolf]

Originally Posted by asw22

OK Thanks! I will try all that!

Here is one of my config files for NickelMenu. I'm not 100% sure if it's the current one, but it will do a lot of what you may want. It does have the option to import books from the home screen.

# Thursday, September 3, 2020, at 8:45 p.m.
# -----------------------------------------------------------------------------
menu_item : main : Frontlight On : cmd_spawn : quiet :ioctl /dev/ntx_io 241 -v 3
menu_item : main : Frontlight Off : cmd_spawn : quiet : ioctl /dev/ntx_io 241 -v 0
#
menu_item : main    : Dark Mode          : nickel_setting : toggle : dark_mode
menu_item : main    : Invert & Reboot    : nickel_setting :toggle: invert
    chain_success   : power              : reboot
#
menu_item : main : Reboot  : power : reboot
menu_item : main : Shutdown : power : shutdown
#
menu_item :main    :> Portrait          :nickel_orientation :portrait
menu_item :main    :> Landscape         :nickel_orientation :landscape
menu_item :main    :> Reverse Portrait  :nickel_orientation :inverted_portrait
menu_item :main    :> Reverse Landscape :nickel_orientation :inverted_landscape
#
menu_item :main :Import books       :nickel_misc        :rescan_books_full
menu_item:main:Toggle Screenshots:nickel_setting:toggle:screenshots
menu_item : main : USB : nickel_misc : force_usb_connection
#
# -----------------------------------------------------------------------------
menu_item : reader : Frontlight On : cmd_spawn : quiet :ioctl /dev/ntx_io 241 -v 3
menu_item : reader : Frontlight Off : cmd_spawn : quiet : ioctl /dev/ntx_io 241 -v 0
#
menu_item : reader    : Dark Mode          : nickel_setting : toggle : dark_mode
#
menu_item :reader  :> Portrait          :nickel_orientation :portrait
menu_item :reader  :> Landscape         :nickel_orientation :landscape
menu_item :reader  :> Reverse Portrait  :nickel_orientation :inverted_portrait
menu_item :reader  :> Reverse Landscape :nickel_orientation :inverted_landscape
#
menu_item:reader:Toggle Screenshots:nickel_setting:toggle:screenshots
#
menu_item:reader:Home:nickel_misc:home
menu_item:reader:My Books:nickel_open:library:library
#
# -----------------------------------------------------------------------------
menu_item : reader : Frontlight On : cmd_spawn : quiet :ioctl /dev/ntx_io 241 -v 3
menu_item : reader : Frontlight Off : cmd_spawn : quiet : ioctl /dev/ntx_io 241 -v 0
#
menu_item : library : Dark Mode          : nickel_setting : toggle : dark_mode
menu_item : library : Invert & Reboot    : nickel_setting :toggle: invert
    chain_success   : power              : reboot
#
menu_item : library : Reboot  : power : reboot
menu_item : library : Shutdown : power : shutdown
#
menu_item :library :> Portrait          :nickel_orientation :portrait
menu_item :library :> Landscape         :nickel_orientation :landscape
menu_item :library :> Reverse Portrait  :nickel_orientation :inverted_portrait
menu_item :library :> Reverse Landscape :nickel_orientation :inverted_landscape
#
menu_item:library:Toggle Screenshots:nickel_setting:toggle:screenshots
menu_item : library : USB : nickel_misc : force_usb_connection

[asw22]

You got faster than me! I was considering asking you something of that nature so I can only thank you very much!

JVM