adding many books via Calibre

franklekens · 06-28-2021, 09:43 AM

I have the new Ellipsa, to which I'd like to add most of what's in my Calibre library, since it's easier just to lump everything on the device (which has a huge memory anyway) than start picking what I want to transfer and what not.

I sideload these books with Calibre, there's hundreds of titles.
But It seems this won't run smoothly except if I only pick about thirty titles at a time. In fact, sometimes even fewer. Otherwise I get error messages.

At first I thought the process balked at some rather big books (2 Mb and upwards), but even that doesn't to be the problem.

What's the deal with this? Is it so hard for Calibre to mass import books onto the Kobo reader? Is there no other way?

(Yes, I could drag them on to the device via the Windows Explorer, but that doesn't carry over my shelving. And my shelving is rather a mess, but at least it gives collection *some* order, messy as it is. Besides, Calibre puts all the books in separate folders by author, I'm not sure dragging all those folders would even run that smoothly.)

Looks like I'll be hours at this, jeez.

franklekens · 06-28-2021, 09:49 AM

Actually, it's worse than getting error messages. Twice already, Calibre simply crashed while doing a transfer.

I suspect this isn't an Ellipsa problem as much as a Calibre and/or Kobo (or Calibre/Kobo) problem. I've had it with previous devices as well; don't quite remember how I overcame the tedium/irritation.

PeterT · 06-28-2021, 10:08 AM

Run calibre in debug mode and post logs please

Sent from my Pixel 4a using Tapatalk

theducks · 06-28-2021, 10:13 AM

You really need to tell us all about your setup as we can not look over your shoulder.
What OS?
What version of Calibre (note 5.22.0 had a hot fix that won't notify if 5.22.0 was in place) Download that

Send smaller batches than you have been, disconnect between each batch to allow the Kobo to process them.

By crash: Do you mean Calibre just closes with no message (abnormal ending)?
We really need to see a Log

franklekens · 06-28-2021, 10:51 AM

Windows 10.
What happened was that I got error messages that some particular book couldn't be uploaded. But when I then tried to upload that particular book, in many case there was no problem. (In one or two, there was, though I can't figure out why.)
What also happened two or three times that after a number of these errors, Calibre just quit while trying such an upload. No error messages.
I'd gone back to only uploading 30 titles at a time, and disconnecting the device after two or three uploads. Even then...

What I did now:
Upgraded from 5.22.0 to 5.22.1.
Ran in debug mode.
Tried to upload 50 or so books.
Process hangs. No error message, the programme doesn't quite. I have to kill it off. There’s no bug report. Windows says 'calibre debug does not respond'.

I'll try again.

franklekens · 06-28-2021, 11:03 AM

My apologies, a debug file *was* created. I'd attach it here, but it seems to take forever to upload.

franklekens · 06-28-2021, 11:05 AM

What 's with the upload feature on this forum?

Here's the text of the debug file.

Spoiler:

franklekens · 06-28-2021, 11:07 AM

Next, tried again, it crashed again. But this time no hanging, a proper crash -- the window just disappeared.

Here's the text from that debug file.

Spoiler:

franklekens · 06-28-2021, 11:18 AM

Also, although it crashed, I think (I can't be 100% sure) some of the books I tried to upload when it crashed *were* in fact uploaded to the device.

JSWolf · 06-28-2021, 11:38 AM

Could it be that you have some eBooks that have errors?

franklekens · 06-28-2021, 11:51 AM

I don't know, I'll start to parse all 1600 of them one by one.

franklekens · 06-28-2021, 11:51 AM

As I said, sometimes it hangs and says "couldn't upload x or y", and then when I try to upload that one separately, there's no problem. That doesn't seem to be the problem.

DNSB · 06-28-2021, 12:11 PM

Have you tried installing the Windows 64 bit version of calibre? Does this issue occur if you try using the KoboTouch driver instead of the KoboTouchExtended driver?

JSWolf · 06-28-2021, 12:17 PM

Quote:

Originally Posted by DNSB

Have you tried installing the Windows 64 bit version of calibre? Does this issue occur if you try using the KoboTouch driver instead of the KoboTouchExtended driver?

You could very well be correct that the 32-bit version is running low on memory.

franklekens · 06-28-2021, 12:59 PM

Indeed, that does the trick! At least it seems to. After installing the 64-bit version, I started uploading larger and larger groups of books and encountered no problems. I'm done with the entire library by now, but I feel pretty confident that this way I might have uploaded the entire library in one or two goes.

Thanks for the tip and I'll keep this in mind.

Does the upgrade link for the 64-bit version take me to a specific page for that, or will I always have to use the "alternate download site" link to get it?

06-28-2021, 09:43 AM	#1
franklekens Addict Posts: 398 Karma: 3421956 Join Date: Sep 2009 Device: various Kobo's, Onyx Note2, Pocketbook 360, Kindle Keyboard	adding many books via Calibre I have the new Ellipsa, to which I'd like to add most of what's in my Calibre library, since it's easier just to lump everything on the device (which has a huge memory anyway) than start picking what I want to transfer and what not. I sideload these books with Calibre, there's hundreds of titles. But It seems this won't run smoothly except if I only pick about thirty titles at a time. In fact, sometimes even fewer. Otherwise I get error messages. At first I thought the process balked at some rather big books (2 Mb and upwards), but even that doesn't to be the problem. What's the deal with this? Is it so hard for Calibre to mass import books onto the Kobo reader? Is there no other way? (Yes, I could drag them on to the device via the Windows Explorer, but that doesn't carry over my shelving. And my shelving is rather a mess, but at least it gives collection some order, messy as it is. Besides, Calibre puts all the books in separate folders by author, I'm not sure dragging all those folders would even run that smoothly.) Looks like I'll be hours at this, jeez.

06-28-2021, 11:05 AM	#7
franklekens Addict Posts: 398 Karma: 3421956 Join Date: Sep 2009 Device: various Kobo's, Onyx Note2, Pocketbook 360, Kindle Keyboard	What 's with the upload feature on this forum? Here's the text of the debug file. Spoiler: calibre Debug log calibre 5.22.1 embedded-python: True is64bit: False Windows-10-10.0.19041 Windows ('32bit', 'WindowsPE') 32bit process running on 64bit windows ('Windows', '10', '10.0.19041') Python 3.8.5 Windows: ('10', '10.0.19041', '', 'Multiprocessor Free') Interface language: None Failed to initialize plugin: 'C:\\Users\\frank\\AppData\\Roaming\\calibre\\plug ins\\DeDRM.zip' Failed to initialize plugin: 'C:\\Users\\frank\\AppData\\Roaming\\calibre\\plug ins\\Inept Epub DeDRM.zip' Successfully initialized third party plugins: Goodreads Sync (1, 15, 1) && KePub Output (3, 4, 4) && KindleUnpack - The Plugin (0, 83, 0) && Kobo Utilities (2, 14, 0) && KoboTouchExtended (3, 4, 4) calibre 5.22.1 embedded-python: True is64bit: False Windows-10-10.0.19041 Windows ('32bit', 'WindowsPE') 32bit process running on 64bit windows ('Windows', '10', '10.0.19041') Python 3.8.5 Windows: ('10', '10.0.19041', '', 'Multiprocessor Free') Interface language: None Successfully initialized third party plugins: Goodreads Sync (1, 15, 1) && KePub Output (3, 4, 4) && KindleUnpack - The Plugin (0, 83, 0) && Kobo Utilities (2, 14, 0) && KoboTouchExtended (3, 4, 4) Turning on automatic hidpi scaling devicePixelRatio: 1.0 logicalDpi: 96.0 x 96.0 physicalDpi: 109.21999999999998 x 109.18208955223879 Using calibre Qt style: True [0.00] Starting up... [0.00] Showing splash screen... [0.31] splash screen shown [0.31] Initializing db... [0.36] db initialized [0.36] Constructing main UI... DEBUG: 0.0 Goodreads Sync::dialogs.py - loading translations DEBUG: 0.0 GoodreadsSync::action.py - loading translations DEBUG: 0.0 KoboUtilites::action.py - loading translations DEBUG: 0.0 KoboUtilites::dialogs.py - loading translations DEBUG: 0.0 KoboUtilites::action.py - loading translations DEBUG: 0.5 HttpHelper::__init__: proxy=None DEBUG: 0.4 No Kobo Touch, Glo or Mini appears to be connected DEBUG: 0.4 rebuild_menus - self.supports_ratings=None, self.supports_tiles=None DEBUG: 0.4 KoboUtilities:set_toolbar_button_tooltip - start: text='None' DEBUG: 0.4 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders Driver: KoboTouchExtended' [1.00] main UI initialized... [1.00] Hiding splash screen Starting QuickView Storage number map: {(7, 0): [(2, 'D')], (7, 1): [(3, 'C')], (7, 2): [(1, 'Y')], (7, 3): [(1, 'X')], (7, 4): [(1, 'W')], (7, 5): [(1, 'E')]} Storage number for USBSTOR\DISK&VEN_LINUX&PROD_FILE-STOR_GADGET&REV_0409\N604130003056&0: StorageDeviceNumber(type=7, number=5, partition_number=0) Drive letters for USBDevice(vendor_id=0x2237 product_id=0x4233 bcd=0x409 devid=usb\vid_2237&pid_4233&rev_0409 devinst=11) {'drive_letters': ['E'], 'pnp_id_map': {'E': '\\\\?\\usbstor#disk&ven_linux&prod_file-stor_gadget&rev_0409#n604130003056&0#{53f56307-b6bf-11d0-94f2-00a0c91efb8b}'}, 'readonly_drives': set(), 'sort_map': {'E': (5, 1)}} DEBUG: 5.4 KoboUtilities:_on_device_connection_changed - self.plugin_device_connection_changed.__class__: <class 'PyQt5.QtCore.pyqtBoundSignal'> DEBUG: 5.4 Methods for self.plugin_device_connection_changed: ['__call__', '__class__', '__delattr__', '__dir__', '__doc__', '__eq__', '__format__', '__ge__', '__getattribute__', '__getitem__', '__gt__', '__hash__', '__init__', '__init_subclass__', '__le__', '__lt__', '__module__', '__ne__', '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__setattr__', '__sizeof__', '__str__', '__subclasshook__', 'connect', 'disconnect', 'emit', 'signal'] DEBUG: 5.4 Have a Kobo device connected connected DEBUG: 5.4 BEGIN Get Device Path DEBUG: 5.4 Root path of device: E:\ DEBUG: 5.4 END Get Device Path DEBUG: 5.4 KoboUtilities:get_device - self.device_path="E:\" DEBUG: 5.4 KoboUtilities:set_toolbar_button_tooltip - start: text='None' DEBUG: 5.4 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders Driver: KoboTouchExtended' Job: 0 Get device information started DeviceJob: 0 Get device information done, calling callback DeviceJob: 0 Get device information callback returned Job: 1 Set library information started DeviceJob: 1 Set library information done, calling callback DeviceJob: 1 Set library information callback returned Job: 2 Get list of books on device started DEBUG: 0.0 KoboTouch:books - oncard='None' 2021-06-28 16:47:02 [DEBUG] KoboTouchExtended:settings: settings= Last edited by theducks; 06-28-2021 at 11:12 AM. Reason: spoilered

06-28-2021, 11:07 AM	#8
franklekens Addict Posts: 398 Karma: 3421956 Join Date: Sep 2009 Device: various Kobo's, Onyx Note2, Pocketbook 360, Kindle Keyboard	Next, tried again, it crashed again. But this time no hanging, a proper crash -- the window just disappeared. Here's the text from that debug file. Spoiler: calibre Debug log calibre 5.22.1 embedded-python: True is64bit: False Windows-10-10.0.19041 Windows ('32bit', 'WindowsPE') 32bit process running on 64bit windows ('Windows', '10', '10.0.19041') Python 3.8.5 Windows: ('10', '10.0.19041', '', 'Multiprocessor Free') Interface language: None Failed to initialize plugin: 'C:\\Users\\frank\\AppData\\Roaming\\calibre\\plug ins\\DeDRM.zip' Failed to initialize plugin: 'C:\\Users\\frank\\AppData\\Roaming\\calibre\\plug ins\\Inept Epub DeDRM.zip' Successfully initialized third party plugins: Goodreads Sync (1, 15, 1) && KePub Output (3, 4, 4) && KindleUnpack - The Plugin (0, 83, 0) && Kobo Utilities (2, 14, 0) && KoboTouchExtended (3, 4, 4) calibre 5.22.1 embedded-python: True is64bit: False Windows-10-10.0.19041 Windows ('32bit', 'WindowsPE') 32bit process running on 64bit windows ('Windows', '10', '10.0.19041') Python 3.8.5 Windows: ('10', '10.0.19041', '', 'Multiprocessor Free') Interface language: None Successfully initialized third party plugins: Goodreads Sync (1, 15, 1) && KePub Output (3, 4, 4) && KindleUnpack - The Plugin (0, 83, 0) && Kobo Utilities (2, 14, 0) && KoboTouchExtended (3, 4, 4) Turning on automatic hidpi scaling devicePixelRatio: 1.0 logicalDpi: 96.0 x 96.0 physicalDpi: 109.21999999999998 x 109.18208955223879 Using calibre Qt style: True [0.00] Starting up... [0.00] Showing splash screen... [0.31] splash screen shown [0.31] Initializing db... [0.36] db initialized [0.36] Constructing main UI... DEBUG: 0.0 Goodreads Sync::dialogs.py - loading translations DEBUG: 0.0 GoodreadsSync::action.py - loading translations DEBUG: 0.0 KoboUtilites::action.py - loading translations DEBUG: 0.0 KoboUtilites::dialogs.py - loading translations DEBUG: 0.0 KoboUtilites::action.py - loading translations DEBUG: 0.6 HttpHelper::__init__: proxy=None DEBUG: 0.5 No Kobo Touch, Glo or Mini appears to be connected DEBUG: 0.5 rebuild_menus - self.supports_ratings=None, self.supports_tiles=None DEBUG: 0.5 KoboUtilities:set_toolbar_button_tooltip - start: text='None' DEBUG: 0.5 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders Driver: KoboTouchExtended' [1.03] main UI initialized... [1.03] Hiding splash screen Starting QuickView [17.83] splash screen hidden [17.83] Started up in 17.83 seconds with 1605 books Storage number map: {(7, 0): [(2, 'D')], (7, 1): [(3, 'C')], (7, 2): [(1, 'Y')], (7, 3): [(1, 'X')], (7, 4): [(1, 'W')], (7, 5): [(1, 'E')]} Storage number for USBSTOR\DISK&VEN_LINUX&PROD_FILE-STOR_GADGET&REV_0409\N604130003056&0: StorageDeviceNumber(type=7, number=5, partition_number=0) Drive letters for USBDevice(vendor_id=0x2237 product_id=0x4233 bcd=0x409 devid=usb\vid_2237&pid_4233&rev_0409 devinst=32) {'drive_letters': ['E'], 'pnp_id_map': {'E': '\\\\?\\usbstor#disk&ven_linux&prod_file-stor_gadget&rev_0409#n604130003056&0#{53f56307-b6bf-11d0-94f2-00a0c91efb8b}'}, 'readonly_drives': set(), 'sort_map': {'E': (5, 1)}} DEBUG: 45.6 KoboUtilities:_on_device_connection_changed - self.plugin_device_connection_changed.__class__: <class 'PyQt5.QtCore.pyqtBoundSignal'> DEBUG: 45.6 Methods for self.plugin_device_connection_changed: ['__call__', '__class__', '__delattr__', '__dir__', '__doc__', '__eq__', '__format__', '__ge__', '__getattribute__', '__getitem__', '__gt__', '__hash__', '__init__', '__init_subclass__', '__le__', '__lt__', '__module__', '__ne__', '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__setattr__', '__sizeof__', '__str__', '__subclasshook__', 'connect', 'disconnect', 'emit', 'signal'] DEBUG: 45.6 Have a Kobo device connected connected DEBUG: 45.6 BEGIN Get Device Path DEBUG: 45.6 Root path of device: E:\ DEBUG: 45.6 END Get Device Path DEBUG: 45.6 KoboUtilities:get_device - self.device_path="E:\" DEBUG: 45.6 KoboUtilities:set_toolbar_button_tooltip - start: text='None' DEBUG: 45.6 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders Driver: KoboTouchExtended' Job: 0 Get device information started DeviceJob: 0 Get device information done, calling callback DeviceJob: 0 Get device information callback returned Job: 1 Set library information started DeviceJob: 1 Set library information done, calling callback DeviceJob: 1 Set library information callback returned Job: 2 Get list of books on device started DEBUG: 0.0 KoboTouch:books - oncard='None' 2021-06-28 16:35:56 [DEBUG] KoboTouchExtended:settings: settings= Last edited by theducks; 06-28-2021 at 11:15 AM. Reason: Please ise spoiler tags for logs

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
How to avoid importing duplicate copies of Kindle books when adding books to calibre	kgwdc	Calibre	1	08-11-2018 07:19 PM
adding books to calibre	lexuitmokum	Library Management	2	07-09-2018 03:32 PM
Calibre & Covers: Adding books through Calibre vs dragging and dropping?	VirgoGirl	Calibre	12	06-08-2014 05:34 AM
Adding books to Calibre...	jrickert	Library Management	1	02-15-2013 02:41 AM

06-28-2021, 09:49 AM	#2
franklekens Addict Posts: 398 Karma: 3421956 Join Date: Sep 2009 Device: various Kobo's, Onyx Note2, Pocketbook 360, Kindle Keyboard	Actually, it's worse than getting error messages. Twice already, Calibre simply crashed while doing a transfer. I suspect this isn't an Ellipsa problem as much as a Calibre and/or Kobo (or Calibre/Kobo) problem. I've had it with previous devices as well; don't quite remember how I overcame the tedium/irritation.

06-28-2021, 10:08 AM	#3
PeterT Grand Sorcerer Posts: 13,511 Karma: 78910202 Join Date: Nov 2007 Location: Toronto Device: Libra H2O, Libra Colour	Run calibre in debug mode and post logs please Sent from my Pixel 4a using Tapatalk

06-28-2021, 10:13 AM	#4
theducks Well trained by Cats Posts: 31,055 Karma: 60358908 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	You really need to tell us all about your setup as we can not look over your shoulder. What OS? What version of Calibre (note 5.22.0 had a hot fix that won't notify if 5.22.0 was in place) Download that Send smaller batches than you have been, disconnect between each batch to allow the Kobo to process them. By crash: Do you mean Calibre just closes with no message (abnormal ending)? We really need to see a Log

06-28-2021, 10:51 AM	#5
franklekens Addict Posts: 398 Karma: 3421956 Join Date: Sep 2009 Device: various Kobo's, Onyx Note2, Pocketbook 360, Kindle Keyboard	Windows 10. What happened was that I got error messages that some particular book couldn't be uploaded. But when I then tried to upload that particular book, in many case there was no problem. (In one or two, there was, though I can't figure out why.) What also happened two or three times that after a number of these errors, Calibre just quit while trying such an upload. No error messages. I'd gone back to only uploading 30 titles at a time, and disconnecting the device after two or three uploads. Even then... What I did now: Upgraded from 5.22.0 to 5.22.1. Ran in debug mode. Tried to upload 50 or so books. Process hangs. No error message, the programme doesn't quite. I have to kill it off. There’s no bug report. Windows says 'calibre debug does not respond'. I'll try again.

06-28-2021, 11:03 AM	#6
franklekens Addict Posts: 398 Karma: 3421956 Join Date: Sep 2009 Device: various Kobo's, Onyx Note2, Pocketbook 360, Kindle Keyboard	My apologies, a debug file was created. I'd attach it here, but it seems to take forever to upload.

06-28-2021, 11:18 AM	#9
franklekens Addict Posts: 398 Karma: 3421956 Join Date: Sep 2009 Device: various Kobo's, Onyx Note2, Pocketbook 360, Kindle Keyboard	Also, although it crashed, I think (I can't be 100% sure) some of the books I tried to upload when it crashed were in fact uploaded to the device.

06-28-2021, 11:38 AM	#10
JSWolf Resident Curmudgeon Posts: 79,752 Karma: 145864619 Join Date: Nov 2006 Location: Roslindale, Massachusetts Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3	Could it be that you have some eBooks that have errors?

06-28-2021, 11:51 AM	#11
franklekens Addict Posts: 398 Karma: 3421956 Join Date: Sep 2009 Device: various Kobo's, Onyx Note2, Pocketbook 360, Kindle Keyboard	I don't know, I'll start to parse all 1600 of them one by one.

06-28-2021, 12:11 PM	#13
DNSB Bibliophagist Posts: 46,190 Karma: 168983734 Join Date: Jul 2010 Location: Vancouver Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos	Have you tried installing the Windows 64 bit version of calibre? Does this issue occur if you try using the KoboTouch driver instead of the KoboTouchExtended driver?

06-28-2021, 12:59 PM	#15
franklekens Addict Posts: 398 Karma: 3421956 Join Date: Sep 2009 Device: various Kobo's, Onyx Note2, Pocketbook 360, Kindle Keyboard	Indeed, that does the trick! At least it seems to. After installing the 64-bit version, I started uploading larger and larger groups of books and encountered no problems. I'm done with the entire library by now, but I feel pretty confident that this way I might have uploaded the entire library in one or two goes. Thanks for the tip and I'll keep this in mind. Does the upgrade link for the 64-bit version take me to a specific page for that, or will I always have to use the "alternate download site" link to get it?

Advert

Advert