[Kobo] remarks on loading big libraries

[anacreon]

I have the Elipsa since day one (24 June) and started reorganizing my library before, since I had many books in my Archives I wished to read or have at hand but couldn't before, either because of bulk (all my other Kobos have 8 Go storage, Elipsa 32), or readability on smaller devices (PDFs, kepubs with maps/tables etc.)

I always use the latest versions of Calibre (5.22, portable so 32bit) and its plugins, mainly Kobo Utilities/Kobo Touch Extended. I recently downloaded the regular 64bit Calibre to convert those rare epubs which didn't convert to kepub either within Calibre, or (the great majority) while transferred, but I have had only 10 epubs to copy for conversion up to now.

Transferring 4372 items/5.63 Go was a long and painful process. I had a few "database corrupted". The first time, disconnecting from my Kobo account wasn't enough, so I had to do a manual reboot. Subsequently, disconnecting/reconnecting was enough, but still some work. Today, I decided to write down the whole rigmarole:

1. connection of Elipsa to Calibre: Elipsa and Calibre register 2039 items in common
2. connection: Elipsa registers 3051, Calibre 3005; I manage to harmonize 45 items (all with multiple authors), but one can't be found (it has only one author)
3. connection: Elipsa registers 4096 items of which 37 must be harmonized (36 multiple authors, 1 single author with two first names)
4. connection: Elipsa registers 4372 items of which 15 must be harmonized
5. connection, just to update metadata and reading positions, check the database and save it

Calibre seems to have difficulties with a few multiple authors, but none with many many more items with multiple authors, or authors with 2 or more first names.

The bulk of my transfers is done, and I hope I won't have to repeat the process soon.

[davidfor]

If the issue is matching multiple authors, then it is probably Kobo at fault as much as anything. Calibre will write the author details using a dc:contributor for each author. But, Kobo only reads the first dc:contributor. I use a metadata plugboard to put all the authors on one, separated by commas as Kobo expects. Doing that has reduced the number of mismatches when adding books to nearly zero.

[anacreon]

Originally Posted by davidfor

If the issue is matching multiple authors, then it is probably Kobo at fault as much as anything. Calibre will write the author details using a dc:contributor for each author. But, Kobo only reads the first dc:contributor. I use a metadata plugboard to put all the authors on one, separated by commas as Kobo expects. Doing that has reduced the number of mismatches when adding books to nearly zero.

That's very interesting. Could you possibly put up your plugboard? Presently I have {author_sort}/{series}/{title} {series_index}, and I don't know how to modify the author_sort.

[davidfor]

Originally Posted by anacreon

That's very interesting. Could you possibly put up your plugboard? Presently I have {author_sort}/{series}/{title} {series_index}, and I don't know how to modify the author_sort.

That looks like a save template. Which is use for the file name when sending the book.

The metadata plugboard I use is:

program: raw_list('authors', ', ')

And that goes into the "authors" field.

[anacreon]

Originally Posted by davidfor

That looks like a save template. Which is use for the file name when sending the book.

The metadata plugboard I use is:

program: raw_list('authors', ', ')

And that goes into the "authors" field.

I feel stupid, but where is that plugboard? I explored Kobo Utilities, and looked at preferences, but have no idea.
Sorry, and thanks

[theducks]

P(Calibre) Preferences: Plugboards
You designate which device an entry applies to.

[anacreon]

Originally Posted by theducks

P(Calibre) Preferences: Plugboards
You designate which device an entry applies to.

I moved Calibre from French to English in case it was a language problem, but I still can't find "Plugboards "except in Plug-ins\preferences\plugboard, which can't be modified.
And in Kobo Touch Extended, the template language doesn't seem to fit with Davidfor's code.

[chaley]

Originally Posted by anacreon

I moved Calibre from French to English in case it was a language problem, but I still can't find "Plugboards "except in Plug-ins\preferences\plugboard, which can't be modified.
And in Kobo Touch Extended, the template language doesn't seem to fit with Davidfor's code.

See the attached screen capture.

[anacreon]

Originally Posted by chaley

See the attached screen capture.

Thank you!

I created one new plugboard with Format any, Device KoboTouchExtended, Source Template program: raw_list('authors', ', ',) and Destination Field Authors.
I hope I didn't introduce errors, and I wonder whether it will also apply for PDFs or if I should create a line for PDFs for any device, and duplicate the first plugboard I created, so there is one for kepubs and one for epubs.

EDIT: FYI, I returned to French for Calibre, and "plugboard" was translated as "Tableaux de connexion des métadonnées" - quite a mouthful, which I had not connected to "plugboard", since there are a few "plugboards" found in the depths of the preferences in the French version. Which might explain also why my eyes automatically skimmed over it when I did turn to the English version of Calibre.

EDIT 2: Should I have chosen Kobo instead of KoboTouchExtended for the device? Which would probably also work for any Format too.

[DNSB]

Originally Posted by anacreon

EDIT 2: Should I have chosen Kobo instead of KoboTouchExtended for the device? Which would probably also work for any Format too.

I'm going to assume that that you meant Kobo instead of KoboTouch since I didn't see KoboTouchExtended as an option, KoboTouch is intended for any Kobo reader with a touch screen so it would be the correct choice. Generally, I tend to set most plugboards to any device and any format unless there is some reason such adding series to title which is needed for a Kindle but not a Kobo.

[davidfor]

Originally Posted by anacreon

EDIT 2: Should I have chosen Kobo instead of KoboTouchExtended for the device? Which would probably also work for any Format too.

You choose the driver that you use, or the "any" versions as @DNSB suggested. But, "Kobo" is only for the Kobo WiFi and the original Kobo devices. For current Kobo devices, you would use whichever of KoboTouch or KoboTouchExtended driver that you are using. I have both plugboards configured as I use both at different times.

[anacreon]

@ both Davids: I chose KoboTouchExtended since it is what I use. I don't use KoboTouch, but it does appear in my drop down list. I don't know why KoboTouchExtended doesn't appear in DNSB's list.

[davidfor]

Originally Posted by anacreon

@ both Davids: I chose KoboTouchExtended since it is what I use. I don't use KoboTouch, but it does appear in my drop down list. I don't know why KoboTouchExtended doesn't appear in DNSB's list.

It means he hasn't installed the KoboTouchExtended driver.

[DNSB]

Originally Posted by davidfor

It means he hasn't installed the KoboTouchExtended driver.

I checked and the KoboTouchExtended v3.4.5 driver is installed. However it is disabled. I prefer reading epubs so only enable the KoboTouchExtended driver when I am testing kepub features. I could use the Enable Extended Kobo Features checkbox but on several occasions, I forgot to uncheck it.

[davidfor]

Originally Posted by DNSB

I checked and the KoboTouchExtended v3.4.5 driver is installed. However it is disabled. I prefer reading epubs so only enable the KoboTouchExtended driver when I am testing kepub features. I could use the Enable Extended Kobo Features checkbox but on several occasions, I forgot to uncheck it.

You mentioned the drop-down. I didn't look at that and forgot that only active drivers appear in it. I have configured a metadata plugboard for both drivers. They appear in the "Existing plugboards" list. But, the plugboard for the disabled driver is shown in grey. When you select it, there is a message about the driver being disabled and you cannot change the plugboard.