View Full Version : Sending metadata to Wifi Kobo is slow


Joyful
10-29-2010, 06:07 AM
I hate to bring this up because I love Calibre but this is bothering me.

I've noticed that Calibre is handling uploads much slower than it used to.

time to get device info: 0s
time to get list of books on device: 4s
time to upload 1 book to device: 2s
time to send metadata to device: 2m 16s

It was quite fast with my original Kobo so I'm wondering what may have happened since I started using my WiFi Kobo.
Any ideas?

Joyful

kovidgoyal
10-29-2010, 10:29 AM
Proper support for the Wifi Kobo will only be in the next release of calibre.

Joyful
10-29-2010, 02:54 PM
Thanks, Kovid!

Joyful

chrisakavern
04-06-2011, 01:30 AM
Proper support for the Wifi Kobo will only be in the next release of calibre.

I just got a WiFi Kobo and it is still very slow to upload Meta Data. Otherwise I love this reader and Calibre is AWESOME!!

kovidgoyal
04-06-2011, 01:38 AM
I have no idea, I don't maintain the Kobo plugin in calibre, timlegge is your man. I'd say that sending metadata will take long if you have a lot of books.

Manichean
04-06-2011, 01:40 AM
Which version of Calibre are you running? What is your OS?

chrisakavern
04-08-2011, 01:57 AM
Windows 7, Calibre 0.7.53 and the Kobo 1.9

Joyful
04-23-2011, 04:10 AM
I'm finding this problem again with my WiFi Kobo (not the one I had the original problem with - this is a newer one).
Time to upload a book 3 secs.
Time to upload the metadata has risen to 16 minutes 38 secs.
(To compare, I uploaded the same book onto my original Kobo and it took 0 s and 1 s for the metadata.)
Anyone have any idea why this is and what I can do to fix the problem?

According to Windows the total free space on the device is 799 MB.

Kobo WiFi
software version 1.9
Calibre 0.7.50

timlegge
04-23-2011, 06:36 AM
Hi

I have been busy but I will take a look at it. It will probably be early next week though.

Tim

Joyful
04-23-2011, 06:05 PM
Thanks, Tim!
Joyful

Shack70
04-23-2011, 06:23 PM
I'm finding this problem again with my WiFi Kobo (not the one I had the original problem with - this is a newer one).
Time to upload a book 3 secs.
Time to upload the metadata has risen to 16 minutes 38 secs.
(To compare, I uploaded the same book onto my original Kobo and it took 0 s and 1 s for the metadata.)
Anyone have any idea why this is and what I can do to fix the problem?

According to Windows the total free space on the device is 799 MB.

Kobo WiFi
software version 1.9
Calibre 0.7.50


Are you plugging it into a hub or directly into the PC? This may not be a Calibre problem but a Windows 7 problem. http://windows7professional.wordpress.com/2010/02/06/windows-7-usb-transfers-slow/

Joyful
04-26-2011, 08:20 PM
USB hub can't be the problem as metadata upload times to original Kobo are short using the hub.

No matter which USB port I use the metadata times are 14-17 minutes on the WiFi Kobo and it doesn't matter whether I'm uploading 5 books at a time or just one. Same time to remove a book as well.

I'm worried this may be a Kobo problem and nothing to do with Calibre and I'll have to do a reset of the device but I'll wait and see what Tim says first.

timlegge
04-26-2011, 10:03 PM
USB hub can't be the problem as metadata upload times to original Kobo are short using the hub.

No matter which USB port I use the metadata times are 14-17 minutes on the WiFi Kobo and it doesn't matter whether I'm uploading 5 books at a time or just one. Same time to remove a book as well.

I'm worried this may be a Kobo problem and nothing to do with Calibre and I'll have to do a reset of the device but I'll wait and see what Tim says first.

So far my testing on Linux sees to support that it might be local to your kobo. I see metadata times under 3 seconds in my testing. I dont have access to windows 7 at the moment so I cannot test there.

How many books do you have on your device.

Tim

Joyful
04-30-2011, 01:35 AM
About 300.
Is number of books significant?

I'm trying to remember if this behaviour starting showing up after I upgraded the firmware or whether this was happening before.

I appreciate you taking the time to look into this for me, Tim!
I'll probably do a reset and start over. I don't really know what else to do.

Joyful

chrisakavern
04-30-2011, 02:47 AM
I too am experiencing this slow load time of the Metadata if I load one book or 20 it's still very slow. Including the preloaded I have 305 books loaded. I am also nut plugging it into the computer via a hub. and the reader is software version 1.9

Update: I installed Calibre on my Linux Machine and this problem is not present, I am thinking it has to be a Windows 7 issue.

Joyful
05-06-2011, 01:43 AM
A friend of mine has just upgraded the software on her WiFi Kobo to 1.9 and is now having the same issue of long metadata uploads. She wasn't having any issues before the upgrade.

itimpi
05-06-2011, 01:52 AM
The fact that the issue starts with a firmware upgrade strongly suggests it is basically a Kobo issue rather than a Calibre one.

DoctorOhh
05-06-2011, 02:09 AM
A friend of mine has just upgraded the software on her WiFi Kobo to 1.9 and is now having the same issue of long metadata uploads. She wasn't having any issues before the upgrade.

In the next release (0.8) there is going to be a user defined device driver. Chaley talks about it below, you might want to give it a try.

There is a new device driver in the next release (0.8.0 I think) that allows you to customize where books go. The driver plugin name is User Defined. The intent was to supply a driver that can be used for rooted or non-standard devices, but it can also replace standard device drivers.

You specify three things to set it up:
- The USB IDs to match your device.
- For Windows, the names of the drives for the device for both main memory and a card.
- The root folders for books in main memory and the card.
There is a function in preferences -> miscellaneous to help you get the correct USB IDs and (on windows) the drive names.

If you use this driver to replace an existing one, you must disable the original or it will match (and connect) first.

Note that this driver provides no device-specific functionality. For example, it doesn't know about Sony collections, Kindle annotations, and the Nook Color magazine special case. It provides functions similar to connect-to-folder, but with automatic connection and main + SD card capability.

timlegge
05-06-2011, 09:24 PM
A friend of mine has just upgraded the software on her WiFi Kobo to 1.9 and is now having the same issue of long metadata uploads. She wasn't having any issues before the upgrade.

Hi

Sorry for the delay. I just tried on Windows XP and I am seeing 24 seconds to simply update the metadata for one record.

I am not sure though when I will be able to look for the reason.

Tim

TonyToews
05-11-2011, 01:07 AM
I'm not concerned as I need to charge the Kobo anyhow usually but I'm seeing the same problem. Over 7 minutes to update the metadata. While I'm currently on Windows 7 and version 0.8 of Calibre I also was having the same problem on Windows XP with an older version of Calibre.

TonyToews
05-17-2011, 01:45 AM
BTW I've added more books to my Kobo and the time taken has increased from 7m 47s to 8m 10s. The time is very consistent plus or minus 1 or 2 seconds when I only add 1 or 2 books but is slowly increasing as I add more books.

theducks
05-17-2011, 10:56 AM
I think some of this may be the re-write of metadata.calibre (the list oflast known books on your device).
Mine is now 12.5M :eek: for 2146 books

slieveen
05-27-2011, 12:18 PM
On a single ereader, why would you want more than 100 books? I have 5000 ebooks in my Calibre Library on the PC but but on my kindle I have four collections: 50 unread novels, 20 humor books, 20 non-fiction, and 8 reference.

These numbers fluctuate as I read through the books and I add to the ereader as I come across anything new that I want to read right away.

Unless you're kidnapped and held in a cave somewhere with your charger and an electrical outlet, it's unlikely that you need many more books than this on any portable device at any given time. Moreover, Calibre has a far superior library management capability on a PC than that found on any dedicated ereader.

By limiting the number of books on your device and ensuring that you have selected "manual management" in Preferences > Sending data to devices, I would hope that your load times were measured in a few seconds per upload.

Of course I'm no expert and only relating my experience with this excellent software when used with two kindle 3's, a Sony PRS 350, and a Hipstreet Reader. In all cases metadata transfers take seconds per book.

Joyful
05-30-2011, 04:56 PM
I think some of this may be the re-write of metadata.calibre (the list oflast known books on your device).
Mine is now 12.5M for 2146 books.

Hmmm, so if I do a factory reset then I may see metadata upload times come down but the more books I add the longer the times will get?

I'm reluctant to do a factory reset of my Kobo because if it doesn't help then it's going to take a loooonng time to reload my books.

I'm concerned that not too many people are reporting this problem. Does that mean that this is specific to just a few Kobos or are there not that many people with the upgrade that use Calibre and post here?

On a single ereader, why would you want more than 100 books? I have 5000 ebooks in my Calibre Library on the PC but but on my kindle I have four collections: 50 unread novels, 20 humor books, 20 non-fiction, and 8 reference.

These numbers fluctuate as I read through the books and I add to the ereader as I come across anything new that I want to read right away.

Unless you're kidnapped and held in a cave somewhere with your charger and an electrical outlet, it's unlikely that you need many more books than this on any portable device at any given time. Moreover, Calibre has a far superior library management capability on a PC than that found on any dedicated ereader.



I like to read more than one book at a time and I like to have them all or most of them with me . It's just easier and works for me. (and the Kobo comes preloaded with 100 books).

By limiting the number of books on your device and ensuring that you have selected "manual management" in Preferences > Sending data to devices, I would hope that your load times were measured in a few seconds per upload.

I would like to use my Kobo to it's full potential.
I do have manual management selected.
I would hope so too but that's not the reality.


The problem seems to be on my Windows 7 and my XP machines.
I updated Calibre to 8.2.

Joyful
06-12-2011, 02:57 AM
I finally did a factory reset and and my metadata upload times went from 14-17 minutes to a few seconds!
I've added quite a few of my books back and upload times remain very short.
:)