06-06-2010, 12:23 PM
|
#1 |
|
curmudgeon
  
Posts: 1,481
Karma: 5748190
Join Date: Jun 2006
Location: Redwood City, CA USA
Device: Kobo Aura HD, (ex)nook, (ex)PRS-700, (ex)PRS-500
|
0.7 -- Sending metadata to device is SSSSLLLOOOOOOOOOOW
Calibre 0.7, Mac OS X 10.6.3, Mac Pro Quad-core Xeon 2.8GHz, Sony PRS-700.
When I send books to my Reader, Calibre updates the metadata on the device. That's great! The problem is that with 400-ish books on the device it takes... wait for it... 10 minutes for the update to complete. And the update runs automatically each time I add or remove books from the reader. If the update can be sped up, that would be super. If not, can it at least be deferred until I finish deleting and downloading books? For most of those 10 minutes Calibre is consuming 100% of the CPU on one of my four cores. A quick sampling of the application suggests that nearly all of that time is spent messing around with xml files somehow (e.g., I saw an awful lot of XMLpathxxx entries in the profile data). What further information can I provide to help diagnose the problem? I'm happy to provide further data as needed. Xenophon Last edited by Xenophon; 06-06-2010 at 12:29 PM. Reason: complete a truncated sentence. |
|
|
|
06-07-2010, 09:45 AM
|
#2 |
|
Grand Sorcerer
Posts: 11,728
Karma: 6690881
Join Date: Jan 2010
Location: Notts, England
Device: Kobo Libra 2
|
I am trying with only some success to duplicate this. With 400 books on my PRS-300 and all metadata optimizations turned off (trying to simulate what I think is happening in your case), it takes 90 seconds to add a book, which is a far cry from 600 seconds.
One possibility: after adding, I have approx 233 collections. Do you have many more than that? |
|
|
|
| Advert | |
|
|
|
06-07-2010, 02:38 PM
|
#3 |
|
Member
Posts: 13
Karma: 60
Join Date: Feb 2009
Device: PRS-700
|
I'm seeing a similar problem (Windows XP, Calibre 0.7.1, Sony PRS-700).
Any time I do anything with the device (add a book, delete a book, update an author name, whatever) the actual update happens very fast, but 'sending metadata' always takes just over a minute. Over and over I have two entries in the job log. The first shows the book delete taking 0m 0s. The second shows sending metadata for 1m 4s or thereabouts. Its always just over a minute. Makes me wonder if there's a 60 second timeout involved somehow. (Collections: 116, Books 762) |
|
|
|
|
06-07-2010, 04:00 PM
|
#4 |
|
Evangelist
Posts: 412
Karma: 546196
Join Date: Mar 2009
Location: UK canal boat
Device: sony prs505, prs650, kobo Glo HD liseuses
|
Win XP Pro, Calibre 0.7.0, Sony 550 - regrettably I'm experiencing similar problems - collection of ~320 title spread over main memory and two cards in the reader. Every change made when the reader is plugged in is taking ~2m 30s. Exactly the same symptoms - a very fast update and then an agonising 'sending metadata'. Will see if this recurs on 0.7.1 - just a passing thought, is *all* the metadata being re-sent or just the metadata for the modified item(s)?
|
|
|
|
|
06-07-2010, 04:19 PM
|
#5 | |
|
Grand Sorcerer
Posts: 11,728
Karma: 6690881
Join Date: Jan 2010
Location: Notts, England
Device: Kobo Libra 2
|
Quote:
0.7.0 & 1 have a problem where corrected metadata for matched books is sent back to the device, then ignored. This isn't a problem for epubs that were put on the device by the instance of calibre currently used, because they will have the necessary ID in them to avoid sending the info again. Other formats aren't so lucky. To give hope: there are some changes that should appear in 0.7.2 that help. 1) the problem described above is fixed. Corrected metadata will be put in the device cache, and therefore not sent again and, more importantly, not converted to XML again. 2) several performance issues were fixed in the driver. Before these fixes, on my machine with 400 books (mostly epubs but ignoring the optimization), connecting the device took 14 seconds. Now it takes 1.6 seconds. Adding a book varied between 60 and 80 seconds. Now it takes 7. Given that my original numbers are so different from yours, I can't say what improvement you will see. It will probably be substantial, but we will need to see how much so. Another 'improvement' is the addition of much more detailed Sony driver performance tracing when using calibre-debug. The information should help localize where the problems are, if the problems remain. |
|
|
|
|
| Advert | |
|
|
|
06-07-2010, 06:35 PM
|
#6 |
|
Curmudgeon
Posts: 3,085
Karma: 722357
Join Date: Feb 2010
Device: PRS-505
|
I'm having the same problem. Looking forward to the fix. Calibre still rocks.
|
|
|
|
|
06-07-2010, 06:47 PM
|
#7 |
|
creator of calibre
Posts: 43,826
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
I will be releasing a beta specially for you SONY users with chaley's fixes before 0.7.2 so that we can nail the problem in 0.7.2, so stay tuned.
|
|
|
|
|
06-07-2010, 08:15 PM
|
#8 |
|
Wizard
Posts: 1,156
Karma: 32196
Join Date: Jan 2007
Location: Anchorage, AK
Device: Sony Reader PRS-505, PRS-650, PRS-T3, Pocketbook HD2
|
I'm glad to know I'm not the only one experiencing this.
|
|
|
|
|
06-07-2010, 11:26 PM
|
#9 |
|
creator of calibre
Posts: 43,826
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
Betas with chaley's fixes are available here:
http://calibre-ebook.com/downloads/betas/ Version number on the betas is the same as current release so if you're on windows you have to uninstall calibre and then install the beta |
|
|
|
|
06-08-2010, 08:07 AM
|
#10 |
|
Grand Sorcerer
Posts: 11,728
Karma: 6690881
Join Date: Jan 2010
Location: Notts, England
Device: Kobo Libra 2
|
If someone suffering from the performance problem tries the beta (and I hope someone does), it would help me if you would capture and post the performance log. That information will help me understand where the bottlenecks are.
To get the log, run calibre-debug -g from a command prompt/box. Capture the output (there might be several hundred lines) and post it. Also note that the best performance will come only with the second insertion. The first one will attempt to update the metadata, and I hope succeed. |
|
|
|
|
06-08-2010, 09:24 AM
|
#11 |
|
Member
Posts: 13
Karma: 60
Join Date: Feb 2009
Device: PRS-700
|
Seems to fix it. Here's what I did:
Uninstalled Calibre 0.7.1 Installed the beta and started it After it got the book list, I deleted a couple of books from the SD card metadata send took just over a minute Deleted a book from the main memory metadata send took just over a minute Then I came here and saw your post about wanting debug log.. Ran the debug version and added back the book I had deleted from main memory metadata send took 4 seconds (of course) Ran the non-debug version and deleted the book again metadata send took 4 seconds So I think it works, but you need to 'touch' both main memory and the SD card (and/or the memory stick) to get all the metadata sorted. Then you're good to go. Huzzah! Thanks! Now to go back to thinking up clever things to do with custom columns :-) (edit - fixed typo) |
|
|
|
|
06-08-2010, 07:48 PM
|
#12 |
|
Junior Member
Posts: 3
Karma: 10
Join Date: Dec 2009
Device: Sony PRS-505
|
Beta works for me!!
Great job - the beta seems to have solved the problem for me. Speeds are now almost back to those I got with version 0.6.55, and presumably Calibre is now doing more work.
|
|
|
|
|
06-09-2010, 11:24 AM
|
#13 |
|
curmudgeon
Posts: 1,481
Karma: 5748190
Join Date: Jun 2006
Location: Redwood City, CA USA
Device: Kobo Aura HD, (ex)nook, (ex)PRS-700, (ex)PRS-500
|
I downloaded the beta-for-sony version of Calibre last night, but I didn't have time to install it or try it out. I'll attempt to get a debug log produced and uploaded tonight.
Xenophon |
|
|
|
|
06-09-2010, 02:32 PM
|
#14 |
|
Evangelist
Posts: 412
Karma: 546196
Join Date: Mar 2009
Location: UK canal boat
Device: sony prs505, prs650, kobo Glo HD liseuses
|
If I get time, will download 2nite; should definitely get there by Thursday! Just love Calibre!
|
|
|
|
|
06-09-2010, 11:41 PM
|
#15 |
|
curmudgeon
Posts: 1,481
Karma: 5748190
Join Date: Jun 2006
Location: Redwood City, CA USA
Device: Kobo Aura HD, (ex)nook, (ex)PRS-700, (ex)PRS-500
|
I just gave it a try with the beta 7.1. Updating meta-data now takes about 13-15 seconds. A tremendous improvement! The debug log reads as follows:
Spoiler:
Thanks for the improvements; hope this log is useful. Xenophon |
|
|
|
 |
«
Previous Thread
|
Next Thread
»
| Thread Tools | Search this Thread |
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Book covers not sending to device | tdavis74 | Calibre | 5 | 07-25-2010 11:38 PM |
| PRS-505 sending PDF to device too much slow | danizzz | Sony Reader | 3 | 07-07-2010 01:26 AM |
| PDF metadata not written sending to device | joselitux | Calibre | 8 | 05-25-2010 12:03 AM |
| Sending E-Books to Device | Lady Fitzgerald | Calibre | 3 | 05-16-2010 03:43 PM |
| default format when sending to device | richreads | Calibre | 5 | 04-05-2010 04:20 PM |
All times are GMT -4. The time now is 02:06 AM.