04-29-2011, 10:06 AM | #1 |
Quack! Quack!
Posts: 92
Karma: 9176
Join Date: Apr 2011
Location: Florida
Device: kindle 3 & sony daily prs950sc
|
[Old Thread] Large Bulk Conversion
Has anyone else had the issue of calibre hanging when trying to bulk convert jobs large jobs like 18,000+
I found that i'm having to sort by author and then do like 3000 at a time. something else thats irratating is that im getting a bunch of errors and this little error window stacks up and i will have to go through each one and write down the error into notpad individually so i can go back an work on those files It would be nice if the jobs list was sortable by error or finished so it could be copied out of there... or all the errors could be spat out in a log file. Is there some such thing? And any suggestion on what i can do to prevent it hanging on large jobs? Intel 2 Quad q6600 @ 2.40ghz 6gb ram 64bit windows 7 so i'm pretty sure i have the computing power. |
04-29-2011, 10:11 AM | #2 |
Wizard
Posts: 3,130
Karma: 91256
Join Date: Feb 2008
Location: Germany
Device: Cybook Gen3
|
Moderator Notice Moved to correct forum. What exactly do you mean by "hanging"? If you mean that Calibre takes a long time on a certain conversion, that is probably normal. Depending on the quality of the source, it can take quite some time to convert certain books. |
Advert | |
|
04-29-2011, 10:12 AM | #3 |
creator of calibre
Posts: 43,858
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
Run calibre in debug mode and you will get a debug log.
|
04-29-2011, 10:13 AM | #4 |
Quack! Quack!
Posts: 92
Karma: 9176
Join Date: Apr 2011
Location: Florida
Device: kindle 3 & sony daily prs950sc
|
hanging = calibre freezes up doesnt respond and after waiting 30 minutes its still in such a state that its unlikely ever to continue and actually start doing the job.
It hangs after it has read the job list but before it starts doing the actual job conversions... so the little job counter still shows as 0 |
04-29-2011, 10:15 AM | #5 |
Quack! Quack!
Posts: 92
Karma: 9176
Join Date: Apr 2011
Location: Florida
Device: kindle 3 & sony daily prs950sc
|
@kovidgoyal ill try that after this next batch of 3k is done thanks...
so when running in debug mode and calibre freezes and u have to end task and restart where do u retrieve the bug file? |
Advert | |
|
04-29-2011, 10:24 AM | #6 |
Wizard
Posts: 3,130
Karma: 91256
Join Date: Feb 2008
Location: Germany
Device: Cybook Gen3
|
If you're trying to add all 18.000 files at once, I'd expect that to take about six times as long as adding 3.000 books to the queue.
"Unlikely ever to continue" is a very vague and subjective statement, by the way. You'll have to remember that Calibre is written in Python, which is, despite its obvious benefits, not the most performant of programming languages. Doing certain things may take a little while. As for the debug log, you'll get a message on startup telling you where the log will be saved. The log will also automatically be displayed once Calibre is terminated. |
04-29-2011, 10:34 AM | #7 | |
Quack! Quack!
Posts: 92
Karma: 9176
Join Date: Apr 2011
Location: Florida
Device: kindle 3 & sony daily prs950sc
|
"Unlikely ever to continue" is also very vague and subjective statement, by the way lol. Are we talking 6 x 30min for a total of 3 hours before it begins to actually convert. When i ctrl-alt-del run task manager and check out processes it has it listed as "Not Responding"
Quote:
cheers |
|
04-29-2011, 10:39 AM | #8 | |
Wizard
Posts: 3,130
Karma: 91256
Join Date: Feb 2008
Location: Germany
Device: Cybook Gen3
|
Quote:
As far as I know, Windows polls tasks somewhat regularly and if they don't respond, they get marked as "not responding", which doesn't necessarily mean that they aren't working. I've had programs doing calculations run for quite some time with a status "not responding" and finish their job. Like I said, Python isn't the fastest language around. You should be patient when trying to do such huge bulks. |
|
04-29-2011, 10:57 AM | #9 |
Quack! Quack!
Posts: 92
Karma: 9176
Join Date: Apr 2011
Location: Florida
Device: kindle 3 & sony daily prs950sc
|
thats somewhat true... you can tell the difference between the programs that are trully hung and the ones that are not by the movement/change of the memory in the private working set field.
If it stays the same and doesn't change at all over say a 5-30min time span. You can also go to the performance tab and click the resource monitor button down at the bottom then go to the through the different tabs and it will give you indicators as well if the program is truly frozen or just working things out in memory. |
05-10-2011, 04:56 PM | #10 |
Wizard
Posts: 4,812
Karma: 26912940
Join Date: Apr 2010
Device: sony PRS-T1 and T3, Kobo Mini and Aura HD, Tablet
|
I have an I7 with12 gig Ram and one book usually converts instantly. 10 books can take minutes. 100 books seem to take forever and calibre stops responding several times during this process. Just curious how long 3,000 books would take.
Helen |
05-10-2011, 05:57 PM | #11 | |
Well trained by Cats
Posts: 29,800
Karma: 54830978
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
Quote:
Pant Pant...'Could you slow down on the conversions for Petes sake ' I7. Gimme a break |
|
05-11-2011, 12:29 AM | #12 | |
Wizard
Posts: 4,812
Karma: 26912940
Join Date: Apr 2010
Device: sony PRS-T1 and T3, Kobo Mini and Aura HD, Tablet
|
Quote:
|
|
05-11-2011, 10:17 AM | #13 |
Well trained by Cats
Posts: 29,800
Karma: 54830978
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
|
05-11-2011, 11:57 AM | #14 | |
Wizard
Posts: 4,812
Karma: 26912940
Join Date: Apr 2010
Device: sony PRS-T1 and T3, Kobo Mini and Aura HD, Tablet
|
Quote:
Going to work in the Yukon for a few months with only a couple of antique laptops, so desktop will look better in the fall Helen |
|
05-11-2011, 02:23 PM | #15 | |
Well trained by Cats
Posts: 29,800
Karma: 54830978
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
Quote:
And I could be out of date , my newest PC has a P4 (No PCI-e, so I don't know PCI-E speeds) |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Bulk Command Line Conversion? | blobbo | Conversion | 1 | 05-24-2011 05:32 AM |
[Old Thread] Bulk ISBN Removal | brewjono | Calibre | 8 | 05-04-2011 06:15 PM |
[Old Thread] Bulk Converting Experiences | the_callant | Conversion | 5 | 04-29-2011 09:45 AM |
Easy way to modify thread subscription emails in bulk? | snipenekkid | Feedback | 11 | 02-06-2011 03:47 AM |
Bulk file font size conversion | Greg Rosler | Sony Reader | 5 | 08-07-2007 07:57 AM |