04-27-2011, 04:42 PM | #106 |
creator of calibre
Posts: 43,779
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
change author/title/delete/run a conversion.
|
04-29-2011, 04:48 PM | #107 |
calibre/Sigil Developer
Posts: 4,606
Karma: 2092290
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
v1.3 Released
Changes in this release:
|
Advert | |
|
05-05-2011, 04:18 PM | #108 |
Addict
Posts: 293
Karma: 21022
Join Date: Mar 2011
Location: NL
Device: Sony PRS-650
|
A new sort of ISBN:
978-xxx-xxx-xxx^C so a ^ just before the check digit. Interesting one. Just seen once ISBN-13: 978-0-451-46121^6 (alk. paper) ISBN-10: 0-451-46121-5 (alk. paper) (also interesting, the ISBN-10 is a 'normal' one |
05-05-2011, 04:25 PM | #109 |
calibre/Sigil Developer
Posts: 4,606
Karma: 2092290
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
@drMerry - is that a retail book or a scan error? It does look very odd.
|
05-05-2011, 07:36 PM | #110 |
Addict
Posts: 293
Karma: 21022
Join Date: Mar 2011
Location: NL
Device: Sony PRS-650
|
It IS odd.
It is a scan of a retail book. I do not think it is an error, but I will look if I can find the a image of the book. One other thing. While you scan at background, there is a new problem. I scanned 18000 (yes 18000) books at once. No problem. On details I could see a lot of numbers found. @79% calibre crashed. And no isbn was saved. A fix to this would be to save direct (performance issue) or maybe to save it in a temp-file that you could look for next time you start calibre / the plugin. But maybe I'm the only one with this problem. |
Advert | |
|
05-06-2011, 01:29 AM | #111 |
Junior Member
Posts: 1
Karma: 10
Join Date: May 2011
Device: none
|
Thanks for this plugin!
I had problems with some books. One of them I would get this exception: XMLSyntaxError: PCDATA invalid Char value 24, line 159, column 54 After some print statements, I noticed the xml generated in function _read_pdf_text from file scan.py had some invalid characters. So I modified it to replace most of non-printable chars by something else ('_'). I'm attaching a diff of the modifications I did. patch.scan.py.txt |
05-06-2011, 05:31 AM | #112 |
calibre/Sigil Developer
Posts: 4,606
Karma: 2092290
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
@Saddan - any chance you could PM me a link to the file that caused this error? I will delete it when done if it is commercial or whatever. I appreciate you taking the time to volunteer a fix, though there are some other functions in Calibre I could possibly use so if I could test with a file or two it would help greatly.
@drMerry - 18,000? Sigh. You wouldn't try to convert 18,000 books at once - Extract ISBN is doing a lot of the same steps underneath so I am not surprised it died. I cannot update ISBNs from the background as the database updates are single threaded, that is why it works the same way as metadata downloads in 0.8. Trying to "resume" a job after a Calibre crash is way more work than I can be bothered with to be honest, I would rather just not have it crash in the first place. Did you see memory usage climbing before it crashed? The most likely explanation is a memory leak somewhere. |
05-06-2011, 08:44 AM | #113 |
calibre/Sigil Developer
Posts: 4,606
Karma: 2092290
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
I've had a quick look at the "bulk extract" and there is a memory leak issue going on. However it is inside the Calibre code in the converters (non-pdf) as far as I can tell - certainly extracting from LRF files (which is horribly slow) the leak is pretty nasty and noticeable.
I'm sure at some point Kovid and co may take a look into this - in the meantime stick to extracting ISBN from small batches at a time and you will be fine. The other option I have is to run the extraction in separate worker processes like bulk conversions do. It would be a little slower probably but at least this problem should disappear and the GUI hopefully wouldn't choke every now and then like it does currently. |
05-06-2011, 09:03 AM | #114 | |
Addict
Posts: 293
Karma: 21022
Join Date: Mar 2011
Location: NL
Device: Sony PRS-650
|
Quote:
And of-course you should want to convert / run it in small parts, but if I had, this leak would not be noticed at this point . I did not check the mem, but I see you did it. A (rather easy?) way to 'catch' this error (partly) would be to do the following: Create a silent-run function. This function would run a scan and silently apply changes. You than could use this function to create your own batch, and have a list of files todo whom you run in batches of 100, 1000, user-selected number of files at once. After each batch, apply changes, remove files from todo. |
|
05-06-2011, 10:59 AM | #115 |
calibre/Sigil Developer
Posts: 4,606
Karma: 2092290
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
v1.3.1 Released
Changes in this release:
Note that as per my post above there are still memory leak issues with some of the "conversions" that get run in the background. I've made sure that the plugin releases all file handles and resources that it creates asap so anything else is in the Calibre code. To try to work around that will require greater changes to this plugin than I want to make at this point but I will likely revisit it in future once I finish another new plugin that will work in a similar way. |
05-06-2011, 11:22 AM | #116 | |
Addict
Posts: 293
Karma: 21022
Join Date: Mar 2011
Location: NL
Device: Sony PRS-650
|
hmm
error on install Quote:
|
|
05-06-2011, 11:25 AM | #117 |
calibre/Sigil Developer
Posts: 4,606
Karma: 2092290
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
Works fine for me... you sure you haven't run out of space or something with all your temp file issues? Try it again.
|
05-06-2011, 11:29 AM | #118 |
Addict
Posts: 293
Karma: 21022
Join Date: Mar 2011
Location: NL
Device: Sony PRS-650
|
|
05-06-2011, 11:38 AM | #119 |
calibre/Sigil Developer
Posts: 4,606
Karma: 2092290
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
Do the usual checklist - is antivirus or something else blocking the downloads etc. Do other plugins install ok. Does it work if you install it manually etc.
|
05-06-2011, 11:43 AM | #120 |
Addict
Posts: 293
Karma: 21022
Join Date: Mar 2011
Location: NL
Device: Sony PRS-650
|
On my second pc, I can now use the plugin.
I can see there is some mem-usage improvement Thanks for this quick fix! (first pc has no problem with other plugins, strange....) EDIT: Works Don't know what the issue was.. Last edited by drMerry; 05-06-2011 at 12:06 PM. |
Thread Tools | Search this Thread |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Extract ISBN from PDF? | mdroberts | Calibre | 14 | 12-16-2016 07:32 AM |
[Old Thread] Extract ISBN from file name | ChristianQ | Calibre | 59 | 12-09-2015 05:08 AM |
[GUI Plugin] Plugin Updater **Deprecated** | kiwidude | Plugins | 159 | 06-19-2011 12:27 PM |
[Old Thread] Auto Extract ISBN-Feature request | UnraisedArc | Calibre | 60 | 03-23-2011 09:31 AM |
Displaying ISBN column in the main GUI | tilleydog | Library Management | 26 | 02-25-2011 04:08 AM |