[GUI Plugin] Extract ISBN - Page 35

Wiggo · 04-04-2024, 04:57 PM

Cause of PDF

kiwidude · 04-04-2024, 06:16 PM

Quote:

Originally Posted by Shet

Hi, is there a way to try to tell me where is the problem with this book?

Code:

Starting job: Extract ISBN for 1 books 
=================================================== 
Title:  TEST 
Format: PDF 
Path:   D:\E_BOOKS\E_BOOK LIBRARY\Shet\TEST (29191)\TEST - Shet.pdf 
--------------------------------------------------- 
Exception when scanning for ISBN: not all arguments converted during string formatting 
  Failed to extract ISBN 
=================================================== 
Scan complete, with 1 failures

Thanks

Hi Shet - this looks like the same problem that NegevRain is having. My answer to you is the same as to them - what version of calibre are you running and on what operating system? Run calibre in debug mode and include all the output.

Running the latest version of this plugin on calibre 7.7 on Windows 10 for me everything works perfectly fine.

Wiggo · 04-05-2024, 12:01 PM

Quote:

Originally Posted by kiwidude

Running the latest version of this plugin on calibre 7.7 on Windows 10 for me everything works perfectly fine.

Even extracting ISBN from PDFs?

Shet · 04-05-2024, 03:24 PM

Quote:

Originally Posted by kiwidude

Hi Shet - this looks like the same problem that NegevRain is having. My answer to you is the same as to them - what version of calibre are you running and on what operating system? Run calibre in debug mode and include all the output.

Running the latest version of this plugin on calibre 7.7 on Windows 10 for me everything works perfectly fine.

HI:
calibre 7.7.0
Win 10

Code:

ApplicationPaletteChange event ignored
Using calibre Qt style: True
calibre Protokol diagnostiky
calibre 7.7  embedded-python: True
Windows-10-10.0.19045-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19045')
Python 3.11.5
Windows: ('10', '10.0.19045', 'SP0', 'Multiprocessor Free')
Interface language: sk
EXE path: C:\Program Files\Calibre2\calibre-debug.exe
Successfully initialized third party plugins: Count Pages (1, 13, 5) && Extract ISBN (1, 6, 1) && Find Duplicates (1, 10, 9) && Goodreads (1, 8, 1) && databazeknih.cz (1, 5, 18)
calibre 7.7  embedded-python: True
Windows-10-10.0.19045-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19045')
Python 3.11.5
Windows: ('10', '10.0.19045', 'SP0', 'Multiprocessor Free')
Interface language: sk
EXE path: C:\Program Files\Calibre2\calibre-debug.exe
Successfully initialized third party plugins: Count Pages (1, 13, 5) && Extract ISBN (1, 6, 1) && Find Duplicates (1, 10, 9) && Goodreads (1, 8, 1) && databazeknih.cz (1, 5, 18)
QPA platform: windows
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 127.66492146596858 x 127.59069767441859
[0.00] Starting up...
[0.00] Showing splash screen...
[0.17] splash screen shown
[0.17] Initializing db...
[0.91] db initialized
[0.91] Constructing main UI...
[2.11] GUI main window shown
Key 'S' for shortcut Uložiť na disk is already used by Zlúčiť záznamy o knihách, ignoring
Key 'A' for shortcut Open book folder is already used by Pridať knihy, ignoring
Key 'E' for shortcut Presunúť na ďalšiu zhodu is already used by Upraviť metadáta, ignoring
[2.16] main UI initialized...
[2.16] Hiding splash screen
Traceback (most recent call last):
  File "calibre_plugins.extract_isbn.pdf", line 46, in get_isbn_from_pdf
  File "calibre\utils\ipc\simple_worker.py", line 255, in fork_job
  File "calibre\utils\ipc\simple_worker.py", line 180, in run_job
  File "calibre\utils\ipc\simple_worker.py", line 119, in communicate
calibre.utils.ipc.simple_worker.WorkerError: Worker failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "calibre_plugins.extract_isbn.jobs", line 263, in scan_format_for_isbn
  File "calibre_plugins.extract_isbn.pdf", line 50, in get_isbn_from_pdf
RuntimeError: Failed to run pdfinfo/pdftohtml

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "calibre_plugins.extract_isbn.jobs", line 77, in extract_threaded
  File "calibre_plugins.extract_isbn.jobs", line 244, in scan_for_isbn
  File "calibre_plugins.extract_isbn.jobs", line 271, in scan_format_for_isbn
TypeError: not all arguments converted during string formatting

THX

kiwidude · 04-05-2024, 10:28 PM

Quote:

Originally Posted by Wiggo

Even extracting ISBN from PDFs?

Yes Wiggo - there is no issue whatsoever for me with PDFs. So stop making statements about how this plugin does not work in that regard to everyone. If you are having issues then it is something specific to your setup.

kiwidude · 04-05-2024, 10:31 PM

Quote:

Originally Posted by Shet

HI:
calibre 7.7.0
Win 10

Hi Shet - thanks for that debug log. Now we can see more of the actual underlying problem happening. As I had hypothesised there are two errors happening and one is "hiding" the other. However that still doesn't explain what the original error is.

Please install the attached version of the plugin which includes some extra debug print statements so maybe we can see where it starts to go wrong and figure out why. My guess is a problem with the pdftohtml.exe not running on your machine - perhaps due to over-aggressive antivirus software? If you can either disable such A/V scanning or add an exclusion for the C:\Program Files\Calibre2 folder/subfolders.

Please paste back the job output from when you run it (assuming you still get an error with any antivirus disabled).

Wiggo · 04-06-2024, 02:05 AM

Quote:

Originally Posted by kiwidude

Yes Wiggo - there is no issue whatsoever for me with PDFs. So stop making statements about how this plugin does not work in that regard to everyone. If you are having issues then it is something specific to your setup.

Yes, I have Windows and for me and others it has not worked with PDFs for years. There is also a workaround, but unfortunately it has other disadvantages. If you are interested then read from post #410, #420 ff, #428 ff and #475 ff.

Unfortunately, you have so far avoided commenting on this particular problem.

kiwidude · 04-06-2024, 02:41 AM

Wiggo - if you do something constructive (like follow the instructions I gave above and provide the debug and plugin logs) then maybe I can try to help. However the *fact* is that I can't replicate the issue - the plugin works perfectly fine for me and clearly the vast majority of users or else there would be far more posts about it. As for why no response before from me - in 2021 I wasn't maintaining this plugin at that time, davidfor was so I never saw that post.

There has been a bug where it reports a string formatting error rather than the real underlying error. So the actual "final" error that people have posted is useless from a debugging perspective. Until I see debug logs to say otherwise I believe the problem will lie in trying to run pdftohtml or pdfinfo executables on your system. Which are calibre provided executables and nothing I have control over. As I said in the post above if they are failing to execute then the first step is to find out why that is - perhaps you have antivirus interfering for instance. You could try running the command line it is executing manually to see if that works.

But only *you* can do anything about this when I can't replicate the issue.

Comfy.n · 04-06-2024, 08:57 AM

FWIW, I did some rounds of tests with the suggested pdfinfo.exe replacement, to see if I would get more ISBN detections than with the built-in one. Conclusion was: I get the same results, using either.

On this specific round, I've used the save to single folder Calibre feature and ran a PDF-Xchange search on all PDFs in that directory for "ISBN", and here's what I found (I've pasted the search results):

ISBN 978-85*275-0036-4
ISBN 0S-2CM - 1655-1
ISBN 978-I-'77046-048-5
ISBN 978 -S 5 -204-43 14-9

Those were mere OCR errors, there's a wildcard, there's an I instead of 1, some random apostrophe and so on.

ISBN 1-56924-647-5
ISBN: 0-595-26912-5
ISBN 0-7710-8157-X
ISBN 0-664-25513-2
ISBN 0-07-056317-9
ISBN Number 0-913878-50-2
ISBN 85-7326·196-X

The above seem to be valid ISBN-10, though I'm not really familiar with ISBN specs, can't really tell what could have impeded correct detection

ISBN-13: 978-1-5095-4619-0
ISBN-13: 978-1-5095-4620-6
ISBN 978—0—8254—2666-7
ISBN 978-85-401-5414-1
ISBN 9780099511564
ISBN 978-85-7622-857-8
ISBN 978-85-204-4224-1

And these were the undetected ISBN-13.

Out of 27 PDFs containing ISBNs, the plugin has detected correctly the ISBN in 9 of them, so I wouldn't say "it doesn't work with PDFs"!

Shet · 04-06-2024, 09:03 AM

Quote:

Originally Posted by kiwidude

...sion for the C:\Program Files\Calibre2 folder/subfolders.

Please paste back the job output from when you run it (assuming you still get an error with any antivirus disabled).

Hi, i tried with completely A/V off with the same result. After using the ExISBN you provided I get the same result with logs:

Code:

Starting job: Extract ISBN for 1 books 
=================================================== 
Title:  TEST 
Format: PDF 
Path:   D:\E_BOOKS\E_BOOK LIBRARY\Shet\TEST (29191)\TEST - Shet.pdf 
--------------------------------------------------- 
get_isbn is running forked job for: src.pdf 
get_page_count invoking pdftohtml 
get_page_count pdfinfo being invoked C:\Program Files\Calibre2\app\bin\pdfinfo.exe 
get_page_count pdfinfo raw retrieved 
get_page_count pdfinfo decoding output 
pdfinfo returned no UTF-8 data 
get_isbn found total pages:  None 
get_isbn no pages so returning nothing 
 
  Scan time: 0.47 secs 
  The scan failed to find an isbn in 0.47 secs 
  Failed to extract ISBN 
=================================================== 
Scan complete, with 1 failures

Code:

ApplicationPaletteChange event ignored
Using calibre Qt style: True
calibre Protokol diagnostiky
calibre 7.7  embedded-python: True
Windows-10-10.0.19045-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19045')
Python 3.11.5
Windows: ('10', '10.0.19045', 'SP0', 'Multiprocessor Free')
Interface language: sk
EXE path: C:\Program Files\Calibre2\calibre-debug.exe
Successfully initialized third party plugins: Count Pages (1, 13, 5) && Extract ISBN (1, 6, 2) && Find Duplicates (1, 10, 9) && Goodreads (1, 8, 1) && databazeknih.cz (1, 5, 18)
calibre 7.7  embedded-python: True
Windows-10-10.0.19045-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19045')
Python 3.11.5
Windows: ('10', '10.0.19045', 'SP0', 'Multiprocessor Free')
Interface language: sk
EXE path: C:\Program Files\Calibre2\calibre-debug.exe
Successfully initialized third party plugins: Count Pages (1, 13, 5) && Extract ISBN (1, 6, 2) && Find Duplicates (1, 10, 9) && Goodreads (1, 8, 1) && databazeknih.cz (1, 5, 18)
QPA platform: windows
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 127.66492146596858 x 127.59069767441859
[0.00] Starting up...
[0.00] Showing splash screen...
[0.17] splash screen shown
[0.17] Initializing db...
[0.86] db initialized
[0.86] Constructing main UI...
[1.88] GUI main window shown
Key 'S' for shortcut Uložiť na disk is already used by Zlúčiť záznamy o knihách, ignoring
Key 'A' for shortcut Open book folder is already used by Pridať knihy, ignoring
Key 'E' for shortcut Presunúť na ďalšiu zhodu is already used by Upraviť metadáta, ignoring
[1.94] main UI initialized...
[1.94] Hiding splash screen

THX for your time

Shet · 04-06-2024, 10:38 AM

Quote:

Originally Posted by kiwidude

sion for the C:\Program Files\Calibre2 folder/subfolders.

Please paste back the job output from when you run it (assuming you still get an error with any antivirus disabled).

Hi, I tried install on ubuntu with the same config as on win, and it works just fine. Here is the log if it helps:

Code:

ApplicationPaletteChange event ignored
Using calibre Qt style: True
calibre Debug log
calibre 7.8  embedded-python: True
Linux-5.19.0-46-generic-x86_64-with-glibc2.35 Linux ('64bit', 'ELF')
('Linux', '5.19.0-46-generic', '#47~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Wed Jun 21 15:35:31 UTC 2')
Python 3.11.5
Interface language: None
EXE path: /opt/calibre/bin/calibre-debug
Successfully initialized third party plugins: Extract ISBN (1, 6, 1)
calibre 7.8  embedded-python: True
Linux-5.19.0-46-generic-x86_64-with-glibc2.35 Linux ('64bit', 'ELF')
('Linux', '5.19.0-46-generic', '#47~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Wed Jun 21 15:35:31 UTC 2')
Python 3.11.5
Interface language: None
EXE path: /opt/calibre/bin/calibre-debug
Successfully initialized third party plugins: Extract ISBN (1, 6, 1)
QPA platform: wayland
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 100.0 x 100.0
[0.00] Starting up...
[0.00] Showing splash screen...
[0.10] splash screen shown
[0.10] Initializing db...
[0.11] db initialized
[0.11] Constructing main UI...
[0.61] GUI main window shown
[0.63] main UI initialized...
[0.63] Hiding splash screen
[3.18] splash screen hidden
[3.18] Started up in 3.18 seconds with 2 books

kiwidude · 04-06-2024, 10:45 AM

@shet - thx for trying and posting that. Now we can see the actual underlying problem - for whatever reason the calibre pdfinfo.exe is returning no data for your pdf on your system, whereas it works perfectly fine on mine. This falls into the “a question for Kovid” domain - as I said above the pdfinfo and pdftohtml executables are not part of this plugin, they are supplied with calibre. Perhaps he may have an explanation as to what might be the problem here.

Shet · 04-06-2024, 10:58 AM

Quote:

Originally Posted by kiwidude

@shet - thx for trying and posting that. Now we can see the actual underlying problem - for whatever reason the calibre pdfinfo.exe is returning no data for your pdf on your system, whereas it works perfectly fine on mine. This falls into the “a question for Kovid” domain - as I said above the pdfinfo and pdftohtml executables are not part of this plugin, they are supplied with calibre. Perhaps he may have an explanation as to what might be the problem here.

Again: thank you for your time

theducks · 04-06-2024, 11:31 AM

Quote:

Originally Posted by Comfy.n

ISBN-13: 978-1-5095-4619-0
ISBN-13: 978-1-5095-4620-6
ISBN 978—0—8254—2666-7
ISBN 978-85-401-5414-1
ISBN 9780099511564
ISBN 978-85-7622-857-8
ISBN 978-85-204-4224-1

Out of 27 PDFs containing ISBNs, the plugin has detected correctly the ISBN in 9 of them, so I wouldn't say "it doesn't work with PDFs"!

What I see (been a long time since I did anything with ISBN (13)

IIRC ASCII characters only
A single space is valid but not when a dash is used
A minus sign dash is valid, but not emdash or double dash
No space when used with dash is valid. And no mix

What is Language code 85? There are 3 books with that one.

Comfy.n · 04-06-2024, 11:57 AM

Quote:

Originally Posted by theducks

What is Language code 85? There are 3 books with that one.

brazilian portuguese was 85 until 2018 from what I gathered, then it's been replaced by 65, from what I learned just now that you asked!

04-06-2024, 08:57 AM	#519
Comfy.n want to learn what I want Posts: 1,172 Karma: 6426808 Join Date: Sep 2020 Device: Calibre E-book viewer	FWIW, I did some rounds of tests with the suggested pdfinfo.exe replacement, to see if I would get more ISBN detections than with the built-in one. Conclusion was: I get the same results, using either. On this specific round, I've used the save to single folder Calibre feature and ran a PDF-Xchange search on all PDFs in that directory for "ISBN", and here's what I found (I've pasted the search results): ISBN 978-85275-0036-4 ISBN 0S-2CM - 1655-1 ISBN 978-I-'77046-048-5 ISBN 978 -S 5 -204-43 14-9 Those were mere OCR errors, there's a wildcard, there's an I instead of 1, some random apostrophe and so on. ISBN 1-56924-647-5 ISBN: 0-595-26912-5 ISBN 0-7710-8157-X ISBN 0-664-25513-2 ISBN 0-07-056317-9 ISBN Number 0-913878-50-2 ISBN 85-7326·196-X The above seem to be valid ISBN-10, though I'm not really familiar with ISBN specs, can't really tell what could have impeded correct detection ISBN-13: 978-1-5095-4619-0 ISBN-13: 978-1-5095-4620-6 ISBN 978—0—8254—2666-7 ISBN 978-85-401-5414-1 ISBN 9780099511564 ISBN 978-85-7622-857-8 ISBN 978-85-204-4224-1 And these were the undetected ISBN-13. Out of 27 PDFs containing ISBNs, the plugin has detected correctly the ISBN in 9 of them, so I wouldn't say "it doesn't work with PDFs"! Last edited by Comfy.n; 04-06-2024 at 09:10 AM.*

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Extract ISBN from PDF?	mdroberts	Calibre	14	12-16-2016 07:32 AM
[Old Thread] Extract ISBN from file name	ChristianQ	Calibre	59	12-09-2015 05:08 AM
[GUI Plugin] Plugin Updater Deprecated	kiwidude	Plugins	159	06-19-2011 12:27 PM
[Old Thread] Auto Extract ISBN-Feature request	UnraisedArc	Calibre	60	03-23-2011 09:31 AM
Displaying ISBN column in the main GUI	tilleydog	Library Management	26	02-25-2011 04:08 AM

04-04-2024, 04:57 PM	#511
Wiggo Leftutti Posts: 450 Karma: 1153449 Join Date: Feb 2019 Location: Bavaria Device: iPad Pro, Kobo Libra 2	Cause of PDF

04-06-2024, 02:41 AM	#518
kiwidude Calibre Plugins Developer Posts: 4,677 Karma: 2162246 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	Wiggo - if you do something constructive (like follow the instructions I gave above and provide the debug and plugin logs) then maybe I can try to help. However the fact is that I can't replicate the issue - the plugin works perfectly fine for me and clearly the vast majority of users or else there would be far more posts about it. As for why no response before from me - in 2021 I wasn't maintaining this plugin at that time, davidfor was so I never saw that post. There has been a bug where it reports a string formatting error rather than the real underlying error. So the actual "final" error that people have posted is useless from a debugging perspective. Until I see debug logs to say otherwise I believe the problem will lie in trying to run pdftohtml or pdfinfo executables on your system. Which are calibre provided executables and nothing I have control over. As I said in the post above if they are failing to execute then the first step is to find out why that is - perhaps you have antivirus interfering for instance. You could try running the command line it is executing manually to see if that works. But only you can do anything about this when I can't replicate the issue.

04-06-2024, 10:45 AM	#522
kiwidude Calibre Plugins Developer Posts: 4,677 Karma: 2162246 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	@shet - thx for trying and posting that. Now we can see the actual underlying problem - for whatever reason the calibre pdfinfo.exe is returning no data for your pdf on your system, whereas it works perfectly fine on mine. This falls into the “a question for Kovid” domain - as I said above the pdfinfo and pdftohtml executables are not part of this plugin, they are supplied with calibre. Perhaps he may have an explanation as to what might be the problem here.

Advert

Advert