[Metadata Source Plugin] BOL.com (NL)

[Pr.BarnArt]

Small update to v.6.0.2.: info added of co-author, if known

[Pr.BarnArt]

Originally Posted by Dompie

@Pr.BarnArt I've done some more testing and it mostly works very well, with significantly more labels and indeed larger cover sizes. However, a number of books do exist at BOL (I even copied the BOL information into Calibre), but they all get the same error:
File "calibre_plugins.BOL_NL.worker", line 212, in parse_details
KeyError: 'author'

The interesting thing is that the book was actually retrieved, because sometimes the log contains information that isn't in my Calibre (series name and number).
Here are the logs for several books, all with the same error:


PS: There are apparently two different versions of single quotes. Can you correct that in your book search (is the same with the old version-so new request)?

Thanks for your testing. It is very usefull.
I presumed that, if the json dictionary was found, all info was in there.
I was wrong, p.e. the author is not always given, resulting in the key errors.
Not only authors, but also publisher, relase dates, isbn. Sometimes with a different key
So I added some other keys and after that, the plug-in will try the old ways of scraping for the missing item, if not found in the json-info
That's is little more complex.

I also implemented a way for the different single quotes ( yes there are different ones), but don't know if that works. I have no good example for testing.

So a new version 6.1.0 is now available.
Please lety me know if you encounter issues

[Dompie]

I've updated several books where the plugin version 6 wasn't working, and they all work. So, it seems to be working perfectly again for me.
I don't have an example of several single quotes at the moment because I always copied the correct title from the log and changed it accordingly. If I encounter another one, I'll let you know.
But for now, you've got it all working again, and I'm very satisfied.

[Dompie]

@Pr.BarnArt Single Quote: I have handled 5 different books with single quotes and all went perfect. So I think your implementation is correct.

[Pr.BarnArt]

Originally Posted by Dompie

@Pr.BarnArt Single Quote: I have handled 5 different books with single quotes and all went perfect. So I think your implementation is correct.

[Dompie]

I have the log of a single-quote book that slipped through your special treatment. Attached is the log. It's certainly no problem to fix, but since you've created a special conversion and almost all single-quote files work fine these days, I thought it would be nice to share it with you.

Spoiler:

calibre, version 7.13.0
FOUT: Geen zoekresultaten gevonden: <p>Kan geen boeken vinden die overeenkomen met uw zoekopdracht. Probeer de zoekopdracht <b>minder specifiek</b> te maken. Gebruik bijvoorbeeld alleen de achternaam van de auteur en een enkel onderscheidend woord uit de titel.<p>Klik op 'Details weergeven' om het volledige logbestand weer te geven.

Running identify query with parameters:
{'title': 'Miss Eliza’s \xadEngelse keuken', 'authors': ['Annabel Abbs'], 'identifiers': {}, 'timeout': 30}
Using plugins: BOL_NL (6, 1, 0)
The log from individual plugins is below

****************************** BOL_NL (6, 1, 0) ******************************
Found 0 results
Downloading from BOL_NL took 0.6935093402862549
Querying: https://www.bol.com/nl/nl/s/?searcht...eryContextHook
Rejecting as not close enough match: Miss Eliza's Engelse keuken
Rejecting as not close enough match: Miss Eliza's Engelse keuken

************************************************** ******************************
The identify phase took 0.80 seconds
The longest time (0.693509) was taken by: BOL_NL
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds

[Gkblijleven]

The Bol NL plugin does not work since today. What is wrong

Gé

[Gkblijleven]

The plugin Bol Nl does not does not download Metadata since yesterday.

Gé

[fvdham]

Hallo,
It is not only the metadata, the plugin also does not find any picture anymore. Both from bol.com or from google images.

[Toontje35]

calibre, version 9.6.0
FOUT: Geen zoekresultaten gevonden: <p>Kan geen boeken vinden die overeenkomen met uw zoekopdracht. Probeer de zoekopdracht <b>minder specifiek</b> te maken. Gebruik bijvoorbeeld alleen de achternaam van de auteur en een enkel onderscheidend woord uit de titel.<p>Klik op 'Details weergeven' om het volledige logbestand weer te geven.

Running identify query with parameters:
{'title': 'Wat eens ongeschonden was', 'authors': ['Jos Govaarts'], 'identifiers': {'isbn': '9789464643589'}, 'timeout': 30}
Using plugins: BOL_NL (6, 1, 0), Google (1, 1, 3), Amazon.com (1, 3, 18)
The log from individual plugins is below

****************************** BOL_NL (6, 1, 0) ******************************
Found 0 results
Downloading from BOL_NL took 0.7229418754577637
Querying: https://www.bol.com/nl/s/?searchtext...eryContextHook
Failed to parse BOL.com page for query: 'https://www.bol.com/nl/s/?searchtext=9789464643589&bltgh=6f4031a5-0202-4553-a6c7-f1cd1cd9e1b5.g.i.QueryContextHook'
Traceback (most recent call last):
File "calibre_plugins.BOL_NL.__init__", line 314, in identify
File "lxml\html\__init__.py", line 854, in fromstring
File "lxml\html\__init__.py", line 740, in document_fromstring
File "src/lxml/etree.pyx", line 3428, in lxml.etree.fromstring
File "src/lxml/parser.pxi", line 2066, in lxml.etree._parseMemoryDocument
File "src/lxml/parser.pxi", line 1921, in lxml.etree._parseDoc
File "src/lxml/parser.pxi", line 1937, in lxml.etree._parseDoc_unicode
File "src/lxml/parser.pxi", line 1136, in lxml.etree._BaseParser._parseUnicodeDoc
File "src/lxml/parser.pxi", line 647, in lxml.etree._ParserContext._handleParseResultDoc
File "src/lxml/parser.pxi", line 765, in lxml.etree._handleParseResult
File "src/lxml/parser.pxi", line 689, in lxml.etree._raiseParseError
File "<string>", line 3
lxml.etree.XMLSyntaxError: internal error, line 3, column 2180

************************************************** ******************************

****************************** Google (1, 1, 3) ******************************
Found 0 results
Downloading from Google took 4.5835490226745605
Making query: https://books.google.com/books/feeds...ewability=none
No results found, doing a web search instead
Making query: https://www.google.com/search?q=9789...gle.com&nfpr=1
Failed to find any results on results page, with title: 9789464643589 site:books.google.com - Google Zoeken
Making query: https://www.google.com/search?q=Wat+...oks.google.com
Failed to find any results on results page, with title: Wat eens ongeschonden was Jos Govaarts site:books.google.com - Google Zoeken

************************************************** ******************************

****************************** Amazon.com (1, 3, 18) ******************************
Found 0 results
Downloading from Amazon.com took 6.968649387359619
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/143.0.0.0 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=%289...zon.com&nfpr=1
Failed to find any results on results page, with title: (9789464643589 or 978-9464643589) site:www.amazon.com - Google Zoeken
No search engine results for terms: (9789464643589 OR 978-9464643589)
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=%28978...www.amazon.com
Bing returned no results
No search engine results for terms: (9789464643589 OR 978-9464643589)
No matches found with identifiers, retrying using only title and authors. Query: ['(9789464643589', 'OR', '978-9464643589)']
User-agent: Lynx/2.8.6rel.5 libwww-FM/2.14
Server: auto
Making google query: https://www.google.com/search?q=Wat+...www.amazon.com
Failed to find any results on results page, with title: Wat eens ongeschonden was Jos Govaarts site:www.amazon.com - Google Zoeken
No search engine results for terms: Wat eens ongeschonden was Jos Govaarts
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=Wat+ee...www.amazon.com
Bing returned no results
No search engine results for terms: Wat eens ongeschonden was Jos Govaarts
No matches found with query: ['Wat', 'eens', 'ongeschonden', 'was', 'Jos', 'Govaarts']

************************************************** ******************************
The identify phase took 7.02 seconds
The longest time (6.968649) was taken by: Amazon.com
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds

[Pr.BarnArt]

Originally Posted by Toontje35

calibre, version 9.6.0
FOUT: Geen zoekresultaten gevonden: <p>Kan geen boeken vinden die overeenkomen met uw zoekopdracht. Probeer de zoekopdracht <b>minder specifiek</b> te maken. Gebruik bijvoorbeeld alleen de achternaam van de auteur en een enkel onderscheidend woord uit de titel.<p>Klik op 'Details weergeven' om het volledige logbestand weer te geven.

Running identify query with parameters:
{'title': 'Wat eens ongeschonden was', 'authors': ['Jos Govaarts'], 'identifiers': {'isbn': '9789464643589'}, 'timeout': 30}
Using plugins: BOL_NL (6, 1, 0), Google (1, 1, 3), Amazon.com (1, 3, 18)
The log from individual plugins is below

Bol.com Bol.com seems (now?) a React/Remix app that serves its initial HTML with JSX-style self-closing tags. I won't bore you with the details, but that produces errors exploring the resultpages.
Made a fix for that with version 6.2.0, as usual also available at thet start of this thread.

Thank you for notifying, and the example you posted.

[Gkblijleven]

Thanks