[Metadata Source Plugin] BOL.com (NL)

[Pr.BarnArt]

Originally Posted by Dompie

Sorry, I think BOL is doing something strange with books without an ISBN. The book exists at BOL, but without an ISBN, it's not found, even though there are three (or more) blank "rejected not close enough" messages in the log. If you enter the ISBN, it works perfectly.
The annoying thing for your troubleshooting is that this problem does not always occur if you do not have an ISBN.

I use the same computer, same Calibre, same internet connection, no updates.
I don't understand it.
@Pr.BarnArt - Do you have any idea what's happening here?

Sorry for this late response. I was away for a while. Back now I tested and got good results with and without isbn. No errors. It is strange, it could be that the website not always serve the same resultpages (code/html) , so that in some cases the plugin cannot find the result. An empty title, rejected as not close enough, means that it couldnot extract the title from the resultpage

[Dompie]

Ah, that's handy, this way I can see that the Bol server hasn't sent an understandable page to the plugin.

[WPCMS]

I'm also having problems with the Bol.com plugin.
When I try to search for a book using Ctrl+D, I see the following:
Failed to download metadata or cover image.
Missing details.
When I edit metadata, I do get details:
calibre, version 8.12.0
ERROR: No search results found: <p>Could not find any books that match your search. Try making the search <b>less specific</b>. For example, use only the author's last name and a single distinguishing word from the title.<p>Click 'Show details' to view the full log file.

Running identify query with parameters:
{'title': 'The Last Man', 'authors': ['Pepijn Keppel'], 'identifiers': {'isbn': '9789400408500'}, 'timeout': 30}
Using plugins: BOL_NL (5, 2, 8)
The log from individual plugins is below

****************************** BOL_NL (5, 2, 8) ******************************
Found 0 results
Downloading from BOL_NL took 1.8331995010375977
Querying: https://www.bol.com/nl/s/?searchtext...eryContextHook
BOL_NL url: 'https://www.bol.com/nl/nl/p/de-laatste-man/9300000064688609//?bltgh=db90ce03-cfe0-46af-97d7-c50df0ab7105.ProductList_Middle.0.ProductImage'
Failed to parse Bol.com details page: 'https://www.bol.com/nl/nl/p/de-laatste-man/9300000064688609//?bltgh=db90ce03-cfe0-46af-97d7-c50df0ab7105.ProductList_Middle.0.ProductImage'
Traceback (most recent call last):
File "calibre_plugins.BOL_NL.worker", line 117, in get_details
File "lxml\html\__init__.py", line 854, in fromstring
File "lxml\html\__init__.py", line 740, in document_fromstring
File "src/lxml/etree.pyx", line 3428, in lxml.etree.fromstring
File "src/lxml/parser.pxi", line 2059, in lxml.etree._parseMemoryDocument
File "src/lxml/parser.pxi", line 1914, in lxml.etree._parseDoc
File "src/lxml/parser.pxi", line 1930, in lxml.etree._parseDoc_unicode
File "src/lxml/parser.pxi", line 1133, in lxml.etree._BaseParser._parseUnicodeDoc
File "src/lxml/parser.pxi", line 647, in lxml.etree._ParserContext._handleParseResultDoc
File "src/lxml/parser.pxi", line 765, in lxml.etree._handleParseResult
File "src/lxml/parser.pxi", line 689, in lxml.etree._raiseParseError
File "<string>", line 126
lxml.etree.XMLSyntaxError: internal error, line 126, column 10

************************************************** ******************************
The identify phase took 2.01 seconds
The longest time (1.833200) was taken by: BOL_NL
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds

If I have the following link in my browser Paste:
https://www.bol.com/nl/nl/p/de-laats...0.ProductImage

I see the information for the correct book.

I can't load it to Calibre.
I'm using Calibre 8.12 and Plugin 5.2.8.

The above is just an example. I'm entering the ISBN number.
For a limited number of books, the information is downloaded, but not the cover.

A solution for this would be great.
Thanks in advance.

[Pr.BarnArt]

Originally Posted by WPCMS

I'm also having problems with the Bol.com plugin.
When I try to search for a book using Ctrl+D, I see the following:
Failed to download metadata or cover image.
Missing details.
When I edit metadata, I do get details:
calibre, version 8.12.0
ERROR: No search results found: <p>Could not find any books that match your search. Try making the search <b>less specific</b>. For example, use only the author's last name and a single distinguishing word from the title.<p>Click 'Show details' to view the full log file.

Running identify query with parameters:
{'title': 'The Last Man', 'authors': ['Pepijn Keppel'], 'identifiers': {'isbn': '9789400408500'}, 'timeout': 30}
Using plugins: BOL_NL (5, 2, 8)
The log from individual plugins is below

****************************** BOL_NL (5, 2, 8) ******************************
Found 0 results
Downloading from BOL_NL took 1.8331995010375977
Querying: https://www.bol.com/nl/s/?searchtext...eryContextHook
BOL_NL url: 'https://www.bol.com/nl/nl/p/de-laatste-man/9300000064688609//?bltgh=db90ce03-cfe0-46af-97d7-c50df0ab7105.ProductList_Middle.0.ProductImage'

Do you have other examples.
I got covers from 'de laatste man' with and wthout isbn. So i cannot reproduce this,
Do you have literatuurplein checked ( 2x) in the configurationfile? That can also be the cause of missing covers

[Dompie]

I also tried Pepijn Keppel - De laatste man (The Last Man) both with and without an ISBN, and I got the Bol info and a cover.
I'm using the same version of the Bol plugin, but with Calibre version 7.13, so it might not be a good comparison with @WPCMS.

[WPCMS]

I added three books with only an ISBN number. These are 9789046830918, 9789046831748, and 9789046833872. When downloading metadata, only BOL is selected. In the plugin settings, all options are selected except "Search only for ebooks."
The result I get is:
"Downloading metadata or covers for each of the three books failed." Then, three times, I get the message "Unknown (failed metadata)" (failed metadata) without any further details.
When I select a book, I get the message: "Downloading the metadata or cover image for the selected book failed." This also doesn't include any details. When I try to download metadata via Edit Metadata, I do get details.

calibre, version 8.12.0
FOUT: Geen zoekresultaten gevonden: <p>Kan geen boeken vinden die overeenkomen met uw zoekopdracht. Probeer de zoekopdracht <b>minder specifiek</b> te maken. Gebruik bijvoorbeeld alleen de achternaam van de auteur en een enkel onderscheidend woord uit de titel.<p>Klik op 'Details weergeven' om het volledige logbestand weer te geven.

Running identify query with parameters:
{'title': None, 'authors': None, 'identifiers': {'isbn': '9789046830918'}, 'timeout': 30}
Using plugins: BOL_NL (5, 2, 8)
The log from individual plugins is below

****************************** BOL_NL (5, 2, 8) ******************************
Found 0 results
Downloading from BOL_NL took 1.352337121963501
Querying: https://www.bol.com/nl/s/?searchtext...eryContextHook
BOL_NL url: 'https://www.bol.com/nl/nl/p/de-verloren-dochters-2-de-cubaanse-dochter/9300000143393480//?bltgh=db90ce03-cfe0-46af-97d7-c50df0ab7105.ProductList_Middle.0.ProductImage'
Failed to parse Bol.com details page: 'https://www.bol.com/nl/nl/p/de-verloren-dochters-2-de-cubaanse-dochter/9300000143393480//?bltgh=db90ce03-cfe0-46af-97d7-c50df0ab7105.ProductList_Middle.0.ProductImage'
Traceback (most recent call last):
File "calibre_plugins.BOL_NL.worker", line 117, in get_details
File "lxml\html\__init__.py", line 854, in fromstring
File "lxml\html\__init__.py", line 740, in document_fromstring
File "src/lxml/etree.pyx", line 3428, in lxml.etree.fromstring
File "src/lxml/parser.pxi", line 2059, in lxml.etree._parseMemoryDocument
File "src/lxml/parser.pxi", line 1914, in lxml.etree._parseDoc
File "src/lxml/parser.pxi", line 1930, in lxml.etree._parseDoc_unicode
File "src/lxml/parser.pxi", line 1133, in lxml.etree._BaseParser._parseUnicodeDoc
File "src/lxml/parser.pxi", line 647, in lxml.etree._ParserContext._handleParseResultDoc
File "src/lxml/parser.pxi", line 765, in lxml.etree._handleParseResult
File "src/lxml/parser.pxi", line 689, in lxml.etree._raiseParseError
File "<string>", line 126
lxml.etree.XMLSyntaxError: internal error, line 126, column 10

************************************************** ******************************
The identify phase took 1.40 seconds
The longest time (1.352337) was taken by: BOL_NL
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds

The same for all three books.

[Pr.BarnArt]

Originally Posted by WPCMS

I added three books with only an ISBN number. These are 9789046830918, 9789046831748, and 9789046833872.

Strange, I got description and cover for all three books.
Even with the same confgiration like you said. I myself should uncheck get covers form literaturplein and get only covers from letratuurplein.

What system do you use and which browser?

[WPCMS]

I use Windows 11 and Firefox as my browser (I'm not aware that I'm using a browser to download data).
I tried all the combinations in the Literatureplein download settings.
Then I tried downloading via a VPN connection (maybe I'm blocked by Bol.com?). This didn't work either.
After that, I created a completely new catalog with the same settings. I'm getting the same error messages here as well.
Next, I reset everything to the default settings for downloading metadata. Now, for the book with ISBN number 9789046831748, I get the title and other details of "Partypooper" by Jeff Kinney instead of "The Greek Daughter" by Soraya Lane.
The plugin has worked perfectly for the past 10 years. I have no idea what I'm doing wrong. Any help or suggestions are welcome.

[Pr.BarnArt]

Originally Posted by WPCMS

I use Windows 11 and Firefox as my browser (I'm not aware that I'm using a browser to download data).
I tried all the combinations in the Literatureplein download settings.
Then I tried downloading via a VPN connection (maybe I'm blocked by Bol.com?). This didn't work either.
After that, I created a completely new catalog with the same settings. I'm getting the same error messages here as well.
Next, I reset everything to the default settings for downloading metadata. Now, for the book with ISBN number 9789046831748, I get the title and other details of "Partypooper" by Jeff Kinney instead of "The Greek Daughter" by Soraya Lane.
The plugin has worked perfectly for the past 10 years. I have no idea what I'm doing wrong. Any help or suggestions are welcome.

It seems probably related to calibre 8.12/8.13 ( with an older version of calibre i had no issues) in combination with a changed html code for some images. I have made a new version 5.2.9, also available at the start of this thread.
Hope it will do. Enjoy.

[WPCMS]

It's working again!
Thank you so much for the support.

[Aat]

Is it possible to make a choise where you only want to search of comments in a choosen language?

[Pr.BarnArt]

Originally Posted by Aat

Is it possible to make a choise where you only want to search of comments in a choosen language?

No, is the short answer

[eekiemaster]

Using calibre 8.13 with BOL plugin 5.2.9 all imported books from now can not get any metadata from Bol. The same happens with books I already imported with metadata. Probably a change on Bol.com.... This is an example with error details of a new import:

calibre, version 8.13.0
FOUT: Geen zoekresultaten gevonden: <p>Kan geen boeken vinden die overeenkomen met uw zoekopdracht. Probeer de zoekopdracht <b>minder specifiek</b> te maken. Gebruik bijvoorbeeld alleen de achternaam van de auteur en een enkel onderscheidend woord uit de titel.<p>Klik op 'Details weergeven' om het volledige logbestand weer te geven.

Running identify query with parameters:
{'title': 'Misleid', 'authors': ['Yvonne Kersten'], 'identifiers': {}, 'timeout': 30}
Using plugins: BOL_NL (5, 2, 9)
The log from individual plugins is below

****************************** BOL_NL (5, 2, 9) ******************************
Found 0 results
Downloading from BOL_NL took 2.2738170623779297
Querying: https://www.bol.com/nl/nl/s/?searcht...eryContextHook
BOL_NL url: 'https://www.bol.com/nl/nl/p/misleid/9300000234035411/'
Could not find title for 'https://www.bol.com/nl/nl/p/misleid/9300000234035411/'
Could not find authors for 'https://www.bol.com/nl/nl/p/misleid/9300000234035411/'
Could not find title/authors/bol_nl_id for 'https://www.bol.com/nl/nl/p/misleid/9300000234035411/'
bol_nl_id: 'nl/nl/p/misleid/9300000234035411' Title: None Authors: None

************************************************** ******************************
The identify phase took 2.42 seconds
The longest time (2.273817) was taken by: BOL_NL
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds

[Pr.BarnArt]

Originally Posted by eekiemaster

Using calibre 8.13 with BOL plugin 5.2.9 all imported books from now can not get any metadata from Bol. The same happens with books I already imported with metadata. Probably a change on Bol.com.... This is an example with error details of a new import:

calibre, version 8.13.0
FOUT: Geen zoekresultaten gevonden:
Running identify query with parameters:
{'title': 'Misleid', 'authors': ['Yvonne Kersten'], 'identifiers': {}, 'timeout': 30}
Using plugins: BOL_NL (5, 2, 9)

Strange, with the same configuration I got the results with and also without isbn. So i cannot reproduce this

[eekiemaster]

Hi Pr.BarnArt,
It just tested it and it works..... Must have been my network or internet connection because I shutted down after trying yesterday. So no problem at all now. Next time I will wait a little bit longer to post issues. Sometimes they are solved by themselves
Sorry for the inconvenience.