[Metadata Source Plugin] BOL.com (NL)

[Dompie]

I believe BOL has changed something again. Without ISBN = no result.
With ISBN I have partly result but there is no publisher and no labels which exist on the BOL site.
Yes I'm using the old Calibre version with the old BOL-plugin. Do I have to change to the newer versions?

LOG without ISBN:
calibre, version 5.23.0
FOUT: Geen zoekresultaten gevonden: <p>Kan geen boeken vinden die overeenkomen met uw zoekopdracht. Probeer de zoekopdracht <b>minder specifiek</b> te maken. Gebruik bijvoorbeeld alleen de achternaam van de auteur en een enkel onderscheidend woord uit de titel.<p>Klik op 'Details weergeven' om het volledige logbestand weer te geven.

Running identify query with parameters:
{'title': 'Reünie in Toscane', 'authors': ['Annemartien Berkelaar'], 'identifiers': {}, 'timeout': 30}
Using plugins: BOL_NL (4, 5, 5)
The log from individual plugins is below

****************************** BOL_NL (4, 5, 5) ******************************
Found 0 results
Downloading from BOL_NL took 4.081604242324829
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
No matches found with query: 'https://www.bol.com/nl/s/?searchtext=Reunie+in+Toscane+Annemartien+Berkelaa r&searchContext=media_all&appliedSearchContextId=& suggestFragment=&adjustedSection=&originalSection= &originalSearchContext=&section=main&N=0&defaultSe archContext=media_all'

************************************************** ******************************
The identify phase took 4.23 seconds
The longest time (4.081604) was taken by: BOL_NL
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds




LOG With ISBN:
Running identify query with parameters:
{'title': 'Reünie in Toscane', 'authors': ['Annemartien Berkelaar'], 'identifiers': {'isbn': '9789020549164'}, 'timeout': 30}
Using plugins: BOL_NL (4, 5, 5)
The log from individual plugins is below

****************************** BOL_NL (4, 5, 5) ******************************
Found 1 results
Downloading from BOL_NL took 0.6975343227386475


---
Title : Reünie in Toscane
Author(s) : Annemartien Berkelaar
Rating :
Identifiers : isbn:9789020549164
Comments : <p> Zeven bijzondere vrouwen gaan op ontdekkingstocht in het schitterende Toscane in 'Reünie in Toscane', het tweede deel van de Toscane-serie van Annemartien Berkelaar. </p>
<p> In 'Reünie in Toscane' van Annemartien Berkelaar gaat het verhaal van de hechte vriendinnengroep verder. Iedereen staat op een ander punt in het leven. Chloë en Roberto gaan eindelijk trouwen, waar anders dan in het prachtige Toscane? Maar niet ieders leven is zo mooi en romantisch. Relaties staan onder druk door een postnatale depressie, verschillende levensdoelen, twijfels en nieuwe liefdes. Kan iedereen de relatie redden, zonder zichzelf te verliezen? De emoties lopen hoog op en komen tot uitbarsting rond de bruiloft. </p>
<p> 'Reünie in Toscane' is het tweede deel in de feelgoodserie van Annemartien Berkelaar. Lees ook 'Betoverend Toscane'. </p>
<br>(source: Bol.com)<br>
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
BOL_NL url: 'https://www.bol.com/nl/nl/p/reunie-in-toscane/9300000095378808/'
Error parsing publisher for url: 'https://www.bol.com/nl/nl/p/reunie-in-toscane/9300000095378808/'
Traceback (most recent call last):
File "calibre_plugins.BOL_NL.worker", line 219, in parse_details
File "calibre_plugins.BOL_NL.worker", line 612, in parse_publisher
IndexError: list index out of range

************************************************** ******************************
The identify phase took 0.83 seconds
The longest time (0.697534) was taken by: BOL_NL
Merging results from different sources
We have 1 merged results, merging took: 0.00 seconds

[Dompie]

I have installed the latest versions of Caliber (6.5) and BOL_NL (5.0) but the problems remain the same. So Bol has changed something again.
-Without an ISBN no book will be found and with ISBN the book will be found.
-The publisher is not found but that does not produce an error message but the Publisher field is not filled in.
-The labels that were sometimes not filled in, is because many strange labels are used by Bol that are not relevant to me. I really like your limited set.


LOG with ISBN (with:IndexError: list index out of range):
Running identify query with parameters:
{'title': 'Reünie in Toscane', 'authors': ['Annemartien Berkelaar'], 'identifiers': {'isbn': '9789020549164'}, 'timeout': 30}
Using plugins: BOL_NL (5, 0, 0)
The log from individual plugins is below

****************************** BOL_NL (5, 0, 0) ******************************
Found 1 results
Downloading from BOL_NL took 0.6333427429199219


---
Title : Reünie in Toscane
Author(s) : Annemartien Berkelaar
Rating :
Identifiers : isbn:9789020549164
Comments : <p> ZErroreven bijzondere vrouwen gaan op ontdekkingstocht in het schitterende Toscane in 'Reünie in Toscane', het tweede deel van de Toscane-serie van Annemartien Berkelaar. </p>
<p> In 'Reünie in Toscane' van Annemartien Berkelaar ......blabla......arsting rond de bruiloft. </p>
<p> 'Reünie in Toscane' is het tweede deel in de feelgoodserie van Annemartien Berkelaar. Lees ook 'Betoverend Toscane'. </p>
<br>(source: Bol.com)<br>
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
BOL_NL url: 'https://www.bol.com/nl/nl/p/reunie-in-toscane/9300000095378808/'
Error parsing publisher for url: 'https://www.bol.com/nl/nl/p/reunie-in-toscane/9300000095378808/'
Traceback (most recent call last):
File "calibre_plugins.BOL_NL.worker", line 219, in parse_details
File "calibre_plugins.BOL_NL.worker", line 612, in parse_publisher
IndexError: list index out of range

************************************************** ******************************
The identify phase took 0.84 seconds
The longest time (0.633343) was taken by: BOL_NL
Merging results from different sources
We have 1 merged results, merging took: 0.00 seconds



LOG without ISBN:
calibre, version 6.5.0
FOUT: Geen zoekresultaten gevonden: <p>Kan geen boeken vinden die overeenkomen met uw zoekopdracht. Probeer de zoekopdracht <b>minder specifiek</b> te maken. Gebruik bijvoorbeeld alleen de achternaam van de auteur en een enkel onderscheidend woord uit de titel.<p>Klik op 'Details weergeven' om het volledige logbestand weer te geven.

Running identify query with parameters:
{'title': 'Reünie in Toscane', 'authors': ['Annemartien Berkelaar'], 'identifiers': {}, 'timeout': 30}
Using plugins: BOL_NL (5, 0, 0)
The log from individual plugins is below

****************************** BOL_NL (5, 0, 0) ******************************
Found 0 results
Downloading from BOL_NL took 0.4107985496520996
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
Plugin BOL_NL failed
Traceback (most recent call last):
File "calibre\ebooks\metadata\sources\identify.py", line 47, in run
File "calibre_plugins.BOL_NL.__init__", line 374, in identify
AttributeError: module 'PyQt6.QtGui' has no attribute 'QApplication'

************************************************** ******************************
The identify phase took 0.61 seconds
The longest time (0.410799) was taken by: BOL_NL
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds

[Pr.BarnArt]

Originally Posted by Dompie

I have installed the latest versions of Caliber (6.5) and BOL_NL (5.0) but the problems remain the same. So Bol has changed something again.
-Without an ISBN no book will be found and with ISBN the book will be found.
-The publisher is not found but that does not produce an error message but the Publisher field is not filled in.
-The labels that were sometimes not filled in, is because many strange labels are used by Bol that are not relevant to me. I really like your limited set.

There were two factors:
First: the popup-screen for a dialog with rejected titles have problems with qt6. I have temporay disabled this dialog.
Second: the website indeed changed the search page. I have made a quick update for that, version 5.1.0, also available at the start of this thread.
Enjoy.

[Dompie]

Thanks Pr.BarnArt, without ISBN works again.

When you have some spare time left, the name of the Publisher isn't fixed yet, every book lookup gave the same IndexError:

...........
Error parsing publisher for url: 'https://www.bol.com/nl/nl/p/pleasant-valley/9300000084268646/'
Traceback (most recent call last):
File "calibre_plugins.BOL_NL.worker", line 219, in parse_details
File "calibre_plugins.BOL_NL.worker", line 612, in parse_publisher
IndexError: list index out of range

[Pr.BarnArt]

Originally Posted by Dompie

Thanks Pr.BarnArt, without ISBN works again.

When you have some spare time left, the name of the Publisher isn't fixed yet, every book lookup gave the same IndexError:

Sorry missed that one. will fix that asap

[jefkeklakke]

I installed your version 5.1.0 on Calibre 6.5.0 and it works fine again.

Many thanks Pr.Barnart

[Pr.BarnArt]

Update version 5.1.1 available.
Fix for website-changes related to publisher and publish date.

[Dompie]

Yessss Pr.BarnArt everything is perfect again.
Thank you for your time!!

[Dompie]

Bol made an ugly change. If you search for a book by title and author that is part of a series, Bol has apparently added the series name to the title and so it is an inappropriate title and rejected. (With ISBN it works correctly)
Below the log of two books.

Serie=Rani Diaz
calibre, version 6.5.0
FOUT: Geen zoekresultaten gevonden: <p>Kan geen boeken vinden die overeenkomen met uw zoekopdracht. Probeer de zoekopdracht <b>minder specifiek</b> te maken. Gebruik bijvoorbeeld alleen de achternaam van de auteur en een enkel onderscheidend woord uit de titel.<p>Klik op 'Details weergeven' om het volledige logbestand weer te geven.

Running identify query with parameters:
{'title': 'Zonder genade', 'authors': ['Sterre Carron'], 'identifiers': {}, 'timeout': 30}
Using plugins: BOL_NL (5, 1, 1)
The log from individual plugins is below

****************************** BOL_NL (5, 1, 1) ******************************
Found 0 results
Downloading from BOL_NL took 0.4421055316925049
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
Rejecting as not close enough match: Rani Diaz - Zonder genade
Rejecting as not close enough match: Rani Diaz - Zonder genade

************************************************** ******************************
The identify phase took 0.62 seconds
The longest time (0.442106) was taken by: BOL_NL
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds

================================================== ===============================
================================================== ===============================

Serie=Josie Quinn
calibre, version 6.5.0
FOUT: Geen zoekresultaten gevonden: <p>Kan geen boeken vinden die overeenkomen met uw zoekopdracht. Probeer de zoekopdracht <b>minder specifiek</b> te maken. Gebruik bijvoorbeeld alleen de achternaam van de auteur en een enkel onderscheidend woord uit de titel.<p>Klik op 'Details weergeven' om het volledige logbestand weer te geven.

Running identify query with parameters:
{'title': 'Haar moeders geheim', 'authors': ['Lisa Regan'], 'identifiers': {}, 'timeout': 30}
Using plugins: BOL_NL (5, 1, 1)
The log from individual plugins is below

****************************** BOL_NL (5, 1, 1) ******************************
Found 0 results
Downloading from BOL_NL took 0.44255828857421875
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
Rejecting as not close enough match: Josie Quinn 3 - Haar moeders geheim

************************************************** ******************************
The identify phase took 0.63 seconds
The longest time (0.442558) was taken by: BOL_NL
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds

[Pr.BarnArt]

This is a tricky one. Also because the actual serie info is missing. Have to think about this, how it can be solved. Most extreme will be to get the isbn from another site. ��

[Dompie]

Yes, and not only the serie name is given but sometimes also the serie sequence number as you can see in the seconds example Serie=Josie Quinn and the sequence number is 3. The first example has no sequence number, only the serie name.

I have analyzed several cases and the problem cases all have the layout:
"<Series> [<sequencenumber> ]- <Title>"
Maybe you can accept these kind of strings as a workaround.

[Pr.BarnArt]

Originally Posted by Dompie

Yes, and not only the serie name is given but sometimes also the serie sequence number as you can see in the seconds example Serie=Josie Quinn and the sequence number is 3. The first example has no sequence number, only the serie name.

I have analyzed several cases and the problem cases all have the layout:
"<Series> [<sequencenumber> ]- <Title>"
Maybe you can accept these kind of strings as a workaround.

Sorry for the delay, very busy at the moment.
I have made an update 5.1.2. which look for the seperator ' - ', in case there is no match with the title. I think that will do in most of the cases.
But I noticed that the serie-info is add to the title , also with a ISBN search.

Well let's see, update available at the start of this topic.

[Dompie]

Don't apologize, work and home come first.
I tested it with several series of books and they all had (correct) results. Awesome!!
Thank you very much for correcting this annoying change.

[Dompie]

@Pr.BarnArt I've been working with your latest version for a while now and the solution you chose works great. I have not discovered any problem.
Thanks again!

[Pr.BarnArt]

Originally Posted by Dompie

@Pr.BarnArt I've been working with your latest version for a while now and the solution you chose works great. I have not discovered any problem.
Thanks again!