[Metadata Source Plugin] BOL.com (NL)

[PeterT]

I created a dummy book with your data; no issues from a ChromeBook running calibre 9.20.101

[Lehkz]

It's working for me now, thanks for testing!

[Pr.BarnArt]

Originally Posted by Lehkz

It's working for me now, thanks for testing!

well, how did you solve it?

[AAS]

Dear Pr.BarnArt
Please see the problem below

calibre, version 7.21.0
FOUT: Geen zoekresultaten gevonden: <p>Kan geen boeken vinden die overeenkomen met uw zoekopdracht. Probeer de zoekopdracht <b>minder specifiek</b> te maken. Gebruik bijvoorbeeld alleen de achternaam van de auteur en een enkel onderscheidend woord uit de titel.<p>Klik op 'Details weergeven' om het volledige logbestand weer te geven.

Running identify query with parameters:
{'title': 'Wraaklust', 'authors': ['Saskia M.N. Oudshoorn'], 'identifiers': {'isbn': '9789461099426'}, 'timeout': 30}
Using plugins: BOL_NL (5, 1, 3)
The log from individual plugins is below

****************************** BOL_NL (5, 1, 3) ******************************
Found 0 results
Downloading from BOL_NL took 1.647416353225708
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
Plugin BOL_NL failed
Traceback (most recent call last):
File "calibre\ebooks\metadata\sources\identify.py", line 47, in run
File "calibre_plugins.BOL_NL.__init__", line 302, in identify
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals >.httperror_seek_wrapper: HTTP Error 403: Forbidden

************************************************** ******************************
The identify phase took 1.65 seconds
The longest time (1.647416) was taken by: BOL_NL
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds

[Pr.BarnArt]

Originally Posted by Lehkz

Also on Linux Mint Calibre is unable to retrieve anything from Bol.com using the plug-in.

Originally Posted by AAS

Dear Pr.BarnArt
Please see the problem below

calibre, version 7.21.0
FOUT: Geen zoekresultaten gevonden: <p>Kan geen boeken vinden die overeenkomen met uw zoekopdracht. Probeer de zoekopdracht <b>minder specifiek</b> te maken. Gebruik bijvoorbeeld alleen de achternaam van de auteur en een enkel onderscheidend woord uit de titel.<p>Klik op 'Details weergeven' om het volledige logbestand weer te geven.

Running identify query with parameters:
{'title': 'Wraaklust', 'authors': ['Saskia M.N. Oudshoorn'], 'identifiers': {'isbn': '9789461099426'}, 'timeout': 30}
Using plugins: BOL_NL (5, 1, 3)

It is like the same problem as @Lehkz reported ( see posts above)and which he solved. Maybe ask him.

[Twink53]

Dear Pr.BarnArt,

I noticed the Bol.com plugin stopped working overhere, also

Running identify query with parameters:
{'title': 'Hans Klok', 'authors': ['Marcel Langedijk'], 'identifiers': {'isbn': '9789400410657', 'google': 'V6S3EAAAQBAJ'}, 'timeout': 30}
Using plugins: BOL_NL (5, 1, 3), Google (1, 1, 1), Amazon.com (1, 3, 10), Edelweiss (2, 0, 1)
The log from individual plugins is below

****************************** BOL_NL (5, 1, 3) ******************************
Found 0 results
Downloading from BOL_NL took 1.8733761310577393
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
Plugin BOL_NL failed
Traceback (most recent call last):
File "calibre\ebooks\metadata\sources\identify.py", line 47, in run
File "calibre_plugins.BOL_NL.__init__", line 302, in identify
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httper ror_seek_wrapper: HTTP Error 403: Forbidden

But when I switched OFF my VPN Connection, the plugin suddenly works:


Running identify query with parameters:
{'title': 'Hans Klok', 'authors': ['Marcel Langedijk'], 'identifiers': {'isbn': '9789400410657', 'google': 'V6S3EAAAQBAJ'}, 'timeout': 30}
Using plugins: BOL_NL (5, 1, 3), Google (1, 1, 1), Amazon.com (1, 3, 10), Edelweiss (2, 0, 1)
The log from individual plugins is below

****************************** BOL_NL (5, 1, 3) ******************************
Found 1 results
Downloading from BOL_NL took 1.7853693962097168


---
Title : Hans Klok
Author(s) : Marcel Langedijk
Publisher : Thomas Rap
Rating :
Published : 2023-09-26T00:00:00+00:00
Identifiers : isbn:9789400410657
Comments :
Hans Klok is al meer dan dertig jaar een begrip in de internationale showbizz en een constante factor in onze eigen polderentertainmentindustrie. Al vanaf begin jaren negentig treedt hij onafgebroken op over de hele wereld: van China tot Frankrijk, van Duitsland tot Las Vegas, van Engeland tot een circustent op een verwaaid industrieterrein in de Hollandse provincie.
In eigen land is hij al vele jaren een echte BN’er – te zien in talkshows, reclames, quizshows en op rode lopers als goedlachse, aimabele publieksfavoriet. Soms vergeten we daarom misschien wel eens dat hij behoort tot de top drie van beste illusionisten ter wereld, vergelijkbaar met legendes als David Copperfield en Siegfried & Roy. Een echte vakman, al vanaf zijn vroegste jeugd geobsedeerd door de magie en de geschiedenis van zijn metier. Ook nu nog is hij dagelijks vol overgave in de weer met nieuwe trucs: bouwen, repeteren, verfijnen.
Ondanks dat hij nog altijd op de top van zijn kunnen is, beginnen ook voor The World’s Fastest Magician de jaren te tellen: lange dagen en nachten op tour, blessures die opspelen, een blousje dat inmiddels wat strak om de buik zit. Journalist Marcel Langedijk volgde Hans Klok een jaar lang op de voet, op zoek naar de man en de wereld achter de illusie. Hans Klok is een goudeerlijk, geestig en onweerstaanbaar verhaal over de avonturen van een van de meest authentieke entertainers die ons land rijk is.


(source: Bol.com)

Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
BOL_NL url: 'https://www.bol.com/nl/nl/p/hans-klok/9300000147218444/'

************************************************** ******************************

It looks as if bol.com has changed something at their site: They probably want to see and check your REAL IP number....
It worries me...

[AAS]

Originally Posted by Pr.BarnArt

It is like the same problem as @Lehkz reported ( see posts above)and which he solved. Maybe ask him.

I forgot to report that I normally have no problem. Only if I use VPN nothing works.

[Pr.BarnArt]

Originally Posted by Twink53

Dear Pr.BarnArt,

I noticed the Bol.com plugin stopped working overhere, also

****************************** BOL_NL (5, 1, 3) ******************************
Found 0 results
Downloading from BOL_NL took 1.8733761310577393
Querying: [url]https://tperror_seek_wrapper: HTTP Error 403: Forbidden

But when I switched OFF my VPN Connection, the plugin suddenly works:


Running

It looks as if bol.com has changed something at their site: They probably want to see and check your REAL IP number....
It worries me...

Good notice. That explains the problem. It is not related tothe plugin.
For me it is unclear how bol checks if someone use a vpn.
Thanks for notifying

[kanjer]

Since a couple of weeks a have problems with the plugin Bol.nl.
if gives wrong comments and does not give any cover.

[Dompie]

An hour ago the plugin (v5.1.3) has no problem and gives covers and comment. I don't use literatuurplein.nl for covers that was a problem maker for me.

[Lehkz]

Originally Posted by Pr.BarnArt

It is like the same problem as @Lehkz reported ( see posts above)and which he solved. Maybe ask him.

I thought my issue was resolved but it is still an issue. It appears Bol is actively blocking access, probably per IP, but for me with or without VPN I am unable to pull data from Bol nor Amazon

[Dompie]

Bol has changed something again I think (it was going well for so long). Logging says that result has been found but no info has been transferred to Calibre.
(with ISBN it isn't working either -often)

EDIT: if you repeat your request several times (5-8), then there is sometimes result in Calibre!!??

Logging:
Running identify query with parameters:
{'title': 'Puinvrouw In Berlijn', 'authors': ['Hilde Keteleer'], 'identifiers': {}, 'timeout': 30}
Using plugins: BOL_NL (5, 1, 3)
The log from individual plugins is below

Spoiler:

****************************** BOL_NL (5, 1, 3) ******************************
Found 1 results
Downloading from BOL_NL took 0.8468186855316162


---
Title : Puinvrouw in Berlijn
Author(s) : Hilde Keteleer
Rating :
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
BOL_NL url: 'https://www.bol.com/nl/nl/p/puinvrouw-in-berlijn/1001004006824208/'
Error parsing publisher for url: 'https://www.bol.com/nl/nl/p/puinvrouw-in-berlijn/1001004006824208/'
Traceback (most recent call last):
File "calibre_plugins.BOL_NL.worker", line 219, in parse_details
File "calibre_plugins.BOL_NL.worker", line 619, in parse_publisher
IndexError: list index out of range

************************************************** ******************************
The identify phase took 1.03 seconds
The longest time (0.846819) was taken by: BOL_NL
Merging results from different sources
We have 1 merged results, merging took: 0.00 seconds



Starting cover download for: Puinvrouw in Berlijn
Query: Puinvrouw In Berlijn ['Hilde Keteleer'] {}

****************************** BOL_NL Covers ******************************
Request extra headers: [('User-agent', 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4.1 Safari/605.1.15')]
Downloaded cover: 549x840
Took 0.9898900985717773 seconds
No cached cover found, running identify
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
BOL_NL url: 'https://www.bol.com/nl/nl/p/puinvrouw-in-berlijn/1001004006824208/'
Downloading cover from: https://media.s-bol.com/qMpnXzzX5Mxy...5r/549x840.jpg

************************************************** ******************************

[Pr.BarnArt]

Originally Posted by Dompie

Bol has changed something again I think (it was going well for so long). Logging says that result has been found but no info has been transferred to Calibre.
(with ISBN it isn't working either -often)

EDIT: if you repeat your request several times (5-8), then there is sometimes result in Calibre!!??

Its very strange, sometimes no problems and with the same url another time no results.
I am trying to pinpoint the errors , but without succes till now.

[Dompie]

Originally Posted by Pr.BarnArt

Its very strange, sometimes no problems and with the same url another time no results.
I am trying to pinpoint the errors , but without succes till now.

Yes strange error. Today I tried many times on different books to get a result and after trying again I finally got a result (it has nothing to do with the ISBN number). Every time there is no result, the error message appears in the logging:
"IndexError: list index out of range"

A not very meaningful error message for me.
Good luck!!

[Pr.BarnArt]

Originally Posted by Pr.BarnArt

Its very strange, sometimes no problems and with the same url another time no results.
I am trying to pinpoint the errors , but without succes till now.

Bol is somtetimes serving different html pages for the same book. I updated the plugin, to manage the different types. Hope that will do.
New version 5.2.0, also avaialable at thet start of this thread.

Enjoy!