Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 06-17-2011, 07:59 AM   #1
Pr.BarnArt
Groupie
Pr.BarnArt began at the beginning.
 
Pr.BarnArt's Avatar
 
Posts: 170
Karma: 34
Join Date: Jun 2011
Device: Pocketbook 902 / Ipad2
[Metadata Source Plugin] BOL_NL

BOL_NL - Version 3.4 - november 9th, 2014 by Pr. BarnArt.

This plugin is for using BOL.com as a metadata source.
It is only for books in the Dutch language, that's why it is called BOL_NL.
It was based on the 'Barnes' work by 'Grant Drake'.

Main Features of BOL_NL v 3.4
  • retrieve isbn.
  • retrieve (multiple) author(-s) (no contributors/translators), title.
  • retrieve comments, cover, rating, publisher and publishing date.
  • retrieve language
  • option: to retrieve rejected titles in case no exact match is found - default= yes
  • option: to retrieve reviews(NBD/Biblion) besides description - default = yes
    (request Triniton ;-)
  • option: to retrieve covers from Literatuurplein.nl if availalble - default = no (request Wipneus )
  • option: to retrieve only covers from Literatuurplein.nl, not from bol.com (request Wipneus)
  • option: to retrieve tags for Age, Categorie (request Sanghoku)

Special Notes:
  • BOL_NL first looks for a match on the isbn-number, if that is know.
  • Otherwise it takes the author's name and the exact booktitle.
  • If there is no match, the user is shown the rejected titles, so he/she can choose if there is an alternative (not under osX, see know issues).
  • requires calibre 0.8.5 or higher.

Update info 3.4
  • - Update due to timezone problems with the publishing date , default day of the month is set to 2.

known issues:
  • sometimes no cover with "inkijkexemplaar", just text.
  • when search is based on isbn there is no rating-info
  • Under osX it is not possible to use a dialog window in a plugin for rejected titles. So for osX users the advise is to disable this option in the configuration of the plugin.

Installation Notes:
  • Download the attached zip file and install the plugin as described in the Introduction to plugins thread.
  • You can configure the plugin within Calibre.
  • Here you can select the options for description and reviews (NBD/Biblion),
    for covers from Literatuurplein and for tags.


Paypal Donations:
  • If you find this plugin useful please feel free to show your appreciation.

Version History:
Spoiler:


v.3.4.0 9-11-2014
- - Update due to timezone problems with the publishing date , default day of the month is set to 2.

v.3.3.0 16-10-2014
- Update due to website change


v.3.2.1 10-9-2014
- Update due to website change / clean description to almost plain text

v 3.2.0 25-8-2014
- Update due to website change
- removed keywords and genre as base for tag search

v.3.1 1-8-2014
- update for retreiving cover due to website change

v.3.0 21-7-2014
- Porting to Qt5 for Calibre 2.0

v2.4 9-5-2014
- fix due to website change

v2.3 12-12-2013
- fix due to website change

v.2.2.5 19-9-2013
- fix authors-bug ( translators were add to the authors , if they are mentioned)
- fix bug publish_date, in case there was extra information shown, p.e. "midprice".

v.2.2.4 21-8-2013
- fix for another websitechange of bol.com.

v.2.2.3 5-7-2013
- update correct publisher and publish date in case of eBook version (Thx Wipneus)

v.2.2.2 15-6-2013
- correct publisher and publish date in case of eBook version

v.2.2.1 13-1-2013
- fix error when there are no reviews or when reviews were not selected by the user

v.2.2.0 11-1-2013
- fix for another websitechange of bol.com.

V.2.1.0
- small fix to prevent crash in case the default value for rejected books is not saved

v.2.0.0 9-11-2011
- add a dialog for choosing an alternative title if there no match with the exact title.
- small fix because of website-change.
- delete serie variables.
- add option for rejected titles in the configuration settings.(2.0.1)
- delete extra<br> at comments (2.0.1)

v.1.8.2 - 21-10-2012
- cleanup code , because some debug code was left.

v.1.8.1 - 19-10-2012
- fix for another websitechange of bol.com.

v.1.8.0 - 27-9-2012
- Quick fix for another dirty websitechange of bol.com.
They now serve different (xml-)pages of the same object in a random way.
So the plugin needs to do some more analyzing

v.1.7.0 - 6-7-2012
- add option: to retrieve tags/labels Genre,Age,Categorie,Keywords ((request SangHoku)) Default = no tags

v 1.6.2 - 22-4-2012
- added language as metadata item
- add option: to retrieve covers from Literatuurplein.nl if availalble- default = no (request Wipneus )
- add option: to retriev only covers from Literatuurplein.nl, not from bol.com (request Wipneus)
- settings are done in the configuration window

v 1.6.0 - 7-2-2012
- fix for another websitechange of bol.com related to authors
- add link to mobileread forum for error and requests in the configuration section

v.1.5.1 - 22-1-2012
- fix for title-info when searching on isbn-number.


v. 1.5.0 - 19-1-2012
- Quick fix for another websitechange of bol.com

v.1.4.0 - 4-1-2012
- Quick fix for websitechange of bol.com

v. 1.3.0 - 31-7-2011
- add option for description and reviews, or just description (request from Triniton)

v. 1.2.0 - 7-7-2011
- fix noimage now skipped as cover
- fix no match if Bol ommits 'de','het' or 'een' as start of the title

v. 1.1.0 - 25-6-2011
fix: rating was set to 0 when searching on isbn.
fix: parsing end of lines in comments (problem: no space after a word on the end of a line) (thx Dompie).

v. 1.0.0 - 21-6-2011
intial production release.
fix: no matches found on isbn-pages with less information.
fix: error when "verschijningsjaar" is more than just a year.

v. 0.3.1 - 20-6-2011 - beta
change: skip "Beschrijving" at description.
fix: prevent unnecessary "<br>"'s in description by converting webtext.

v. 0.3.0 - 19-6-2011 - beta
add: more specific publish date.
add: rating.
add: exclude 'luisterboek / cd / voorgelezen' from results.
add: if no 'inkijkememplaar', then take the small one on the webpage.
fix: now getting larger covers (bol.com mislead me a bit, by offering thumbs in stead of large cover;-).

v. 0.2.1 - 18-6-2011 - beta
fix: cleanud up to much (debug-)code.

v. 0.2.0 - 18-6-2011 - beta
change: comments is more accurate, also including "(source:Bol.com)" .
add: publisher_data, pub_date(year only).
fixed: multiple authors.

v. 0.1.1 - 17-6-2011 - beta
initial release.
Attached Files
File Type: zip 3.4P.ZIP (16.2 KB, 887 views)

Last edited by Pr.BarnArt; 11-09-2014 at 04:20 PM. Reason: update 3.4
Pr.BarnArt is offline   Reply With Quote
Old 06-18-2011, 03:21 AM   #2
bolligske
Junior Member
bolligske began at the beginning.
 
bolligske's Avatar
 
Posts: 9
Karma: 10
Join Date: May 2011
Device: sony prs-600
Hi,
thank you very much for the plugin.
I've installed like the other plugins (I assume it works the same because your txt was empty ). But when I try to find metadata, it doesn't find anything. I've tried it on several books and no result.
Any ideas ?

Bolligske
bolligske is offline   Reply With Quote
Old 06-18-2011, 07:21 AM   #3
mamagaai
Junior Member
mamagaai began at the beginning.
 
Posts: 2
Karma: 10
Join Date: May 2011
Device: bebook club
Would be a great plug-in, but it does not work for me.

This is the message in Calibre:

calibre, version 0.8.6
ERROR: Geen overeenkomsten gevonden: <p>Geen boeken gevonden voor de zoekopdracht. Probeer de zoekopdracht <b>minder specifiek</b> te maken. Gebruik bijvoorbeeld alleen de achternaam van de schrijver of één enkel sleutelwoord uit de titel. Om alle meldingen te zien klik je op "Toon details".

Starting download
Navraag: title:Het scherventapijt; authors:Loes den Hollander
Running identify query with parameters:
{u'authors': [u'Loes den Hollander'], u'identifiers': {}, u'timeout': 30, u'title': u'Het scherventapijt'}
Using plugins: BOL_NL
The log from individual plugins is below

****************************** BOL_NL ******************************
Request extra headers: [('User-agent', 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:2.0.1) Gecko/20100101 Firefox/4.0.1')]
Found 0 results
Downloading from BOL_NL took 0.43499994278
Querying: http://www.bol.com/nl/s/boeken/zoekr...equestid=17572
Plugin BOL_NL failed
Traceback (most recent call last):
File "site-packages\calibre\ebooks\metadata\sources\identify. py", line 41, in run
File "calibre_plugins.BOL_NL.__init__", line 193, in identify
ImportError: cannot import name Worker

************************************************** ******************************
The identify phase took 0.64 seconds
The longest time (0.435000) was taken by: BOL_NL
Merging results from different sources and finding earliest publication dates
We have 0 merged results, merging took: 0.00 seconds
mamagaai is offline   Reply With Quote
Old 06-18-2011, 08:56 AM   #4
Timeb
Junior Member
Timeb began at the beginning.
 
Posts: 1
Karma: 10
Join Date: Jun 2011
Device: Sony PRS-650
Same here

calibre, version 0.8.6
ERROR: Geen overeenkomsten gevonden: <p>Geen boeken gevonden voor de zoekopdracht. Probeer de zoekopdracht <b>minder specifiek</b> te maken. Gebruik bijvoorbeeld alleen de achternaam van de schrijver of één enkel sleutelwoord uit de titel. Om alle meldingen te zien klik je op "Toon details".

Starting download
Navraag: title:Ik wil trouwen!; authors:Ghada Abdel Aal; isbn:9789046808221
Running identify query with parameters:
{u'authors': [u'Ghada Abdel Aal'], u'identifiers': {u'isbn': u'9789046808221'}, u'timeout': 30, u'title': u'Ik wil trouwen!'}
Using plugins: BOL_NL
The log from individual plugins is below

****************************** BOL_NL ******************************
Request extra headers: [('User-agent', 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:2.0.1) Gecko/20100101 Firefox/4.0.1')]
Found 0 results
Downloading from BOL_NL took 3.34999990463
Querying: http://www.bol.com/nl/s/boeken/zoekr...questid=116710
Plugin BOL_NL failed
Traceback (most recent call last):
File "site-packages\calibre\ebooks\metadata\sources\identify. py", line 41, in run
File "calibre_plugins.BOL_NL.__init__", line 193, in identify
File "site-packages\calibre\customize\zipplugin.py", line 147, in load_module
File "calibre_plugins.BOL_NL.worker", line 210
pub_date_node = root.xpath('//div [@class="first_tab_paragraph"]/label [@for="search_more_option3138"]')
^
IndentationError: expected an indented block

************************************************** ******************************
The identify phase took 3.41 seconds
The longest time (3.350000) was taken by: BOL_NL
Merging results from different sources and finding earliest publication dates
We have 0 merged results, merging took: 0.00 seconds

When I copy/paste the generated url by the plugin in the browser "http://www.bol.com/nl/s/boeken/zoekresultaten/Ntt/9789046808221/Nty/1/search/true/searchType/adv/section/books/N/8293/Ntk/isbncode/index.html?_requestid=116710" i'm getting te correct book

I hope it's getting solved soon because i was realy looking forward to this plugin.
Timeb is offline   Reply With Quote
Old 06-18-2011, 09:35 AM   #5
Pr.BarnArt
Groupie
Pr.BarnArt began at the beginning.
 
Pr.BarnArt's Avatar
 
Posts: 170
Karma: 34
Join Date: Jun 2011
Device: Pocketbook 902 / Ipad2
Quote:
Originally Posted by bolligske View Post
Hi,
thank you very much for the plugin.
I've installed like the other plugins (I assume it works the same because your txt was empty ). But when I try to find metadata, it doesn't find anything. I've tried it on several books and no result.
Any ideas ?

Bolligske
Hi,
Please be me more specific, what book did you tried ( seach by isbn or by title / author). Post the log file and I can take a look.
Thx for your reaction, only that we way can make it good


btw: the txt file needs to be empty, it is used by calibre.

Last edited by Pr.BarnArt; 06-18-2011 at 02:51 PM.
Pr.BarnArt is offline   Reply With Quote
Old 06-18-2011, 10:04 AM   #6
Pr.BarnArt
Groupie
Pr.BarnArt began at the beginning.
 
Pr.BarnArt's Avatar
 
Posts: 170
Karma: 34
Join Date: Jun 2011
Device: Pocketbook 902 / Ipad2
Quote:
Originally Posted by mamagaai View Post
Would be a great plug-in, but it does not work for me.

This is the message in Calibre:

File "site-packages\calibre\ebooks\metadata\sources\identify. py", line 41, in run
File "calibre_plugins.BOL_NL.__init__", line 193, in identify
ImportError: cannot import name Worker

Due to the log I think u need the newer 0.2a version. ( i did cleanup too much from the debug code). See the first post in this topic

But the title could be a problem, connected to the way bol uses the title of the book.
They show the title sometimes without "Het" or "De".
That conflicts with the exact title of the book.
And they are not consequent. P.e. see "De eetclub saskia noort", some say only "Eetclub" and other(older ones?) say "De eetclub".

For that this version only accepts the exact match of the book title.
(Othere wise the title of your book in Calibre may be changed the wrong way"
But thinking for a solution.

Thx for your comment.

Last edited by Pr.BarnArt; 06-18-2011 at 11:12 AM.
Pr.BarnArt is offline   Reply With Quote
Old 06-18-2011, 10:13 AM   #7
Pr.BarnArt
Groupie
Pr.BarnArt began at the beginning.
 
Pr.BarnArt's Avatar
 
Posts: 170
Karma: 34
Join Date: Jun 2011
Device: Pocketbook 902 / Ipad2
Quote:
Originally Posted by Timeb View Post
Same here

pub_date_node = root.xpath('//div [@class="first_tab_paragraph"]/label [@for="search_more_option3138"]')
^
IndentationError: expected an indented block
.

I will take a look, dont think it is a big problem.
Before i distribute a version I am used to clean up the code (used for debugging). I am newbie for python and it seems to be critical for indents in the code. I presume I deleted an extra space or so.

edit: Yes I did, see new version in the start of this topic 0-2a

Thx for the remarks
I will keep you informed

Last edited by Pr.BarnArt; 06-18-2011 at 11:13 AM.
Pr.BarnArt is offline   Reply With Quote
Old 06-18-2011, 04:31 PM   #8
Dompie
Enthusiast
Dompie began at the beginning.
 
Dompie's Avatar
 
Posts: 27
Karma: 10
Join Date: Jul 2010
Location: Gouda, The Netherlands
Device: PRS-600 and PRS-650
Yes, version 2a is working. I've tried 3 different (Dutch) books and all 3 are correct. This wil save me lots and lots of cut-and-paste. Thank you
Dompie is offline   Reply With Quote
Old 06-19-2011, 06:17 AM   #9
mamagaai
Junior Member
mamagaai began at the beginning.
 
Posts: 2
Karma: 10
Join Date: May 2011
Device: bebook club
Version 2a works great!! Thanks a lot
mamagaai is offline   Reply With Quote
Old 06-19-2011, 09:55 AM   #10
bolligske
Junior Member
bolligske began at the beginning.
 
bolligske's Avatar
 
Posts: 9
Karma: 10
Join Date: May 2011
Device: sony prs-600
It is working for me too now. Thank you.

bolligske is offline   Reply With Quote
Old 06-19-2011, 10:06 AM   #11
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,230
Karma: 1345754
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
@Pr.BarnArt - when you are happy that this plugin is ready to be "officially" released and added to the Plugin Index sticky thread (so people can download via plugin updater), drop me a PM. All the information I need is detailed on that page at the spoiler at the top - look at the existing entries for other plugins and you will see everything I need to be able to add it such as the internal plugin name, description, internal version, calibre version etc.
kiwidude is offline   Reply With Quote
Old 06-19-2011, 11:16 AM   #12
Dompie
Enthusiast
Dompie began at the beginning.
 
Dompie's Avatar
 
Posts: 27
Karma: 10
Join Date: Jul 2010
Location: Gouda, The Netherlands
Device: PRS-600 and PRS-650
There is stil a slight problem with the description field. There are many <br> extra in the text wich are not in the original text at BOL?

One example
BOL Original:
<div id="js_product_description" class="content_tab">
<h2>Beschrijving</h2>
Dit boek vertelt mijn verlangen en vastberadenheid om weer
heel te worden, het zoeken naar een andere, betekenisvolle relatie
met mijn overleden zoon en mijn zoektocht naar een zinvolle
toekomst.<br />

The plugin:
<div><p class="description">Beschrijving<br><br>Dit boek vertelt mijn verlangen en vastberadenheid om weer<br>heel te worden, het zoeken naar een andere, betekenisvolle relatie<br>met mijn overleden zoon en mijn zoektocht naar een zinvolle<br>toekomst.<br>

I hope you can fix it!

==
Not every book has this problem!! The above one is "De dood & de jongen" by "Tsjitske Waanders"

Last edited by Dompie; 06-19-2011 at 11:29 AM. Reason: Extra Info
Dompie is offline   Reply With Quote
Old 06-19-2011, 04:47 PM   #13
Pr.BarnArt
Groupie
Pr.BarnArt began at the beginning.
 
Pr.BarnArt's Avatar
 
Posts: 170
Karma: 34
Join Date: Jun 2011
Device: Pocketbook 902 / Ipad2
New update: version 0.3 released

It is becoming more mature , please comment ,that can make it better.

You can find the new version at the start-post op this thread.
Pr.BarnArt is offline   Reply With Quote
Old 06-19-2011, 04:48 PM   #14
Pr.BarnArt
Groupie
Pr.BarnArt began at the beginning.
 
Pr.BarnArt's Avatar
 
Posts: 170
Karma: 34
Join Date: Jun 2011
Device: Pocketbook 902 / Ipad2
Quote:
Originally Posted by kiwidude View Post
@Pr.BarnArt - when you are happy that this plugin is ready to be "officially" released and added to the Plugin Index sticky thread (so people can download via plugin updater), drop me a PM. All the information I need is detailed on that page at the spoiler at the top - look at the existing entries for other plugins and you will see everything I need to be able to add it such as the internal plugin name, description, internal version, calibre version etc.
I will, just need some more testing in practise
Pr.BarnArt is offline   Reply With Quote
Old 06-19-2011, 04:49 PM   #15
Pr.BarnArt
Groupie
Pr.BarnArt began at the beginning.
 
Pr.BarnArt's Avatar
 
Posts: 170
Karma: 34
Join Date: Jun 2011
Device: Pocketbook 902 / Ipad2
Quote:
Originally Posted by Dompie View Post
There is stil a slight problem with the description field. There are many <br> extra in the text wich are not in the original text at BOL?

One example
BOL Original:
<div id="js_product_description" class="content_tab">
<h2>Beschrijving</h2>
Dit boek vertelt mijn verlangen en vastberadenheid om weer
heel te worden, het zoeken naar een andere, betekenisvolle relatie
met mijn overleden zoon en mijn zoektocht naar een zinvolle
toekomst.<br />

The plugin:
<div><p class="description">Beschrijving<br><br>Dit boek vertelt mijn verlangen en vastberadenheid om weer<br>heel te worden, het zoeken naar een andere, betekenisvolle relatie<br>met mijn overleden zoon en mijn zoektocht naar een zinvolle<br>toekomst.<br>

I hope you can fix it!

==
Not every book has this problem!! The above one is "De dood & de jongen" by "Tsjitske Waanders"

Thank you, I will take a look
Pr.BarnArt is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[Metadata Source Plugin] Libri.hu [Deprecated] Daermond Plugins 5 10-02-2012 06:07 AM
[Metadata Source Plugin] Moly.hu [Deprecated] Daermond Plugins 7 09-23-2012 04:48 AM
Request : metadata source plugin for bol.com bolligske Plugins 8 06-17-2011 08:44 AM
[Metadata Download Plugin] Goodreads Metadata **Deprecated** kiwidude Plugins 30 04-23-2011 03:10 PM
metadata plugin redneck_momma Plugins 1 05-21-2010 09:41 PM


All times are GMT -4. The time now is 10:55 AM.


MobileRead.com is a privately owned, operated and funded community.