12-15-2015, 06:43 PM | #241 | |
Grand Sorcerer
Posts: 24,907
Karma: 47303748
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
Quote:
But, my real problem with doing this is being a "good citizen". The proper URL has been blocked for a reason. We should respect that. Maybe we should work out why it was blocked in the first place. |
|
12-15-2015, 10:18 PM | #242 |
Zealot
Posts: 137
Karma: 2156958
Join Date: Jan 2013
Device: Too many random androids to list
|
I'm not so sure it's hurting anything.
The URL's working with text after the ID is definitely by design, it's not a bug. The url's internally on the site, such as the ones you get when you use the search interface or add a link into one of their forum posts using that search (an entirely different one to the main site search), are constructed by contatenating/truncating the title something similar to how Calibre shortens titles on save to disk. You can see them changing when you edit a book title (or, since Authors work the same way, if you edit an author name on the site.) It's been that way for years too, and is unlikely to be changing . Secondly, if the GR plugin was truly being a good citizen, it'd be using the API, not scraping. The API certainly has rate limits set (And doesn't the UI stop you pulling up more than 50 books at a time in some circumstances? It's been a very long time since I had 50 books to add metadata too, so I may be misremembering.) I think, since Calibre is already being a bit of a dandy highwayman as far as data fetching goes, this isn't so bad. As long as it's not hitting more than once a second, it's not being any worse of a citizen than it's ever been. |
Advert | |
|
12-17-2015, 02:06 AM | #243 | ||
Member
Posts: 21
Karma: 104
Join Date: Oct 2013
Device: none
|
Quote:
Code:
import random randomletter = chr(random.randint(97,122)) But it's not necessary at this point. Just adding a dash works fine, and I also doubt goodreads will change this (for the same reasons you gave in your next post). Without my one char fix, however, people will see 403 errors when they try to download goodreads metadata for books that already have a "goodreads:" identifier. This behavior is easily reproducible by anyone. Quote:
I presume (though I didn't look into it) that Calibre is purposely not sending more than 1 request per second per Calibre instance in order to try to follow the spirit of the Goodreads terms of use if not the letter. If the plugin did use the API then the limit would be 1 request per second per developer key. All users of the plugin would then have to get their own key, otherwise there could only be 1 request per second for all simultaneous users of the plugin. |
||
12-17-2015, 07:47 AM | #244 | ||
Grand Sorcerer
Posts: 24,907
Karma: 47303748
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
Quote:
Quote:
Personally, I'm not interested in working around Goodreads restrictions. The real question on all this is why is the 403 error appearing? I haven't seen anything from Goodreads on restrictions like this. The only references I can see are some problems when using the API. I also haven't seen the error myself. And that includes when I am fiddling with a metadata source plugin and continuously repeating the same request. |
||
12-21-2015, 02:57 PM | #245 | |
Connoisseur
Posts: 51
Karma: 10
Join Date: Nov 2012
Device: none
|
Quote:
Oops. didn't quote quite the right post. Published dates are one day off. This can result in being a whole year off. Jan 1 2005->Dec 31 2004 |
|
Advert | |
|
02-06-2016, 04:00 PM | #246 |
Evangelist
Posts: 435
Karma: 572984
Join Date: Jan 2010
Location: Long Island
Device: Kobo Libra 2, Kindle 4, Nook Gl4, Nook STR, REB 1100, Ebookwise 1500,
|
Has anyone been having a problem with this plugin lately? Every time I go to download metadata for a book in the last couple of days if I don't have an ISBN number it returns with a no match error message. Yet if I go to Goodreads and do the same exact search it will bring up the book I'm looking for. I checked and I am running the latest version of the plugin.
|
02-06-2016, 05:44 PM | #247 | |
Junior Member
Posts: 2
Karma: 10
Join Date: Nov 2013
Device: Android
|
Quote:
|
|
02-06-2016, 07:53 PM | #248 |
Grand Sorcerer
Posts: 24,907
Karma: 47303748
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
There has been a small change in the search results page that broke it. The attached version should fix it. Please test and tell me so I can arrange for it to be released.
|
02-07-2016, 12:17 AM | #249 |
Evangelist
Posts: 435
Karma: 572984
Join Date: Jan 2010
Location: Long Island
Device: Kobo Libra 2, Kindle 4, Nook Gl4, Nook STR, REB 1100, Ebookwise 1500,
|
Yay! I tried it on a few different books and that seems to have done the trick. Thank you!
|
02-08-2016, 06:43 AM | #250 |
Junior Member
Posts: 6
Karma: 10
Join Date: Oct 2015
Device: none
|
Thank you davidfor I tried it on about 40 books and it works perfectly both in single and bulk metadata download.
|
02-08-2016, 02:19 PM | #251 |
Enthusiast
Posts: 35
Karma: 10
Join Date: Jun 2014
Device: Paperwhite
|
It works. Thanks,
|
02-08-2016, 02:47 PM | #252 |
Calibre Plugins Developer
Posts: 4,637
Karma: 2162064
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
v1.1.11 Released
Changes in this release
Thanks to davidfor for making the changes. |
02-14-2016, 07:12 PM | #253 |
Long in the tooth junior
Posts: 13
Karma: 10
Join Date: Apr 2011
Location: melbourne, australia
Device: none
|
Good morning.
I am using the Goodreads Metadata Plugin, and I have an error in the mapping function. I originally reported this to the main bug system - https://bugs.launchpad.net/calibre/+bug/1540848, but was referred to this forum, as it appears the 'bug' is in the plugin. Full details of the circumstances are posted in the original bug report. A high level summary - In Preferences - Adding Books - Create rules to filter/transform tags. I have set up some rules: An Example - 'Replace the tag, if it matches pattern: biog* with the tag: Biography When I run 'download metadata in bulk' the above tag ends up biographyphyphyphpyphyp, and variants. Some of the residual original tag info is added to the end of the long line, no spaces are copied or added. I am now using Calibre 2.51, Windows 7 64 bit. In my original report, I was using 2.50.1 Thanks - shirley |
02-16-2016, 07:06 AM | #254 |
Grand Sorcerer
Posts: 24,907
Karma: 47303748
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
Shirley: It isn't the plugin. I did some testing using the tag mapper test dialog. I had the same results. I've added that to the bug report.
|
02-16-2016, 06:30 PM | #255 |
Guru
Posts: 808
Karma: 2260766
Join Date: Apr 2008
Device: Kindle Oasis 2
|
Is there a way the plugin could include the "I own this book" field on Goodreads?
|
Tags |
goodreads, metadata |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
[GUI Plugin] Goodreads Sync | kiwidude | Plugins | 1722 | Yesterday 03:09 PM |
[Metadata Download Plugin] Goodreads Metadata **Deprecated** | kiwidude | Plugins | 30 | 04-23-2011 02:10 PM |
[Covers Plugin] Goodreads Covers **Deprecated** | kiwidude | Plugins | 13 | 04-17-2011 05:09 PM |
metadata plugin | redneck_momma | Plugins | 1 | 05-21-2010 08:41 PM |