Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 02-21-2013, 03:17 PM   #496
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
@Swallmark

It all comes down to which edition you have linked to. The linking itself will have been done either by using the Goodreads metadata plugin if you use that, or by linking from the book isbn. You can switch edition using one of the menu options in this plugin, then add to your shelf.

@All

There are some suggestions I will look into when I next revisit this plugin. However I did get my first email from Goodreads support warning that several users have had their ip addresses blocked due to overloading the api threshold with calls. I am still waiting for further details from them to allow identifying which feature they were using and figure out what to do about it. My guess is that they have or were attempting to put very large amounts of books on shelves in some way, but exactly how many and how reasonable their intentions were etc. I do not know.

So please do remember all my warnings about this in the first post of this thread, and don't abuse this plugin, it is being monitored. When I know from their tech guys exactly which feature is causing this issue, either i will have to make that feature get throttled in some way to make it run slower or less likely perhaps they will add some new api calls to make sure there is less involved with it. Until this all gets resolved I won't be making any other changes to this plugin to make sure to not worsen the issue.

If you are one of those users who got their IP blocked, please post or PM me with any details of what you were trying to do, how many books involved etc. I want to fix or workaround the issue so this plugin does not get completely blocked for everyone.

Last edited by kiwidude; 02-21-2013 at 03:22 PM.
kiwidude is offline   Reply With Quote
Old 02-22-2013, 09:43 AM   #497
edwdecarlo
Enthusiast
edwdecarlo began at the beginning.
 
Posts: 35
Karma: 41
Join Date: Nov 2011
Location: North Kingstown, RI, USA
Device: Kindle DX,Fire HD
Quote:
Originally Posted by kiwidude View Post
So please do remember all my warnings about this in the first post of this thread, and don't abuse this plugin, it is being monitored. When I know from their tech guys exactly which feature is causing this issue, either i will have to make that feature get throttled in some way to make it run slower or less likely perhaps they will add some new api calls to make sure there is less involved with it. Until this all gets resolved I won't be making any other changes to this plugin to make sure to not worsen the issue.
Just trying to figure out how I/we can help keep this plug-in from being blocked:

I see in your initial post that Goodreads monitors/limits the number of API calls per minute. I know that you have built in a 50 Book selection limit to control the number of API calls within a Sync block. I always do my posts manually from within Calibre, selecting 50 book blocks at a time, and with the time to post a block and resolve books that could not be automatically matched/linked I don't believe that I have ever been able to Sync more than 50 books within a minute.

Perhaps there is some other limit that may be causing you to get e-mails from Goodreads and IPs blocked. They may have a daily limit on the number of API calls per IP. If this is the case, would you have an idea of what the limit may be (probably not a hard fast number)? I have seen a lot of posting from users with very large collections (50,000+), so we probably need to limit our daily posts.

Also, when kiwidude created this plug-in he had to register with Goodreads to receive a Developer Key, to allow for access to all API calls. This means that to Goodreads, we are all one API user. So the Goodreads limits apply to all of us as a group (except any per IP limits). So if 100 of us are Syncing 50 books at the same time, that is 50,000+ API calls to Goodreads.

Once again, thank you kiwidude for this and all the other great plug

edwdecarlo is offline   Reply With Quote
 
Enthusiast
Old 02-22-2013, 10:25 AM   #498
DoctorOhh
US Navy, Retired
DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.
 
DoctorOhh's Avatar
 
Posts: 8,800
Karma: 12528001
Join Date: Feb 2009
Location: North Carolina
Device: Nexus 7
Quote:
Originally Posted by edwdecarlo View Post
I have seen a lot of posting from users with very large collections (50,000+), so we probably need to limit our daily posts.
Just a reminder to folks, as it states in the first post if you have more than a small library you should upload your books to GoodReads via a csv file. I haven't done it but the create catalog feature can create a csv file of your books.

Then use the plugin the keep your books in Goodreads up to date.

Quote:
Originally Posted by kiwidude View Post
Special Notes:
  • Please don't abuse this plugin by using it to put many hundreds or thousands of books on your shelves. Goodreads T&C require a very limited threshold on the number of API calls per minute. Worst case they will block the plugin and that ruins it for everyone. You can use CSV export/import to Goodreads for large volumes if you need it. Refer to the help page within the plugin for the full details.
DoctorOhh is offline   Reply With Quote
Old 02-22-2013, 03:28 PM   #499
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
@edwecarlo - yeah I am still awaiting the technical details from them, I haven't looked at the code to try to guess in advance of it. That they said a few users had their IP blocked implies that those specific users were flooding the api, which means there is some feature in the plugin that escapes my 50 books at a time limit. I could make random guesses or speculate from looking at the code but I really want to hear from their tech team as to what triggered it from their side.

And you are absolutely correct that all users share the same developer key for this plugin, so simultaneous usage by thousands of users would in theory be an issue. It really depends on how they do their throttling. I originally thought they would disable the developer key if the threshold gets hit. It seems that is their action of last resort which hopefully we can workaround to avoid. Instead they blocked some IPs. Was this because a couple of people were randomly chosen as "victims" due to a whole bunch of other users also simultaneously using the plugin? Or does their blocking have more intelligence and target only specific IPs which are exceeding their limits? Only their tech team can tell me that, hopefully it is the latter.

I did have a conversation with one of their team a long time ago when writing this plugin to try to figure out if it would become an issue if the plugin got very popular. At the time I was told that the measuring is done as an average over a time period.

Another suggestion from a user ages ago was using multiple developer keys, even getting users to register to use an individual key. However as I said back then I believe that is completely and totally against the spirit and intent of the API and their T&Cs. And if Goodreads are blocking specific IPs that are flooding their API then using a different key wouldn't achieve much anyway.

So... we wait for their response. The original support person did not have the technical details I need so handed it off to their tech team.

As I said above if anyone reading this happened to be someone who had their Goodreads account blocked and can hence provide any hints as to what may have happened to them please do get in touch with me via any means. This isn't a witch hunt, I am not grumpy about it or anything like that. It could be that some feature just has to be changed or that I petition Goodreads for an api change to reduce the calls I need to make.
kiwidude is offline   Reply With Quote
Old 03-21-2013, 11:15 PM   #500
Illyrie
Junior Member
Illyrie began at the beginning.
 
Posts: 9
Karma: 10
Join Date: Nov 2012
Device: iPad
Is there any way to tell what books I have already linked, without selecting each book and checking if the linked book link is greyed out? Maybe a custom goodreads column?
Illyrie is offline   Reply With Quote
Old 03-22-2013, 12:17 AM   #501
Penny_Dreadful
Member
Penny_Dreadful has much to be proud ofPenny_Dreadful has much to be proud ofPenny_Dreadful has much to be proud ofPenny_Dreadful has much to be proud ofPenny_Dreadful has much to be proud ofPenny_Dreadful has much to be proud ofPenny_Dreadful has much to be proud ofPenny_Dreadful has much to be proud ofPenny_Dreadful has much to be proud ofPenny_Dreadful has much to be proud ofPenny_Dreadful has much to be proud of
 
Penny_Dreadful's Avatar
 
Posts: 16
Karma: 27758
Join Date: Aug 2009
Location: Perth, Australia
Device: Kindle Paperwhite
Quote:
Originally Posted by Illyrie View Post
Is there any way to tell what books I have already linked, without selecting each book and checking if the linked book link is greyed out? Maybe a custom goodreads column?
A custom column is just what you need, the instruction to set one up are in the original post.

Quote:
Originally Posted by kiwidude View Post
Displaying a Goodreads Identifier Column:

As of v1.1 of this plugin you can display the Goodreads Id as a column in Calibre, to quickly see which books you have linked:

Add a custom column with Preferences->Add your own columns. I suggest the following values if you want to display the numeric id:
Lookup name: goodreads
Column heading: Goodreads
Column type: Column built from other columns
Template: {identifiers:select(goodreads)}

If instead you want to display a yes/no type column then do the above with the following differences:
Template: program: test(select(field('identifiers'),'goodreads'),'Yes ','No')
Show checkmarks: Ticked

If you do not want a cross to appear next to unlinked books, change the 'No' to '' in the above template
Penny_Dreadful is online now   Reply With Quote
Old 03-22-2013, 08:31 AM   #502
edwdecarlo
Enthusiast
edwdecarlo began at the beginning.
 
Posts: 35
Karma: 41
Join Date: Nov 2011
Location: North Kingstown, RI, USA
Device: Kindle DX,Fire HD
@Illyrie - I have set up a custom column which stores the Goodreads shelf to which my books have been added.

Lookup name: book_shelf
Column heading: Shelf
Column type: Text, but with a fixed set of permitted values
Values: Unread,Reading,Read

I used a fixed set of values so I could move books between shelves easier.

I then use the Shelf Add/Sync Actions in the Goodreads Sync plugin to set this column with the proper value. The advantage of this is that you can then use the Calibre column coloring/icon options and Tag Browser to be Shelf specific.
edwdecarlo is offline   Reply With Quote
Old 03-23-2013, 06:20 PM   #503
Tinkergnome
Member
Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.
 
Posts: 10
Karma: 20650
Join Date: Mar 2013
Device: Kindle Paperwhite
just a wee bit of help please. I have installed calibre and the plugin. Upon clicking yes on confirm authorization i have received an error it follows below any help would be greatly appriciated.

Code:
calibre, version 0.9.24
ERROR: Goodreads Failure: The request contacting Goodreads has failed. Please try again.

URL: http://www.goodreads.com/oauth/access_token
Response Code: 404
<!DOCTYPE html>
<html>
<head>
  <title>Goodreads - Page Not Found</title>
	<link href="/assets/goodreads.css" media="screen" rel="Stylesheet" type="text/css" />
	<link href="/assets/main.css" media="screen" rel="Stylesheet" type="text/css" />
    <!--[if lt IE 8]>
    <link href="/assets/common_images_ie.css" media="screen" rel="Stylesheet" type="text/css" />
    <![endif]-->
    <!--[if gte IE 8]><!-->
    <link href="/assets/common_images.css" media="screen" rel="Stylesheet" type="text/css" />
    <!--<![endif]-->
</head>
<body id="home">
  <div class="headerContainer">
	  <div class="header">

		  <div class="branding">
		    <a href="/"><img src="/assets/layout/goodreads_logo.gif" width="200" height="41" border="0" alt="goodreads" class="logo"/></a>
		  </div>
		</div>
	</div>

  <!-- BEGIN: mainContent -->
  <div class="mainContentContainer">
    <div class="mainContent">
      <div class="mainContentFloat">

				<div class="leftContainer mediumText">

				  <h1>Page Not Found</h1>
				  <br/>
					The page you requested doesn't exist.
					Please check the url again, or visit the home page.
					<br/><br/>

					<a class="actionLink" href="/">&laquo; go to the goodreads homepage</a>
				</div>
			</div>
		</div>
	</div>
  <!-- END: mainContent -->

  <script type="text/javascript">
      var gaJsHost = (("https:" == document.location.protocol) ? "https://ssl." : "http://www.");
      document.write(unescape("%3Cscript src='" + gaJsHost + "google-analytics.com/ga.js' type='text/javascript'%3E%3C/script%3E"));
  </script>  <script type="text/javascript">
      try {
          var pageTracker = _gat._createTracker("UA-968618-1");
          pageTracker._trackPageview("/404_notfound");
      }
      catch(err) {}
  </script>

</body>
</html>
Tinkergnome is offline   Reply With Quote
Old 03-24-2013, 06:29 PM   #504
Goldie112299
Junior Member
Goldie112299 began at the beginning.
 
Posts: 5
Karma: 10
Join Date: Mar 2013
Device: Kindle HD
When I try to authorize the plugin, it goes to goodreads.com, opens the main page then automatically goes to a different page that says "Page Not Found".

Every page that I click on does the above described.

I am puling my hair out trying to figure this out!!!! Please HELP!!
Goldie112299 is offline   Reply With Quote
Old 03-24-2013, 08:32 PM   #505
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
@Tinkergnome and Goldie112299 - the plugin is working fine for me at the moment. Either there was a temporary blip on the servers at Goodreads, or there is some problem with your internet connection/sites viewable via your firewalls etc. I can only suggest you keep trying, and contact Goodreads support if you continue to have issues with it. There is nothing wrong with the plugin code itself, I just deauthorised and reauthorised myself just now using it.
kiwidude is offline   Reply With Quote
Old 03-24-2013, 10:15 PM   #506
rifka
Enthusiast
rifka began at the beginning.
 
Posts: 25
Karma: 10
Join Date: Mar 2013
Location: Canada
Device: iPhone, iPad, Sony, Kobo
I am having the same problem. I just installed the plugin and tried to authorize it. It goes to my goodreads main page and does nothing. I tried installing it from plugins within calibre. I have tried uninstalling it and reinstalling it from the download from this thread. I don't understand what's going on.
rifka is offline   Reply With Quote
Old 03-24-2013, 10:25 PM   #507
Tinkergnome
Member
Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.Tinkergnome can self-interpret dreams as they happen.
 
Posts: 10
Karma: 20650
Join Date: Mar 2013
Device: Kindle Paperwhite
hey kiwidude, I just tried uninstalling and re-installing to no avail. Changed default browser from chrome to IE just to see if browser was issue. Same problem but now have a little more info.

the api appears to get to goodreads but comes back with

page not found
the page you requested doesn't exist. Please check the url again, or visit the homepage.

also when pasting the url from the failure log goodreads responds with failure Invalid OAuth Request.

something may have changed with the api or code request.
Tinkergnome is offline   Reply With Quote
Old 03-24-2013, 10:32 PM   #508
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
As I said above guys, the problem is *not* the plugin, I have verified it still works perfectly fine this morning. You need to contact Goodreads - there are no code or API changes, I have been to their forums and the proof is the fact that it works for me. Most likely they are having some sort of problem with just some of their authentication servers.
kiwidude is offline   Reply With Quote
Old 03-24-2013, 11:10 PM   #509
rifka
Enthusiast
rifka began at the beginning.
 
Posts: 25
Karma: 10
Join Date: Mar 2013
Location: Canada
Device: iPhone, iPad, Sony, Kobo
Just to make this more interesting. I have 2 accounts on Goodreads. One account I can authorize, the other (the one I need to) I can't. I cannot figure out why. Any ideas?
rifka is offline   Reply With Quote
Old 03-25-2013, 12:49 AM   #510
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
@rifka, see my answer above, you need to contact Goodreads support. The issues anyone has with this plugin in trying to authorise has been proven time and time again to be a problem on their side. The plugin is doing its job correctly, as proven yourself by the fact that it works for one of your accounts. As to why a minority of people seem to have issues that require Goodreads to sort out, I have no idea but it is *nothing* we can do about it, talk to them.
kiwidude is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] Clipboard Search kiwidude Plugins 9 08-12-2014 03:36 AM
[GUI Plugin] Search the Internet kiwidude Plugins 205 08-11-2014 02:22 PM
[GUI Plugin] Quick Preferences kiwidude Plugins 31 08-05-2014 10:45 PM
[GUI Plugin] Open With kiwidude Plugins 228 07-31-2014 01:06 AM
[GUI Plugin] Book Sync **Deprecated** kiwidude Plugins 111 06-07-2011 07:47 PM


All times are GMT -4. The time now is 04:18 AM.


MobileRead.com is a privately owned, operated and funded community.