[GUI Plugin] Goodreads Sync

[michelleanne]

Hi, I'm new here but I've been trying for several weeks (on and off) to set up a new install of calibre with the goodreads sync plugin, but cannot get it to authorise. I feel like I must be missing something or doing something wrong, because I don't have issues with any other plugins.

The error I get consistently is:

calibre, version 2.47.0
ERROR: Goodreads Failure: The request contacting Goodreads has failed. Please try again.

URL: http://www.goodreads.com/oauth/request_token
Response Code: 401
Invalid OAuth Request

I've tried uninstalling and reinstalling the plugin a few times, including installing from the zip file as an alternative to directly from the plugin settings of calibre, and also tried uninstalling and reinstalling calibre itself a few times and can't get past this error.

Any ideas? Thanks in advance.

[PeterT]

Looks like your id / password is not correct.

Did you

Click on "Customize plugin" in the context menu to authorize the plugin with your Goodreads account. This option is also available via the Preferences->Plugins dialog once you select it within the list.

[davidfor]

Is the time and date on the computer correct? Or close to correct? This is used as part of the request and if it is to far out, you will get this error.

If the time is correct, then please restart calibre in debug mode (right click on the preferences button) and try again. Then close calibre and post the displayed log.

[Rellwood]

This is the bug report I got for the same problem as above
calibre Debug log
calibre 2.47 [64bit] isfrozen: True is64bit: True
Windows-7-6.1.7601-SP1 Windows ('64bit', 'WindowsPE')
('Windows', '7', '6.1.7601')
Python 2.7.9
Windows: ('7', '6.1.7601', 'SP1', 'Multiprocessor Free')
DeDRM v6.1.0: In __init__
DeDRM v6.1.0: In load_resources
DeDRM v6.1.0: verdir C:\Users\Toshiba\AppData\Roaming\calibre\plugins\D eDRM\6.1.0
DeDRM v6.1.0: In initialize
Successfully initialized third party plugins: DeDRM && Quality Check && ScrambleEbook && Modify ePub && Consolidate All Library Metadata && Clean Metadata && APNX Generator && Diaps Editing Toolbag && Quick Preferences && MultiColumnSearch && KindleUnpack - The Plugin && Prettify Cover && Annotations && Fantastic Fiction && Extract ISBN && Generate Cover && FanFicFare && Goodreads Sync && View Manager && Goodreads && Overdrive Link && Find Duplicates && Import List && Ex Libris && Favourites Menu && Fantastic Fiction Adults && Resize Cover && Count Pages && Library Codes && User Category && Search The Internet && EpubSplit && EpubMerge
Starting up...
Traceback (most recent call last):
File "site-packages\calibre\gui2\ui.py", line 152, in __init__
File "site-packages\calibre\gui2\ui.py", line 166, in init_iaction
File "site-packages\calibre\customize\__init__.py", line 582, in load_actual_plugin
File "importlib\__init__.py", line 37, in import_module
File "site-packages\calibre\customize\zipplugin.py", line 179, in load_module
File "calibre_plugins.apnx_generator.apnxaction", line 14, in <module>
ImportError: No module named PyQt4.Qt
FFF:INFO:calibre_plugins.fanficfare_plugin.prefs(1 39):Attempting to read settings from predecessor--FFDL
FFF:INFO:calibre_plugins.fanficfare_plugin.prefs(1 44):Using default settings
FFFEBUG:calibre_plugins.fanficfare_plugin.fff_pl ugin(185):Plugin FanFicFare macmenuhack file_path:C:\Users\Toshiba\AppData\Roaming\calibre \plugins\fanficfare_macmenuhack.txt
HttpHelper::__init__: proxy=None
EpubMergeEBUG:calibre_plugins.epubmerge.epubmerg e_plugin(152):macmenuhack file_path:C:\Users\Toshiba\AppData\Roaming\calibre \plugins\fanficfare_macmenuhack.txt
Started up in 14.87 seconds with 1888 books
SMART_DEV ( 0.01: 0.007) _attach_to_port try ip address "" on port 9090
SMART_DEV ( 1.15: 0.805) startup_on_demand listening on port 9090
SMART_DEV ( 1.34: 0.002) _attach_to_port try ip address "" on port 54982
SMART_DEV ( 1.53: 0.000) startup_on_demand broadcast socket listening on port 54982
SMART_DEV ( 2.71: 1.018) run All IP addresses {'{846EE342-7039-11DE-9D20-806E6F6E6963}': [{'addr': '127.0.0.1', 'broadcast': '127.255.255.255', 'netmask': '255.0.0.0'}], '{CD9D4A37-B241-4793-838C-4CCD9FC5EA9E}': [{'addr': '169.254.196.55'}], '{CBC5BA79-20CB-400F-A807-55371CEEB06C}': [{'addr': '192.168.1.75', 'broadcast': '192.168.1.255', 'netmask': '255.255.255.0'}], '{E03B3B1E-0DE7-4D6E-AD7B-21709A2A5FA5}': [{'addr': '169.254.21.163'}]}
_oauth_request_get: url=http://www.goodreads.com/review/list.xml?v=2&shelf=to-read&page=1&per_page=200
Goodreads failure calling: http://www.goodreads.com/review/list...1&per_page=200
Response: {'x-xss-protection': '1; mode=block', 'cache-control': 'no-cache', 'vary': 'User-Agent,Accept-Encoding', 'content-type': 'text/html; charset=utf-8', 'www-authenticate': 'OAuth realm="http://www.goodreads.com"', 'x-request-id': '0B9KAQBT1S2DEPB1V7Q3', 'x-runtime': '0.040624', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'content-length': '14', 'server': 'Server', 'status': '401', 'set-cookie': 'csid=BAhJIhg2MzMtNDc2NTk4MS0zNzc0NzQ3BjoGRVQ%3D--5c3743dd8f1377450bb1ee64a92af72e7ad109d1; path=/; expires=Sun, 30 Dec 2035 05:59:40 -0000, locale=en; path=/, _session_id2=2939e4d9d24918dfcb8f678e1624a498; path=/; expires=Wed, 30 Dec 2015 11:59:40 -0000; HttpOnly', 'x-content-type-options': 'nosniff', 'date': 'Wed, 30 Dec 2015 05:59:40 GMT'}
Content: not authorized
File "site.py", line 132, in main
File "site.py", line 109, in run_entry_point
File "site-packages\calibre\debug.py", line 225, in main
File "site-packages\calibre\debug.py", line 191, in run_debug_gui
File "site-packages\calibre\gui_launch.py", line 63, in calibre
File "site-packages\calibre\gui2\main.py", line 525, in main
File "site-packages\calibre\gui2\main.py", line 377, in run_gui
File "calibre_plugins.goodreads_sync.action", line 319, in sync_shelves
File "calibre_plugins.goodreads_sync.dialogs", line 342, in _accept_clicked
File "calibre_plugins.goodreads_sync.core", line 373, in get_goodreads_books_on_shelves
File "calibre_plugins.goodreads_sync.core", line 120, in _oauth_request_get
File "calibre_plugins.goodreads_sync.core", line 171, in _handle_failure
_oauth_request_get: url=http://www.goodreads.com/review/list.xml?v=2&shelf=to-read&page=1&per_page=200
Goodreads failure calling: http://www.goodreads.com/review/list...1&per_page=200
Response: {'x-xss-protection': '1; mode=block', 'cache-control': 'no-cache', 'vary': 'User-Agent,Accept-Encoding', 'content-type': 'text/html; charset=utf-8', 'www-authenticate': 'OAuth realm="http://www.goodreads.com"', 'x-request-id': '11CY3EHDJ0XPHM2CJS1H', 'x-runtime': '0.047217', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'content-length': '14', 'server': 'Server', 'status': '401', 'set-cookie': 'csid=BAhJIhgyNDEtMjYxNzgxOC0xNzgyMzY3BjoGRVQ%3D--78028926f28bf03f25ff245673a635854064bded; path=/; expires=Sun, 30 Dec 2035 06:01:21 -0000, locale=en; path=/, _session_id2=6c74c3d661926eb69e3d9474a8927830; path=/; expires=Wed, 30 Dec 2015 12:01:21 -0000; HttpOnly', 'x-content-type-options': 'nosniff', 'date': 'Wed, 30 Dec 2015 06:01:21 GMT'}
Content: not authorized
File "site.py", line 132, in main
File "site.py", line 109, in run_entry_point
File "site-packages\calibre\debug.py", line 225, in main
File "site-packages\calibre\debug.py", line 191, in run_debug_gui
File "site-packages\calibre\gui_launch.py", line 63, in calibre
File "site-packages\calibre\gui2\main.py", line 525, in main
File "site-packages\calibre\gui2\main.py", line 377, in run_gui
File "calibre_plugins.goodreads_sync.action", line 319, in sync_shelves
File "calibre_plugins.goodreads_sync.dialogs", line 342, in _accept_clicked
File "calibre_plugins.goodreads_sync.core", line 373, in get_goodreads_books_on_shelves
File "calibre_plugins.goodreads_sync.core", line 120, in _oauth_request_get
File "calibre_plugins.goodreads_sync.core", line 171, in _handle_failure
Starting debug executable: C:\Program Files\Calibre2\calibre-debug.exe

[Wolphin]

I had created a custom lastread field for my Kobo Utilities, that it updates when I sync my Kobo Aura H2O to calibre.

I am trying to get it to sync with the Goodreads. The utility sees it as the Read Date field. How to I get it to upload that information to Goodreads, so I don't have to manually do so?

I looked through (and searched) this thread, but didn't see anything.

[Terisa de morgan]

Originally Posted by Wolphin

I had created a custom lastread field for my Kobo Utilities, that it updates when I sync my Kobo Aura H2O to calibre.

I am trying to get it to sync with the Goodreads. The utility sees it as the Read Date field. How to I get it to upload that information to Goodreads, so I don't have to manually do so?

I looked through (and searched) this thread, but didn't see anything.

I've set this plugin so when I add a file to the read shelve, it adds the rating and the date too ("Edit shelf add actions")

[davidfor]

Originally Posted by Wolphin

I had created a custom lastread field for my Kobo Utilities, that it updates when I sync my Kobo Aura H2O to calibre.

I am trying to get it to sync with the Goodreads. The utility sees it as the Read Date field. How to I get it to upload that information to Goodreads, so I don't have to manually do so?

I looked through (and searched) this thread, but didn't see anything.

There isn't a way to update the status on Goodreads automatically. You need to configure the plugin, as Terisa said, and then select the "Add to shelf" function yourself. Or "Update reading progress" if you use that while reading.

Hmm, I suppose one thing that could be done is if the "Update reading progress" is used and the book was at 100%, then also as the book to the "read" shelf. That would solve an annoyance I have with this.

And I suppose it would be possible to call these functions after the Kobo Utilities has run it's store. That's a little more complicated and I'd have to think about it.

[davidfor]

Originally Posted by Rellwood

Traceback (most recent call last):
File "site-packages\calibre\gui2\ui.py", line 152, in __init__
File "site-packages\calibre\gui2\ui.py", line 166, in init_iaction
File "site-packages\calibre\customize\__init__.py", line 582, in load_actual_plugin
File "importlib\__init__.py", line 37, in import_module
File "site-packages\calibre\customize\zipplugin.py", line 179, in load_module
File "calibre_plugins.apnx_generator.apnxaction", line 14, in <module>
ImportError: No module named PyQt4.Qt

This isn't related to the problem you are seeing, but that says the APNX generator plugin hasn't been updated. It won't work, so you should either remove it, or see if there is an upgrade to a version that works with the 2.x versions of calibre.

Spoiler:

_oauth_request_get: url=http://www.goodreads.com/review/list.xml?v=2&shelf=to-read&page=1&per_page=200
Goodreads failure calling: http://www.goodreads.com/review/list...1&per_page=200
Response: {'x-xss-protection': '1; mode=block', 'cache-control': 'no-cache', 'vary': 'User-Agent,Accept-Encoding', 'content-type': 'text/html; charset=utf-8', 'www-authenticate': 'OAuth realm="http://www.goodreads.com"', 'x-request-id': '0B9KAQBT1S2DEPB1V7Q3', 'x-runtime': '0.040624', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'content-length': '14', 'server': 'Server', 'status': '401', 'set-cookie': 'csid=BAhJIhg2MzMtNDc2NTk4MS0zNzc0NzQ3BjoGRVQ%3D--5c3743dd8f1377450bb1ee64a92af72e7ad109d1; path=/; expires=Sun, 30 Dec 2035 05:59:40 -0000, locale=en; path=/, _session_id2=2939e4d9d24918dfcb8f678e1624a498; path=/; expires=Wed, 30 Dec 2015 11:59:40 -0000; HttpOnly', 'x-content-type-options': 'nosniff', 'date': 'Wed, 30 Dec 2015 05:59:40 GMT'}
Content: not authorized
  File "site.py", line 132, in main
  File "site.py", line 109, in run_entry_point
  File "site-packages\calibre\debug.py", line 225, in main
  File "site-packages\calibre\debug.py", line 191, in run_debug_gui
  File "site-packages\calibre\gui_launch.py", line 63, in calibre
  File "site-packages\calibre\gui2\main.py", line 525, in main
  File "site-packages\calibre\gui2\main.py", line 377, in run_gui
  File "calibre_plugins.goodreads_sync.action", line 319, in sync_shelves
  File "calibre_plugins.goodreads_sync.dialogs", line 342, in _accept_clicked
  File "calibre_plugins.goodreads_sync.core", line 373, in get_goodreads_books_on_shelves
  File "calibre_plugins.goodreads_sync.core", line 120, in _oauth_request_get
  File "calibre_plugins.goodreads_sync.core", line 171, in _handle_failure
_oauth_request_get: url=http://www.goodreads.com/review/list.xml?v=2&shelf=to-read&page=1&per_page=200
Goodreads failure calling: http://www.goodreads.com/review/list...1&per_page=200
Response: {'x-xss-protection': '1; mode=block', 'cache-control': 'no-cache', 'vary': 'User-Agent,Accept-Encoding', 'content-type': 'text/html; charset=utf-8', 'www-authenticate': 'OAuth realm="http://www.goodreads.com"', 'x-request-id': '11CY3EHDJ0XPHM2CJS1H', 'x-runtime': '0.047217', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'content-length': '14', 'server': 'Server', 'status': '401', 'set-cookie': 'csid=BAhJIhgyNDEtMjYxNzgxOC0xNzgyMzY3BjoGRVQ%3D--78028926f28bf03f25ff245673a635854064bded; path=/; expires=Sun, 30 Dec 2035 06:01:21 -0000, locale=en; path=/, _session_id2=6c74c3d661926eb69e3d9474a8927830; path=/; expires=Wed, 30 Dec 2015 12:01:21 -0000; HttpOnly', 'x-content-type-options': 'nosniff', 'date': 'Wed, 30 Dec 2015 06:01:21 GMT'}
Content: not authorized
  File "site.py", line 132, in main
  File "site.py", line 109, in run_entry_point
  File "site-packages\calibre\debug.py", line 225, in main
  File "site-packages\calibre\debug.py", line 191, in run_debug_gui
  File "site-packages\calibre\gui_launch.py", line 63, in calibre
  File "site-packages\calibre\gui2\main.py", line 525, in main
  File "site-packages\calibre\gui2\main.py", line 377, in run_gui
  File "calibre_plugins.goodreads_sync.action", line 319, in sync_shelves
  File "calibre_plugins.goodreads_sync.dialogs", line 342, in _accept_clicked
  File "calibre_plugins.goodreads_sync.core", line 373, in get_goodreads_books_on_shelves
  File "calibre_plugins.goodreads_sync.core", line 120, in _oauth_request_get
  File "calibre_plugins.goodreads_sync.core", line 171, in _handle_failure
Starting debug executable: C:\Program Files\Calibre2\calibre-debug.exe

I can't see anything wrong there. A simple answer is the one I suggested for michelleanne; check the date and time of your computer. If this is out by to much, the server will reject the request with this error. And the timezone will have an affect as well.

The other thing is to check that the plugin is authorized properly. See the first post for instructions.

Also, which version of the plugin are you running? The released version or the beta in this post. If you aren't running the beta, can you install that and post a new debug log. From memory, it has a bit more debug information that might help.

[Terisa de morgan]

Originally Posted by davidfor

Hmm, I suppose one thing that could be done is if the "Update reading progress" is used and the book was at 100%, then also as the book to the "read" shelf. That would solve an annoyance I have with this.

Optional, please, as I add the books to more shelves after finishing it, and I don't want to guess where my book has gone

Originally Posted by davidfor

And I suppose it would be possible to call these functions after the Kobo Utilities has run it's store. That's a little more complicated and I'd have to think about it.

Again, optional please. At the end I would set it to automatic, but I prefer to control it

[davidfor]

Originally Posted by Terisa de morgan

Optional, please, as I add the books to more shelves after finishing it, and I don't want to guess where my book has gone

Again, optional please. At the end I would set it to automatic, but I prefer to control it

As much as options sometime seem to be the bane of life, there would be options.

My thought is that the KU reading positions dialog would have a checkbox something like "Update Goodreads progress". When that was selected and the OK button pressed, the reading status would be updated in the library and then GS "Reading progress update" would be called for those books.

On the GS "Reading progress update" would have a checkbox like "Put finished books on read shelf". Then the books reading progress would get set like it is now an any book at 100% would be put on the read shelf.

[Terisa de morgan]

I like that, really like it. And I agree options are the bane of life

[davidfor]

As suggested yesterday, I have extended the "Update Reading Progress" function. There is now the option to add finished books, to the read shelf. The function is enabled by selecting the checkbox "Put Finished books on read shelf" on the "Update Reading Progress" dialog. When this is selected, the rating, date read and review column will be displayed. This is similar to on the "Add to shelf" dialog when the read shelf is selected.

This beta also include the fixes for comments I made about a month ago.

As usual, please report any problems and if everything works properly. Or suggestions on how it would work better. Or even a better name for the option.

[michelleanne]

Originally Posted by davidfor

Is the time and date on the computer correct? Or close to correct? This is used as part of the request and if it is to far out, you will get this error.

If the time is correct, then please restart calibre in debug mode (right click on the preferences button) and try again. Then close calibre and post the displayed log.

The time is correct, though I am in Australia (not sure if that makes a difference?).

Did as you suggested, and interestingly in debug mode I could see all the other menu items for the plugin - previously the only item I could see when I clicked on it was 'customise plugin'.

Here is the log:

calibre Debug log
calibre 2.48 isfrozen: True is64bit: False
Windows-7-6.1.7601-SP1 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '7', '6.1.7601')
Python 2.7.9
Windows: ('7', '6.1.7601', 'SP1', 'Multiprocessor Free')
Successfully initialized third party plugins: DeDRM && Goodreads Sync && EpubMerge && Manage Series && Generate Cover && EpubSplit
Starting up...
HttpHelper::__init__: proxy=None
EpubMergeEBUG:calibre_plugins.epubmerge.epubmerg e_plugin(152):macmenuhack file_path:C:\Users\Watson\AppData\Roaming\calibre\ plugins\fanficfare_macmenuhack.txt
Started up in 97.65 seconds with 92 books
HttpHelper::__init__: proxy=None
_oauth_request_get: url=http://www.goodreads.com/oauth/request_token
Goodreads failure calling: http://www.goodreads.com/oauth/request_token
Response: {'cache-control': 'no-cache', 'www-authenticate': 'OAuth realm="http://www.goodreads.com"', 'vary': 'Accept-Encoding,User-Agent', 'x-xss-protection': '1; mode=block', 'set-cookie': 'csid=BAhJIhgwNTctMTI1NTAyMS0xNzcwNTA1BjoGRVQ%3D--f8c256bfd878104db77b786085d5e923ab376b53; path=/; expires=Sun, 06 Jan 2036 08:42:10 -0000, locale=en; path=/, _session_id2=e4b251b381578ddde5463bbe79758dc8; path=/; expires=Wed, 06 Jan 2016 14:42:10 -0000; HttpOnly', 'status': '401', 'server': 'Server', 'x-request-id': '1ZH0G3Q4VX9T5RZFVP3Q', 'content-length': '21', 'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 'x-runtime': '0.017807', '-content-encoding': 'gzip', 'content-type': 'text/html; charset=utf-8', 'date': 'Wed, 06 Jan 2016 08:42:10 GMT'}
Content: Invalid OAuth Request
File "site.py", line 132, in main
File "site.py", line 109, in run_entry_point
File "site-packages\calibre\debug.py", line 225, in main
File "site-packages\calibre\debug.py", line 191, in run_debug_gui
File "site-packages\calibre\gui_launch.py", line 63, in calibre
File "site-packages\calibre\gui2\main.py", line 525, in main
File "site-packages\calibre\gui2\main.py", line 377, in run_gui
File "calibre_plugins.goodreads_sync.action", line 857, in show_configuration
File "site-packages\calibre\customize\__init__.py", line 168, in do_user_config
File "calibre_plugins.goodreads_sync.config", line 1087, in authorize_plugin
File "calibre_plugins.goodreads_sync.core", line 192, in get_request_token_secret
File "calibre_plugins.goodreads_sync.core", line 120, in _oauth_request_get
File "calibre_plugins.goodreads_sync.core", line 171, in _handle_failure

What I find wierd in this log is it mentions fanficfare - that is not a plugin I've ever used or knowingly installed...

[Rellwood]

I checked the date and time, they are spot on. I ended up grabbing the .JSON file from another calibre library on another computer, it seems to be working now. I did however, download and install the new beta version you pointed out to me, as well as uninstalled and reinstalled the APNX generator. I don't know if its updated or not, but it's what was available in the "add plugins" arena. I will see how the beta and the reinstalled APNX generators work. Thanks!

This is still coming up when I try to sync...I never had a problem with big libraries before, but it seems like there is some kind of number limit


calibre, version 2.48.0
ERROR: Goodreads Failure: The request contacting Goodreads has failed. Please try again.

URL: http://www.goodreads.com/review/list...1&per_page=200
Response Code: 401
not authorized

[auspex]

Originally Posted by davidfor

You put in a review? It looks like this is limited to 420 characters. I'll have to add a check to prevent the error.

That's got to be new. I've never had it disallow longer reviews. That's horrible. It's already impossible to download full reviews without explicitly visiting the site, now they seem to be preventing doing it the other way. Which makes it difficult to keep my own copy of reviews for when they go on another purge.