[GUI Plugin] Goodreads Sync - Page 55

davidfor · 02-11-2016, 07:07 PM

Quote:

Originally Posted by Krazykiwi

David, I just thought I'd mention, syncing is currently working fine, on all shelves and I can no longer reproduce the failures. I've (finally yay) synched all my shelves, including the 600+ one, with no problems.

I just today got around to updating to 1.7.7 on Calibre 2.49 (I suppose I should update that too, but now that it's unbroken, I'm loathe to touch it.) I did not yet test the beta with the sorting, but it doesn't sound like that has anything to do with the issues I was having earlier anyway.

Good to hear it is working for you. For what it is worth, I do not think this was ever a calibre or plugin problem. From all the results that were posted and my experiments, I think it was something on the Goodreads end. Unless the plugin was somehow generating the wrong call the Goodreads for some users, then it had to be their servers.

Rellwood · 02-12-2016, 02:22 AM

When a user of the GR sync plug-in gets the "Not Authorized" error notice, this doesn't mean you have not authorized the plugin, it means GR is pissed with your over use of the GR sync and they froze you out. There is no work around, no updating the plugin, no changing the JSON. There is only one way to fix it and it kind of goes against their rules, however, since the mistake was made unknowingly and without malice or intent and I wasn't really aware that I was being frozen out, and there is NO way I could continue without the plugin, I had to make a drastic change, and start over.

If you get this "Not Authorized" error notice, your screwed and mayyyybe it will work later, maybe you have been put in time out, but have the ability to wait it out, or they just restrict your access to shelves populated with a few books, but for the most part, kiss the access to your shelves through Calibre Goodbye. If any GR moderators or site managers see this, I apologize and promise to behave in a less greedy way in the future.

This might not be true for everyone, but I am pretty sure it is true for me, because an attempt to create a new profile and adding just the "read" books at once resulted in an immediate "not authorized" and no work around. Occasionally some times it would go through one random time, but then the choosing books to link would stop it from going further. Maybe other users are able to change calibre accounts, or update and it works for them, but nothing I did make it work for me. So...it a csv file from now on.

Rellwood · 02-27-2016, 07:29 PM

I have made it a point to populate my GR shelves from the site rather than Calibre. Now my requests for syncing aren't always met with an Not Authorized, but I still get it every now and then. However when it comes to linking the books that need syncing ther is a caution sign on each one. No matter what book I choose, there is a caution sign. When I try to override the caution sign or click to link the book I get a table widget error saying there is none type for the arugments.

the following is a copy and paste of the error....
calibre, version 2.51.0
ERROR: Unhandled exception: <b>TypeError</b>:QTableWidget.setItem(int, int, QTableWidgetItem): argument 1 has unexpected type 'NoneType'

calibre 2.51 [64bit] embedded-python: True is64bit: True
Windows-7-6.1.7601-SP1 Windows ('64bit', 'WindowsPE')
('Windows', '7', '6.1.7601')
Python 2.7.9
Windows: ('7', '6.1.7601', 'SP1', 'Multiprocessor Free')
Successfully initialized third party plugins: DeDRM && Import List && EpubSplit && Quick Preferences && ScrambleEbook && MultiColumnSearch && APNX Generator && Find Duplicates && QuarantineAndScrub && Annotations && Count Pages && Search The Internet && Extract ISBN && Generate Cover && Overdrive Link && Fantastic Fiction Adults && Ex Libris && Goodreads && Library Codes && Clean Metadata && Fantastic Fiction && Diaps Editing Toolbag && User Category && Resize Cover && FanFicFare && Consolidate All Library Metadata && Prettify Cover && EpubMerge && Quality Check && Modify ePub && KindleUnpack - The Plugin && Favourites Menu && Goodreads Sync
Traceback (most recent call last):
File "calibre_plugins.goodreads_sync.dialogs", line 2223, in handle_search_calibre_for_goodreads_books
File "calibre_plugins.goodreads_sync.dialogs", line 2262, in link_to_calibre_books
File "calibre_plugins.goodreads_sync.dialogs", line 1825, in populate_table_row
TypeError: QTableWidget.setItem(int, int, QTableWidgetItem): argument 1 has unexpected type 'NoneType'

Any suggestions?

davidfor · 02-27-2016, 09:56 PM

Rellwood: I'm not sure what's happening. But, the line numbers don't match up to the code I have. I have made a couple of changes since the last beta I published, but the line numbers don't quite match with the last posted version either. Please try the attached beta. It has the latest changes I have made in it. It will probably have the same error, but I'll be able to match the error against the code better.

Edit: OK, I see what is going on. The attached beta doesn't fix this. I'll have a look at it a bit later.

As to the exclamation mark, hover the mouse of the entry and a tooltip will be displayed to describe the problem.

davidfor · 02-28-2016, 07:35 AM

The attached beta should fix the syncing problem that Rellwood reported. In one of the earlier betas, I added the ability to sort the different lists. I was expecting to find a couple of problems like this, but hopefully this is the last one.

As usual, if there are any problems, please report them here.

Rellwood · 03-05-2016, 06:30 PM

Thanks,

I am wondering how much is due to the fact that Goodreads really doesn't like the fact that I attempted to upload my library after deleting it off their website?

It seems that if I try to sync, or try to get too many page count downloads (perhapse not stacking the requests on each other would help) causes the dreaded "Error 403"

My biggest problem is that I now have an entire library that I cannot seem to do more than a few books at a time before I get the "error in request try back later".

If I could just get what I have organized and shelved then I can go back to leaving them alone for a while.

I'll try the new beta and see what happens.

auspex · 03-05-2016, 06:52 PM

Quote:

Originally Posted by Rellwood

My biggest problem is that I now have an entire library that I cannot seem to do more than a few books at a time before I get the "error in request try back later".

But that's normal. You can only make a limited number of calls to the API before it starts throttling all of us! Every calibre plugin has its own (I hope) API key. Goodreads won't let that key make too many requests. So unless you have got your own key and modified the one in the plugin, you're using the same pool that the rest of us are, but even if you go to the trouble of doing that, you won't get to make many more requests than you do now.

davidfor · 03-05-2016, 07:07 PM

Firstly, based on the experiences reported with this, I don't think the issue is the plugin. And I can't think of a way to use the plugin to resolve this. The latest beta version will have no effect on this. It fixing errors in how the dialogs work and in this case, it is after any interaction with the Goodreads site.

What I think is that Goodreads is seeing to many requests of some sort and throttling you. I don't know exactly what it is counting and how it is grouping the counts. But, I think the latter is the important bit. It could be grouping the requests on Goodreads user name, IP address or subnet, the developer key in the plugin, the actual request or something else I can't think of. And of course if could be a combination of any of these. And then we don't know the time frames involved for either starting to block someone, or unblocking them. And if you are being blocked by them, then chances are that trying again before being unblocked will extend the block more.

About the only thing I can suggest to try is to go nowhere near Goodreads from your IP or account for a few days. Then try the shelf sync or whichever function is causing the problem first. And then wait a few minute between each interaction with goodreads. If the error still happens with this, then there is probably nothing you can do.

davidfor · 03-05-2016, 07:14 PM

Quote:

Originally Posted by auspex

But that's normal. You can only make a limited number of calls to the API before it starts throttling all of us! Every calibre plugin has its own (I hope) API key. Goodreads won't let that key make too many requests. So unless you have got your own key and modified the one in the plugin, you're using the same pool that the rest of us are, but even if you go to the trouble of doing that, you won't get to make many more requests than you do now.

That's only partly true. The Goodreads metadata search doesn't use the API. It simply scrapes the site. And at least half of Goodreads Sync doesn't use API functions that need the developers key. With all the problems Rellwood and others has reported, I have never had the error. Unless I'm getting lucky because of my timezone, I don't tend to think we are exceeding the developers key based requests.

But that does suggest a test for Rellwood. Try doing the problem request at an unusual time. If you usually do this in the evening after dinner, try in the morning. Or the afternoon.

Terisa de morgan · 03-06-2016, 01:29 AM

Quote:

Originally Posted by Rellwood

Thanks,

I am wondering how much is due to the fact that Goodreads really doesn't like the fact that I attempted to upload my library after deleting it off their website?

It seems that if I try to sync, or try to get too many page count downloads (perhapse not stacking the requests on each other would help) causes the dreaded "Error 403"

My biggest problem is that I now have an entire library that I cannot seem to do more than a few books at a time before I get the "error in request try back later".

If I could just get what I have organized and shelved then I can go back to leaving them alone for a while.

I'll try the new beta and see what happens.

Why don't you upload the library through a file instead of the plugin?

Rellwood · 03-08-2016, 04:23 AM

@Krazykiwi, @davidfor

They track the ip address. I know its against policy to create a new account using other information, but I did. There was nothing other than my ip address that could track the account. I can't use a tor browser to use the gr sync. This is the reason that other gr plugins (pages, and metadata) have had issues.

I have very limited functions with the plugin. I can download metadata, I can count pages*, I can sync to gr, and I can sometimes get the sync from, but since December 30 (when I scrapped my GR library, and attempted to reinstall it using Calibre- my GR plugin usage has been pretty much stopped.

Day after day of trying to figure out what went wrong, finding old plug in JSON's and reworking my GR settings, my browser settings, pretty much every tinker to work the program failed.

Then I realized that it wasn't the plug in, it was me.

I deleted the account. I then created a new account (I know there are GR people who are reading this and tsk'ing me, but what else could I do?)

New account name, email address, etc. I even changed my Amazon profile to match.

This time I used a CSV upload to the site. I always have their csv's of my library because I use them to get the average rating as well as a back up of my add and read dates.

I must have done something wrong with the csv dumps because the download page indicated a completely different number of books that had been downloaded than what was on my shelves. I scrapped that library and finally conceded defeat. I was going to have to get by without the GR sync.

Now I add books to gr using the site, rather than Calibre. I have not even attempted to make rules for the plug in because even if the request goes through, and I am presented with a list to sync, once I try to match a link to a book, I get a weird widget table error.

As far as how long this is going to last? I have no idea. I know that since I scrapped my library at the end of December, I have taken time away from gr, I have been limited in my requests, but they will not allow me to sync from them. I can add, I can refresh the shelves in the customize page, I can create shelves, I can add to shelves, I just cannot sync.

Regarding the page counts, I had always used the page count with no problems, but within the past few weeks I discovered if I ask for page numbers of more than a few books the plug in will either error out, or it won't actually download a number.

The hardest part is knowing that once I get my library settled down again, I won't need them so much, but until that time, my GR library and my Calibre library aren't speaking to each other, and I am forced to use their csv's to get my info.

Rellwood · 03-08-2016, 04:39 AM

@Davidfor,

I am wondering....I switched Calibre versions from the 16 to the 32 around the time my GR problems started.

I have reinstalled the 16 version, and added your newest plugin version.....

And was given the list of books to sync from as well as the ability to connect the missing links. All the caution icons that were present let me override them, and I got a green checkmark. I haven't gone past that part because I really wasn't ready for the sync, but knowing I could was a relief.

How much of a headache could I have avoided if I simply stayed using the original 16bit version of Calibre?

davidfor · 03-08-2016, 05:38 AM

Quote:

Originally Posted by Rellwood

@Davidfor,

I am wondering....I switched Calibre versions from the 16 to the 32 around the time my GR problems started.

Where'd you get a 16 bit version of calibre? Or did you miss a power of 2?

Quote:

I have reinstalled the 16 version, and added your newest plugin version.....

And was given the list of books to sync from as well as the ability to connect the missing links. All the caution icons that were present let me override them, and I got a green checkmark. I haven't gone past that part because I really wasn't ready for the sync, but knowing I could was a relief.

How much of a headache could I have avoided if I simply stayed using the original 16bit version of Calibre?

The errors you mention in the previous post, should have been fixed by the latest beta version of the plugin. I had a version up for a few hours and then another with the fix. My guess is that you weren't using this version when you were using 64bit calibre. There are very few places where there is a difference between 32bit and 64bit calibre. I very much doubt this is one of them. From your earlier description, the error is caused by the changes I made to allow sorting the lists. That was me not checking something. And, to be honest, I was expecting that sort of error to occur for at least one of the lists. I should have hem all fixed, but I won't be that surprised if there is still a problem somewhere.

kiwidude · 03-25-2016, 03:32 PM

Changes in this release:

Add sorting for most of the dialogs
Add option to put finished books on the read shelf from the update progress dialog
Limit comment text to 420 characters when updating the reading progress.
Don't use the review column for the reading progress comment.

Thanks to davidfor who made the changes.

Efreak · 03-26-2016, 02:16 AM

Is there any chance of linking a book to multiple books on goodreads? I have several ebooks in calibre for samplers from various publishers; goodreads doesn't seem to have entries for these, so it would be nice to be able to link the book to each of the books in it.

Also, it might be nice to have a git or other browsable source code for this plugin.

02-12-2016, 02:22 AM	#812
Rellwood Library Breeder (She/Her) Posts: 1,265 Karma: 1937891 Join Date: Apr 2015 Location: Fullerton, California Device: Paperwhite 2015 (2), PW 2024 (12 GEN), PW 2023 (11 GEN), Scribe (1st)	Soooo...I finally figured it out.... When a user of the GR sync plug-in gets the "Not Authorized" error notice, this doesn't mean you have not authorized the plugin, it means GR is pissed with your over use of the GR sync and they froze you out. There is no work around, no updating the plugin, no changing the JSON. There is only one way to fix it and it kind of goes against their rules, however, since the mistake was made unknowingly and without malice or intent and I wasn't really aware that I was being frozen out, and there is NO way I could continue without the plugin, I had to make a drastic change, and start over. If you get this "Not Authorized" error notice, your screwed and mayyyybe it will work later, maybe you have been put in time out, but have the ability to wait it out, or they just restrict your access to shelves populated with a few books, but for the most part, kiss the access to your shelves through Calibre Goodbye. If any GR moderators or site managers see this, I apologize and promise to behave in a less greedy way in the future. This might not be true for everyone, but I am pretty sure it is true for me, because an attempt to create a new profile and adding just the "read" books at once resulted in an immediate "not authorized" and no work around. Occasionally some times it would go through one random time, but then the choosing books to link would stop it from going further. Maybe other users are able to change calibre accounts, or update and it works for them, but nothing I did make it work for me. So...it a csv file from now on. Last edited by Rellwood; 02-12-2016 at 02:32 AM.

02-27-2016, 07:29 PM	#813
Rellwood Library Breeder (She/Her) Posts: 1,265 Karma: 1937891 Join Date: Apr 2015 Location: Fullerton, California Device: Paperwhite 2015 (2), PW 2024 (12 GEN), PW 2023 (11 GEN), Scribe (1st)	Weird Syncing I have made it a point to populate my GR shelves from the site rather than Calibre. Now my requests for syncing aren't always met with an Not Authorized, but I still get it every now and then. However when it comes to linking the books that need syncing ther is a caution sign on each one. No matter what book I choose, there is a caution sign. When I try to override the caution sign or click to link the book I get a table widget error saying there is none type for the arugments. the following is a copy and paste of the error.... calibre, version 2.51.0 ERROR: Unhandled exception: <b>TypeError</b>:QTableWidget.setItem(int, int, QTableWidgetItem): argument 1 has unexpected type 'NoneType' calibre 2.51 [64bit] embedded-python: True is64bit: True Windows-7-6.1.7601-SP1 Windows ('64bit', 'WindowsPE') ('Windows', '7', '6.1.7601') Python 2.7.9 Windows: ('7', '6.1.7601', 'SP1', 'Multiprocessor Free') Successfully initialized third party plugins: DeDRM && Import List && EpubSplit && Quick Preferences && ScrambleEbook && MultiColumnSearch && APNX Generator && Find Duplicates && QuarantineAndScrub && Annotations && Count Pages && Search The Internet && Extract ISBN && Generate Cover && Overdrive Link && Fantastic Fiction Adults && Ex Libris && Goodreads && Library Codes && Clean Metadata && Fantastic Fiction && Diaps Editing Toolbag && User Category && Resize Cover && FanFicFare && Consolidate All Library Metadata && Prettify Cover && EpubMerge && Quality Check && Modify ePub && KindleUnpack - The Plugin && Favourites Menu && Goodreads Sync Traceback (most recent call last): File "calibre_plugins.goodreads_sync.dialogs", line 2223, in handle_search_calibre_for_goodreads_books File "calibre_plugins.goodreads_sync.dialogs", line 2262, in link_to_calibre_books File "calibre_plugins.goodreads_sync.dialogs", line 1825, in populate_table_row TypeError: QTableWidget.setItem(int, int, QTableWidgetItem): argument 1 has unexpected type 'NoneType' Any suggestions?

02-27-2016, 09:56 PM	#814
davidfor Grand Sorcerer Posts: 24,905 Karma: 47303824 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	Rellwood: I'm not sure what's happening. But, the line numbers don't match up to the code I have. I have made a couple of changes since the last beta I published, but the line numbers don't quite match with the last posted version either. Please try the attached beta. It has the latest changes I have made in it. It will probably have the same error, but I'll be able to match the error against the code better. Edit: OK, I see what is going on. The attached beta doesn't fix this. I'll have a look at it a bit later. As to the exclamation mark, hover the mouse of the entry and a tooltip will be displayed to describe the problem. Last edited by davidfor; 02-28-2016 at 07:36 AM. Reason: Removed beta. New version in next post.

03-25-2016, 03:32 PM	#824
kiwidude Calibre Plugins Developer Posts: 4,729 Karma: 2197770 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	v1.9.0 Released Changes in this release: Add sorting for most of the dialogs Add option to put finished books on the read shelf from the update progress dialog Limit comment text to 420 characters when updating the reading progress. Don't use the review column for the reading progress comment. Thanks to davidfor who made the changes.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[GUI Plugin] Search the Internet	kiwidude	Plugins	436	05-12-2025 09:02 PM
[GUI Plugin] Open With	kiwidude	Plugins	404	02-21-2025 05:42 AM
[GUI Plugin] Clipboard Search	kiwidude	Plugins	29	04-02-2024 10:05 PM
[GUI Plugin] Quick Preferences	kiwidude	Plugins	62	03-16-2024 11:47 PM
[GUI Plugin] Book Sync Deprecated	kiwidude	Plugins	111	06-07-2011 07:47 PM

03-05-2016, 06:30 PM	#816
Rellwood Library Breeder (She/Her) Posts: 1,265 Karma: 1937891 Join Date: Apr 2015 Location: Fullerton, California Device: Paperwhite 2015 (2), PW 2024 (12 GEN), PW 2023 (11 GEN), Scribe (1st)	Thanks, I am wondering how much is due to the fact that Goodreads really doesn't like the fact that I attempted to upload my library after deleting it off their website? It seems that if I try to sync, or try to get too many page count downloads (perhapse not stacking the requests on each other would help) causes the dreaded "Error 403" My biggest problem is that I now have an entire library that I cannot seem to do more than a few books at a time before I get the "error in request try back later". If I could just get what I have organized and shelved then I can go back to leaving them alone for a while. I'll try the new beta and see what happens.

03-05-2016, 07:07 PM	#818
davidfor Grand Sorcerer Posts: 24,905 Karma: 47303824 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	Firstly, based on the experiences reported with this, I don't think the issue is the plugin. And I can't think of a way to use the plugin to resolve this. The latest beta version will have no effect on this. It fixing errors in how the dialogs work and in this case, it is after any interaction with the Goodreads site. What I think is that Goodreads is seeing to many requests of some sort and throttling you. I don't know exactly what it is counting and how it is grouping the counts. But, I think the latter is the important bit. It could be grouping the requests on Goodreads user name, IP address or subnet, the developer key in the plugin, the actual request or something else I can't think of. And of course if could be a combination of any of these. And then we don't know the time frames involved for either starting to block someone, or unblocking them. And if you are being blocked by them, then chances are that trying again before being unblocked will extend the block more. About the only thing I can suggest to try is to go nowhere near Goodreads from your IP or account for a few days. Then try the shelf sync or whichever function is causing the problem first. And then wait a few minute between each interaction with goodreads. If the error still happens with this, then there is probably nothing you can do.

03-08-2016, 04:23 AM	#821
Rellwood Library Breeder (She/Her) Posts: 1,265 Karma: 1937891 Join Date: Apr 2015 Location: Fullerton, California Device: Paperwhite 2015 (2), PW 2024 (12 GEN), PW 2023 (11 GEN), Scribe (1st)	@Krazykiwi, @davidfor They track the ip address. I know its against policy to create a new account using other information, but I did. There was nothing other than my ip address that could track the account. I can't use a tor browser to use the gr sync. This is the reason that other gr plugins (pages, and metadata) have had issues. I have very limited functions with the plugin. I can download metadata, I can count pages*, I can sync to gr, and I can sometimes get the sync from, but since December 30 (when I scrapped my GR library, and attempted to reinstall it using Calibre- my GR plugin usage has been pretty much stopped. Day after day of trying to figure out what went wrong, finding old plug in JSON's and reworking my GR settings, my browser settings, pretty much every tinker to work the program failed. Then I realized that it wasn't the plug in, it was me. I deleted the account. I then created a new account (I know there are GR people who are reading this and tsk'ing me, but what else could I do?) New account name, email address, etc. I even changed my Amazon profile to match. This time I used a CSV upload to the site. I always have their csv's of my library because I use them to get the average rating as well as a back up of my add and read dates. I must have done something wrong with the csv dumps because the download page indicated a completely different number of books that had been downloaded than what was on my shelves. I scrapped that library and finally conceded defeat. I was going to have to get by without the GR sync. Now I add books to gr using the site, rather than Calibre. I have not even attempted to make rules for the plug in because even if the request goes through, and I am presented with a list to sync, once I try to match a link to a book, I get a weird widget table error. As far as how long this is going to last? I have no idea. I know that since I scrapped my library at the end of December, I have taken time away from gr, I have been limited in my requests, but they will not allow me to sync from them. I can add, I can refresh the shelves in the customize page, I can create shelves, I can add to shelves, I just cannot sync. Regarding the page counts, I had always used the page count with no problems, but within the past few weeks I discovered if I ask for page numbers of more than a few books the plug in will either error out, or it won't actually download a number. The hardest part is knowing that once I get my library settled down again, I won't need them so much, but until that time, my GR library and my Calibre library aren't speaking to each other, and I am forced to use their csv's to get my info.

03-08-2016, 04:39 AM	#822
Rellwood Library Breeder (She/Her) Posts: 1,265 Karma: 1937891 Join Date: Apr 2015 Location: Fullerton, California Device: Paperwhite 2015 (2), PW 2024 (12 GEN), PW 2023 (11 GEN), Scribe (1st)	@Davidfor, I am wondering....I switched Calibre versions from the 16 to the 32 around the time my GR problems started. I have reinstalled the 16 version, and added your newest plugin version..... And was given the list of books to sync from as well as the ability to connect the missing links. All the caution icons that were present let me override them, and I got a green checkmark. I haven't gone past that part because I really wasn't ready for the sync, but knowing I could was a relief. How much of a headache could I have avoided if I simply stayed using the original 16bit version of Calibre?

03-26-2016, 02:16 AM	#825
Efreak Junior Member Posts: 8 Karma: 10 Join Date: Jul 2011 Device: Pandigital Novel 7	Is there any chance of linking a book to multiple books on goodreads? I have several ebooks in calibre for samplers from various publishers; goodreads doesn't seem to have entries for these, so it would be nice to be able to link the book to each of the books in it. Also, it might be nice to have a git or other browsable source code for this plugin.

Advert

Advert