[Metadata Source Plugin] Goodreads - Page 41

Eskoe · 09-03-2022, 10:13 PM

Quote:

Originally Posted by kiwidude

After many hours of pain I have a new version of the plugin that should fix all the issues (and probably create some new ones but that is part of software dev). Goodreads do indeed have two different versions of their book details pages at the moment and it is random as to which you will see (or indeed what the plugin will see).

I had to completely rewrite the plugin scraping logic to support the new Goodreads pages while still keeping support for the old ones. One side effect of this is there is slightly better data at least in some cases due to how I am able to extract it. For instance I found extra tags appearing for books over previous.

I will give the new plugin to DavidFor to manage the distribution, hopefully he isn't too busy to do the usual release stuff nowadays. Otherwise I will put a zip file here for manual download for people who are more keen to start testing it...

Amazing! Thank you so much, the response and speed with the new version is unreal lol. I'd be happy to do any testing when the time comes.

Terisa de morgan · 09-04-2022, 02:55 AM

Quote:

Originally Posted by kiwidude

After many hours of pain I have a new version of the plugin that should fix all the issues (and probably create some new ones but that is part of software dev). Goodreads do indeed have two different versions of their book details pages at the moment and it is random as to which you will see (or indeed what the plugin will see).

I had to completely rewrite the plugin scraping logic to support the new Goodreads pages while still keeping support for the old ones. One side effect of this is there is slightly better data at least in some cases due to how I am able to extract it. For instance I found extra tags appearing for books over previous.

I will give the new plugin to DavidFor to manage the distribution, hopefully he isn't too busy to do the usual release stuff nowadays. Otherwise I will put a zip file here for manual download for people who are more keen to start testing it...

Yes, the "new and wonderful" book page is ongoing, I only have it at ONE browser in the account, but not the others.

Terisa de morgan · 09-04-2022, 02:55 AM

Quote:

Originally Posted by kiwidude

After many hours of pain I have a new version of the plugin that should fix all the issues (and probably create some new ones but that is part of software dev). Goodreads do indeed have two different versions of their book details pages at the moment and it is random as to which you will see (or indeed what the plugin will see).

I had to completely rewrite the plugin scraping logic to support the new Goodreads pages while still keeping support for the old ones. One side effect of this is there is slightly better data at least in some cases due to how I am able to extract it. For instance I found extra tags appearing for books over previous.

I will give the new plugin to DavidFor to manage the distribution, hopefully he isn't too busy to do the usual release stuff nowadays. Otherwise I will put a zip file here for manual download for people who are more keen to start testing it...

And THANK YOU a lot, it's a very useful plugin.

kiwidude · 09-04-2022, 06:08 AM

I've been told davidfor is perhaps not around at the moment, here is the plugin for people to get their grubby mitts on in the meantime. Feel free to PM me if you see an issue...

EDIT: Removed this version, new one coming...

ownedbycats · 09-04-2022, 03:55 PM

Quote:

Originally Posted by kiwidude

I've been told davidfor is perhaps not around at the moment,

https://www.mobileread.com/forums/sh...wpost&t=348925

PeterT · 09-04-2022, 04:49 PM

Quote:

Originally Posted by ownedbycats

https://www.mobileread.com/forums/sh...wpost&t=348925

Yes... I'd been keeping kiwidude in the loop. That was why he posted the zip.

I believe that because kiwidude is the originator of this thread that he can edit the original post to attach the new release.

Sent from my Pixel 4a using Tapatalk

Eskoe · 09-05-2022, 10:44 PM

I've attempted to use the new plugin but I'm having every attempt fail. I'm not sure if it's anything to do with the plugin, though, as frankly I'm a moron lol. I removed the previous Goodreads plugin, loaded the new one from the zip and then tried to download the metadata. Is there any further configuration I need to do?

ownedbycats · 09-05-2022, 11:37 PM

Do you have a debug log? That might help with the troubleshooting.

Eskoe · 09-06-2022, 01:43 AM

Is there a way to view a metadata plugin log if the attempts return failures? Debug mode doesn't seem to log attempts at all and the "View log" option only shows for me if there was at least one success

Terisa de morgan · 09-06-2022, 02:37 AM

I've installed the kiwidude's test version and it's not working for me with the old layout (I think it gets the layout from the default browser), but the oficial version works for me (checked today both versions with 4 books). I'll try to test on the weekend with the new version and the new layout.

kiwidude · 09-06-2022, 04:22 AM

I think there is a pretty good reason why some of you will be having problems - if you don't have an E: mapped on your machine (I had left some debugging code in there which is writing out the page). I will remove that in the next version I will put out later today along with some other tweaks. I did warn that build was for test purposes

Just FYI for anyone who is having an issue it will help to be more specific.
- Exactly what title/author does your book have.
- What identifier(s) does your book already have in calibre.

The log file that matters is what you see from the "View log" button on the Downloading metadata screen. From that it can be determined which version of the goodreads book page (if any) the plugin was dealing with at that particular attempt and any errors that may have happened.

Also remember not every book exists in Goodreads, and the Goodreads search engine has always been of pretty low quality for title/author searches. Putting aside the different version of the html pages issue, if there is no match from this Goodreads metadata plugin then I use the Goodreads Sync plugin "Link to Goodreads..." feature (ctrl+L) to do a more comprehensive search for the book. If it finds no matches then the book probably does not exist on Goodreads at all. If you have found it yourself on Goodreads in a web browser you can drag/drop the web browser URL onto the Link search dialog and click ok (that will save the Goodreads id into that books metadata in calibre). Then you can retry this Goodreads metadata plugin to download the details as it can directly jump to the book page for that id.

Anyways keep an eye out for the next build...

Terisa de morgan · 09-06-2022, 04:34 AM

I'll try to find the log the next time I use the test version. I can say that the books exist for sure as the test version didn't download the metadata but, once I installed the released version, the plugin was able to download the data (Goodreads sync worked too, I was using it before reverting to the released version).

kiwidude · 09-06-2022, 04:41 AM

Quote:

Originally Posted by Terisa de morgan

I'll try to find the log the next time I use the test version. I can say that the books exist for sure as the test version didn't download the metadata but, once I installed the released version, the plugin was able to download the data (Goodreads sync worked too, I was using it before reverting to the released version).

Hi Terisa - I think you responded before I edited my message above. I suspect the plugin was just crashing out for you from not being able to write to an E: file on your machine. I've removed the previous test version above, new one coming soon...

Terisa de morgan · 09-06-2022, 05:49 AM

Quote:

Originally Posted by kiwidude

Hi Terisa - I think you responded before I edited my message above. I suspect the plugin was just crashing out for you from not being able to write to an E: file on your machine. I've removed the previous test version above, new one coming soon...

Thank you and sorry for answering soon. I'll check the new one when you publish it.

kiwidude · 09-06-2022, 07:48 AM

This version has a number of fixes (thanks Kabutak for the issues you spotted). I have also added a similar feature to the Fantastic Fiction plugin allowing you to choose whether to retrieve the first published date (default) or the specific edition date for a book.

I think I also remembered to remove the debugging code this time, apologies for those who tried and failed with the last version...

Give this one a whirl, if it gets a thumbs up I will update the first post so everyone can easily get it...

(EDIT) New version that ensures the default is "true" for first published date, for the one person who downloaded you may want to go in and turn this option off/on to ensure you see the same

09-04-2022, 06:08 AM	#604
kiwidude Calibre Plugins Developer Posts: 4,731 Karma: 2197770 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	Goodreads plugin v1.6.0 beta I've been told davidfor is perhaps not around at the moment, here is the plugin for people to get their grubby mitts on in the meantime. Feel free to PM me if you see an issue... EDIT: Removed this version, new one coming... Last edited by kiwidude; 09-06-2022 at 04:39 AM.

09-06-2022, 04:22 AM	#611
kiwidude Calibre Plugins Developer Posts: 4,731 Karma: 2197770 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	I think there is a pretty good reason why some of you will be having problems - if you don't have an E: mapped on your machine (I had left some debugging code in there which is writing out the page). I will remove that in the next version I will put out later today along with some other tweaks. I did warn that build was for test purposes Just FYI for anyone who is having an issue it will help to be more specific. - Exactly what title/author does your book have. - What identifier(s) does your book already have in calibre. The log file that matters is what you see from the "View log" button on the Downloading metadata screen. From that it can be determined which version of the goodreads book page (if any) the plugin was dealing with at that particular attempt and any errors that may have happened. Also remember not every book exists in Goodreads, and the Goodreads search engine has always been of pretty low quality for title/author searches. Putting aside the different version of the html pages issue, if there is no match from this Goodreads metadata plugin then I use the Goodreads Sync plugin "Link to Goodreads..." feature (ctrl+L) to do a more comprehensive search for the book. If it finds no matches then the book probably does not exist on Goodreads at all. If you have found it yourself on Goodreads in a web browser you can drag/drop the web browser URL onto the Link search dialog and click ok (that will save the Goodreads id into that books metadata in calibre). Then you can retry this Goodreads metadata plugin to download the details as it can directly jump to the book page for that id. Anyways keep an eye out for the next build... Last edited by kiwidude; 09-06-2022 at 04:34 AM.

09-06-2022, 07:48 AM	#615
kiwidude Calibre Plugins Developer Posts: 4,731 Karma: 2197770 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	Goodreads 1.6.1 Beta This version has a number of fixes (thanks Kabutak for the issues you spotted). I have also added a similar feature to the Fantastic Fiction plugin allowing you to choose whether to retrieve the first published date (default) or the specific edition date for a book. I think I also remembered to remove the debugging code this time, apologies for those who tried and failed with the last version... Give this one a whirl, if it gets a thumbs up I will update the first post so everyone can easily get it... (EDIT) New version that ensures the default is "true" for first published date, for the one person who downloaded you may want to go in and turn this option off/on to ensure you see the same Last edited by kiwidude; 09-08-2022 at 01:40 PM. Reason: Beta removed

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[GUI Plugin] Goodreads Sync	kiwidude	Plugins	1781	02-12-2025 07:09 PM
[Metadata Download Plugin] Goodreads Metadata Deprecated	kiwidude	Plugins	30	04-23-2011 02:10 PM
[Covers Plugin] Goodreads Covers Deprecated	kiwidude	Plugins	13	04-17-2011 05:09 PM
metadata plugin	redneck_momma	Plugins	1	05-21-2010 08:41 PM

09-05-2022, 10:44 PM	#607
Eskoe Member Posts: 14 Karma: 10 Join Date: Jan 2011 Device: Sony Reader	I've attempted to use the new plugin but I'm having every attempt fail. I'm not sure if it's anything to do with the plugin, though, as frankly I'm a moron lol. I removed the previous Goodreads plugin, loaded the new one from the zip and then tried to download the metadata. Is there any further configuration I need to do?

09-05-2022, 11:37 PM	#608
ownedbycats Custom User Title Posts: 11,039 Karma: 75555555 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	Do you have a debug log? That might help with the troubleshooting.

09-06-2022, 01:43 AM	#609
Eskoe Member Posts: 14 Karma: 10 Join Date: Jan 2011 Device: Sony Reader	Is there a way to view a metadata plugin log if the attempts return failures? Debug mode doesn't seem to log attempts at all and the "View log" option only shows for me if there was at least one success

09-06-2022, 02:37 AM	#610
Terisa de morgan Grand Sorcerer Posts: 6,637 Karma: 12595249 Join Date: Jun 2009 Location: Madrid, Spain Device: Kobo Clara/Aura One/Forma,XiaoMI 5, iPad, Huawei MediaPad, YotaPhone 2	I've installed the kiwidude's test version and it's not working for me with the old layout (I think it gets the layout from the default browser), but the oficial version works for me (checked today both versions with 4 books). I'll try to test on the weekend with the new version and the new layout.

09-06-2022, 04:34 AM	#612
Terisa de morgan Grand Sorcerer Posts: 6,637 Karma: 12595249 Join Date: Jun 2009 Location: Madrid, Spain Device: Kobo Clara/Aura One/Forma,XiaoMI 5, iPad, Huawei MediaPad, YotaPhone 2	I'll try to find the log the next time I use the test version. I can say that the books exist for sure as the test version didn't download the metadata but, once I installed the released version, the plugin was able to download the data (Goodreads sync worked too, I was using it before reverting to the released version).

Advert

Advert